These data contain surface meteorological measurements of the Integrated Surface Flux System (ISFS) during the Shallow Cold Pool Study (SCP) at the Pawnee Grasslands, Colorado, during September, October and November of 2012.
For general information about the operations of the ISFS during SCP see https://www.eol.ucar.edu/field_projects/scp.
The ISFS high-rate dataset contains all variables measured at one sample/second or higher by at the NCAR ISFS stations during SCP.
The data are stored in NetCDF files. Information on the NetCDF file format and software is available at http://www.unidata.ucar.edu/software/netcdf/.
Datasets
Two datasets are available, which are identical, except for the sonic tilt corrections, described below.
- high-rate, geographic and tilt-corrected sonic winds: http://data.eol.ucar.edu/codiac/dss/id=385.001
- high-rate, geographic but not tilt-corrected sonic winds: http://data.eol.ucar.edu/codiac/dss/id=385.002
The NetCDF files contain two hours of data each. There are 865 files in each dataset. Each file is about 112 Mbytes, for a total of 88 GBytes in each dataset.
NetCDF File Names
The file names for the tilt-corrected data are of the form "scp_tc_YYYYMMDD_HH.nc", where YYYYMMDD is the UTC date of year, month and day. HH is the two digit hour of the first time in the file, in the UTC time zone.
For the non-tilt-corrected data, the file names are "scp_ntc_YYYYMMDD_HH.nc"
Measurements
The measurment sites (or stations) were given names A1-A19, C and M. All "A" stations had a CSAT3 3D sonic anemometer and two NCAR aspirated hygrothermometers. As shown in the tables on the SCP project page, some "A" stations had an additional Handar 2-D sonic anemometer and/or a barometer. Station C was a 3 meter tower with 2 CSAT3 sonics, 4 hygrothermeters, a barometer and a 2D sonic. Station M (main tower) was a 20 meter tower with 13 levels of measurements. A CSI EC150 3-D sonic was added later in the project on Nov 12 at station A8.
Sensors | Rate (sample/sec or Hz) |
---|---|
CSAT3 3-D anemometers | 20 |
CSI Krypton hygrometers | 20 |
LI-COR 7500 gas analyzers | 20 |
CSI EC150 3-D anemometer and infra-red gas analyzer | 10 |
ParoScientific 6000 barometers | 13 (P.5m.M at approx 14.85) |
Vaisala PTB barometers | 1 |
NCAR Hygrothermometers | 1 |
Handar 2-D anemometers | 1 |
Time Representation
The base_time variable contains one value, the time of the start of the file, as a number of POSIX (non-leap) seconds since 1970 Jan 1, 00:00 UTC. See http://en.wikipedia.org/wiki/Unix_time for more information about POSIX or Unix time.
Values for each time-varying measurement will be found in the NetCDF files, as a variable with a time dimension.
The files also contain a time variable with a time dimension. This variable contains the middle time of each one second sampling period in units of seconds since the base_time.
Variables that were sample at rates higher than once a second will have an additional sample dimension, which will be 10, 13 or 20 for variables that were sampled at 10, 13 or 20 samples/second.
All ISFS sensors at SCP ran asynchronously, each with their own internal processor clock. The samples from each sensor were time-tagged at the time of their receipt by the data sytem. Time tags for samples from some sensors were further adjusted as appropriate for the given sensor, based on documentation of the internal processing of the sensor.
Before being written to the NetCDF files, the raw, asynchronous samples were then re-sampled to a evenly spaced time sequence, using a simple method of matching the raw sample nearest-in-time to the evenly-spaced times. No interpolation or averaging was done.
The time tag, as a number of POSIX seconds from Jan 1, 1970 00:00 UTC, for a sample from variable sampled at rate R, with time index i, sample index j is:
ti,j = base_time + timei - 0.5 + (1/R) x (1/2 + j)
where R is the sample dimension (1,10,13 or 20), i = [0:7199], and j = [0:(R-1)]
For 1 Hz variables, R=1, j=0 and the times are simply:
ti = base_time + timei
In the NetCDF files, the values for each variable are stored with the sample index, j, varying more rapidly than the time index, i.
If a variable is read in one continguous read with a C or C++ program, or any language which stores multi-dimensional data in a row-major order, the variable should be dimensioned with the time dimension first followed by the sample dimension:
float x[7200][20];
With Fortran, or in any column-major programming language, the dimensions would be reversed:
real x(20,7200)
Stations
A variable measured at more than one station, such as winds from the 3-D sonic at 1 meter, will have a station dimension of 21. Station indices 1-19 are for the "A" stations, 20 is "C" and 21 is "M". Variables that were measured at one or two sites generally do not have a "station" dimension. Instead the short_name will have a suffix indicating the station, such as ".C".
The station dimension is the last dimension for time-series variables, so that the station index will vary most rapidly when accessing the values in a continguous manner.
In C/C++, if a variable has a time, sample and station dimension, it would be declared as follows:
float x[7200][20][21];
For 1 Hz variables, with only a time and station dimension:
float x[7200][21];
Dimensions
The NetCDF dimensions in each file are:
Dimension name | size | description |
---|---|---|
time | 7200 | number of seconds in 2 hour file |
sample | 20 | additional time dimension for variables sampled at 20 Hz |
sample_10 | 10 | additional time dimension for 10 Hz variables |
sample_13 | 13 | additional time dimenstion for 13 Hz variables |
station | 21 | index for each of the 21 ISFS stations |
layout | 2 | index to indicate one of two station layouts. |
Short Name Attributes
Each measured variable has a short_name NetCDF attribute. The field before the first period in the short_name is a generic variable name, such as T for temperature, or u for the U component of the wind.
Measurement Height
The height in meters above ground of the measurement, if appropriate, will be indicated in a second field after a period in the short_name, for example RH.0.5m.
NetCDF Variable Names
The actual NetCDF variable names will have underscores, '_', in place of periods. Therefore a variable with a short_name attribute of co2.3m.A8 will have a NetCDF variable name of co2_3m_A8.
Units and Long Names
Each variable will have NetCDF attributes containing the units of the measurement, and a long name giving more information.
Missing Data
The missing data value is 1x10^37. A missing value indicates either that nothing was measured at the location indicated in the variable name and station index, or the sensor was not reporting at the given time, or it was detemined that the data value did not meet QC criteria during post-project analysis.
Non-Time Series Variables
The files also contain non-time series values for station latitude, longitude and altitude. The latitude and longitude were determined with a handheld GPS during the project. The altitudes were determined by survey with a theodolite during the project. The online field logbook has further information on these values.
Example NetCDF Header Listings
1 sample/sec, at all stations:
float RH_2m(time, station) ;
RH_2m:_FillValue = 1.e+37f ;
RH_2m:long_name = "Relative humidity from NCAR hygrothermometer" ;
RH_2m:short_name = "RH.2m" ;
RH_2m:units = "%" ;
1 sample/sec, one location:
float RH_1_5m_C(time) ;
RH_1_5m_C:_FillValue = 1.e+37f ;
RH_1_5m_C:long_name = "Relative Humidity from NCAR hygrothermometer" ;
RH_1_5m_C:short_name = "RH.1.5m.C" ;
RH_1_5m_C:units = "%" ;
20 sample/sec, all stations:
float tc_1m(time, sample, station) ;
tc_1m:_FillValue = 1.e+37f ;
tc_1m:long_name = "Virtual air temperature from speed of sound, CSAT3" ;
tc_1m:short_name = "tc.1m" ;
tc_1m:units = "degC" ;
13 sample/sec, all stations:
float P_1m(time, sample_13, station) ;
P_1m:_FillValue = 1.e+37f ;
P_1m:long_name = "Barometric Pressure, Vaisala PTB or Paroscientfic 6000" ;
P_1m:short_name = "P.1m" ;
P_1m:units = "mb" ;
Station Moves and Layouts
Stations 15 and 17 were moved on October 4th. The latitude, longitude and altitude variables therefore have a layout dimension of 2, to provide for the two locations of station 15 and 7. The sonic at station 15 was also raised from 1 to 2 meters above ground as part of the move, and the sonic at 17 lowered from 1 to 0.5 meters.
Wind Coordinates
The U and V components of the wind vectors from the 2D and 3D anemometershave been rotated to geographic coordinates, such that a positive U is the component of the wind blowing to the east, and a positive V is the component of the wind blowing to the north.
Sonic Tilt Correction
The 3D sonic anemometers were installed as level as possible, but some tilt of the vertical sonic w axis relative to a bubble level was unavoidable.
Two datasets are provided. In one dataset no correction of the sonic tilt has been applied to the 3D wind vectors from the sonic anemometers. In the other dataset the 3D wind vectors have been rotated to a coordinate system where the mean W component is zero, as described in /content/sonic-tilt-corrections.
Data Edits for Quality Control
In addition to the wind coordinate changes and correction for the tilt of the 3D sonic anemometers, the following corrections have been applied to the SCP 5 minute data:
- co2, h2o from LI/COR 7500 on M tower: data removed during times of sensor maintenance.
- kh2o from krypton hygrometers on M tower: data removed during times of sensor maintenance, and low voltages due to liquid water in the absorption path.
- co2,h2o from EC150 on A8: data removed during times of sensor maintenance as well as some instances where excess moisture affected sensor operation.
- P from barometers: corrected for offsets seen in comparison with transfer standard
- T,RH from NCAR hygrothermometers: data removed during times of sensor maintenance and cleaning well as some instances prompted by erratic Ifan (aspiration fan current) values specific to each sensor.