Introduction > General Concepts for HEC-DSS


Data Conventions

HEC-DSS can store data of most types using a pathname of any structure.  To facilitate the ability of application and utility programs to work with and display data, standard record conventions were developed.  These conventions define what should be contained in a pathname, how data is stored, and what additional information is stored along with the data.  For regular-interval time series data (e.g., hourly data), the conventions specify that data is stored in blocks of a standard length, uniform for that time interval, with a pathname that contains the date of the beginning of the block and the time interval.  The conventions identify how a pathname for the data should be constructed.  Conventions have been defined for regular and irregular interval time series data, paired (curve) data, gridded data (such as NEXRAD radar data), and text (alphanumeric) data.

 

Regular-interval time series data is data that occurs at a standard time interval. This data is divided into blocks whose length depends on the time interval. For example, hourly data is stored with a block length of a month, while daily data is stored with a block length of a year.  Only the date and time of the first piece of data for a block is stored; the times of the other data elements are implied by their location within the block.  If a data element, or a set of elements, does not exist for a particular time, a missing data flag is placed in that element’s location.  Data quality flags may optionally be stored along with a regular-interval time series record.

 

Irregular-interval time series data does not have a constant time interval between values.  This type of data is stored with a date/time stamp for each element.  The user-selectable block size is based on the amount of data that is to be stored.  For example, the user may select a block length of a month or a year.  Because a date/time stamp is stored with each data element, approximately twice the amount of space is required compared with regular-interval time series data.  Data quality flags may optionally be stored along with an irregular-interval time series record.

 

A convention for paired data has been defined for data that generally defines a curve.  It is used for rating tables, flow-frequency curves, and stage-damage curves, etc.  One paired data record may contain several curves within it as long as it has a common set of ordinates.  For example, a stage-damage curve will contain a set of stages and it may have associated residential damages, commercial damages, agricultural damages, etc.; however, a stage-damage curve and a stage-flow curve cannot be stored in the same record.

 

Conventions for spatially gridded data can be found in the “GridUtil” User’s Manual.  Text conventions are specified in the HEC-DSS Programmer’s Manual.