Task 4: Configure the Extract List

As you have observed when setting up the model linking in the last task, several model inputs were set to come from the Extract List. The purpose of the Extract List is to tell the CAVI where to get that data and how to extract it into the forecast.dss file. The extract builds a single HEC-DSS file that all models can use (read from/write to) during the computation of a forecast.

Create a New Time Series Data Extract Group

First you must create a new time-series Extract Group. Extract Groups allow you to configure how to extract data and where to extract it from.

The main settings for extract groups are:

1. From the Setup module, select Edit Extract from the Models menu.
2. In the lower left corner of the Extract Editor, press the button labeled New Extract Group.
3. Name the extract group Observed Time Series and fill in the dialog like the example below.  
   
   1. The DSS file location is C:\CWMS_Class\database\Russian_TimeSeries.dss
   2. Use an offset of -8 hours from the extract start and +8 hours from the forecast time.
4. Click OK to create your new Extract Group.

Configure the Extract List

The top half of the Extract Editor shows the Required Input - all the model locations that we linked to the Extract List during model linking. You need to assign each of them to an Extract Group.

1. To make this easier, modify the Required Input portion of the dialog to display more information about the models requiring input.
2. Select Filter List and turn on the Model, Parameter, and Type columns. Now you can see what model needs data and the type of data needed.
   
3. Highlight all of the Time Series paths (see the Type column) from the upper panel and press the Add to Group (make sure the new Extract Group is selected before clicking the Add To Group button).
4. The DSS pathnames for the time-series will now appear in the lower half of the editor. To customize the columns in the lower half of the editor, select the magnifying glass icon next to the To forecast.dss column heading.
   

5. Hover your cursor over the From… and To… column headers in the lower table to read the tooltips.
   
   For this case, you can only edit the From... column in the lower panel by double-clicking a cell. Why does the CAVI not allow you to edit the To... column as well?

   Answer

   We cannot edit the To... column because the models are already configured to use those particular pathnames in the forecast.dss file.

6. Click Apply and Ok to close the Extract Editor. 
7. Reopen the Extract Editor - The Extract Editor reviews the local DSS file for missing pathnames and highlights missing entries in red. Are there any missing entries?
   
   Answer

   Yes, three entries show up in red under the "From Russian_TimeSeries.dss" Column. Russian/Coyote/Stage//1HOUR/CDEC, Dry Creek/Warm Springs/Stage//1HOUR/CDEC and Brush C/Santa Rosa CA/Flow/1DAY/USGS

8. We can ignore the Brush Creek missing flow data as that is an additional observed flow location. However the observed stage at both dams is important to have for calibration.
9. Select the Add Extract Data Set button at the bottom of the Extract Editor window.
10. Open the Russian_TimeSeries.dss if it does not open by default.
11. Filter the C-Part by ELEVATION and select the Russian and Dry Creek paths with a 1hour E-Part. 
12. Click Add Pathnames and close the pathname selection interface.
    
13. Was there a different way we could have made sure the Stage pathnames were added to the Extract Group?
    
    Answer

    Yes, instead of adding another entry to the Extract Group, we could have modified the pathname in the "From Russian_TimeSeries.dss" column from STAGE to ELEVATION since this is how the timeseries is stored in the Russian_TimeSeries.dss

14. At this time, you would typically verify that each pathname corresponds to the correct path from the local HEC-DSS file or the correct Time Series Identifier from the Oracle database. For the sake of time, skip this step.
15. Press Apply to save the changes to your Extract Group.

Create new Cumulus Gridded Data Extract Groups

You will need to create two new Extract Groups - one for Precipitation Data and another for Temperature Data. 

1. Click the New Extract Group button.
2. Fill out the dialog as shown below for Precipitation Data:
   
   
   1. Click the "refresh" symbol to load the available offices
   2. From Office, select SPN, and Watershed Russian River
   3. To expand the products menu click the small three dots highlighted below.
      
   4. Highlight the following two products and select Add:
      1. MRMS-V12 QPE Pass 2 PRECIP 1hr
      2. WPC QPF PRECIP 6hr
         
      3. click OK to add the products to the Extract Group.
3. Click OK to create the New Extract Group.
4. Add the two products to the Extract group by clicking the Add Extract Data Set button, selecting both products, and clicking the Select button.
   
5. Click Apply to save the changes.
6. Click the New Extract Group button.
7. Fill out the dialog as shown below for Temperature Data:
   
   
   1. Click the "refresh" symbol to load the available offices
   2. From Office, select SPN, and Watershed Russian River
   3. To expand the products menu click the small three dots highlighted below.
      
   4. Highlight the following two products and select Add:
      1. NDGD RTMA AIRTEMP 1hr
      2. NAEFS Mean QTF AIRTEMP 6hr
         
      3. click Ok to add the products to the Extract Group.
8. Click OK to create the New Extract Group.
9. Add the two products to the Extract group by clicking the Add Extract Data Set and selecting both products.
10. Click Apply to save the changes.
11. Ensure that all Extract Groups are set to Run By Default.
12. Press Apply to save your changes and OK to exit the Extract Editor