Download PDF
Download page Cumulus.
Cumulus
Planned Activities
| Activity | Funded (Y/N) | Cost | Delivery Date |
|---|---|---|---|
| Maintenance and Field Support | Y | $50,000 (HEC & Field labor) |
|
| Product Additions | Y | $45,000 (HEC & Field labor) |
|
| Cumulus/LDM/Airflow/Prometheus Deployment to GovCloud | Y | $70,000 (CRREL Labor) |
|
| CWBI Deployment Assistance | Y | $20,000 (contract) |
|
| Cumulus Performance Enhancements | N | $50,000 (contract) |
|
| Enhancements of Validation and Monitoring Tools | Y | $25,000 (CRREL labor) |
|
| Interface Improvements | Y | $50,000 (HEC labor) |
|
| Forecast Versioning Improvements | N | $30,000 (HEC & Field labor) |
|
| Development of Admin Documentation | N | $10,000 (HEC labor) |
|
| Updated Product Notes | Y | $5,000 (HEC labor) |
|
| Development of Process to Migrate Historical Data from T7 Servers | Y | $20,000 (HEC labor) |
|
Maintenance and Field Support
In FY25, the Cumulus team will continue to provide user support and ensure reliability of the national gridded data service. Reports submitted by users through cwms-griddeddata-support@usace.army.mil will be addressed, and the Cumulus GitHub Repository will be used to track issues and resolutions.
Product Additions
The team will work through the backlog of requests for new product additions, including the NOAA Analysis of Record Calibration (AORC) period-of-record precipitation dataset, additional National Operational Hydrologic Remote Sensing Center (NOHRSC) snow products, soil moisture, and ensemble products.
Cumulus/LDM/Airflow/Prometheus Deployment to GovCloud
The team will migrate Cumulus (and its related LDM, Airflow, and Prometheus monitoring services) to newly stood up CWBI GovCloud DEVELOPMENT/TEST/PRODUCTION Environments. The migration to the new GovCloud environments will allow for implementation of Continuous Integration/Continuous Development (CI/CD) to streamline the development process and implement automated testing and deployment.
CWBI Deployment Assistance
Support for services deployment to CWBI's production environment are provided by a contractor. For the deployment of Cumulus/LDM/Airflow/Prometheus to the new CWBI GovCloud environments, funding is required to cover contractor labor assistance.
Cumulus Performance Enhancements (Not Funded)
With the growing usage of Cumulus, as well as the number and size of products available from the service, there are marked signs of reduced performance with respect to efficiency of queries and interface rendering. The team will explore the possibilities of optimizing Cumulus's performance and possibly target contractor support for the task.
Enhancements of Validation and Monitoring Tools
For Cumulus service monitoring, the Prometheus monitoring toolkit is used to provide some metrics on at least data reporting continuity and system health. Proposed enhancements include monitoring of data volume and usage as well as implementation of alerts.
Interface Improvements
The team will add interface improvements to the Cumulus website. In particular, more data availability information will be incorporated in the interface to more clearly display missing data records. Additionally, a new Map Explorer will be developed to provide users an interactive way to find available data products and define download spatial extents based on their geographic areas of interests.
Forecast Versioning Improvements (Not Funded)
Pending time availability of the team, Cumulus improvements will be implemented to better handle versioned forecast products, especially updating the Cumulus API to provide more direct options for users to select any specific forecast version from the available archives.
Development of Admin Documentation (Not Funded)
Pending time availability of the team, administrator documentation will be developed to improve the onboarding of new team members.
Updated Product Notes
The team will improve and update the product notes in the Cumulus web site so that users have more information on the source and product metadata, such as data resolution and coordinate system.
Development of Process to Migrate Historical Data from T7 Servers
The team will provide guidance to districts on required cleanup of archive data prior to migration. The team will also develop a process for transferring archive files to the cloud and ingesting into Cumulus.