RoadMap Notes

Client Tools

HEC-RTS

  • COMPLETE FY23 Milestone – Integrated Cumulus Download feature in the CWMS 3.3 Extract Editor.
  • COMPLETE FY23 Milestone – Support CDA Data Reads in the CWMS 3.3 Extract Editor, Data Status Summary Report, and Time Series Icons
  • COMPLETE FY24 Milestone – Support CDA Data Writes in the CWMS 3.4 Data Validation Editor and Post Editor.
  • FY25+ Milestone – Add HEC-RTS features for Cloud Compute Configuration and Execution

CWMS-Vue

  • COMPLETE FY24 Milestone – Support CDA Data Writes in the CWMS 3.4 release.

HEC-MetVue

  • COMPLETE F24 Milestone – Integrated Cumulus Download feature in MetVue 3.3 Beta towards release with CWMS 3.4.

National Database

Cumulus

  • COMPLETE FY24 Milestone – Onboarding new Cumulus contributors (Krishna Khatri – HEC, Jordan Van Aalsburg – HEC, Kat Feingold – HEC, Mitch Weier – MVP).
  • COMPLETE FY24 Milestone – Addressing bugs/issues and fulfilling new gridded data product requests
    https://github.com/USACE/cumulus/issues
  • FY25+ Milestone – Annual maintenance and addition of new products based on user requests.
  • FY25+ Milestone – Website and API enhancements to support specification of and downloads based on user-defined areas of interest.

CDA

  • COMPLETE FY23 Milestone – Support CDA data reads from T7 servers.
  • COMPLETE FY23 Milestone – Support CDA data reads from National Sites in CWBI Cloud.
  • COMPLETE FY24 Milestone – LRL testing of CDA data writes.
  • COMPLETE FY24 Milestone – Support CDA new data writes capabilities for versioned/text/binary/forecast times series.
  • COMPLETE FY24 Milestone – Complete initial versions of additional CWMS Data APIs (cwms-python, cwms-jython, and cwms-javascript).
  • COMPLETE FY24 Milestone – Ready for field data entry into the national database in CWBI.
  • COMPLETE FY25 Milestone – Adding new endpoints, especially to accommodate REGI needs.
  • IN PROGRESS FY25 Milestone – Load testing of all Districts’ Data.
  • FY25+ Milestone – Various minor fixes/additions to end points based on user requests.

CWBI Database

  • COMPLETE FY23 Milestone – Deployment of national database into production in CWBI, with replication of public data from the CPC.
  • COMPLETE FY24 Milestone – Bypassing the CPC with direct Goldengate replication of real-time public data from District servers.
  • COMPLETE FY24 Milestone – National database serving A2W Production instance in CWBI, completing the CPC bypass.
  • FY25 Milestone – Implement Flyway for automating national database schema updates and version control.
  • FY25 Milestone - Migrate District private data for applicable districts.

Authorization

  • COMPLETE FY24 Milestone – Complete plan for Authorization (Public/Private Data), scope and put out contract request for information.
  • COMPLETE F25 Milestone – Award Contract for Authorization Design and Implementation.
  • IN PROGRESS FY26 Milestone – Complete Authorization Implementation.

Migration of Historical Data

  • FY24+ Milestone – Begin Districts historical data migration from Oracle database incrementally based on order of requests through FY27.

Data Processing

OpenDCS (LRGS/Decodes)

  • COMPLETE FY24 Milestone – Initial test setup and configuration in CWBI.
  • COMPLETE FY24 Milestone – Configuration for LRL.
  • COMPLETE FY24 Milestone – Testing of LRL configuration.
  • COMPLETE FY24 Milestone – Configure and test up to three more districts.
  • FY26+ Milestone - Incremental District Migration

OpenDCS (CCP)

  • COMPLETE FY24 Milestone – Initial test setup and configuration in CWBI.
  • COMPLETE FY24 Milestone – Configuration for LRL in CWBI
  • COMPLETE FY24 Milestone – Testing of LRL configuration in CWBI.
  • COMPLETE FY24 Milestone – Configure and test locally up to three more districts.
  • IN PROGRESS FY25 Milestone - Configure and test multi-office OpenDCS in CWBI
  • FY26+ Milestone - Incremental District Migration

National Data Acquisition

LDM

  • COMPLETE FY24 Milestone – Deploy development version of national LDM service in CWBI.
  • IN PROGRESS FY25 Milestone – Implementing LDM data acquisition for LRL.
  • IN PROGRESS FY25 Milestone – Implementing LDM data acquisition for Cumulus.
  • FY26 Milestone – Begin Districts LDM migration incrementally based on order of requests through FY27.
  • FY26 Milestone – Deploy national LDM service into full production in CWBI.

USGS

  • COMPLETEFY24 Milestone – Implement initial version of cwms-python to work in conjunction with CWMS-Vue time series groups for USGS data acquisition and test for LRL.
  • COMPLETEFY24 Milestone – Test a few other districts and provide guidance to all districts on usage of cwms-python and required CWMS-Vue time series groups configurations.
  • FY25 Milestone – Production deployment of cwms-python and Airflow automated tasks scheduling in CWBI.


District Specific Data Acquisition

SCADA/GDACS

  • COMPLETEFY23 Milestone – Design for SAS SCADA data ingestion and CDA data writes to SAS server.
  • COMPLETEFY23 Milestone – Testing of SAS SCADA data ingestion and CDA data writes to SAS server.
  • IN PROGRESSFY25 Milestone – Testing of SAS SCADA data ingestion and CDA data writes to national database in CWBI.
  • FY26 Milestone – Refinements of SAS SCADA data ingestion and CDA data writes to national database in CWBI.
  • FY26 Milestone – Implementation of SAS SCADA data ingestion and CDA data writes to national database in CWBI.

Additional Sources as Identified

  • FY25+ Milestone – Implement data acquisition for other data sources as identified during cloud migration coordination with Districts.

COOP

Planning

  • COMPLETE FY24 Milestone – Research cloud services uptime and restoration requirements for CWMS-WMES in CWBI and socialize with the CURG.
  • FY25 Milestone – Finalize cloud services uptime and restoration requirements for CWMS-WMES in CWBI and submit to CWBI for costs estimates.

Testing

  • FY25 Milestone – Orchestrate a COOP exercise in CWBI for LRL.

ADMIN Roles/Responsibilities

  • COMPLETE FY24 Milestone – Complete draft on CWMS-WMES administrative cloud services roles and responsibilities across AWS service providers (CWBI), developers (HEC/CRREL/National Teams) and district/public users.

Model Library

  • COMPLETE FY24 Milestone – Design and coordination meeting with the MMC to plan a future implantation of CWMS watershed models storage in the Model Library.
  • COMPLETE FY25 Milestone – Setup a prototype Model Library storage repository for a few District CWMS watershed models.

Cloud Compute

  • COMPLETE FY24 Milestone – Design and coordination meeting between HEC, CRREL, and contractors to onboard a new Cloud Compute developer and identify future development needs and funding opportunities.
  • COMPLETE FY24 Milestone – Complete a new HEC-MetVue Cloud Compute Plugin to add the existing Cloud Compute suite of plugins (HMS, ResSim, and RAS among others) already developed through an interagency project with FEMA.
  • FY25+ Milestone – Develop HEC-FIA Cloud Compute Plugin

Training

Resources

Webinars

  • COMPLETE FY23 Milestone – Introduction to CDA
  • COMPLETE FY23 Milestone – Introduction to Git/GitHub Parts 1&2
  • COMPLETE FY24 Milestone – CDA and Web Development
  • COMPLETE FY24 Milestone – Git/GitHub and Web Development
  • COMPLETE FY24 Milestone – New CWMS-Python API and USGS Data Acquisition
  • COMPLETE FY24 Milestone – Python3 and conversion of legacy scripts
  • COMPLETE FY24 Milestone – OpenDCS
  • IN PROGRESS FY25 Milestone – Biweekly webinar series on CDA Endpoints
  • FY25+ Milestone – Additional webinars as identified.

Virtual Working Sessions

  • COMPLETE FY24 Milestone – NWD division-wide data and scripts review session for cloud migration planning
  • COMPLETE FY25 Milestone – General cloud migration review and discussion (Q&A) session.
  • COMPLETE FY25 Milestone – LRN cloud migration review and general discussion (Q&A) session.
  • COMPLETE FY25 Milestone – SPK cloud migration review and general discussion (Q&A) session.
  • COMPLETE FY25 Milestone – SWF/SWT cloud migration review and general discussion (Q&A) session.

In-Person

  • COMPLETE FY23 Milestone – Web Development Workshop using React and CDA
  • COMPLETE FY24 Milestone – Web Development Workshop using React, CDA, and new developed generalized components for water management.
  • COMPLETE FY24 Milestone – CWMS Data Migration Workshop
  • COMPLETE FY24 Milestone – OpenDCS Annual Workshop
  • FY26 Milestone – CWMS Data Migration Workshop

LRL Pilot

  • COMPLETE FY23 Milestone – Cumulus integration in CAVI watersheds.
  • COMPLETE FY23 Milestone – Rewrite of LRL web application to leverage new LPMS API.
  • COMPLETE FY23 Milestone – Testing of CDA read capabilities.
  • COMPLETE FY24 Milestone – Testing of CDA write capabilities.
  • COMPLETE FY24 Milestone – Testing of CDA Text write capabilities.
  • COMPLETE FY24 Milestone – Web Migration into CWBI Development Environment.
  • COMPLETE FY24 Milestone – Testing of OpenDCS.
  • COMPLETE FY24 Milestone – Testing Airflow.
  • COMPLETE FY24 Milestone – LRL USGS data acquisition in CWBI.
  • COMPLETE FY24 Milestone – Ingest other LRL data sources.
  • IN PROGRESS FY25 Milestone – Testing LDM in CWBI for LRL data acquisition.
  • IN PROGRESS FY25 Milestone – Web Migration into CWBI Production Environment.