Overview
The WMES-CWMS Cloud Migration is a national effort to transition Water Management functions from relying on end-of-life local servers and soon-to-be decommissioned processing centers to modernized infrastructure and web services in the CWBI cloud.
The team is following an initial multi-year plan to achieve a Minimum Viable Product (MVP) that focuses primarily on the migration of the CWMS database and data services, including:
- CWMS National Oracle Database in CWBI
- CWMS Data API (CDA) for data reads and writes
- CWMS data acquisition through centralized cloud-based services in CWBI
- CWMS data processing (OpenDCS) services for data acquisition as well as automated data transformations and computations
- CWMS data dissemination services and web hosting in CWBI
Funded Activities
Accomplishments
LDM
The team completed the design and preliminary implementation of an Enterprise LDM service for CWMS in the cloud. Currently, the CWMS LDM service provides a web-based user interface for configuring data acquisition and dissemination of products. The CWMS LDM services acquire meteorological gridded data products for Cumulus from National Weather Service River Forecast Center offices, as well as project data from the Tennessee Valley Authority. The team also completed a newly developed python-based SHEF parser, which was integrated in Airflow to process SHEF files from LDM.
Additionally, the team worked with the CWBI Project Management Office and CWBI contractor and accomplished the establishment of a new CWBI GovCloud infrastructure to support all CWMS cloud deployments in an automated fashion, relying on the Infrastructure as Code (IaC) approach. Going forward, the IaC approach for managing CWMS services (especially Cumulus, LDM, and Airflow) cloud setup will no longer use the legacy CWBI contractor manual configuration approach, thus improving the efficiency and consistency of CWMS services deployments.
District Web Migration
The team coordinated with National Web Development PDT and provided training and information sharing support through recorded webinars, virtual one-one-one working sessions, and an in-person workshop on the use of the CWMS-Data-API (CDA) and the Groundwork React Component Library, which was designed to provide (consistent and 508-compliant) building blocks for USACE webpages.
Model Library
The team coordinated with the MMC and Model Library developers to design repositories (operational, test, and archive) for all district CWMS watersheds. The team tested the initial setup in version 2.0 of the Model Library and is planning to roll out standard operation procedure instructions in FY25 to districts on populating and using the Model Library.
The team centralized all the CWMS Cloud Migration information on the HEC confluence pages, including monthly updated roadmap and status updates on the various activities. The team also developed guidance on a number of areas of cloud migration that districts can implement in the next year. The team provided webinars on the newly developed CWMS-Python API and demonstrated its implementation for acquiring USGS data. The team also hosted an in-person workshop to assist districts in converting server-side scripts to Python3 using CWMS-Python. The team continued field participation in CWMS developer meetings on the CWMS Database, OpenDCS, and CWBI Deployments.