CWMS Database

Planned Activities

Most of the planned activities for the CWMS Database support cloud migration efforts. 

Support Field Operations

HEC staff will support the field in investigating, debugging, and fixing database issues that are encountered throughout FY26. This includes developing and deploying at least one new schema update in FY26 that contains fixes and improvements to the database.

Improve Performance

The team will continually monitor performance of the database and improve as needed, based on feedback from the field and through internal performance reviews. HEC will conduct internal meetings at least monthly to identify, prioritize, and implement database performance improvements. 

Monitor and Improve Goldengate Performance

Goldengate is a tool used to copy data between databases in real time. It is utilized to move data from District T7s to the national CWMS database in CWBI. Continued monitoring of Goldengate is needed to ensure data transfer is up to date and running. As disruptions occur, HEC staff remediate the issue and backfills data into the national database. HEC staff also install patches to Goldengate as they become available from Oracle.  

Support Data Acquisition and National Database Administration

As we migrate systems to the cloud, HEC staff will develop tools, train district staff, and assist in developing scripts in python 3 for data acquisition at district offices. As district follow the what can districts do now steps, HEC and field staff will support the migration of server side processed and scripts. This migration includes the training and funding of district staff, with the goal of forming a national team of experts to assist other districts in script migration. Other tasks include integrating district data acquisition scripts into the Airflow application for scheduling runs. As part of this updated process, we’re introducing a new service called Batch, which will trigger custom scripts (eliminating the need for direct integration with Airflow). Districts will begin using this new system during a data workshop in October 2025, and continue integration during data working sessions throughout the fiscal year.

Develop Access to Water Tables

Access To Water requires some additional configuration information stored in its own tables. These tables need to be brought in line with standard designs for performance and maintainability.

Develop Custom Database Schemas for Districts

Some districts have reasonable schema additions to support their operations. As we migrate into the cloud, we need to determine how best support these additions by either integrating them into the main database code and providing a standard means of updating and maintenance.

Migrate to Flyway

As we move into the cloud environment, migrating away from scheduled database schema updates into a Continuous Integration and Continuous Deployment (CI/CD) environment will make database updates more regular and standardized. Flyway is a system to implement CI/CD into database development. This task includes investigating and beginning the migration of our database to the Flyway system.  

Host Workshops and Webinars

The team will host workshops and webinars as needed to assist districts in cloud migration tasks related to the CWMS database. This includes training on converting data acquisition scripts, using cwms-python to interact with the database, and any new tools developed by HEC for cloud migration. HEC staff will lead a three-day workshop on data acquisition tools and processes in October 2025.