|
CHPS News & Activities
April 2008
Visit the CHPS web site at http://www.nws.noaa.gov/ohd/hrl/chps/index.html. This "News & Activities" section contains reports from the HSEB quarterly newsletters which are posted at: http://www.nws.noaa.gov/oh/hrl/hseb/hseb_newsletters.htm. The CHPS page can also be accessed from the main OHD page (http://www.nws.noaa.gov/ohd/).
As of January 1, 2008 WL | Delft Hydraulics became part of Deltares, an independent Dutch institute. Visit http://www.wldelft.nl/gen/intro/english/index.html for more information. OHD now uses the new name, Deltares, instead of ‘Delft’ or ‘Delft Hydraulics’.
CHPS Pilot
The CHPS Acceleration Team (CAT) delivered a report to Gary Carter, Director OHD, on January 9, 2008 recommending that the NOAA Hydrology Program proceed with FEWS as the infrastructure component for CHPS. Gary subsequently accepted and approved the recommendation and named Chris Dietz in OHD to lead the CHPS implementation project.
HSEB successfully led the CHPS Pilot Enhancements project through HOSIP Gate 4 on February 20, 2008. The CHPS Pilot project has now achieved its goal; therefore no further enhancements will be developed. Instead, OHD will focus its efforts on the operational implementation of CHPS.
CHPS Operational Implementation
TERMINOLOGY: Many people have expressed confusion over the terms CHPS, FEWS, CHPS/FEWS, etc. Here is some clarification:
FEWS (Flood Early Warning System) is the infrastructure software owned and maintained by Deltares. Several agencies in Europe have developed forecasting systems based on FEWS. The term Delft-FEWS is sometimes used, especially by Deltares themselves, but the CAT prefers to use FEWS, because the context is always clear. FEWS on its own (without specific configurations) does nothing; one analogy is that FEWS is like an electricity grid.
CHPS (Community Hydrologic Prediction System) is an NWS operational river forecasting system encompassing FEWS for its infrastructure and containing additional capabilities needed for RFC operations. Such additional capabilities include, for example, the SNOW-17 model. The extensibility of the FEWS infrastructure design will allow the NWS to access other modeling capabilities in the future. To continue with the electricity grid analogy, CHPS would encompass all appliances plugged into the grid as well as the grid itself.
The CAT would like to avoid using the terms "CHPS/FEWS", "CHPS-FEWS", and "CHPS FEWS" because they are confusing. You will notice that the term "CHPS FEWS Pilot" above has been revised to "CHPS Pilot".
After the December workshop at NCRFC OHD worked closely with Deltares to define a broad migration strategy to introduce the first operational version of CHPS at all RFCs. HSEB presented early details of the strategy at the HIC conference in Silver Spring in January 2008.
The CHPS project leader and the CAT members have begun to flesh out an implementation plan based on the broad migration strategy. Weekly conference calls have been instituted to address the large number of activities that will occur under the plan. Karel Heynert from Deltares visited OHD in Silver Spring on February 21, 2008, to discuss and refine the proposed migration schedule.
Meanwhile, Apex re-focused their effort (the contract task was originally to conduct the Pilot Evaluation) to hold a series of fact-finding interviews with each of the CAT RFCs. The goal was to discover several key pieces of information:
- What the RFC end-to-end forecast process involves
- What RFCs see as weaknesses with the current system
- RFC’s short-term needs
- RFC’s vision for the future
The result was a report entitled "FEWS Pilot Results" (to be published on the CHPS web page later this month). Information contained in the report will be used by Deltares and OHD as the basis for a comprehensive gap analysis for CHPS implementation at the CAT sites.
HSEB members have now begun work on the migration of NWSRFS operations into CHPS. The development team grew from one Project Area Leader (PAL) plus two developers to two PALs and 10 developers in a very short period of time. Many developers have NWSRFS experience, although one or two come from other OHD projects. The CHPS software development team is now led by the second CHPS PAL, Joe Gofus. Developers have begun work on 7 NWSRFS model operations: CONS_USE, LAG/K, RES-SNGL, SARROUTE, SSARRESV, TATUM, and UNIT-HG. Some will be re-coded; some will be pulled from the NWSRFS infrastructure in the original FORTRAN and adapted for use in CHPS.
OHD has been working with NWS OS&T to investigate accessing Deltares through the AWIPS contract with Raytheon. The advantage of this approach would be to facilitate development of the AWIPS II-CHPS interface by leveraging professional software engineers who are familiar with AWIPS II technology. Discussions will continue into April.
ResSim into Operations (CNRFC)
The ResSim model was added as a new operation to NWSRFS at CNRFC during 2007. The operation was designed to be "CHPS ready" via the use of FEWS as a "middle man" between NWSRFS and ResSim. Deltares developed the FEWS adapter for ResSim.
CNRFC continued to run the ResSim over the winter with few problems. There was a brief interruption as CNRFC had to make some adjustments after installation of the AWIPS OB8.2 release.
Meanwhile HEC continued to work on the changes needed for a compatible warm start capability. CNRFC’s upgrade to AWIPS OB8.2 caused a few glitches, but these have now been resolved. Phase 2 (support for ensemble functionality) is just beginning as CNRFC has conducted various requirements gathering sessions with California customers.
HEC-RAS into CHPS
Deltares and OHD traveled to LMRFC in February to discuss functional requirements for the HEC-RAS capability in CHPS. OHRFC also attended. The Deltares-OHD team then traveled on to Davis, CA to meet with USACE HEC and its contractor Resource Management Associates (RMA); RMA is the contractor that built the Corps Water Management System (CWMS) in collaboration with HEC. The goal of the meeting in Davis was to discuss potential solutions.
Deltares, HEC, and LMRFC came to an agreement concerning the overall technical solution, which allowed Deltares to draw up a proposal for review on March 25.
Phase 1 (design) of the project is now complete. Phase 2 (implementation of the proposed solution) is expected to begin once contract tasks are in place for Deltares and HEC.
With the decision that OHD will discontinue support for FldWav, the transition of forecasting operations from FldWav to HEC-RAS is now a CHPS operational capability pre-requisite.
Experimental Ensemble Forecast System (XEFS)
Following Gary Carter’s approval of the CAT’s recommendation to proceed with FEWS as the software infrastructure for CHPS, planning activities to include an ensemble forecasting capability began in earnest. FEWS already contains the basic computational elements to generate a climatology-based ensemble; this feature was added to the CHPS pilot system in December 2007 and demonstrated at NCRFC. However, until the basic CHPS components are in place, work on the XEFS sub-system of CHPS must take a back seat for a while.
Meanwhile HSEB made good progress on porting HSMB HEP’s existing prototype software to the FEWS environment. Output from the classical climatology-based Ensemble Pre-Processor (EPP) and the Ensemble Post-Processor can now be successfully displayed via the FEWS time series viewer. HSEB hopes to provide HEP with a more complete version by early May as a first step towards transitioning the HSMB from its previous development environment to a more CHPS-compatible framework.
HydroXC
The HydroXC effort did not receive any FY08 funding; all work has now been placed on indefinite hold. Apex will continue to host the website at http://www.hydroxc.org/ until June 20, 2008 at which point the site will either be returned to NWS hosting or retired.
[Top]
Archives – previous articles
January 2008
October 2007
July 2007
April 2007
January 2007
October 2006
July 2006
April 2006
January 2006
October 2005
January 2008
The main CHPS web site is available at:
http://www.nws.noaa.gov/ohd/hrl/chps/index.html. This "News & Activities" section contains reports from the HSEB quarterly newsletters. The CHPS page can also be accessed from the main OHD page (http://www.nws.noaa.gov/ohd/).
HydroXC
In October Apex Digital Systems and Dr. Michael Piasecki from Drexel University submitted to OHD a proposal for the FY08 Hydrology budget that would build upon work completed in previous fiscal years, and help make the HydroXC work successful and self-sustaining. The Apex/Piasecki proposal suggests aligning the Hydro XML with the Consortium of Universities for the Advancement of Hydrologic Science (CUAHSI)'s WaterML schema (ref. http://www.cuahsi.org/his/documentation.html); this would provide sorely needed resources to the overall hydrologic XML effort. OHD expects to finalize the FY08 Hydrology budget during the next quarter.
CHPS FEWS Pilot
As of January 1, 2008 WL | Delft Hydraulics became part of Deltares, an independent Dutch institute. Visit http://www.wldelft.nl/gen/intro/english/index.html for more information.
At a workshop hosted by the NCRFC in Chanhassen, MN during the week of December 17, Delft Hydraulics (now Deltares) presented and demonstrated the final version of the CHPS FEWS Pilot system. The most recent set of enhancements include:
- Install the Pilot at ABRFC (3rd Pilot site, joining NWRFC and NCRFC)
- Develop a MODs-like capability for the SAC-SMA model states
- Configure all Pilot sites as client-servers (formerly standalone)
- Provide additional segment definitions for the Santiam River for NWRFC
- Provide more in-depth training to all Pilot sites; and more detailed documentation
- Provide access to SNOW-17 (replaces Delft's SNOWMELT in the original Pilot)
At the end of the first day of presentations, the CHPS Acceleration Team (CAT) concluded that it was ready to make a recommendation to the NOAA Hydrology Program Manager (Gary Carter, Director OHD) concerning use of FEWS for CHPS. Based on the CHPS FEWS Pilot system, the team is now satisfied that FEWS is a comprehensive platform which can be adapted to meet the current operational needs of NWS RFCs (i.e., is a suitable foundation for an NWSRFS replacement); and additionally has the potential to meet future needs of CHPS as a whole.
The CAT is now in the process of preparing a final recommendation paper to be delivered to the OHD Director.
During the upcoming weeks the CAT will work closely with Deltares and other contractors to define a migration strategy which will introduce the first operational version of CHPS at all RFCs. HSEB expects to present details of the strategy to HICs at the HIC meeting in Silver Spring in January 2008.
CHPS-AWIPS II
Raytheon concluded their analysis of CHPS (FEWS), and delivered a proposal to OHD at the end of October for an approach to the CHPS-AWIPS II interface. Delft (Deltares) played a significant role in the task. The report suggested a 3-phased approach as follows:
- Phase 1 - CHPS co-exists with AWIPS II in its existing form. Neither CHPS nor AWIPS II will impact the other. This allows deployment of CHPS to proceed independently of the AWIPS II deployment.
- Phase 2 - Extend AWIPS II services to support CHPS-specific input and output data needs. No changes to FEWS (or CHPS) would be required.
- Phase 3 - Optionally extend FEWS to provide certain AWIPS II-specific extensions.
HSEB is waiting for Raytheon to submit a cost/technical proposal for Phase 2 activities.
"CHPS-ready" ResSim
Acceptance testing at CNRFC occurred during November. An adequately functional version of ResSim was installed, along with OHD’s/Apex’s enhanced version of NWSRFS. An outstanding issue concerning ResSim’s ability to execute a warm start in the manner expected by RFC forecasters was never resolved. As the necessary changes to ResSim would be extensive, CNRFC agreed that their plan to move forward with ResSim in their operations could proceed with minor impact. The USACE HEC will submit a proposal to the YCWA to make the necessary design and code changes to ResSim. This HEC activity will delay Phase 2, which is expected to add processing of ensemble forecasts in ResSim.
CNRFC will continue to run ResSim over the winter to evaluate its behavior/performance.
HEC-RAS into CHPS
Phase 1 of the project began with a kick-off conference call in December where a proposed project schedule was discussed. The project team consists of the following members:
- Delft (Deltares) as the overall software project lead.
- LMRFC (David Welch, Dave Ramirez) will provide the RFC forecaster perspective, as well as technical support for potential use of local applications. [Note: OHD has also contacted OHRFC to request their participation on the team.]
- HEC will identify the level of effort required to port their existing Sun Solaris-based RAS software to Linux.
- OHD HSMB will represent OHD's requirements for getting RAS into operations as a replacement for FldWav.
- OHD HSEB will monitor the contract task with Apex (mechanism used to access Deltares), and also the MOA between HEC and OHD.
Deltares plans to travel to the U.S. at the end of February to meet with HEC, OHD, and LMRFC, and begin the process of prototyping/designing a solution.
Phase 2 of the project - implementation of the final solution - is expected to begin later this FY.
Experimental Ensemble Forecast System (XEFS)
On October 19 HSEB submitted a "High Level Analysis and Design" document to the XEFS Implementation Team for review. This document contained a proposed software design to meet the requirements specified in the XEFS Design and Gap Analysis Report (available at http://www.weather.gov/oh/rfcdev/docs/XEFS_design_gap_analysis_report_final.pdf).
In December HSEB held a meeting to address feedback received on the document. However the discussion prompted a re-think of the implementation strategy, which - until that point - had been to develop a solution based on CHPS concepts but independently of FEWS.
Since it was becoming clear that FEWS would be the solution of choice for CHPS the XEFS Execution Manager, in consultation with the XEFS Oversight Group and numerous other subject matter experts, determined that the XEFS software design should be based entirely on FEWS. This is the most cost effective and least risky path to take.
[Top]
October 2007
The main CHPS web site is available at:
http://www.nws.noaa.gov/ohd/hrl/chps/index.html. This "News & Activities" section contains reports from the HSEB quarterly newsletters. The CHPS page can also be accessed from the main OHD page (http://www.nws.noaa.gov/ohd/).
HydroXC
A visit in September by the Australian Water Information Delegation to establish closer ties for information exchange revealed their interest in our work on Hydrology XML. Apex Digital Services and Dr. Michael Piasecki from Drexel University met with them about the XML schema and the Consortium. There may be opportunities for further collaboration in the future.
CHPS FEWS Pilot
On August 15 RTi led a kick-off meeting for the CHPS FEWS Pilot Enhancements project. To recap, these enhancements include:
- Installation of the Pilot at ABRFC (3rd Pilot site, joining NWRFC and NCRFC)
- Develop a MODs-like capability for the SAC-SMA
- Configure all Pilot sites as client-servers, not standalone as now
- Provide additional segment definitions for the Santiam River for NWRFC
- Provide more in-depth training to all Pilot sites
- Provide access to SNOW-17 (replaces Delft's SNOWMELT in the existing Pilot)
A workshop to demonstrate these new features is scheduled for December, at NCRFC. During a discussion in early September, the CAT agreed that the term ‘Initial Operating Capability (IOC)’ will refer to the suite of functionality at the CHPS FEWS Pilot sites that will enable those sites to abandon use of NWSRFS as their primary forecasting tool. Delft recently proposed a user interface design for the MODs-like feature, and held a meeting to review and discuss with the CHPS Acceleration Team (CAT) members in late September.
HSEB, through its RSIS contract, completed testing of the SNOW-17 model and adapter for use within the CHPS FEWS Pilot system, and delivered the code to Delft. HSEB also developed and delivered segment definitions for all basins of the Pilot sites. In response to a request at the July meeting of HICs in Silver Spring, MD HSEB invited all RFCs to participate in its "chps_fews_pilot" list server forum. The list quickly reached its membership limit and has since been increased to accommodate.
CHPS-AWIPS II
With the contract task successfully initiated, Raytheon began their analysis of CHPS (in the form of Delft-FEWS) to develop a design approach for the CHPS-AWIPS II interface. Delft visited Raytheon in Omaha, Nebraska at the end of September to provide a walk-through of the FEWS system, and to develop technical details of a proposed approach. HSEB expects to receive a draft analysis and design approach document at the end of October 2007, with a follow-up discussion meeting occurring some time in November.
ResSim
The purpose of this project is to integrate use of the USACE HEC's Reservoir Simulation (ResSim) model into CNRFC operations. The project is a joint effort between the HEC, who is enhancing the ResSim and converting it to Linux, and the NWS who will provide a software interface between ResSim and the NWSRFS. HSEB, through its contract with RSIS, Apex, and Delft, has specifically designed this interface to be compatible with CHPS as well as NWSRFS; therefore the solution will incorporate the Delft-FEWS as a significant component.
During the week of July 9, Delft led an installation at CNRFC bringing all collaborative components together in one place for the first time. This included the Delft-FEWS configured for CNRFC, an early Linux version of the ResSim from HEC, and a modified version of NWSRFS from Apex. The installation revealed some missing functionality needed for NWSRFS, which HSEB provided at short notice, and which was delivered to CNRFC during August.
Full end-to-end testing continued throughout August and early September. Delft sent a hydrologist to CNRFC during the week of September 17 to troubleshoot an outstanding issue on-site. The cause of the problem turned out to be configuration and environment, not software.
For these and other reasons related to CNRFC's anticipated workload, acceptance testing at CNRFC has been delayed until mid-November. A fully functional version of ResSim will be installed at that time, along with an enhanced version of NWSRFS. During the ensuing months CNRFC will run ResSim in parallel with their normal operations.
HEC-RAS
The goal of this project is to provide RFCs with access to the USACE HEC River Analysis System (HEC-RAS) via CHPS (not NWSRFS). HSEB anticipates two phases, the first of which (Phase 1) will be the solution design; this piece has now been contracted out to Delft. The solution is expected to leverage much of the CHPS-based software developed on the ResSim project, without the connection to NWSRFS.
Also this quarter NOAA and the USACE finalized an updated Memorandum of Agreement (MOA) between the two agencies, thereby providing a vehicle to fund HEC's contributions to Phase 1 of this project. Funding is also now secured. With agreements, contracts, and funding in place, all that remains is for HEC to complete other unrelated commitments and release their staff to begin Phase 1.
The second phase, implementation of the design, will require HEC and other HSEB contractors (to be determined) to implement the proposed software design into CHPS.
Experimental Ensemble Forecast System (XEFS)
HSEB spent most of this quarter conducting an in-depth analysis of existing prototype software that is related to experimental hydrologic ensembles. That analysis, along with an examination of requirements captured in the XEFS Design and Gap Analysis Report (available at http://www.weather.gov/oh/rfcdev/docs/XEFS_design_gap_analysis_report_final.pdf), forms the basis of a high level software design for the XEFS. With the design in place, the XEFS Execution Manager is in the process of putting together a preliminary implementation plan, and specifying cross-functional team composition. An XEFS implementation kick-off meeting is expected in October.
The XEFS Execution Manager announced a one-month slip in the schedule, due to some AWIPS OB9 work which has impacted key XEFS resources.
[Top]
July 2007
HydroXC
Apex Digital Services completed development of a proof of concept tool that converts between SHEF .B format and HydroXC-compliant XML. Apex led a workshop for Consortium members in June to demonstrate the tool, using actual SHEF .B data. The goal is for Consortium members other than OHD to further this work, or begin using HydroXC-compliant XML on real (i.e., not proof of concept) projects. The new HydroXC web site has now been launched: http://www.hydroxc.org. The former OHD-hosted HydroXC web page (http://www.nws.noaa.gov/ohd/hydroxc/) is still available; however it will automatically forward you to the new site after 10 seconds.
CHPS FEWS Pilot
Installation of the CHPS FEWS Pilot system at NWRFC and NCRFC occurred this quarter; Delft demonstrated the system in Portland, OR during the week of April 15. Those in attendance included: OHD, the Bonneville Power Administration, RTi, Apex Digital Systems, Delft, RSIS, and the CHPS Acceleration Team (CAT) members.
Beyond the success of the demonstration, CAT members recognized immediately that additional functionality is required for the Pilot system to be viable. In response to this, HSEB initiated a contract task with Delft through RTi to implement the following:
- Installation of the Pilot at ABRFC
- Develop a MODs-like capability (the "what-if scenarios" are inadequate for operations)
- Configure all Pilot sites as client-servers, not standalone as now
- Provide additional segment definitions for the Santiam River for NWRFC
- Provide more in-depth training to all Pilot sites
HSEB expects Delft to begin work on these additional tasks in July or August.
Meanwhile, Apex distributed an early version of the Pilot evaluation criteria document to the CAT; however in the absence of the additional functionality described above, the CAT members suggested that the evaluation effort be postponed until all functionality is complete.
CHPS-AWIPS II
HSEB completed negotiations with Raytheon to define the interface between AWIPS II and CHPS. After delivery of Raytheon's new AWIPS Development Environment (ADE), Raytheon has agreed to begin an analysis of the CHPS FEWS Pilot system to determine how FEWS will best fit within the AWIPS II architecture; also to identify any additional tasks that might be required to make CHPS operate successfully within AWIPS II. In their dual role as Raytheon AWIPS sub-contractor and OHD CHPS architect, Apex Digital Systems will participate in this analysis. OHD expects the task to begin in July or August.
ResSim
The purpose of this project is to integrate use of the USACE HEC's Reservoir Simulation (ResSim) model into CNRFC operations. The project is a joint effort between the HEC, who is enhancing the ResSim and converting it to Linux, and the NWS who will provide a software interface between ResSim and the NWSRFS. The NWS has specifically designed this interface to be compatible with CHPS; therefore the solution will incorporate the Delft-FEWS as a significant component.
Members of HSEB (Jon Roe, Chris Dietz), Apex, and Delft attended a progress meeting on April 19 in Sacramento, CA for the Yuba-Feather Forecast-Coordinated Operations (F-CO) Management Team. Joan Klipsch, HEC, provided a status report of ResSim development activities; Manuel Mattke (Apex) provided a progress update on NWS activities.
During the past quarter Apex and Delft continued to make good progress. Installation of the NWS solution at CNRFC will occur the week of July 9, with acceptance expected in September.
Following Gary Carter's request for a briefing package suitable for presentation to a wide range of audiences (hydrologists, program managers, upper level management, partners, etc.), Apex developed a package showcasing ResSim as an example of the new business model to be realized through CHPS. Apex completed this briefing by the end of June.
HEC-RAS
After a series of discussions with HSMB and HEC, HSEB began the necessary paperwork to begin the task of incorporating the USACE HEC River Analysis System (HEC-RAS) into CHPS. HSEB anticipates two phases, the first of which will be the solution design; this piece will be contracted out to Apex. The second phase, implementation of the design, will require HEC and possibly others to develop additional software. The solution is expected to leverage much of the CHPS-based software developed on the ResSim project.
Experimental Ensemble Forecast System (XEFS)
In May the XEFS Design and Gap Analysis Team, led by DJ Seo (HSMB) and Rob Hartman (CNRFC) presented to the Director of OHD, Gary Carter, a report entitled "The Experimental Ensemble Forecast System (XEFS) Design and Gap Analysis: Report of the XEFS Design and Gap Analysis Team", dated May 11, 2007. The report is available on the web at: http://www.weather.gov/oh/rfcdev/docs/XEFS_design_gap_analysis_report_final.pdf. This report provides a summary of current prototype Ensembles functionality developed by HSMB, and an identification of functionality that will be required to introduce an initial (experimental) short-to-long term Ensembles capability into RFC operations. Incremental enhancements to the XEFS will ultimately result in a fully operational Hydrologic Ensemble Forecast System (HEFS).
Gary Carter accepted the findings in the report and subsequently tasked HSEB with formulating an execution plan. Chris Dietz (HSEB) has been assigned as the XEFS Execution Manager, supported by an Oversight Committee whose members include DJ Seo, Chris Dietz, Rob Hartman, and Mary Mullusky (OCWWS).
HSEB has now formed a 4-person software engineering team (the final member will arrive on July 9) and has begun an in-depth analysis of the prototype software. The software architect, Sudha Rangan, has begun the process of formulating a design consistent with CHPS. A draft implementation plan is expected by the end of August 2007.
[Top]
April 2007
CHPS FEWS Pilot
In February 2007 HSEB delivered the Java-based implementation of Victor Koren's Sacramento Soil Moisture Accounting (Heat Transfer) model, along with the adapter, to Delft for inclusion in the FEWS Pilot system. This is the first demonstration of a successful science-to-operations migration made possible by the new CHPS environment.
During March, Delft visited NCRFC and NWRFC and began setting up the FEWS Pilot system in preparation for the demonstration which is due to take place the week of April 16 at NWRFC. Several representatives from OHD will attend the demo.
Once the FEWS Pilot system installation (and demonstration) is complete, a 6-month evaluation period will begin. HSEB has engaged Apex Digital Systems to conduct this independent evaluation.
ResSim
The Yuba-Feather Forecast Coordinated Operations (FCO) Management Team has scheduled a progress meeting on April 19 in Sacramento, CA. Manuel Mattke (Apex) will provide a progress update on OHD activities; Jon Roe and Chris Dietz will also attend.
In March HSEB initiated another task with Apex to develop a briefing package suitable for Gary Carter to present to a wide range of audiences, such as: the NWS Corporate Board, the AMS and AGU Conferences, Interagency Committees such as AWCI and SWAQ, HICs and MICs, Congressional Staffers, USGS Meetings, and USACE Meetings. A key point in the briefing package is illustration of the "new way of doing business" being demonstrated concretely with the ResSim project.
HydroXC
Under the leadership of Dr. Michael Piasecki from Drexel University the Hydrology XML Consortium (HydroXC) is now developing sample schema objects. Dr. Piasecki has proposed that the Hydro-XML schema employ the existing spatial referencing features and the defined HydroFeatures of the Geographic Markup Language (GML). Based on these early concepts, Apex Digital Services has begun development of a parser that will convert between SHEF .B format and HydroXC-compliant XML. Apex led a workshop for Consortium members at the end of March to present these ideas.
CHPS-AWIPS II
During March HSEB and Raytheon continued a series of discussions that will result in a definition of the interface between AWIPS II and CHPS. After delivery of Raytheon's new AWIPS Development Environment (ADE) in July, Raytheon has agreed to begin an analysis of the FEWS pilot system to determine how FEWS will best fit within the AWIPS II architecture; also to identify any additional tasks that might be required to make CHPS operate successfully within AWIPS II. In their dual role as Raytheon AWIPS sub-contractor and OHD CHPS architect, Apex Digital Systems is expected to participate in this analysis.
[Top]
January 2007
CHPS Realization Plan
Apex conducted monthly meetings with OHD and members of the CHPS Acceleration Team (CAT: CNRFC, ABRFC, NWRFC, NCRFC, and OHD’s Senior Scientist). The original goal of the meetings was to elicit operational needs of the member RFCs, and to define a sequence of practical steps (projects) towards CHPS realization. However, as reported in the last newsletter, a meeting in September revealed a strong and clear desire by the CAT to introduce a completely new suite of forecasting software not based on the legacy NWSRFS.
On October 16 Apex organized a demonstration of WL | Delft’s Flood Early Warning System (FEWS)
for the CAT. The outcome was that the CAT now considers FEWS a viable solution. The "Evaluate FEWS
for CHPS" contract task was re-defined to provide a working demonstration ("pilot") of
FEWS in an RFC environment. Apex concluded their work on the Realization Plan in December.
Main recommendations included:
- Complete the FEWS Pilot
- Complete the ResSim project (also FEWS based)
- With FEWS knowledge, make decision for CHPS
- Share findings with Raytheon (for AWIPS II)
- Define the broader set of requirements for a new forecasting environment
- Full operational roll-out
CHPS FEWS Pilot
Under contract to WL | Delft Hydraulics via OHD HSEB’s contract with RTi, work on this task began
on September 26.
The work is divided into two phases:
- Phase 1, develop a conceptual solution and generate an implementation plan
- Phase 2, implement the solution
The Pilot system is scheduled to be completed in April 2007.
Delft and RTi led a project kick-off meeting on October 17. During the months of October and November,
Delft and RTi conducted a series of interviews with CAT members to elicit basin configuration information
for selection of the best candidate RFC for the pilot demonstration. The two RFCs selected to run the
Pilot were NWRFC and NCRFC.
Delft and RTi traveled to Silver Spring and on December 1 gave OHD a presentation of their Phase 1
findings and recommendations. Phase 2 is now underway.
As a risk reduction activity, OHD has also formed a small development team, led by RSIS, to integrate
the new SAC–SMA Heat Transfer model (also known as the new Frozen Ground model, developed by Victor
Koren) into FEWS. The RSIS team leader is an experienced Service Oriented Architecture (SOA)
practitioner with a thorough understanding of design and development of services, Ms. Sudha Rangan.
On September 27 OHD met with the Raytheon architect from Omaha to discuss the role of CHPS in AWIPS
II. OHD provided a very detailed review of the NWSRFS architecture and design. Apex – who is also
Raytheon’s SOA subcontractor for AWIPS II – shared their knowledge of Delft FEWS with
Raytheon. Raytheon acknowledged they had underestimated the complexity of NWSRFS, and seemed willing
to accept contributions that would advance AWIPS II. OHD agreed to keep Raytheon apprised of progress
on the FEWS Pilot project.
ResSim
After a series of meetings and discussions between Apex, Delft, CNRFC, and USACE HEC, Apex presented
their technical recommendations to OHD on October 10. This contract task has now been completed; in
December HSEB submitted a Statement of Objectives to Contracts for the follow-on work (implementation
of the technical recommendations). While this project will integrate ResSim into NWSRFS, it will be
designed in such a way as to be "CHPS-ready", so that it will require minimal effort to
integrate the solution into the FEWS Pilot after the completion of that project next year.
[Top]
October 2006
In the autumn of 2006 OHD received the clear and strong message from the CAT that their approach for CHPS was not going to work for two main reasons:
- Simple re-engineering would effectively freeze introduction of new capabilities at River Forecast
Centers (RFCs), potentially for several years. One of the original CHPS projects (RRS Preprocessor) was
specifically rejected by field representatives at HOSIP Gate 2 for this reason.
- The existing software infrastructure of the NWSRFS is so out of date, and requires such a high level
of maintenance, that it is no longer cost effective to keep it in service. The bulk of the NWSRFS
infrastructure software focuses on a 1970’s era need to streamline computer resources in ways
that are now handled by hardware and operating systems. The "core" capabilities of the NWSRFS
are a small portion of the entire software package; these capabilities are the only things that must be
retained in a CHPS environment.
The CAT’s desire was to consider a completely new infrastructure, not hindered by limitations of
the existing NWSRFS design.
On 16 October, 2006 Apex Digital Services hosted a live web-based demonstration of the FEWS for the CAT. The CAT concluded that FEWS has significant potential to become a replacement for NWSRFS, and they requested that OHD develop a demonstration system based on FEWS but functioning in a NWS (RFC) environment.
[Top]
July 2006
On the CHPS front, two new exciting initiatives were begun in June:
CHPS Realization Plan Definition
The purpose of this task is to bring together several thought leaders within OHD and at the River
Forecast Centers (RFCs) to define this specific vision and to create sufficiently detailed plans to
bring CHPS into daily reality. In June OHD awarded the task to Apex Digital Systems, Inc. Apex will
begin the task in July by initiating a "discovery engagement" with all stakeholders.
Evaluate FEWS for CHPS
WL | Delft’s DELFT-FEWS software package, developed originally for the U.K. Environment Agency,
is based on Service Oriented Architecture (SOA) concepts, and uses technology almost identical to that
used for the CHPS Proof Of Concept (POC). OHD believes that the DELFT–FEWS ready-made suite of
SOA and modeling capabilities could accelerate CHPS implementation by several years, yielding
significant savings for the Government, and providing RFCs with much-needed improvements far sooner
than originally envisioned. The purpose of this task is to conduct a pilot study of DELFT-FEWS for
NWSRFS
Manuel Mattke, President & CEO of Apex Digital Systems, Inc., will attend the July 2006 HIC meeting
in Kansas City, MO to brief the new CHPS implementation approach with Jon Roe
ResSim
A third CHPS-related external project to provide RFCs access to the USACE Reservoir Simulation
(ResSim) model from NWSRFS also made good progress this period. In June OHD awarded a contract to
Apex Digital Systems, Inc. to lead this effort. Apex plans to make use of WL | Delft’s FEWS
infrastructure as part of its solution. Over the next several months Apex will be working closely with
Rob Hartman, HIC at CNRFC, the USACE’s Hydrologic Engineering Center (HEC), and consultants from
WL | Delft.
[Top]
April 2006
Rivers, Reservoirs and Snow (RRS) Pre-Processor
Based on a re-assessment of how to get CHPS into operations, HSEB determined in January that the
decision to use the RRS Pre–Processor as an example of a functioning CHPS Data Service would
provide too little benefit to operations. Rather, our approach now is to focus on building CHPS
concepts into high priority projects such as DHM.
This effort remains on hold until HSEB can develop a better road map for building CHPS into real
projects, instead of building CHPS components for their own sakes. In April HSEB intends to initiate a
project to carefully define the evolution of projects needed to effectively roll out various CHPS
capabilities.
Mean Areal Temperature (MAT) Architecture Shell
The project to design and develop a Mean Areal Temperature (MAT) CHPS Architecture Shell was submitted
to, but failed, HOSIP Gate 2 in January. The purpose of this effort was to develop an architecture
shell for a new NWSRFS MAT data pre-processor. However, field representatives at Gate 2 objected to
there being no operational value in the project, preferring to see a new algorithm in operations.
OHD management agreed, and the project was stopped. The revised approach is to re-direct efforts to
the advancement of new MAT science into operations. This will require a re-write of the contract
task statement.
Ensemble Streamflow Prediction (ESP) Control Service
The Ensemble Streamflow Prediction (ESP) component of the NWSRFS, originally selected as a pilot project
to develop the first CHPS Control Service, is still on hold due to a lack of Government personnel
oversight resources and partially because there are technical problems with designing the overall CHPS
Control Service too early compared to other services work needed. Efforts here will be re-directed toward
creating the comprehensive CHPS projects road map mentioned above.
Hydro XML Consortium (HydroXC)
Phase 2 of the contract task to refine and extend The Hydrology XML Consortium (HydroXC) is right now
being completed. Two workshops were held, one in February and one in March. The first workshop presented
a real world example of using HydroXC-compliant XML to serve flood inundation data from the FLDWAV model
to any application that might map those data. The second workshop consisted of presentations by NWRFC and
NCRFC on their uses of XML and their needs as we move toward a third phase of this project. The third
phase of work is being defined right now and will concentrate on crafting tools to manipulate
HydroXC-compliant files, tools to convert into and out of HydroXC, and creation of commonly agreed upon
object templates. The goal of Phase 3 will be to provide tools that can be used by Consortium members
in their operational software as desired. A slightly revised Version 2 of the HydroXC-compliant XML
schema definition will be published in early April as a result of the work performed in Phase 2.
ResSim
The external project to provide RFCs access to the USACE Reservoir Simulation (ResSim) model from
NWSRFS continued progress this period. Rob Hartman, HIC at CNRFC, is leading the way in engaging OHD
and USACE’s Hydrologic Engineering Center (HEC) in a joint project to provide this linkage, funded
entirely by the Yuba County California Water Agency (YCWA). All agreements have now been signed, and HSEB
is waiting for funding details in order to engage a contractor and begin work. We expect work to begin in
early April and USACE-HEC has already begun their tasks.
[Top]
January 2006
Rivers, Reservoirs and Snow (RRS) Pre-Processor
As an initial delivery of CHPS Data Service capability, we were hoping to deliver a revised RRS
pre-processor that could obtain its input observation data from the IHFS Database rather than from the
fs5files in a manner consistent with the new CHPS architecture. However, a re-direction of CHPS Data
Service work toward DHM has forced HSEB to put this task on hold temporarily. We had chosen RRS as an
example application to prove the ability to build a functioning CHPS Data Service. We have achieved that
goal. Now we are trying to aim the resultant Data Service work toward the biggest bang for the buck, DHM.
Also, it is becoming clear that even though we have proved that we can entirely wrap an application
(i.e., RRS) using the CHPS Data Service components, this may not be the smartest application to complete
the wrapping exercise. It is probably more economical in the long run to re-write the basic RRS logic as
a CHPS Algorithm Service than to wrap it. This may be true for several of the NWSRFS data pre-processors
as we move them toward accessing their input data directly from the IHFS Database.
Mean Areal Temperature (MAT) Architecture Shell
Preparations for design and development of a Mean Areal Temperature (MAT) CHPS Architecture Shell took
shape during this quarter, as the contract task with RTi was awarded. The purpose of this effort is to
develop an architecture shell for a new NWSRFS MAT data pre-processor. By the end of this quarter the
contractor had slipped the schedule by one month. We are working closely with RTi to address the
issue.
Ensemble Streamflow Prediction (ESP) Control Service
The Ensemble Streamflow Prediction (ESP) component of the NWSRFS, originally selected as a pilot project
to develop the first CHPS Control Service, has been put on hold partially due to a lack of Government
personnel oversight resources and partially because there are technical problems with designing the
overall CHPS Control Service too early compared to other services work needed.
Hydro XML Consortium (HydroXC)
Phase 2 of the contract task to create and promote the Hydrology XML Consortium (HydroXC) was defined,
proposed, accepted, and awarded during this period. A survey of the RFCs’ XML usage and thoughts
for the future was completed. A report is pending. The contractor maintained contact with the HydroXC
members, added members, and obtained more data examples to refine the schema to version 2. The contractor
also modeled the output data of dynamic wave routing models (e.g., FLDWAV and DamBreak) to create
HydroXC-compliant XML. The contractor reports a considerable increase in HydroXC member interest and
enthusiasm this quarter as Phase 2 has commenced. They are preparing a presentation for HL Management to
outline various HydroXC opportunities that are presenting themselves now.
ResSim
The external project to provide RFCs access to the USACE Reservoir Simulation (ResSim) model from NWSRFS
continued progress this period. Rob Hartman, HIC at CNRFC, is leading the way in engaging OHD and USACE
’s Hydrologic Engineering Center (HEC) in a joint project to provide this linkage, funded entirely
by the Yuba County California Water Agency (YCWA). Rob finalized details of the agreements, and we are
now waiting for DoC clearance for NOAA to sign the contract and give OHD the go-ahead to begin work.
[Top]
October 2005
Rivers, Reservoirs and Snow (RRS) Pre-Processor
As an initial delivery of CHPS capability, we were hoping to deliver a revised RRS pre-processor that
could obtain its observation data from the IHFS Database rather than from the fs5files in a manner
consistent with the new CHPS architecture. The AHPS prime contractor submitted a technical proposal,
which has been accepted by HSEB, but which is still awaiting award.
This task was previously targeted for AWIPS OB7. However, last month we were briefed on the new
AWIPS software development process and we determined that the new process requirements would represent
a change in scope for the task; therefore we had to defer this item from OB7 to a future release (to
be determined) but as soon as practical.
Mean Areal Temperature (MAT) Architecture Shell
Preparations for design and development of a Mean Areal Temperature (MAT) CHPS Architecture Shell are
underway. The purpose of this effort is to develop an architecture shell for a new NWSRFS MAT data
pre-processor. We received the contractor’s proposal in September, but the task has yet to be
awarded. Meanwhile the HOSIP documents have been prepared and the project is expected to pass HOSIP
Gate 1 next month.
Ensemble Streamflow Prediction (ESP) Control Service
The Ensemble Streamflow Prediction (ESP) component of the NWSRFS has been selected as a pilot project to
develop the first CHPS Control Service. This new ESP Control Service is expected to improve RFC
operations by providing a framework for setting up and controlling various sub-components of the ESP.
We accepted the contractor’s technical proposal and are awaiting task award. We expect to complete
preliminary HOSIP Stage 1 documents next month.
Hydro XML Consortium (HydroXC)
Phase 2 of the contract task to create and promote the Hydrology XML Consortium (HydroXC) was defined,
proposed, accepted, and awarded during this period. This second phase should commence around 1 October
and continue for the next six to seven months. Phase 2 will continue to refine the schema using more
member data examples and RFC data examples and will look at converting the output of dynamic wave routing
models from proprietary format files to HydroXC-compliant XML.
ResSim
The external project to provide RFCs access to the USACE Reservoir Simulation (ResSim) model from NWSRFS
continued progress this period. Rob Hartman, HIC at CNRFC, is leading the way in engaging OHD and USACE
’s Hydrologic Engineering Center (HEC) in a joint project to provide this linkage, funded
entirely by the Yuba County California Water Agency (YCWA). Rob has been working to finalize details
of the agreements between all parties and work is now expected to begin in October.
[Top]
[Back to main CHPS web page]
|