Data Management and Real-time Distribution in the HF-Radar National Network

Terrill, E. and M. Otero, L. Hazard, D. Conlee, J. Harlan, J. Kohut, P. Reuter, T. Cook, T. Harris, K.G. Lindquist

The architecture, status and applications of a real-time data access, distribution, processing and storage system designed for networking radial data from surface current mapping HF-Radar instruments across the United States is presented. By leveraging the system design of HF-Radar sites, data access is generalized to nearly all sites while still providing alternate access options where needed. Data format convergence, while not required, is achieved for data from all systems through careful metadata mapping and code development. Object ring buffers (ORBs) and ORB communication protocol provide robust and flexible data transport while a relational database facilitates data storage.

The HF-Radar Network has evolved from a prototype project to an operational status over the last 2.5 years with 4 data access sites (portals) and 1 data aggregation site (node) deployed. By early 2007, an additional portal and 2 additional nodes will be added to create a distributed network. To date, the repository contains over 356,000 radial files produced by 45 sites from 10 participating institutions.

Recent development has focused on real-time total vector processing on a national scale. Base grids for the U.S. West and East/Gulf Coast of 1 km nominal resolution extending 300 km offshore are created using an equidistant cylindrical projection. A community standard MATLAB toolbox for total vector processing is optimized for production on large grids and integrated into the real-time system to produce hourly surface current maps on a national scale at 1 km, 2 km, and 6 km resolutions.

Current applications of the HF-Radar network include an interactive radial diagnostic site for use by site operators and a prototype interactive web site providing the first images of real-time surface currents integrated across a national scale.