Satellite Archive Browse and Retrieval (SABR)
Satellite Archive Browse and Retrieval (SABR) system is designed to provide a unified web access to satellite data sources and products at National Geophysical Data Center NOAA in Boulder, CO.
SABR combines data products from DMSP (DoD), GOES (NOAA), and Terra/Aqua (NASA) satellites with environmental databases (NCEP/NCAR reanalysis project and SPIDR NGDC project) and geoinformation system (MapServer from University of Minnesota) to provide interactive visualization, mining and ordering of satellite images, telemetry and derived products stored at NGDC in relational databases, RAID arrays, and robotic tape library.
SABR functions include interactive search of images and data products; interactive plots of satellite coverage; animated browsing of temporal sequences of preview images (“VCR controls”) and navigation with preview images over satellite orbits (“joystick”); interactive maps with overlaid GIS data and satellite data products using open GIS consortium (OGC) web map server (WMS) interface; interactive plots of satellite telemetry; interactive parallel mining of environmental databases and satellite archives for “events” at a given location, time range and event duration (“fuzzy search engine”); user “shopping basket” with metadata and preview for every ordered item for asynchronous data order processing with e-mail notification of the order results.
In 2004 we plan to include the SABR web application into the web interface to the NOAA-wide Comprehensive Large Array-data Stewardship System (CLASS) electronic library of environmental satellite data products. Using GLORIAD connectivity bandwidth, the SABR near-real time satellite data dissemination model may become a real alternative to the traditional radio telemetry downlinks to the regional satellite tracking stations.
SABR Developers Team:
Eric Kihn, NGDC NOAA, USAChris Elvidge, NGDC NOAA, USA
Dr. Mikhail Zhizhin, Institute of Physics of the Earth
and Geophysical Center, Russian Acad. Sci.
Organization(s) who response for the projects from Russian side
Information Technologies Lab, Institute of Physics of the Earth (IPE) and Geophysical Center (GC) Russian Acad. Sci (http://clust1.wdcb.ru) .The IT Lab was created by IPE in 1996 to develop network and telecommunications infrastructure for geophysical applications. It operates a Joint Computer Center (JCC) of IPE and GC RAS, located at the GC premises in Moscow, 3 Molodezhnaya str., near Moscow State University (MSU).
The computer facilities at JCC IPE and GC RAS are used mainly by 3 World Data Centers (WDC) hosted at GC: WDC for Solar-Terrestrial Physics, WDC for Ionosphere and WDC for Solid Earth (http://www.wdcb.ru).
Leader(s) of the projects from Russian side
Dr. Mikhail ZHIZHIN, Head of Information Technologies LabInstitute of Physics of the Earth and
Geophysical Center RAS
Phone: +7-095-9306115
Fax: +7-095-9305559
E-mail: jjn@wdcb.ru
US Partners
Solar-Terrestrial Physics Division, National Geophysical Data Center, NOAANOAA's National Geophysical Data Center (NGDC) provides scientific stewardship, products, and services for geophysical data describing the sea floor, solid earth, and solar-terrestrial environment, including Earth observations from space. Solar-Terrestrial Physics Division is responsible for archive and real-time data products related to space weather, ionosphere, geomagnetic field, and satellite observations.
Leader(s) of this project from US side
Eric KihnSolar-Terrestrial Physics Division
National Geophysical Data Center NOAA
Phone: +1-303-4976346
Fax: +1-303-4976513
E-mail: Eric.A.Kihn@noaa.gov
Number of the US users currently registered in SPIDR is about 7000 with 150-200 data mining sessions per day. SPIDR data web services are developed after requests from DMSO, NASA, JPL, and LASP of Colorado University. The data loading and synchronization services are used by ionospheric and geomagnetic observatories in the US, European countries, Russia, Australia, South Africa, and China. International bodies coordinating the data exchange within SPIDR are World Data Centers for Solar-Terrestrial Physics.
The IDEAS project development will support the U.S. Department of Defense (DoD) Modeling and Simulation (M&S) office Master Plan, which states that the next generation of M&S programs will require the inclusion of an integrated authoritative representation of the natural environment. The environmental scenarios from the weather data mining services by the IDEAS project are used as boundary conditions to initiate just-in-time regional mesoscale DMSO weather models and simulations.
The satellite data viewers provided by SABR are used by the NGDC and its data subscribers world wide for routine DMSP satellites orbits ordering, quality control and post-processing. Web interface to the NOAA-wide Comprehensive Large Array-data Stewardship System (CLASS) electronic library of environmental satellite data products will use SABR component for the DMSP long-term data archive at NGDC.
It is foreseen that the data sources, mining and visualization GRID services developed by the SPIDR, IDEAS, and SABR projects will be used in the Electronic Earth program of the Presidium of Russian Academy of Sciences and the Electronic Geophysical Year 2007 organized by ICSU.
The Electronic Geophysical Year (eGY), 2007-2008, an IUGG/IAGA initiative, is intended to bring geoscientific data and information availability and world-wide access into the 21st Century. The eGY concept was featured as the lead article in the 16 March 2004 EOS Trans. Amer. Geophys. Un. (Vol. 85, No. 11). Partners joining in the development of eGY are presently International Union of Geological Sciences (IUGS), the Scientific Committee for Solar Terrestrial Physics (SCOSTEP), and the Society of Exploration Geophysicists (SEG) who recently passed a resolution of support.
The hardware installation of JCC IPE and GC RAS includes a parallel computer cluster (16 nodes), 3 Tbytes of disk space at 2 storage servers, about 100 client workstations, mixed 1Gbit/100Mbit LAN, and 1 Gbit fiber optical link to the MSU Internet router providing 1 Gbit link to the Presidium of RAS and 300 Mbit link to the main Moscow exchange at M9.
In the FY05 we plan to double number of cluster nodes, to have the total disk storage about 10 Tbytes, and to upgrade the direct optical link available for international traffic to 2 Gbit/s in cooperation with Moscow State University.
We estimate the current daily incoming international traffic to the JCC about 5 Gbytes, basically by real-time meteo- (IDEAS) and space-weather (SPIDR) database synchronization and DMSP satellites products (SABR) data. For dissemination of additional NOAA and NASA satellite images (archive and near real-time) in SABR project the daily data traffic requirements will increase to 50 Gbytes in both directions. Space weather models output data exchange (similar to LHC) periodically may require up to the 100 Gbytes of daily traffic in both directions.
SPIDR (meta)data web services should be OGSA-compliant to the end of 2004.
We have preliminary agreement with Vladislav Ilyin, Vice-Director SINP MSU, to use the SINP GRID infrastructure to support the arising SPIDR, IDEAS, and SABR grid data services. We plan to use SINP infrastructure as a high-level GRID services and metadata registry and as a digital certificates authority for authentication in GRID.
We have preliminary agreement with Sergei Abramov, Director of Institute of Programming Systems, Botik, Russia, for joint experiments with parallel runs of environmental models (meso-scale meteorological and space-weather) using the IPS computing clusters in Botik. The GLORIDAD infrastructure will help to exchange models output data between Boulder, USA, and Moscow and Botik, Russia, and also to run production versions of the models on the FSL parallel cluster Jet in Boulder, USA.
Data exchange between NGDC and World Data Centers at GC RAS historically was the first step function in the traffic statistics for MirNet/NaukaNet project in 1998-99. Most of the SPIDR, IDEAS, and SABR projects development, software deployment and data exchange will be simply impossible without the parallel deployment of the MirNet/NaukaNet telecommunication pipes. Since then we are using the capacity of the NaukaNet for real-time data exchange, scheduled network backup of databases, and teleworking, such as shared code repositories and video t eleconferencing.
