Multi-Petabyte SOA Storage, Search, and Dissemination System

IIW has developed a massive collection, storage, and retrieval system that is easily adapted to various file formats. The system is developed under Service Oriented Architecture (SOA) and is Unix-based. It includes redundant Storage Area Networks, hot standby ingest nodes, file and streaming playback of data, and extensive data search capabilities. The system is built around a four-node Oracle RAC database, with multi-terabytes of redundant database storage. The system is designed to a PL-3+ standard, has multi-level security, and tags all data and metadata for security purposes. The system is highly scalable in all dimensions and has a demonstrated long-term availability of over 99.7% across a number of locations. Extremely fast metadata searches are enabled, yielding results that allow rapid retrieval of data via a web-based graphical user interfaces (GUI) or web services interfaces. Demonstrated ingest as high as 1200MB/s per stream and stream counts up to 120 per system have been demonstrated and delivered.

Approval: TD-09-0023