Data Services and Documentation
In addition to running computational systems, CIP sites provide resources for short-term and long-term data storage. Higher-level data management and data collection services and expertise are also available. The table below contains a technical summary of these data resources and services and associated documentation.
Researchers with TeraGrid or Core computing allocations are eligible to use the general storage resources described below. Users with specialized requests should contact the sites individually about their data service needs in the areas of data management, data collection hosting, and unique data storage requirements. Eligible PIs who do not have a TeraGrid or Core computing allocation can request a data allocation for presented data services and resources.
For more information about accessing SDSC data services and resources, see DataCentral at SDSC or e-mail datacentral-allocations@sdsc.edu to contact one of SDSC's Data Central experts. For additional information about NCSA data capabilities, send email to help@ncsa.uiuc.eda with your request and a NCSA staff member will contact you.
| Site | Data Service |
Software & Documentation |
Supporting Hardware |
| SDSC | Database Hosting and Management | DB2 Management System DB2 @SDSC Basics Using DB2 on DataStar Using DB2 on TeraGrid IBM DB2 Info DB2 iMiner IBM iMiner Info MySQL MySQL Oracle 10g |
DataStar Power 4 node dedicated to DB users |
| Data Hosting | GPFS and
Sun SAM-QFS Info Areas dedicated for: |
Over 1 Petabyte of SAN online disk storage Collections: Parking: |
|
| Long-Term Storage | HPSS SDSC HPSS User Guide HSI User Guide Sun SAM-QFS HSM SDSC SAM-QFS User Guide |
|
|
| Disk Storage |
Sun SAM-QFS HSM SDSC SAM-QFS User Guide |
||
| Collection Management | Storage Resource Broker SRB User Guide |
Data Movers and Metadata catalog HW:
|
|
| NCSA | Database Hosting and Management | Oracle 10g MySQL |
SGI Altix |
| Data Hosting - variety of technologies available for community datasets |
NFS Lustre IBRIX |
Storage-Area Network 30 + Linux-based Storage Servers |
|
| Long-Term Storage | EMC/Legato DiskXtender/UniTree Mass Storage System NCSA UniTree documentation Man pages for UniTree transfer commands DiskXtender online documentation |
Mass Storage System Front End Servers
35 TB disk cache Tape Library |

