CASTOR status and evolution
Jean-Philippe Baud, Ben Couturier, Charles Curran, Jean-Damien Durand, Emil Knezo, Stefano Occhetti, Olof Barring
Abstract
In January 1999, CERN began to develop CASTOR ("CERN Advanced STORage manager"). This Hierarchical Storage Manager targetted at HEP applications has been in full production at CERN since May 2001. It now contains more than two Petabyte of data in roughly 9 million files. In 2002, 350 Terabytes of data were stored for COMPASS at 45 MB/s and a Data Challenge was run for ALICE in preparation for the LHC startup in 2007 and sustained a data transfer to tape of 300 MB/s for one week (180 TB). The major functionality improvements were the support for files larger than 2 GB (in collaboration with IN2P3) and the development of Grid interfaces to CASTOR: GridFTP and SRM ("Storage Resource Manager"). An ongoing effort is taking place to copy the existing data from obsolete media like 9940 A to better cost effective offerings. CASTOR has also been deployed at several HEP sites with little effort. In 2003, we plan to continue working on Grid interfaces and to improve performance not only for Central Data Recording but also for Data Analysis applications where thousands of processes possibly access the same hot data. This could imply the selection of another filesystem or the use of replication (hardware or software).
Create a lesson
Related papers
Circular Economy Synergies and Trade-offs in Data Centres
Vlad C. Coroamă, Oana Dumbravă
Warfare
Nathan Reitinger
Digital Twin Modeling of a Highly Automated Agricultural Tractor
Clay Hallman, Lukas Pindl, Timo Oksanen
Risk-based Design for Sustainability in Cloud Systems: Insights from an Experts' Survey
Maria Voreakou, Cleopatra Bardaki, George Kousiouris et al.
Model Collapse: On Recursion, Noise, and Uncharted Machine Visions
Violaine Boutet de Monvel
Modelling Scenarios for Carbon-aware Geographic Load Shifting of Compute Workloads
Wim Vanderbauwhede