Operational Aspects of Dealing with the Large BaBar Data Set
Tofigh Azemoon, Adil Hasan, Wilko Kroeger, Artem Trunov
Abstract
To date, the BaBar experiment has stored over 0.7PB of data in an Objectivity/DB database. Approximately half this data-set comprises simulated data of which more than 70% has been produced at more than 20 collaborating institutes outside of SLAC. The operational aspects of managing such a large data set and providing access to the physicists in a timely manner is a challenging and complex problem. We describe the operational aspects of managing such a large distributed data-set as well as importing and exporting data from geographically spread BaBar collaborators. We also describe problems common to dealing with such large datasets.
Create a lesson
Related papers
Navigating Runtime Dynamism in Semantic Query Serving
Hengrui Zhang, Xupeng Miao
SQLoom: Set-Contrastive Learning of Syntactic, Semantic, and Logical Dependencies for Text-to-SQL
Hao Fu, Degang Sun, Wan Wei et al.
Stop Handcrafting Your Engine! GenDB-V: Towards AI-Generated and Formally Verified Database Systems
Jiale Lao, Immanuel Trummer
Recast: Refinement-Centered Approximate Nearest Neighbor Search Optimized for Storage
Zehai Yang, Fengyi Tao, Wenzhuo Dong et al.
USDB: Scaling Storage for Next-Generation Recommender Systems at ByteDance
Xiaoran Zhu, Jieming Cai, Weiping Yu et al.
Mixed-Type Relational Database Synthesis with Graph-Prompted Language Model
Yuxiang Sun, Mengshi Chen, Jianwei Wang et al.