Experience with the Open Source based implementation for ATLAS Conditions Data Management System
A. Amorim, J. Lima, C. Oliveira, L. Pedro, N. Barros
Abstract
Conditions Data in high energy physics experiments is frequently seen as every data needed for reconstruction besides the event data itself. This includes all sorts of slowly evolving data like detector alignment, calibration and robustness, and data from detector control system. Also, every Conditions Data Object is associated with a time interval of validity and a version. Besides that, quite often is useful to tag collections of Conditions Data Objects altogether. These issues have already been investigated and a data model has been proposed and used for different implementations based in commercial DBMSs, both at CERN and for the BaBar experiment. The special case of the ATLAS complex trigger that requires online access to calibration and alignment data poses new challenges that have to be met using a flexible and customizable solution more in the line of Open Source components. Motivated by the ATLAS challenges we have developed an alternative implementation, based in an Open Source RDBMS. Several issues were investigated land will be described in this paper: -The best way to map the conditions data model into the relational database concept considering what are foreseen as the most frequent queries. -The clustering model best suited to address the scalability problem. -Extensive tests were performed and will be described. The very promising results from these tests are attracting the attention from the HEP community and driving further developments.
Create a lesson
Related papers
Navigating Runtime Dynamism in Semantic Query Serving
Hengrui Zhang, Xupeng Miao
SQLoom: Set-Contrastive Learning of Syntactic, Semantic, and Logical Dependencies for Text-to-SQL
Hao Fu, Degang Sun, Wan Wei et al.
Stop Handcrafting Your Engine! GenDB-V: Towards AI-Generated and Formally Verified Database Systems
Jiale Lao, Immanuel Trummer
Recast: Refinement-Centered Approximate Nearest Neighbor Search Optimized for Storage
Zehai Yang, Fengyi Tao, Wenzhuo Dong et al.
USDB: Scaling Storage for Next-Generation Recommender Systems at ByteDance
Xiaoran Zhu, Jieming Cai, Weiping Yu et al.
Mixed-Type Relational Database Synthesis with Graph-Prompted Language Model
Yuxiang Sun, Mengshi Chen, Jianwei Wang et al.