Magda - Manager for grid-based data
Wensheng Deng, Torre Wenaus
Abstract
Magda is a distributed data manager prototype for grid-resident data. It makes use of the MySQL open source relational database, Perl, Java and C++ to provide file cataloging, retrieval and replication services. For data movement, gridFTP, bbftp and scp can be chosen depending on available protocols. Third party transfers are supported. Magda currently catalogs 321K files with total size of 85.8 TB. It was successfully used in the Data Challenge 1 production for the Atlas experiment. It has been used to replicate more than 7 TB of data between BNL and CERN mass stores. We present here the design and implementation of Magda, and how it has been used as a file catalog and replication tool.
Create a lesson
Related papers
Identifying the Shear Piezoelectric Coefficient using Physics-Informed Neural Networks under Exact Boundary and Initial Constraints
Suhas Suresh Bharadwaj
Fracture-Bench: A Controlled Benchmark Suite for Machine Learning Surrogates in Phase-Field Fracture Mechanics
Meenu Krishnan U., Maryam Hakimzadeh, Indrashish Saha et al.
Noise-resilient collective order through temporal memory in self-propelled particles
Mihir Durve, Sauro Succi, Antonio Celani
Site-orbit masked twin-branch Transformer for symmetry-constrained crystal generation
Junchi Liu, Haoran Si, Luo Yan et al.
Maximal correlation and optimal transformations of probability distributions in tensor-train format: a variational algorithm
Kayo Kinjo, Jun Ohkubo
Quantum simulation of dissipative acoustic and elastic waves by Schrödingerisation: absorbing boundaries and explicit polynomial-size circuits
Hoang Anh Nguyen, Ali Tura