Enhancing Fault Diagnosis in GWAC: A Monitoring System for Telescope Arrays

Abstract

The Ground-based Wide-Angle Cameras array (GWAC) necessitates the integration of over 100 hardware devices, more than 100 servers, and upwards of 2500 software modules, all synchronized within a 3-second imaging cycle. However, the complexity of real-time and high concurrency processing of big data have historically resulted in a substantial failure rate, with estimated observation efficiency of less than 50% in 2023. To address these challenges, we developed a monitoring system aimed at enhancing fault diagnosis efficiency. The system features two innovative monitoring views: state evolution monitoring and transient lifecycle monitoring. These, combined with instantaneous state monitoring and key parameter monitoring views, create a comprehensive and holistic monitoring strategy. This paper details the system's architecture, data collection methods, and the design philosophy of monitoring views. After a year of practical fault diagnostics, the system has demonstrated the ability to identify and localize faults within minutes, achieving fault localization speeds nearly ten times faster than traditional methods. Additionally, the system's design exhibits high generalizability, making them applicable to other telescope array systems.