The design of a scientific data management system based on DOMAS at CSNS-II (preliminary stage)

Abstract

At the second stage of China Spallation Neutron Source (CSNS-II), it is predicted that 2 PB raw experimental data will be produced annually from twenty instruments. Scientific computing puts forward higher requirements for data sharing, utilization, retrieval, analysis efficiency, and security. However, the existing data management system (DMS) based on ICAT has several limitations including poor scalability of metadata database, imperfect data-management lifecycle and inflexible API. To ensure the accuracy, usability, scalability and efficiency of CSNS-II experimental data, a new scientific data management system is therefore designed based on the DOMAS framework developed by the Computing Center of IHEP. The data acquisition, transmission, storage and service systems are re-designed and tailored specifically for CSNS-II. Upon its completion, the new DMS will overcome the existing challenges and offer functions such as online display, search functionality and rapid download capabilities for metadata, raw data and analyzed data; flexible and user-friendly authorization; and data lifecycle management. Ultimately, the implementation of the new Data Management System (DMS) is expected to enhance the efficiency of experimental data analysis, propelling CSNS-II to achieve international advanced standards. Furthermore, it aims to reinforce self-reliance and technological strength in the field of science and technology at a high level in China. The development and deployment of the new DMS begin at the end of 2023.