23-28 August 2020
BHSS, Academia Sinica
Asia/Taipei timezone

Distributed Data Management system for LHAASO

Not scheduled
20m
BHSS, Academia Sinica

BHSS, Academia Sinica

Oral Presentation Data Management & Big Data

Speaker

Mr Haibo Li (Chinese)

Description

The LHAASO(Large High Altitude Air Shower Observatory) experiment of IHEP will generate 6 PB per year in the future. These massive data processing faces many challenges in the distributed computing environment. For example, some sites may have no local HEP storage which made the distributed computing unavailable. Our goal is to make the data available for LHAASO in any remote sites. In our architecture, we use EOS as our local storage system, and use LEAF as the data federation system. LEAF is a data cache and access system across remote sites proposed by IHEP. LEAF can present one same file system view at local and the remote sites, supporting directly data access on demand. In this report, we will present the whole data management architecture, data workflow and performance evaluation of LEAF in LHAASO.

Primary author

Mr Haibo Li (Chinese)

Presentation materials

There are no materials yet.