21-25 March 2022
Academia Sinica
Europe/Zurich timezone

An overview of technologies behind the Russian Scientific Data Lake prototype

25 Mar 2022, 11:30
30m
Room 2

Room 2

Oral Presentation Track 6: Data Management & Big Data Data Management & Big Data

Speaker

Andrey Kiryanov (NRC "Kurchatov Institute")

Description

A substantial data volume growth is expected with the start of the HL-LHC era. Even taking into account the hardware evolution it will require substantial changes to the ways data is managed and processed. The WLCG DOMA project was established to address the relevant research, and along with the national Data Lake R&Ds it studied the possible technology solutions for the organization of intelligent distributed federated storage. In this talk we will present one such R&D: the Russian Scientific Data Lake prototype, which is ongoing for the last three years, with the focus on software and technologies used for its deployment and testing.

Primary authors

Presentation materials