Conveners
Data Management & Big Data
- David Groep (Nikhef)
27.
Towards a cloud-based computing and analysis framework to process environmental science big data
Prof.
Eleonora Luppi
(University of Ferrara and INFN)
, Dr
Luca Tomassetti
(University of Ferrara and INFN)
, Dr
Sebastiano Fabio Schifano
(University of Ferrara and INFN)
3/7/17, 2:00 PM
Data Management & Big Data
Environmental sciences are quickly and increasingly adopting research methodologies based on data coming from satellites, large network of sensors installed on the ground or sea-floating stations, as well as from devices installed on balloons or aircraft. These networks produce a big amount of data that needs to be appropriately processed and analyzed to extract information useful for...
Mr
Rob Appleyard
(STFC)
3/7/17, 2:20 PM
Data Management & Big Data
Accounting for storage available and used is important to many communities using grids (and clouds). Several large grids came together to define the GLUE schema (Grid Laboratory Uniform Environment) in order to promote the interoperation and cross-grid use of the infrastructures. Ensuring consistency (across implementations and grids) and usefulness of the information published by these grids...
Dr
Patrick Fuhrmann
(DESY/dCache.org)
3/7/17, 2:40 PM
Data Management & Big Data
For the previous decade, high performance, high capacity Open Source storage systems have been designed and implemented, accommodating the demanding needs of the LHC experiments. However, with the general move away from the concept of local computer centers, supporting their associated communities, towards large infrastructures, providing Cloud-like solutions to a large variety of different...
Prof.
Daniele Bonacorsi
(University of Bologna)
3/7/17, 3:00 PM
Data Management & Big Data
Tens of Petabytes of collision and simulated data have been collected and distributed across WLCG sites in Run-1 and Run-2 at LHC. A low latency in transfers among dozens of computing centres is crucial to make an efficient use of the computing resources. Despite on average the desired level of throughput has been successfully achieved to serve the LHC physics programs, it is not uncommon to...
