Speaker
Mr
Tigran Mkrtchyan
(DESY)
Description
Running a data center is never a trivial job. In addition to daily routine tasks, service provider teams have to provide a meaningful information to upper management, end users and operators. The dCache production instances at DESY, produce gigabytes of billing files per day. Crunching the millions of numbers into a useful and handy information is unpleasant and boring task. Nevertheless, we can analyse and visualize this huge amount of log information with a modern BigData processing tools.
This presentation will show how we built a real-time monitoring system which visualizes dCache billing files and provides intuitive, simple to use web interface using ElasticSearch, Logstash and Kibana.
Primary author
Mr
Tigran Mkrtchyan
(DESY)
