M100 dataset 2: from 21-01 to 21-06

Description

This entry is a part of a larger data set collected from the most recent Tier-0 supercomputer hosted at CINECA (Marconi100, https://www.hpc.cineca.it/hardware/marconi100). The data covers the entirety of the system, ranging from the computing nodes (980+ computing nodes) internal information such as core loads, temperatures, frequencies, memory write/read operations, CPU power consumption, fan speed, GPU usage details, etc., to the system-wide information, including the liquid cooling infrastructure, the air conditioning system, the power supply units, workload manager statistics, and job-related information, system status alerts, and weather forecast. It comprises hundreds of metrics measured on each computing node, in addition to hundreds of other metrics gathered from sensors monitored along all system components. The whole data set is stored as a collection of Zenodo entries; this particular entry corresponds to the period: 21-01, 21-06. The dataset is stored as a partitioned Parquet dataset, with this partitioning hierarchy: year_month ("YY-MM"), plugin, metric. The data is distributed as tarball files, each corresponding to one month of data (first-level partitioning, year_month). The collected data is generated by a monitoring infrastructure working on unstructured data (to improve efficiency and scalability); however, this data has been organized in a structured manner to facilitate its fruition. The simplest way to understand how the access the data is to refer to the companion software modules released together with the dataset itself, which can be found at: https://gitlab.com/ecs-lab/exadata.

Resources

Name Format Description Link
0 http://data.europa.eu/88u/dataset/oai-zenodo-org-7589131
0 http://data.europa.eu/88u/dataset/oai-zenodo-org-7589131
0 http://data.europa.eu/88u/dataset/oai-zenodo-org-7589131
0 http://data.europa.eu/88u/dataset/oai-zenodo-org-7589131
0 http://data.europa.eu/88u/dataset/oai-zenodo-org-7589131
0 http://data.europa.eu/88u/dataset/oai-zenodo-org-7589131
0 http://data.europa.eu/88u/dataset/oai-zenodo-org-7589131

Tags

  • supercomputing
  • high-performance-computing
  • hpc
  • datacenter

Topics

Categories