NREL Eagle supercomputer jobs

Description

High performance computing dataset with 11M+ jobs from NREL's Eagle supercomputer. These jobs were submitted to run on Eagle between Nov 2018 and Feb 2023. The data are sufficiently anonymized and do not include sensitive user or project data. HPC research community does not have many public, large, and complete job traces like this one, and releasing this dataset should help address this gap.

Resources

Name Format Description Link
0 Eagle job trace in a parquet file https://data.openei.org/files/5860/eagle_data.parquet
0 Eagle job trace in a compressed csv file https://data.openei.org/files/5860/eagle_data.csv.bz2
47 Description of the fields in this dataset. https://data.openei.org/files/5860/READ_ME.txt
28 OEDI Public Dataset Documentation https://github.com/openEDI/documentation/blob/eagle-jobs/eagle-jobs.md

Tags

  • processed-data
  • high-performance-computing
  • supercomputer
  • hpc
  • jobs
  • computing
  • job-trace
  • computer-science

Topics

Categories