Description
The BUTTER-E - Energy Consumption Data for the BUTTER Empirical Deep Learning Dataset adds node-level energy consumption data from watt-meters to the primary sweep of the BUTTER - Empirical Deep Learning Dataset. This dataset contains energy consumption and performance data from 63,527 individual experimental runs spanning 30,582 distinct configurations: 13 datasets, 20 sizes (number of trainable parameters), 8 network "shapes", and 14 depths on both CPU and GPU hardware collected using node-level watt-meters. This dataset reveals the complex relationship between dataset size, network structure, and energy use, and highlights the impact of cache effects.
BUTTER-E is intended to be joined with the BUTTER dataset (see "BUTTER - Empirical Deep Learning Dataset on OEDI" resource below) which characterizes the performance of 483k distinct fully connected neural networks but does not include energy measurements.
Resources
| Name | Format | Description | Link |
|---|---|---|---|
| BUTTER-E Paper | Unknown | Paper detailing the BUTTER-E project and dataset. | Open resource |
| BUTTER-E Energy.zip | ZIP | 1-minute raw time series power data corresponding to the runs in the "BUTTER-E Metadata" resource. | Open resource |
| BUTTER-E Metadata.zip | ZIP | Metadata concerning each training run | Open resource |
| Node Power Distribution.csv | CSV | Power consumption quantiles for each node used to generate the BUTTER-E Dataset. | Open resource |
| Node Info.csv | CSV | Characteristics of each compute node used to generate the BUTTER-E data set. | Open resource |
| ReadMe for BUTTER-E Data.md | Markdown | README document describing the columns, schema, size, and format of the data contained in this submission. | Open resource |
| Runs with Standardized Energy.zip | ZIP | Power data joined to run data, including extra columns for standardized energy data as described in the paper. | Open resource |
| Summary by Epoch.tar | TAR | Training losses related to the BUTTER-E dataset, re-summarized from the BUTTER dataset. | Open resource |
| BUTTER - Empirical Deep Learning Dataset on OEDI | HTML | Link to the OEDI submission for the BUTTER dataset which includes a link to the original BUTTER data on AWS, data descriptions, and a tutorial Jupyter notebook for using the data. | Open resource |
| BUTTER-E GitHub ReadMe | Markdown | README document describing the columns, schema, size, and format of the data contained in this submission. | Open resource |
Tags
- benchmark
- butter
- butter-e
- computational-science
- deep-learning
- efficient
- empirical-deep-learning
- empirical-machine-learning
- energy
- energy-consumption
- energy-efficiency
- energy-use
- green-computing
- machine-learning
- model
- network-structure
- neural-networks
- node-level
- power
- power-consumption
- training
- training-efficiency