Description
SDNist (v1.3) is a set of benchmark data and metrics for the evaluation of synthetic data generators on structured tabular data. This version (1.3) reproduces the challenge environment from Sprints 2 and 3 of the Temporal Map Challenge. These benchmarks are distributed as a simple open-source python package to allow standardized and reproducible comparison of synthetic generator models on real world data and use cases. These data and metrics were developed for and vetted through the NIST PSCR Differential Privacy Temporal Map Challenge, where the evaluation tools, k-marginal and Higher Order Conjunction, proved effective in distinguishing competing models in the competition environment.SDNist is available via pip install: pip install sdnist==1.2.8 for Python >=3.6 or on the USNIST/Github. The sdnist Python module will download data from NIST as necessary, and users are not required to download data manually.
Resources
| Name | Format | Description | Link |
|---|---|---|---|
| Datasets for 'Census' evaluation in CSV format | CSV | Three compressed CSV files to run the 'Census'-related functions in SDNist. | Open resource |
| Census GA_NC_SC schema | JSON | GA_NC_SC_10Y_PUMS.json | Open resource |
| Census GA_NC_SC data | Binary | Open resource | |
| Census IL_OH schema | JSON | IL_OH_10Y_PUMS.json | Open resource |
| Census IL-OH data | Binary | Open resource | |
| Census NY_PA schema | JSON | NY_PA_10Y_PUMS.json | Open resource |
| Census NY-PA data | Binary | Open resource | |
| K-marginal report template | Binary | A jinja2 report template to help humans read the k-marginal data | Open resource |
| Taxi 2016 schema | JSON | taxi2016.json | Open resource |
| Taxi 2016 | Binary | Open resource | |
| Taxi 2020 schema | JSON | taxi2020.json | Open resource |
| Taxi 2020 data | Binary | Open resource | |
| Taxi datasets in CSV format | CSV | Three compressed CSV files to run the 'Taxi'-related functions in SDNist. | Open resource |
| Taxi schema | JSON | taxi.json | Open resource |
| Taxi data | Binary | Open resource | |
| DOI Access for SDNist: Benchmark data and evaluation tools for data synthesizers. | Unknown | Open resource | |
| SDNist software respository at Github | Unknown | SDNist: Benchmark data and evaluation tools for synthetic data generators | Open resource |