SDNist v1.3: Temporal Map Challenge Environment

Description

SDNist (v1.3) is a set of benchmark data and metrics for the evaluation of synthetic data generators on structured tabular data. This version (1.3) reproduces the challenge environment from Sprints 2 and 3 of the Temporal Map Challenge. These benchmarks are distributed as a simple open-source python package to allow standardized and reproducible comparison of synthetic generator models on real world data and use cases. These data and metrics were developed for and vetted through the NIST PSCR Differential Privacy Temporal Map Challenge, where the evaluation tools, k-marginal and Higher Order Conjunction, proved effective in distinguishing competing models in the competition environment.SDNist is available via pip install: pip install sdnist==1.2.8 for Python >=3.6 or on the USNIST/Github. The sdnist Python module will download data from NIST as necessary, and users are not required to download data manually.

Resources

Name Format Description Link
Datasets for 'Census' evaluation in CSV format CSV Three compressed CSV files to run the 'Census'-related functions in SDNist. Open resource
Census GA_NC_SC schema JSON GA_NC_SC_10Y_PUMS.json Open resource
Census GA_NC_SC data Binary Open resource
Census IL_OH schema JSON IL_OH_10Y_PUMS.json Open resource
Census IL-OH data Binary Open resource
Census NY_PA schema JSON NY_PA_10Y_PUMS.json Open resource
Census NY-PA data Binary Open resource
K-marginal report template Binary A jinja2 report template to help humans read the k-marginal data Open resource
Taxi 2016 schema JSON taxi2016.json Open resource
Taxi 2016 Binary Open resource
Taxi 2020 schema JSON taxi2020.json Open resource
Taxi 2020 data Binary Open resource
Taxi datasets in CSV format CSV Three compressed CSV files to run the 'Taxi'-related functions in SDNist. Open resource
Taxi schema JSON taxi.json Open resource
Taxi data Binary Open resource
DOI Access for SDNist: Benchmark data and evaluation tools for data synthesizers. Unknown Open resource
SDNist software respository at Github Unknown SDNist: Benchmark data and evaluation tools for synthetic data generators Open resource

Tags

Topics

Categories