Water Quality - Effluent - Electronic Self-Monitoring Report (eSMR) Data

Description

Wastewater discharges are regulated by the Water Board. Those regulated are generally required to submit Self-Monitoring Reports to the State or Regional Water Board. Some dischargers submit their reports through the electronic Self-Monitoring Report (eSMR) module of the California Integrated Water Quality System (CIWQS). Generally these are for discharges into surface waters regulated by an individual National Pollutant Discharge Elimination System (NPDES) permit, though other dischargers may be included in this dataset as well. This dataset are the monitoring results that have been submitted as data points after the submitters have been approved for electronic submittals (i.e. after the "all electronic date").

Note that this dataset does not include records where the sampling date falls outside of the years shown below. The excluded records include: records where the sampling date is missing, records where the sampling date is invalid (e.g., records with sampling dates in the future or unreasonably far in the past), and records for samples taken prior to year 2006. The excluded records represent approximately 0.1% of all records in the complete eSMR dataset.

Resources

Name Format Description Link
2021 eSMR Analytical Data CSV Electronic Self-Monitoring Report (eSMR) data for samples taken in year 2021. Open resource
2019 eSMR Analytical Data CSV Electronic Self-Monitoring Report (eSMR) data for samples taken in year 2019. Open resource
2009 eSMR Analytical Data CSV Electronic Self-Monitoring Report (eSMR) data for samples taken in year 2009. Open resource
2017 eSMR Analytical Data CSV Electronic Self-Monitoring Report (eSMR) data for samples taken in year 2017. Open resource
2010 eSMR Analytical Data CSV Electronic Self-Monitoring Report (eSMR) data for samples taken in year 2010. Open resource
2020 eSMR Analytical Data CSV Electronic Self-Monitoring Report (eSMR) data for samples taken in year 2020. Open resource
2023 eSMR Analytical Data CSV Electronic Self-Monitoring Report (eSMR) data for samples taken in year 2023. Open resource
2012 eSMR Analytical Data CSV Electronic Self-Monitoring Report (eSMR) data for samples taken in year 2012. Open resource
2006 eSMR Analytical Data CSV Electronic Self-Monitoring Report (eSMR) data for samples taken in year 2006. Open resource
2024 eSMR Analytical Data CSV Electronic Self-Monitoring Report (eSMR) data for samples taken in year 2024. Open resource
2007 eSMR Analytical Data CSV Electronic Self-Monitoring Report (eSMR) data for samples taken in year 2007. Open resource
2015 eSMR Analytical Data CSV Electronic Self-Monitoring Report (eSMR) data for samples taken in year 2015. Open resource
2022 eSMR Analytical Data CSV Electronic Self-Monitoring Report (eSMR) data for samples taken in year 2022. Open resource
2013 eSMR Analytical Data CSV Electronic Self-Monitoring Report (eSMR) data for samples taken in year 2013. Open resource
2006-Present eSMR Analytical Data (Zipped CSV) ZIP This resource contains a single zipped csv file that includes all of the eSMR analytical data from 2006 through present. The data is identical to that contained in the csv files for individual years, and is included here as a faster option for users who want a bulk download of all of the eSMR data made available on the open data portal. Open resource
2016 eSMR Analytical Data CSV Electronic Self-Monitoring Report (eSMR) data for samples taken in year 2016. Open resource
2018 eSMR Analytical Data CSV Electronic Self-Monitoring Report (eSMR) data for samples taken in year 2018. Open resource
2008 eSMR Analytical Data CSV Electronic Self-Monitoring Report (eSMR) data for samples taken in year 2008. Open resource
2014 eSMR Analytical Data CSV Electronic Self-Monitoring Report (eSMR) data for samples taken in year 2014. Open resource
2011 eSMR Analytical Data CSV Electronic Self-Monitoring Report (eSMR) data for samples taken in year 2011. Open resource
2006-Present eSMR Analytical Data (Parquet Format) ZIP This resource contains a zipped set of files in the Apache Parquet file format (see: **https://parquet.apache.org/**), which include all of the eSMR analytical data from 2006 through present, partitioned by region (the [California Water Board Region](https://www.waterboards.ca.gov/waterboards_map.html) where the sampling site is located) and year (the calendar year in which the sample was taken). Parquet is a free and open source data storage format that allows for fast and efficient processing of large datasets. It is compatible with a variety of data analysis platforms, including the R and Python programming languages, through the Apache Arrow platform (see: **https://arrow.apache.org/**). See **[here](https://gist.github.com/daltare/d76d63360050810f99ae8d7a6b4d1443)** for an example showing how to use this dataset with the R programming language. The data in this dataset is essentially identical to that contained in the csv files for the individual years (with the exception that missing values in numeric and date fields are encoded as "NA" rather than "NaN" or empty text strings), and is included here as an alternative option for for users who want a bulk download of all of the eSMR data made available on the open data portal. Open resource

Tags

Topics

Categories