Open Data Portal Catalogue

Description

The open data portal catalogue is a downloadable dataset containing some key metadata for the general datasets available on the Government of Canada's Open Data portal. Resource 1 is generated using the [ckanapi tool](https://github.com/ckan/ckanapi/blob/master/README.md#bulk-dumping-and-loading) (*external link*) Resources 2 - 8 are generated using the [Flatterer](https://flatterer.opendata.coop/) (*external link*) utility. ###Description of resources: 1. [Dataset](https://open.canada.ca/data/en/dataset/c4c5c7f1-bfa6-4ff6-b4a0-c164cb2060f7/resource/27f49273-d645-4950-9a58-c3086d833d57) is a [JSON Lines](https://jsonlines.org/) (*external link*) file where the metadata of each Dataset/Open Information Record is one line of JSON. The file is compressed with GZip. The file is heavily nested and recommended for users familiar with working with nested JSON. 2. [Catalogue](https://open.canada.ca/data/en/dataset/c4c5c7f1-bfa6-4ff6-b4a0-c164cb2060f7/resource/b8931c16-0710-4c31-bbda-f60841e98cb4) is a XLSX workbook where the nested metadata of each Dataset/Open Information Record is flattened into worksheets for each type of metadata. 3. [datasets metadata](https://open.canada.ca/data/en/dataset/c4c5c7f1-bfa6-4ff6-b4a0-c164cb2060f7/resource/312a65c5-d0bc-4445-8a24-95b2690cc62b) contains metadata at the ` dataset` level. This is also referred to as the ` package ` in some CKAN documentation. This is the ` main ` table/worksheet in the SQLite database and XLSX output. 4. [Resources Metadata](https://open.canada.ca/data/en/dataset/c4c5c7f1-bfa6-4ff6-b4a0-c164cb2060f7/resource/3c911562-c541-463f-8cd4-490182cd57f9) contains the metadata for the resources contained within each dataset. 5. [resource views metadata](https://open.canada.ca/data/en/dataset/c4c5c7f1-bfa6-4ff6-b4a0-c164cb2060f7/resource/a79f7297-9b20-427a-be79-d286daa92412) contains the metadata for the views applied to each resource, if a resource has a view configured. 6. [datastore fields metadata](https://open.canada.ca/data/en/dataset/c4c5c7f1-bfa6-4ff6-b4a0-c164cb2060f7/resource/3733106d-74f1-428e-beda-cad530b473cf) contains the DataStore information for CSV datasets that have been loaded into the DataStore. This information is displayed in the Data Dictionary for DataStore enabled CSVs. 7. [Data Package Fields](https://open.canada.ca/data/en/dataset/c4c5c7f1-bfa6-4ff6-b4a0-c164cb2060f7/resource/09c51a72-e803-4050-8b8f-165809bccf05) contains a description of the fields available in each of the tables within the Catalogue, as well as the count of the number of records each table contains. 8. [data package entity relation diagram](https://open.canada.ca/data/en/dataset/c4c5c7f1-bfa6-4ff6-b4a0-c164cb2060f7/resource/21ad0300-b9f5-444e-b43b-8bd164901b55) Displays the title and format for column, in each table in the Data Package in the form of a ERD Diagram. The [Data Package](https://open.canada.ca/data/en/dataset/c4c5c7f1-bfa6-4ff6-b4a0-c164cb2060f7/resource/f13ed9cc-e460-42ca-a526-56e02ecaefaa) resource offers a text based version. 9. [SQLite Database](https://open.canada.ca/data/en/dataset/c4c5c7f1-bfa6-4ff6-b4a0-c164cb2060f7/resource/b7f0c11e-e81f-46e7-958d-0bbf878a3df6) is a ` .db ` database, similar in structure to [Catalogue](https://open.canada.ca/data/en/dataset/c4c5c7f1-bfa6-4ff6-b4a0-c164cb2060f7/resource/b8931c16-0710-4c31-bbda-f60841e98cb4). This can be queried with database or analytical software tools for doing analysis.

Resources

Name Format Description Link
8 https://open.canada.ca/data/dataset/c4c5c7f1-bfa6-4ff6-b4a0-c164cb2060f7/resource/312a65c5-d0bc-4445-8a24-95b2690cc62b/download/main.csv
34 https://open.canada.ca/data/dataset/c4c5c7f1-bfa6-4ff6-b4a0-c164cb2060f7/resource/21ad0300-b9f5-444e-b43b-8bd164901b55/download/graph-1.png
23 https://open.canada.ca/data/dataset/c4c5c7f1-bfa6-4ff6-b4a0-c164cb2060f7/resource/f13ed9cc-e460-42ca-a526-56e02ecaefaa/download/datapackage.json
8 https://open.canada.ca/data/dataset/c4c5c7f1-bfa6-4ff6-b4a0-c164cb2060f7/resource/3c911562-c541-463f-8cd4-490182cd57f9/download/resources.csv
8 https://open.canada.ca/data/dataset/c4c5c7f1-bfa6-4ff6-b4a0-c164cb2060f7/resource/a79f7297-9b20-427a-be79-d286daa92412/download/resources_resource_views.csv
8 https://open.canada.ca/data/dataset/c4c5c7f1-bfa6-4ff6-b4a0-c164cb2060f7/resource/3733106d-74f1-428e-beda-cad530b473cf/download/ds_fields.csv
54 https://open.canada.ca/data/dataset/c4c5c7f1-bfa6-4ff6-b4a0-c164cb2060f7/resource/b8931c16-0710-4c31-bbda-f60841e98cb4/download/output.xlsx
8 https://open.canada.ca/data/dataset/c4c5c7f1-bfa6-4ff6-b4a0-c164cb2060f7/resource/09c51a72-e803-4050-8b8f-165809bccf05/download/fields.csv
0 https://open.canada.ca/data/dataset/c4c5c7f1-bfa6-4ff6-b4a0-c164cb2060f7/resource/b7f0c11e-e81f-46e7-958d-0bbf878a3df6/download/sqlite.db
0 https://open.canada.ca/static/od-do-canada.jsonl.gz

Tags

Topics

Categories