Skip to content

Automated, daily backups of COVID-19 data from Canadian government sources

License

Notifications You must be signed in to change notification settings

luoluogogogo/covid-19-canada-gov-data

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Archive of COVID-19 Data from Canadian Government Sources

The data in this archive have moved. They can be accessed at the following link: https://drive.google.com/drive/folders/10ET5FBqO-K8FBdEaXgBjBZwJskIZGKNG?usp=sharing

From now on, this archive will be used only to store and collorate on archival scripts and metadata. Links to the data have been updated. Other options to explore and download the data will be available soon.

This repository provides automated, daily backups of COVID-19 data from various Canadian government sources. Selected non-governmental sources are also included.

File name timestamps are given in ET (America/Toronto) in the following format: %Y-%m-%d_%H-%M. The script is run nightly around 23:00 ET.

All code in this repository is covered by the MIT License. Licenses and terms of use for each archived dataset are given below.

This repository is maintained by Jean-Paul R. Soucy on behalf of the COVID-19 Open Data Working Group.

Table of contents:

Contributing

Community members may contribute to this repository in three ways:

  • Create an issue to request a dataset be added to the archive.
  • Create a pull request for archiver.py adding the ability to automatically archive a requested or not-yet-implemented dataset.
  • Submit archived versions of an existing, requested, or not-yet-implemented dataset. If possible, please use the original file name plus timestamp in the format described above.

Recommended citation

COVID-19 Canada Open Data Working Group. Archive of COVID-19 Data from Canadian Government Sources. https://github.com/jeanpaulrsoucy/covid-19-canada-gov-data. (Access date).

Running archiver.py

archiver.py can run in four modes:

  • python archiver.py serverprod: Download and commit files, running on the Heroku server.
  • python archiver.py localprod: Download and commit files, running on a local machine.
  • python archiver.py servertest: Download but do not commit files, running on the Heroku server.
  • python archiver.py localtest: Download but do not commit files, running on a local machine.

See archiver.py for more details.

Data sources/terms of use/supplementary material

The sources and terms of use for each included dataset are linked below. Supplementary material such as data dictionaries and codebooks are also included in the list below, if available. These files are included with the relevant datasets in a directory named supplementary.

Alberta

Edmonton

British Columbia

Canada

Manitoba

Winnipeg

Northwest Territories

Nova Scotia

Nunavut

Ontario

Toronto

Ottawa

Quebec

When both French and English data files are available, French files should be considered definitive (and in many cases, these files have been captured in the archive for a longer duration). The English versions of files avaiable in both languages will always have their directories marked with "-en" at the end.

Montreal

Saskatchewan

Yukon

Other: Non-governmental sources

Canada

Quebec

COVID-19 Canada Open Data Working Group

Data from the COVID-19 Canada Open Data Working Group is being added on an experimental basis. The full catalogue of historical data will be available in the future.

Data notes

On several occasions, the nightly archival script has failed to run. Depending on when the failure was identified, this may have resulted in a partial or total loss of archival data for that day. A list of these days is provided below:

  • Wednesday, October 21, 2020
  • Thursday, November 19, 2020

In the future, a package will be provided to more easily access the data provided in this archive and to document missing or incomplete data.

Acknowledgements

Many people are to thank for contributing archived data and code to this repository.

About

Automated, daily backups of COVID-19 data from Canadian government sources

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Python 100.0%