Skip to content
This repository has been archived by the owner on May 6, 2024. It is now read-only.

add vaccination data #1574

Closed
wants to merge 40 commits into from
Closed

add vaccination data #1574

wants to merge 40 commits into from

Conversation

maekke
Copy link
Collaborator

@maekke maekke commented Jan 10, 2021

add a very basic vaccination data with the total number of vaccinations and the number vaccinated people (I guess this value is not yet provided by any of the cantons yet).
This should include all the needed scripts and github workflow.
See #1550

@maekke maekke requested a review from metaodi January 10, 2021 09:07
@metaodi metaodi self-assigned this Jan 11, 2021
@maekke
Copy link
Collaborator Author

maekke commented Jan 17, 2021

status update:

  • BE daily data of vaccinations available and scraped
  • BL daily data of first and second vaccinations available and scraped
  • BS daily data of vaccinations available and scraped (though it's named vaccinated people in the data)
  • GE weekly data of vaccinations available and scraped (not really sure if it's worth scraping the daily data, since it's not the accumulated, but daily / weekly data)
  • JU weekly data of vaccinations available and scraped (I'm not sure if this "Total" value is per week, so this might need to be summed up with previous data)
  • SO latest daily data of vaccinations available and scraped

@amslera amslera mentioned this pull request Jan 18, 2021
Closed
@maekke
Copy link
Collaborator Author

maekke commented Jan 20, 2021

@maekke
Copy link
Collaborator Author

maekke commented Jan 20, 2021

VS vaccination scraper e46da8d

maekke added 24 commits January 21, 2021 21:29
@maekke
add VaccinationData class
073250f
@maekke
add vaccination DB scripts
e86c1df 
to populate entries from csv and to add new entries.
@maekke
add run_vaccinations_scraper.sh
2487145
@maekke
add BS vaccination scraper
b4ff0b9
@maekke
add empty fallzahlen_kanton_BS_impfungen.csv
f3cd588
@maekke
add github workflow for vaccination scraper
12cfe18
@maekke
include vaccinations scrapers in test_scrapers.sh
b367c0b
@maekke
add GE vaccination scraper
adc4d2a
@maekke
add SO vaccinations scraper
0e7e2e3
@maekke
add VaccinationData unit test
2aebaa8
@maekke
add vaccination scraper for BE
d2aaaa6
@maekke
add empty fallzahlen_kanton_BE_impfungen.csv
47bee18
@maekke
add BE scraper to github workflow
ff71ad6
@maekke
update GE vaccination scraper to new website
ecda1bc
@maekke
add BL vaccination scraper
4e83627 
- add the scraper
- add empty csv file
- wire it up in the github workflow
@maekke
add JU vaccination scraper
61fd7bb
@maekke
update BE vaccinations scraper to use latest website
b6db4c8
@maekke
update GE vaccinations scraper to latest website
8927a26 
- skip total vaccination row, but check if the total vaccination match what
  was used as output
- sum up vaccinations per week to to a total
@maekke
replace date with start/end-date, week and year for VaccinationData
5620381
@maekke
use start/end date for BE vaccination scraper
139c368 
and update date regex to latest website
@maekke
use start/end-date for BL vaccination scraper
0be284c 
and update to latest columns from website
@maekke
use start/end-date for BS vaccination scraper
aafaef9
@maekke
use week and year for GE vaccination scraper
d0a8fc2
@maekke
use start/end-date for JU vaccination scraper
a8fb9cf
maekke added 15 commits January 21, 2021 21:29
@maekke
use start/end-date for SO vaccination scraper
63e69c5
@maekke
update CSV files with new columns
9f36926
@maekke
update DB and runner scripts with new columns
0c6ccba
@maekke
add missing __get_int_item function and update header of VaccinationData
643727f
@maekke
fix VaccinationData tests
13d2f10
@maekke
add/update columns for VaccinationData in python code
c7b3736 
- remove vaccinated people
- add first/second doses
- add doses delivered
@maekke
update csv file columns
fde36a6
@maekke
add ZG vaccination scraper
37ae178
@maekke
move VS daily PDF find logic and strip function to VS common module
a715819
@maekke
add VS vaccination scraper
bea9ce5
@maekke
update BS vaccination scraper
358736a 
- update total column name
- add first and second dosis values
@maekke
add TG common module and move csv url fetching to common function
6120733
@maekke
add TG vaccination scraper, empty csv and wire it up in the workflow
964a022
@maekke
add AI vaccination scraper
a54d2f2
@maekke
add AR vaccination scraper
e9b88d5
@maekke
Copy link
Collaborator Author

maekke commented Jan 22, 2021

TG/AR/AI added too

@maekke
Copy link
Collaborator Author

maekke commented Jan 23, 2021

VD: 88fabec

@amslera amslera linked an issue Jan 27, 2021 that may be closed by this pull request
Vaccination data #1550
Closed
@maekke
Copy link
Collaborator Author

maekke commented Jan 27, 2021

@metaodi @amslera should we close this? I guess this is not going to get merged.
I've added the scripts to https://github.com/maekke/vaccination_data (not yet the PDF parsing ones), just for fun...

@metaodi metaodi closed this Jan 27, 2021
@maekke maekke deleted the add_vaccination_data branch August 18, 2021 14:35
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Reviewers

@metaodi metaodi Awaiting requested review from metaodi

Assignees

@metaodi metaodi

Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.

Vaccination data
2 participants
@maekke @metaodi