Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[dados-bot] br_ms_vacinacao_covid19 (2021-07-14) #588

Merged
merged 1 commit into from
Jul 15, 2021

Conversation

mavalentim
Copy link
Contributor

No description provided.

@mavalentim mavalentim added the data Data to add on BigQuery label Jul 15, 2021
@mavalentim mavalentim self-assigned this Jul 15, 2021
@github-actions
Copy link

Data Check Report

Table br_ms_vacinacao_covid19/microdados

✔️ Check if table exists

✔️ Check if select all works

✔️ Check if any column is completely null

❌ Check if primary key has unique values

SELECT 
  COUNT(
    DISTINCT CONCAT(id_documento)
  ) / COUNT(*) unique_percentage 
FROM `basedosdados-dev.br_ms_vacinacao_covid19.microdados` t

Table br_ms_vacinacao_covid19/microdados_estabelecimento

✔️ Check if table exists

✔️ Check if select all works

✔️ Check if any column is completely null

❌ Check if primary key has unique values

SELECT 
  COUNT(
    DISTINCT CONCAT(id_estabelecimento)
  ) / COUNT(*) unique_percentage 
FROM `basedosdados-dev.br_ms_vacinacao_covid19.microdados_estabelecimento` t

Table br_ms_vacinacao_covid19/microdados_paciente

✔️ Check if table exists

✔️ Check if select all works

✔️ Check if any column is completely null

❌ Check if primary key has unique values

SELECT 
  COUNT(
    DISTINCT CONCAT(id_paciente)
  ) / COUNT(*) unique_percentage 
FROM `basedosdados-dev.br_ms_vacinacao_covid19.microdados_paciente` t

Table br_ms_vacinacao_covid19/microdados_vacinacao

✔️ Check if table exists

✔️ Check if select all works

✔️ Check if any column is completely null

❌ Check if primary key has unique values

SELECT 
  COUNT(
    DISTINCT CONCAT(id_documento)
  ) / COUNT(*) unique_percentage 
FROM `basedosdados-dev.br_ms_vacinacao_covid19.microdados_vacinacao` t

Action Output

@mavalentim
Copy link
Contributor Author

yay, acho que os checks tao certinhos, a uniqueness é bem alta

@rdahis
Copy link
Member

rdahis commented Jul 15, 2021

Legal. Isso com dados de ontem né? Já vai consertar também a coisa da coluna INT64 né.

@mavalentim
Copy link
Contributor Author

Legal. Isso com dados de ontem né? Já vai consertar também a coisa da coluna INT64 né.

tá consertado! deu bem mais trabalho que só forçar ir pra INT, por isso a demora

@mavalentim
Copy link
Contributor Author

Legal. Isso com dados de ontem né? Já vai consertar também a coisa da coluna INT64 né.

dados são de ontem, hoje já rodam as meninas! (ontem deu o problema da cris, vou ver com ela hoje com calma)

@rdahis rdahis merged commit f703586 into master Jul 15, 2021
@rdahis rdahis deleted the teste_vacinacao_covid19_2 branch July 15, 2021 15:01
JoaoCarabetta added a commit that referenced this pull request Jul 19, 2021
* add table_exists, implement it on table.append

* change order in table.append

* fix default query and path mess (#561)

* add path in folder function

* [dados-revisão] br_seeg_emissoes (#541)

* sobe revisao

* revisao

* dados estão certos no BQ

* [dados-revisão] br_mc_auxilio_emergencial (#553)

* revisao auxilio

* revisao 2

* [dados-bot] br_ms_vacinacao_covid19 (2021-07-07) (#562)

Co-authored-by: terminal_name <github_email>

* [dados-bot] br_ms_vacinacao_covid19 (2021-07-08) (#569)

Co-authored-by: terminal_name <github_email>

* [dados] br_tse_eleicoes & br_tse_filiacao_partidaria (#544)

* Atualiza tudo de eleições e filiação partidária.

* Conserta detalhes_votacao_municipio.

* Conserta probleminhas variados.

* [dados-revisão] br_mapbiomas_estatisticas (#540)

* sobe revisao

* revisao

* revisao

* conserta primary keys

* revisao

* [dados-revisão] br_inep_ideb (#533)

* sobe revisao

* Conserta `organization_id`.

* revisao 2

* revisao 3

* conserta primary keys

* revisao

Co-authored-by: Ricardo Dahis <[email protected]>

* [infra] fix new column name (#571)

* [dados-bot] br_ms_vacinacao_covid19 (2021-07-09) (#572)

Co-authored-by: terminal_name <github_email>

* [dados] br_tse_eleicoes: Conserta tabelas com renomeação nos publish.sql. (#573)

* [dados-revisão] br_mc_indicadores (#575)

* [dados-revisão] br_ms_sim (#577)

* [dados-revisão] br_me_socios (#576)

* [docs] update contribution guidelines

* Update br_novos_dados.md

* Conserta problemas no Ideb. (#581)

* [dados-revisão] br_sp_seduc_inse (#586)

* [dados-revisão] br_sp_seduc_idesp (#585)

* [dados-bot] br_ms_vacinacao_covid19_microdados (2021-07-12) (#579)

Co-authored-by: terminal_name <github_email>

* [dados-bot] br_ms_vacinacao_covid19 (2021-07-14) (#588)

Co-authored-by: terminal_name <github_email>

* [infra] Melhora output das funções list_* e get_* na API do Python (#568)

* Add output_type parameter to list_datasets

* Add output_type parameter to list_dataset_tables

* Add private function to handle list outputs

* Add verbose argument to list_dataset and list_dataset_tables

* Bring back _handle_output, improve verbose docs and tests

* Improve get_* functions output

* Fix test_get_table_size_verbose_false

Co-authored-by: d116626 <[email protected]>

* feat: rascunho do relatorio de coverage

* fix: manter somente o coveralls

* fix: testar debug

* fix: executar testes

* trigger ci

* modulariza a action e exclui a flag de debug

* adiciona a badge ao readme

* extrair setup pro yml principal

* restaurar triggers originais

* restaurar nome original da ci

* Add docstrings to , fix small issues

* [infra] Configurar o basedosdados a partir de variáveis de ambiente (#557)

* add code for acquiring config from envs

* minor fix

* fix json to toml

* change from `const` decorator to python Enum

* Improve code style

* Document environment variables configuration mode

Co-authored-by: Vitor Mussa <[email protected]>

* Update table.py

* Update test_table.py

Co-authored-by: hellcassius <[email protected]>
Co-authored-by: Diego Oliveira <[email protected]>
Co-authored-by: Hevilyn Souza <[email protected]>
Co-authored-by: Matheus Valentim <[email protected]>
Co-authored-by: Ricardo Dahis <[email protected]>
Co-authored-by: Fernanda Scovino <[email protected]>
Co-authored-by: Vítor Mussa <[email protected]>
Co-authored-by: Vinicius <[email protected]>
Co-authored-by: Gabriel Gazola Milan <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
data Data to add on BigQuery data-check-trigger
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants