Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Release 1.8.0 #2109

Closed
wants to merge 2 commits into from
Closed

Release 1.8.0 #2109

wants to merge 2 commits into from

Conversation

pankajkoti
Copy link
Contributor

- Replace openlineage-airflow with Apache Airflow OSS provider apache-airflow-providers-openlineage #2103
- Bump up minimum version of apache-airflow to 2.7 #2103
- Bump up minimum version of Python to 3.8 #2103
- Limit pandas version to <2.2.0 due to an open issue for the release pandas==2.2.0 #2105
We're encountering difficulties achieving success with the 
integration test `test_aql_replace_existing_table` in our CI
environment.
The issue stems from `Google BigQuery` imposing rate limits on table 
operations—specifically, restricting them to `5` per `10` seconds per
table.
As a consequence, our CI pipeline fails, thereby hindering the release
of
version `1.18.0.`
The rate limits are documented here: 
https://cloud.google.com/bigquery/quotas#standard_tables

Initially, I contemplated skipping this test in CI. However,
implementing
a `10s` sleep for the problematic `BigQuery` test appears to 
circumvent the rate limit error, resulting in a fully successful CI
build.

I will cherrypick this PR in the release branch.
@pankajkoti pankajkoti closed this Jan 24, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant