-
Notifications
You must be signed in to change notification settings - Fork 1.2k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
openmetadata_managed_apis uses deprecated Airflow class #12190
Comments
Hi, note that we don't support yet Airflow 2.5 or 2.6. The work to do here is to enable a wider version range. If you want to use our APIs you should stick to 2.3.3 (the one we use in our image) or 2.4 (I think some community users tested that already) Thanks |
Oh, in this case I believe it would be awesome to add a compatibility matrix somewhere in the documentation since in some places where airflow is mentioned it says it's supported on oficial airflow releases (not necessarily for this library, but for the pipeline connector). |
… new ingestion base (#12398) * Bump Airflow version * Support Airflow 2.6 * Lint * Bump airflow version * Fix airflow 2.6 lineage * Fix airflow 2.6 lineage
Affected module
Ingestion
Describe the bug
WIth the change added here, the SchedulerJob class was renamed to SchedulerJobRunner. That change breaks the interaction between openmetadata and airflow in version 2.6 (haven't pinpointed the exact version)
To Reproduce
Fresh installation of airflow running tag 2.6.2 with the latest plugin version added will result in the following
Expected behavior
The plugin should reference the proper class or in it's effect limit the compatibility to the latest version in which the SchedulerJob class is available.
Version:
openmetadata-airflow-managed-apis 0.11.5.3
openmetadata-managed-apis 1.0.5.0
openmetadata-ingestion[docker]==XYZ
] openmetadata-ingestion 0.11.5.3Additional context
I'm using my own docker compose setup, so it's using a previously set version of airflow (2.6.2) instead of the baked in setup provided by openmetadata
The text was updated successfully, but these errors were encountered: