-
Notifications
You must be signed in to change notification settings - Fork 14.8k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
AIP-72: Implement short circuit and branch operators #46584
Conversation
16a1714
to
caf0c04
Compare
providers/standard/src/airflow/providers/standard/operators/python.py
Outdated
Show resolved
Hide resolved
providers/common/compat/src/airflow/providers/common/compat/standard/short_circuit.py
Outdated
Show resolved
Hide resolved
caf0c04
to
34a0644
Compare
00492b1
to
6edd2ef
Compare
239670d
to
b527298
Compare
7fc5e04
to
fc4f8a4
Compare
providers/standard/src/airflow/providers/standard/utils/skipmixin.py
Outdated
Show resolved
Hide resolved
providers/standard/src/airflow/providers/standard/utils/skipmixin.py
Outdated
Show resolved
Hide resolved
b3bf065
to
8930f86
Compare
Known Issue: Branching in Mapped Task Groups does not work. So the issue mentioned in #30883 is back. We will handle that in a separate PR. |
dc487b6
to
5247781
Compare
Added one more known issue to the PR description and added some screenshots |
e74f4c9
to
67dac0b
Compare
We should be finally good to go on this!! Waiting for the CI 🤞 |
closes: apache#45823 related: apache#44912 Co-Authored-By: Kaxil Naik <[email protected]>
67dac0b
to
f6f5805
Compare
CI passed: https://github.com/apache/airflow/actions/runs/13866617491/job/38807327529?pr=46584 The static checks with providers was fixed in the last commit |
@shahar1 and I will fix any teething issues if something fails -- but we wanted to get it in since it is already too big and has been out for a while. |
These comments have been resolved in the original PR apache#46584 .
These comments have been resolved in the original PR #46584 .
closes: apache#45823 related: apache#44912 Co-Authored-By: Kaxil Naik <[email protected]> --------- Co-authored-by: Kaxil Naik <[email protected]>
These comments have been resolved in the original PR apache#46584 .
closes: #45823
related: #44912
Update: issue #43883 (Short Circuit for mapped operators) will be closed in a separate PR.
TODOS:
ShortCircuitOperator
(including decorators)BaseBranchOperator
,BranchPythonOperator
BranchSQLOperator
Verified by running some of the example DAGs:
Known Issues:
BranchExternalPythonOperator
with Task SDK #47854^ Add meaningful description above
Read the Pull Request Guidelines for more information.
In case of fundamental code changes, an Airflow Improvement Proposal (AIP) is needed.
In case of a new dependency, check compliance with the ASF 3rd Party License Policy.
In case of backwards incompatible changes please leave a note in a newsfragment file, named
{pr_number}.significant.rst
or{issue_number}.significant.rst
, in newsfragments.