Skip to content

Commit

Permalink
Limit Apache Beam's numpy used (apache#46286)
Browse files Browse the repository at this point in the history
Separating beam out reveald that the lower limit for numpy migh
lead to installation problems on newer package managers and python
versions (lack of distutils installed by default in Python 3.12 in
causes older versions of numpy to not build and uv / pip trying to
install it will fail.

This PR lower-binds numpy to mid-2023 version.
  • Loading branch information
potiuk authored Jan 30, 2025
1 parent 38b8f78 commit 63d3602
Show file tree
Hide file tree
Showing 4 changed files with 4 additions and 1 deletion.
1 change: 1 addition & 0 deletions generated/provider_dependencies.json
Original file line number Diff line number Diff line change
Expand Up @@ -76,6 +76,7 @@
"deps": [
"apache-airflow>=2.9.0",
"apache-beam>=2.53.0",
"numpy>=1.26.0",
"pyarrow>=14.0.1"
],
"devel-deps": [],
Expand Down
1 change: 1 addition & 0 deletions providers/apache/beam/README.rst
Original file line number Diff line number Diff line change
Expand Up @@ -57,6 +57,7 @@ PIP package Version required
``apache-airflow`` ``>=2.9.0``
``apache-beam`` ``>=2.53.0``
``pyarrow`` ``>=14.0.1``
``numpy`` ``>=1.26.0``
================== ==================

Cross provider package dependencies
Expand Down
1 change: 1 addition & 0 deletions providers/apache/beam/pyproject.toml
Original file line number Diff line number Diff line change
Expand Up @@ -59,6 +59,7 @@ dependencies = [
# Apache Beam > 2.53.0 and pyarrow > 14.0.1 fix https://nvd.nist.gov/vuln/detail/CVE-2023-47248.
"apache-beam>=2.53.0",
"pyarrow>=14.0.1",
"numpy>=1.26.0",
]

# The optional dependencies should be modified in place in the generated file
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -93,7 +93,7 @@ def get_provider_info():
"python-modules": ["airflow.providers.apache.beam.triggers.beam"],
}
],
"dependencies": ["apache-airflow>=2.9.0", "apache-beam>=2.53.0", "pyarrow>=14.0.1"],
"dependencies": ["apache-airflow>=2.9.0", "apache-beam>=2.53.0", "pyarrow>=14.0.1", "numpy>=1.26.0"],
"optional-dependencies": {
"google": ["apache-beam[gcp]"],
"common.compat": ["apache-airflow-providers-common-compat"],
Expand Down

0 comments on commit 63d3602

Please sign in to comment.