Skip to content

Commit

Permalink
Change Paralell constraints generation to sequential (apache#46223)
Browse files Browse the repository at this point in the history
Parallel constraint generation runs several docker containers
and it produces some build artifacts in paralllel (when compiling spar)
that are huge - when run in parallell we are runnig out of disk
space for them. Changing to sequential execution hopefully shoudl
fix it.
  • Loading branch information
potiuk authored Jan 29, 2025
1 parent 085084b commit 004205a
Showing 1 changed file with 6 additions and 3 deletions.
9 changes: 6 additions & 3 deletions .github/workflows/generate-constraints.yml
Original file line number Diff line number Diff line change
Expand Up @@ -112,9 +112,11 @@ jobs:
env:
CHICKEN_EGG_PROVIDERS: ${{ inputs.chicken-egg-providers }}
run: >
breeze release-management generate-constraints --run-in-parallel
--airflow-constraints-mode constraints --answer yes
--chicken-egg-providers "${CHICKEN_EGG_PROVIDERS}" --parallelism 3
for PYTHON in $PYTHON_VERSIONS; do
breeze release-management generate-constraints
--airflow-constraints-mode constraints --answer yes
--chicken-egg-providers "${CHICKEN_EGG_PROVIDERS}"
done
- name: "Dependency upgrade summary"
shell: bash
env:
Expand All @@ -123,6 +125,7 @@ jobs:
for PYTHON_VERSION in $PYTHON_VERSIONS; do
echo "Summarizing Python $PYTHON_VERSION"
cat "files/constraints-${PYTHON_VERSION}"/*.md >> $GITHUB_STEP_SUMMARY || true
df -H
done
- name: "Upload constraint artifacts"
uses: actions/upload-artifact@v4
Expand Down

0 comments on commit 004205a

Please sign in to comment.