Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add Arm64 builds to CI #2093

Merged
merged 44 commits into from
Jan 16, 2025
Merged

Conversation

dagardner-nv
Copy link
Contributor

@dagardner-nv dagardner-nv commented Jan 2, 2025

Description

  • Add Arm64 build and test stages to CI
  • Refactor CI docker images as a multi-arch container
  • Add Arm64 Conda package output
  • Add Arm64 (aarch64) to dependencies.yaml matrix
  • Skip DOCA builds for arm ([BUG]: DOCA build failure on ARM #2092).
  • Skip tests for ARM conda builds, this avoids the need for an ARM GPU runner.
  • The following packages are x86_64 specific: include-what-you-use (later versions support ARM), vale, milvus and pymilvus.
  • The following packages have arm builds on pypi but not on conda-forge: pypdfium2, newspaper3k (package is no-arch but some deps are x86_64 only). For these we obtain them via pip on arm, but continue to install via conda for x86_64.
  • pytorch cuda builds exist for ARM but lack the same meta-data that the x86_64 builds do. For now the cpu version of torch is installed for ARM [BUG]: Arm64 users need to install CUDA enabled PyTorch by hand #2095

Related to nv-morpheus/utilities#90
Requires nv-morpheus/MRC#524 to be merged first
Closes #2094

By Submitting this PR I confirm:

  • I am familiar with the Contributing Guidelines.
  • When the PR is ready for review, new or existing tests cover these changes.
  • When the PR is ready for review, the documentation is up to date with these changes.

@dagardner-nv dagardner-nv requested review from a team as code owners January 2, 2025 21:15
@dagardner-nv dagardner-nv marked this pull request as draft January 2, 2025 21:15
@dagardner-nv dagardner-nv self-assigned this Jan 2, 2025
@dagardner-nv dagardner-nv added non-breaking Non-breaking change improvement Improvement to existing functionality labels Jan 2, 2025
@dagardner-nv dagardner-nv added the conda-build Enables running the conda-build step on a PR label Jan 2, 2025
@dagardner-nv dagardner-nv marked this pull request as ready for review January 3, 2025 20:40
@dagardner-nv dagardner-nv marked this pull request as draft January 3, 2025 22:03
@dagardner-nv dagardner-nv marked this pull request as ready for review January 4, 2025 16:07
@dagardner-nv
Copy link
Contributor Author

/merge

@rapids-bot rapids-bot bot merged commit ac97e6d into nv-morpheus:branch-25.02 Jan 16, 2025
16 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
conda-build Enables running the conda-build step on a PR improvement Improvement to existing functionality non-breaking Non-breaking change
Projects
Status: Done
Development

Successfully merging this pull request may close these issues.

[FEA]: Add Arm64 builds to CI
2 participants