Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Install sentence-transformers via pip to avoid CPU-torch conda dependencies #1974

Merged
merged 11 commits into from
Oct 24, 2024
Merged

Install sentence-transformers via pip to avoid CPU-torch conda dependencies #1974

Show file tree
Hide file tree
Changes from 2 commits
Commits
Show all changes
11 commits
Select commit Hold shift + click to select a range
4fc5010
Use sentence-transformers pip install
efajardo-nv Oct 23, 2024
0578427
Merge branch 'branch-24.10' into use-sentence-transformers-pip
dagardner-nv Oct 24, 2024
5d6a578
Merge branch 'branch-24.10' of https://github.com/nv-morpheus/Morpheu…
efajardo-nv Oct 24, 2024
d374d52
Merge branch 'use-sentence-transformers-pip' of https://github.com/ef…
efajardo-nv Oct 24, 2024
16e1566
add note on why using pip install
efajardo-nv Oct 24, 2024
722a37b
Merge branch 'branch-24.10' of github.com:nv-morpheus/Morpheus into u…
dagardner-nv Oct 24, 2024
8d71366
rapids-dependency-file-generator is already installed in the base image
dagardner-nv Oct 24, 2024
8ee56e6
Update version of ci containers
dagardner-nv Oct 24, 2024
d45740c
No need to run rapids-dependency-file-generator for the all output
dagardner-nv Oct 24, 2024
5c1595e
Fix import of version module
dagardner-nv Oct 24, 2024
4527d22
Merge branch 'branch-24.10' into use-sentence-transformers-pip
dagardner-nv Oct 24, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion conda/environments/all_cuda-125_arch-x86_64.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -107,7 +107,6 @@ dependencies:
- s3fs
- scikit-build=0.17.6
- scikit-learn=1.3.2
- sentence-transformers=2.7
- sphinx
- sphinx_rtd_theme
- sqlalchemy<2.0
Expand Down Expand Up @@ -140,5 +139,6 @@ dependencies:
- nemollm==0.3.5
- pymilvus==2.3.6
- pytest-kafka==0.6.0
- sentence-transformers==2.7
- torch==2.4.0+cu124
name: all_cuda-125_arch-x86_64
2 changes: 1 addition & 1 deletion conda/environments/examples_cuda-125_arch-x86_64.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -55,7 +55,6 @@ dependencies:
- requests-toolbelt=1.0
- s3fs
- scikit-learn=1.3.2
- sentence-transformers=2.7
- sqlalchemy<2.0
- tqdm=4
- transformers=4.36.2
Expand All @@ -78,5 +77,6 @@ dependencies:
- milvus==2.3.5
- nemollm==0.3.5
- pymilvus==2.3.6
- sentence-transformers==2.7
- torch==2.4.0+cu124
name: examples_cuda-125_arch-x86_64
2 changes: 1 addition & 1 deletion dependencies.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -469,14 +469,14 @@ dependencies:
- *pypdfium2
- *python-docx
- requests-toolbelt=1.0 # Transitive dep needed by nemollm, specified here to ensure we get a compatible version
- sentence-transformers=2.7
- pip
- pip:
- langchain==0.1.16
- langchain-nvidia-ai-endpoints==0.0.11
- faiss-cpu
- google-search-results==2.4
- nemollm==0.3.5
- sentence-transformers==2.7

model-training-tuning:
common:
Expand Down
Loading