Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Expose tritonserver args in values.yaml #5582

Merged
merged 11 commits into from
Mar 4, 2024
Merged

Expose tritonserver args in values.yaml #5582

Show file tree
Hide file tree
Changes from 3 commits
Commits
Show all changes
11 commits
Select commit Hold shift + click to select a range
778dfcd
Allow to customise args for tritonserver through values.yanl instead …
okyspace Apr 2, 2023
99e0b8a
Change naming as requested by Triton reviewer.
okyspace Apr 6, 2023
88e4ca1
Merge branch 'triton-inference-server:main' into improve-k8sonprem-chart
okyspace Apr 6, 2023
9901d0c
Slight formatting as requested.
okyspace Jun 3, 2023
e24ac76
Merge branch 'triton-inference-server:main' into improve-k8sonprem-chart
okyspace Jun 3, 2023
1a008e5
Merge branch 'main' into improve-k8sonprem-chart
okyspace Nov 15, 2023
62f26f9
Merge branch 'main' into improve-k8sonprem-chart
okyspace Feb 17, 2024
45e7a82
Merge branch 'triton-inference-server:main' into improve-k8sonprem-chart
okyspace Feb 22, 2024
634ec00
Update deploy/k8s-onprem/templates/deployment.yaml
okyspace Feb 22, 2024
689c8c1
Update deploy/k8s-onprem/values.yaml
okyspace Feb 22, 2024
39e1b54
Merge branch 'main' into improve-k8sonprem-chart
okyspace Feb 24, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
6 changes: 5 additions & 1 deletion deploy/k8s-onprem/templates/deployment.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -69,7 +69,11 @@ spec:
limits:
nvidia.com/gpu: {{ .Values.image.numGpus }}

args: ["tritonserver", "--model-repository=/models"]
args:
okyspace marked this conversation as resolved.
Show resolved Hide resolved
- tritonserver
{{- range .Values.serverArgs }}
- {{.}}
okyspace marked this conversation as resolved.
Show resolved Hide resolved
{{- end }}

ports:
- containerPort: 8000
Expand Down
4 changes: 4 additions & 0 deletions deploy/k8s-onprem/values.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -35,6 +35,10 @@ image:
modelRepositoryPath: /srv/models
numGpus: 1

# add server args here e.g. --grpc-use-ssl, --grpc-server-certs, repository-poll-secs, etc
serverArgs:
okyspace marked this conversation as resolved.
Show resolved Hide resolved
- '--model-repository=/models'

traefik:
ports:
triton-http:
Expand Down