Skip to content

Commit

Permalink
Install pip deps from pyproject.toml not requirements.txt
Browse files Browse the repository at this point in the history
  • Loading branch information
nvonpentz committed Nov 12, 2024
1 parent b1af0a8 commit 0f54ac2
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion Dockerfile
Original file line number Diff line number Diff line change
Expand Up @@ -18,7 +18,7 @@ COPY . .

# Install additional Python dependencies
RUN --mount=type=cache,target=/root/.cache/pip \
python3 -m pip install -r requirements.txt
python3 -m pip install .[vllm]

# Override the VLLM entrypoint with the functionary server
ENTRYPOINT ["python3", "server_vllm.py", "--model", "meetkai/functionary-small-v3.2", "--host", "0.0.0.0", "--max-model-len", "8192"]
Expand Down

0 comments on commit 0f54ac2

Please sign in to comment.