Skip to content
This repository has been archived by the owner on Oct 11, 2024. It is now read-only.

Commit

Permalink
remove cruft
Browse files Browse the repository at this point in the history
  • Loading branch information
andy-neuma committed May 17, 2024
1 parent 8fec02b commit ba51fc6
Showing 1 changed file with 0 additions and 7 deletions.
7 changes: 0 additions & 7 deletions .github/workflows/build.yml
View file
Original file line number Diff line number Diff line change
Expand Up @@ -112,13 +112,6 @@ jobs:
testmo_token: ${{ secrets.TESTMO_TEST_TOKEN }}
source: 'build-test'

# skip this ... should no be handled by setup.py
# - name: rename for nightly
# uses: ./.github/actions/nm-rename-for-nightly-whl/
# if: contains(fromJSON('["NIGHTLY"]'), inputs.wf_category)
# with:
# package_name: "nm-vllm"

- name: build
id: build
uses: ./.github/actions/nm-build-vllm/
Expand Down

1 comment on commit ba51fc6

@github-actions
Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

bigger_is_better

Benchmark suite Current: ba51fc6 Previous: 59cf939 Ratio
{"name": "request_throughput", "description": "VLLM Engine throughput - synthetic\nmodel - NousResearch/Llama-2-7b-chat-hf\nmax_model_len - 4096\nbenchmark_throughput {\n \"use-all-available-gpus_\": \"\",\n \"input-len\": 256,\n \"output-len\": 128,\n \"num-prompts\": 1000\n}", "gpu_description": "NVIDIA A10G x 1", "vllm_version": "0.3.0", "python_version": "3.10.12 (main, May 10 2024, 13:42:25) [GCC 9.4.0]", "torch_version": "2.3.0+cu121"} 3.843029638935122 prompts/s 3.8356107992916173 prompts/s 1.00
{"name": "token_throughput", "description": "VLLM Engine throughput - synthetic\nmodel - NousResearch/Llama-2-7b-chat-hf\nmax_model_len - 4096\nbenchmark_throughput {\n \"use-all-available-gpus_\": \"\",\n \"input-len\": 256,\n \"output-len\": 128,\n \"num-prompts\": 1000\n}", "gpu_description": "NVIDIA A10G x 1", "vllm_version": "0.3.0", "python_version": "3.10.12 (main, May 10 2024, 13:42:25) [GCC 9.4.0]", "torch_version": "2.3.0+cu121"} 1475.723381351087 tokens/s 1472.874546927981 tokens/s 1.00

This comment was automatically generated by workflow using github-action-benchmark.

Please sign in to comment.