Add Support for vllm model deployment from UI #1531
Conversation
Signed-off-by: Tarun Kumar <[email protected]>
![github-advanced-security[bot]](https://avatars.githubusercontent.com/in/57789?s=60&v=4){kind=small}
...ts/400__ods_dashboard/420__model_serving/LLMs/422__model_serving_llm_other_runtimes_UI.robot
Fixed
Show fixed
Hide fixed
| ${test_namespace}= Set Variable ${TEST_NS} | ||
| ${isvc__name}= Set Variable e5-mistral-7b-gpu | ||
| ${model_name}= Set Variable e5-mistral-7b | ||
| ${requests}= Create Dictionary nvidia.com/gpu=1 |
Check notice
Code scanning / Robocop
{{ create_keyword }} can be replaced with VAR Note test
| ${isvc__name}= Set Variable e5-mistral-7b-gpu | ||
| ${model_name}= Set Variable e5-mistral-7b | ||
| ${requests}= Create Dictionary nvidia.com/gpu=1 | ||
| ${limits}= Create Dictionary nvidia.com/gpu=1 |
Check notice
Code scanning / Robocop
{{ create_keyword }} can be replaced with VAR Note test
| [Tags] Sanity Tier1 RHOAIENG-6344 Resources-GPU | ||
| ${test_namespace}= Set Variable ${TEST_NS} | ||
| ${isvc__name}= Set Variable gpt2-gpu | ||
| ${model_name}= Set Variable gpt2 |
Check notice
Code scanning / Robocop
Variable '{{ name }}' is assigned but not used Note test
...ts/400__ods_dashboard/420__model_serving/LLMs/422__model_serving_llm_other_runtimes_UI.robot
Fixed
Show fixed
Hide fixed
...ts/400__ods_dashboard/420__model_serving/LLMs/422__model_serving_llm_other_runtimes_UI.robot
Fixed
Show fixed
Hide fixed
| Container Hardware Resources Should Match Expected container_name=kserve-container | ||
| ... pod_label_selector=serving.kserve.io/inferenceservice=${isvc__name} | ||
| ... namespace=${test_namespace} exp_requests=${requests} exp_limits=${limits} | ||
| Query Model Multiple Times model_name=${isvc__name} isvc_name=${isvc__name} runtime=${VLLM_RUNTIME_NAME} protocol=http |
Check warning
Code scanning / Robocop
Line is too long ({{ line_length }}/{{ allowed_length }}) Warning test
Robot Results
|
tarukumar
added
new test
Signed-off-by: Tarun Kumar <[email protected]>
...ts/400__ods_dashboard/420__model_serving/LLMs/422__model_serving_llm_other_runtimes_UI.robot
Fixed
Show fixed
Hide fixed
Signed-off-by: Tarun Kumar <[email protected]>
|
No description provided.