Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Bug]: Wrong validation of Serving Runtimes in Creation time #1352

Closed
1 task done
lucferbux opened this issue Jun 9, 2023 · 0 comments · Fixed by #1354
Closed
1 task done

[Bug]: Wrong validation of Serving Runtimes in Creation time #1352

lucferbux opened this issue Jun 9, 2023 · 0 comments · Fixed by #1354
Assignees
Labels
feature/model-serving Model Serving Feature kind/bug Something isn't working priority/high Important issue that needs to be resolved asap. Releases should not have too many of these.
Milestone

Comments

@lucferbux
Copy link
Contributor

lucferbux commented Jun 9, 2023

Is there an existing issue for this?

  • I have searched the existing issues

Current Behavior

To check if an object in our template is a Serving Runtime we use this piece of code:

export const isServingRuntimeKind = (obj: K8sResourceCommon): obj is ServingRuntimeKind =>
  obj.kind === 'ServingRuntime' &&
  obj.spec?.builtInAdapter !== undefined &&
  obj.spec?.containers !== undefined &&
  obj.spec?.supportedModelFormats !== undefined;

But builtInAdapter is not a mandatory field, we should remove it from validation.

Expected Behavior

You can create a Serving Runtime without explicitly declaring builtInAdapter.

Steps To Reproduce

  1. Create a new Custom Serving Runtime with the spec bellow
  2. Try to create a model server
  3. See that it's failing
apiVersion: serving.kserve.io/v1alpha1
kind: ServingRuntime
metadata:
  annotations:
    name: ovms-no-builtin
    opendatahub.io/disable-gpu: "true"
    openshift.io/display-name: OpenVINO Model Server No builtinAdapter
  labels:
    opendatahub.io/dashboard: "true"
  name: ovms
spec:
  containers:
    - args:
        - --port=8001
        - --rest_port=8888
        - --config_path=/models/model_config_list.json
        - --file_system_poll_wait_seconds=0
        - --grpc_bind_address=127.0.0.1
        - --rest_bind_address=127.0.0.1
      image: quay.io/opendatahub/openvino_model_server@sha256:20dbfbaf53d1afbd47c612d953984238cb0e207972ed544a5ea662c2404f276d
      name: ovms
      resources:
        limits:
          cpu: "0"
          memory: 0Gi
        requests:
          cpu: "0"
          memory: 0Gi
  grpcDataEndpoint: port:8001
  grpcEndpoint: port:8085
  multiModel: true
  protocolVersions:
    - grpc-v1
  replicas: 1
  supportedModelFormats:
    - autoSelect: true
      name: openvino_ir
      version: opset1
    - autoSelect: true
      name: onnx
      version: "1"
    - autoSelect: true
      name: tensorflow
      version: "2"

Workaround (if any)

Add builtInAdapter in the spec

@lucferbux lucferbux added kind/bug Something isn't working untriaged Indicates the newly create issue has not been triaged yet labels Jun 9, 2023
@github-project-automation github-project-automation bot moved this to Needs prioritization in ODH Dashboard Planning Jun 9, 2023
@lucferbux lucferbux self-assigned this Jun 9, 2023
@lucferbux lucferbux added priority/high Important issue that needs to be resolved asap. Releases should not have too many of these. feature/model-serving Model Serving Feature and removed untriaged Indicates the newly create issue has not been triaged yet labels Jun 12, 2023
@lucferbux lucferbux moved this from Needs prioritization to In progress in ODH Dashboard Planning Jun 12, 2023
@lucferbux lucferbux added this to the Current Release milestone Jun 12, 2023
@github-project-automation github-project-automation bot moved this from In progress to Done in ODH Dashboard Planning Jun 21, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
feature/model-serving Model Serving Feature kind/bug Something isn't working priority/high Important issue that needs to be resolved asap. Releases should not have too many of these.
Projects
No open projects
Archived in project
Development

Successfully merging a pull request may close this issue.

1 participant