Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

frontend: use versatiledatakit/shared rc-builds for data-pipelines #2312

Merged
merged 1 commit into from
Jun 28, 2023

Conversation

DeltaMichael
Copy link
Contributor

@DeltaMichael DeltaMichael commented Jun 23, 2023

Why?

Linking shared-components to data-pipelines using npm fails to produce a working UI docker image. This is a CI-only issue.

What?

Introduce rc-versions for @versatiledatakit/shared
On a successful build of shared, and rc-version is pushed to npm registry
The data-pipelines build pulls the latest rc-version when running, instead of linking to the local installation of shared

Versioning schema follows semver

{major}.{minor}.{patch}-rc.{rc-number}

The rc-number is incremented based on the latest rc-number for the pipeline-id. This helps avoid conflicts between different pipelines running builds for shared

Regular shared versions are tagged with latest in npm registry
Rc versions are tagged with rc, so they don't get pulled accidentally when running npm install

How was this tested?

Ran a build in CI and tested that the docker image starts locally as part of quickstart-vdk by changing the deployment tag

https://gitlab.com/vmware-analytics/versatile-data-kit/-/pipelines/909682172

Docker image tag pushed by pipeline 5eb2c00
To check it locally, run quickstart-vdk and edit the deployment to use this tag.
Screenshot 2023-06-26 at 12 17 49

What kind of change is this?

Feature/non-breaking

@DeltaMichael DeltaMichael force-pushed the person/mdilyan/shared-not-linking-in-ci branch 3 times, most recently from 23d5733 to 870fc3f Compare June 23, 2023 14:20
@DeltaMichael DeltaMichael requested review from antoniivanov and murphp15 and removed request for gorankokin and hzhristova June 26, 2023 08:19
@antoniivanov
Copy link
Collaborator

locally as part of quickstart-vdk by changing the deployment tag

can you provide more details on the testing? Provide such details that I can replicate the manual test done from the description only.

@DeltaMichael
Copy link
Contributor Author

@tozka Added more details on how to test.

@DeltaMichael DeltaMichael force-pushed the person/mdilyan/shared-not-linking-in-ci branch from 870fc3f to 8f9bd8b Compare June 27, 2023 13:08
Copy link
Collaborator

@antoniivanov antoniivanov left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good to me. I left my comments but feel free to address them as you see fit. I see no blockers to merge it.

@DeltaMichael DeltaMichael force-pushed the person/mdilyan/shared-not-linking-in-ci branch from 8f9bd8b to 9e20679 Compare June 28, 2023 11:34
Why?

Linking shared-components to data-pipelines using npm fails to produce
a working UI docker image

What?

Introduce rc-versions for @versatiledatakit/shared
On a successful build of shared, and rc-version is pushed to npm registry
The data-pipelines build pulls the latest rc-version when running, instead of
linking to the local installation of shared

Versioning schema follows semver

<major>.<minor>.<patch>-rc.<rc-number>

The rc-number is incremented based on the latest rc-number for the pipeline-id.
This helps avoid conflicts between different pipelines running builds for shared

Regular shared versions are tagged with latest in npm registry
rc-versions are tagged with rc

How was this tested?

Ran a build in CI and tested that the docker image starts locally
as part of quickstart-vdk by changing the deployment tag

https://gitlab.com/vmware-analytics/versatile-data-kit/-/pipelines/909682172

What kind of change is this?

Feature/non-breaking

Signed-off-by: Dilyan Marinov <[email protected]>
@DeltaMichael DeltaMichael force-pushed the person/mdilyan/shared-not-linking-in-ci branch from 9e20679 to 7e83d74 Compare June 28, 2023 11:47
@DeltaMichael DeltaMichael merged commit c3fa77e into main Jun 28, 2023
@DeltaMichael DeltaMichael deleted the person/mdilyan/shared-not-linking-in-ci branch June 28, 2023 12:21
@DeltaMichael DeltaMichael linked an issue Jul 10, 2023 that may be closed by this pull request
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Run a subset of e2e tests on test environment UI
4 participants