Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

control-service: introduce data job deployment entity #2613

Merged

Conversation

mivanov1988
Copy link
Collaborator

@mivanov1988 mivanov1988 commented Aug 28, 2023

Why

As part of the VEP-2272, we need to switch the source of truth from Kubernetes to the database.

What

Implemented a database table named "data_job_deployment," designated for the storage of all data associated with data job deployments.

Testing Done

Unit tests

Signed-off-by: Miroslav Ivanov [email protected]

@mivanov1988 mivanov1988 force-pushed the person/miroslavi/introduce-data-job-deployment-entity branch 2 times, most recently from e73f954 to 45b9ae4 Compare August 28, 2023 10:13
@mivanov1988 mivanov1988 enabled auto-merge (squash) August 28, 2023 11:09
@mivanov1988 mivanov1988 force-pushed the person/miroslavi/introduce-data-job-deployment-entity branch from 1a4f3a3 to 9d68860 Compare August 29, 2023 13:53
mivanov1988 and others added 2 commits August 29, 2023 16:53
Why
As part of the VEP-2272 we need to switch the source of truth from Kubernetes to the database.

What
Implemented a database table named "data_job_deployment," designated for the storage of all data associated with data job deployments.

Testing Done
Unit tests

Signed-off-by: Miroslav Ivanov [email protected]
@mivanov1988 mivanov1988 force-pushed the person/miroslavi/introduce-data-job-deployment-entity branch from 9cb6e8c to 0a811d9 Compare August 29, 2023 13:53
@mivanov1988 mivanov1988 merged commit 3909c0c into main Aug 30, 2023
@mivanov1988 mivanov1988 deleted the person/miroslavi/introduce-data-job-deployment-entity branch August 30, 2023 07:26
mrMoZ1 added a commit that referenced this pull request Sep 7, 2023
mrMoZ1 pushed a commit that referenced this pull request Sep 7, 2023
what:
Reverts #2613

why:
Adopting latest tpcs showed requests getting slow and taking a long time
to complete. Investigating against a locally running tpcs instance
hooked to a k8s cluster revealed the following results from executing
(multiple times) a query that retrieves all data jobs.:

HEAD is now at 3909c0c control-service: introduce data job deployment
entity (#2613) -> 1.6.986170982 -> **Query took more than a minute to
complete.**

Previous HEAD position was 3909c0c control-service: introduce data job
deployment entity (#2613)
HEAD is now at 98471d8 Update README.md -> 1.6.978504774 - > **Query
took ~ second to complete.**

Conclusion commit - > 3909c0c control-service: introduce data job
deployment entity makes requests slow.

testing:
Checked out the reverted branch from this commit and made the same
request. It now takes ~ second to complete.
N/a reverting so existing CI/CD should suffice.

---------

Signed-off-by: mrMoZ1 <[email protected]>
Co-authored-by: github-actions <>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants