Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fail zombie job attempts and add failure reason #8709

Merged
merged 2 commits into from
Dec 10, 2021

Conversation

lmossman
Copy link
Contributor

What

Cancelling zombie jobs causes headaches for users, as it charges credits for those jobs and does not naturally restart jobs.

How

Fail the current zombie job attempt instead of cancelling the job. Add a failure reason to indicate why the attempt was failed.

@lmossman lmossman temporarily deployed to more-secrets December 10, 2021 19:29 Inactive
@github-actions github-actions bot added area/platform issues related to the platform area/scheduler labels Dec 10, 2021
@lmossman lmossman temporarily deployed to more-secrets December 10, 2021 20:03 Inactive
@lmossman lmossman merged commit b6904c2 into master Dec 10, 2021
@lmossman lmossman deleted the lmossman/fail-zombie-jobs-with-reason branch December 10, 2021 21:34
jrhizor pushed a commit that referenced this pull request Dec 10, 2021
* fail zombie job attempts and add failure reason

* remove failure reason
jrhizor added a commit that referenced this pull request Dec 11, 2021
* upgrade gradle

* upgrade to Java 17 (and fix a few of the node versioning misses)

* oops

* try to run a different format version

* fix spotless by upgrading / reformatting some files

* fix ci settings

* upgrade mockito to avoid other errors

* undo bad format

* fix "incorrect" sql comments

* fmt

* add debug flag

* remove

* bump

* bump jooq to a version that has a java 17 dist

* fix

* remove logs

* oops

* revert jooq upgrade

* fix

* set up java for connector test

* fix yaml

* generate std source tests

* fail zombie job attempts and add failure reason (#8709)

* fail zombie job attempts and add failure reason

* remove failure reason

* bump gcp dependencies to pick up grpc update (#8713)

* Bump Airbyte version from 0.33.9-alpha to 0.33.10-alpha (#8714)

Co-authored-by: jrhizor <[email protected]>

* Change CDK "Caching" header to "nested streams & caching"

* Update fields in source-connectors specifications: file, freshdesk, github, google-directory, google-workspace-admin-reports, iterable (#8524)

Signed-off-by: Sergey Chvalyuk <[email protected]>

Co-authored-by: Serhii Chvaliuk <[email protected]>
Co-authored-by: Sherif A. Nada <[email protected]>

* move S3Config into destination-s3; update dependencies accordingly (#8562)

Co-authored-by: Lake Mossman <[email protected]>
Co-authored-by: jrhizor <[email protected]>
Co-authored-by: Sherif A. Nada <[email protected]>
Co-authored-by: Iryna Grankova <[email protected]>
Co-authored-by: Serhii Chvaliuk <[email protected]>
Co-authored-by: Edward Gao <[email protected]>
schlattk pushed a commit to schlattk/airbyte that referenced this pull request Jan 4, 2022
* fail zombie job attempts and add failure reason

* remove failure reason
schlattk pushed a commit to schlattk/airbyte that referenced this pull request Jan 4, 2022
* upgrade gradle

* upgrade to Java 17 (and fix a few of the node versioning misses)

* oops

* try to run a different format version

* fix spotless by upgrading / reformatting some files

* fix ci settings

* upgrade mockito to avoid other errors

* undo bad format

* fix "incorrect" sql comments

* fmt

* add debug flag

* remove

* bump

* bump jooq to a version that has a java 17 dist

* fix

* remove logs

* oops

* revert jooq upgrade

* fix

* set up java for connector test

* fix yaml

* generate std source tests

* fail zombie job attempts and add failure reason (airbytehq#8709)

* fail zombie job attempts and add failure reason

* remove failure reason

* bump gcp dependencies to pick up grpc update (airbytehq#8713)

* Bump Airbyte version from 0.33.9-alpha to 0.33.10-alpha (airbytehq#8714)

Co-authored-by: jrhizor <[email protected]>

* Change CDK "Caching" header to "nested streams & caching"

* Update fields in source-connectors specifications: file, freshdesk, github, google-directory, google-workspace-admin-reports, iterable (airbytehq#8524)

Signed-off-by: Sergey Chvalyuk <[email protected]>

Co-authored-by: Serhii Chvaliuk <[email protected]>
Co-authored-by: Sherif A. Nada <[email protected]>

* move S3Config into destination-s3; update dependencies accordingly (airbytehq#8562)

Co-authored-by: Lake Mossman <[email protected]>
Co-authored-by: jrhizor <[email protected]>
Co-authored-by: Sherif A. Nada <[email protected]>
Co-authored-by: Iryna Grankova <[email protected]>
Co-authored-by: Serhii Chvaliuk <[email protected]>
Co-authored-by: Edward Gao <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area/platform issues related to the platform area/scheduler
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants