Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[vdk-plugins] Update ingestion interfaces used in plugins #689

Merged
merged 1 commit into from
Feb 1, 2022

Conversation

doks5
Copy link
Contributor

@doks5 doks5 commented Feb 1, 2022

As part of #682, the
signature of the ingest_payload() method was updated to accept a metadata
object as part of the ingestion flow.

Once the interface change is adopted in vdk-core, this would cause data jobs to
fail, due to missing keyword argument "metadata".

This change updates the signatures of the ingest_payload() methods, implemented
in the vdk-plugins that provide ingestion capabilities. This is done in order to
avoid the abovementioned error.

Testing Done: Not required, as no plugins currently process the metadata.

Signed-off-by: Andon Andonov [email protected]

@doks5 doks5 force-pushed the person/andonova/update-ingest-interfaces branch from 8d3c17a to 190d6cc Compare February 1, 2022 15:02
@doks5
Copy link
Contributor Author

doks5 commented Feb 1, 2022

@ivakoleva
Good catch for the one in test-utils, thanks.

I am not sure about the second one, ingestion-file, though. It is already updated, is there something additional that needs to be done?

@ivakoleva
Copy link
Contributor

Copy link
Contributor

@ivakoleva ivakoleva left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

don't see anything else missing except test_run_ingest.py

@doks5 doks5 force-pushed the person/andonova/update-ingest-interfaces branch 2 times, most recently from e727650 to dc0222f Compare February 1, 2022 18:52
As part of #682, the
signature of the ingest_payload() method was updated to accept a metadata
object as part of the ingestion flow.

Once the interface change is adopted in vdk-core, this would cause data jobs to
fail, due to missing keyword argument "metadata".

This change updates the signatures of the ingest_payload() methods, implemented
in the vdk-plugins that provide ingestion capabilities. This is done in order to
avoid the abovementioned error.

Testing Done: Not required, as no plugins currently process the metadata.

Signed-off-by: Andon Andonov <[email protected]>
@doks5 doks5 force-pushed the person/andonova/update-ingest-interfaces branch from dc0222f to 4a5bc09 Compare February 1, 2022 18:54
@doks5 doks5 merged commit 29aa26b into main Feb 1, 2022
@doks5 doks5 deleted the person/andonova/update-ingest-interfaces branch February 1, 2022 19:12
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants