Feature/dhfprod 1715 mapping #1941
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
# Conflicts: # marklogic-data-hub/src/main/resources/ml-modules/root/data-hub/5/impl/config-lib.sjs
* Creating FlowRunner, Collector and listeners * Implement the new Collector * Pass "step" to ml:runFlow endpoint
Implemented:
createFlowRecord(flowId, options) -- currently unused, as I don't believe flow info is tracked, just the use of the flow.
createJobRecord(jobId, flowId, info)
createStepRecord(jobId, flowId, stepType, docURI, info) {
TODO:
* Wrap use of provenance API in eval() statement & point to JOBDATABASE
* Incorporate info.metadata property key/values into provenance data
* Create query function to search by document uri and return full history
* Tombstone prov function when a document is deleted (need to determine what this is)
…spots for right now
…r override purposes
… for process artifacts
…ess.sjs, adding default metadata timestamps to mlcp-flow-transforms, and adding a default 'dummy' main.sjs process to test flows with
Add RunLegacyFlowTask for 4.x flows Add access to FlowRunnerImpl in FlowManager
… of single run in the flow
* Get resource as stream to work in both jar file and via IDE * Add LoadHubArtifactsCommand to deploy default steps and flows * Adds capability to iterate over all dirs under flows and steps
…klogic/marklogic-data-hub into feature/DHFPROD-1715-Mapping
…ng to ingest with, tweaks to mlcp-flow-transform to handle it
…cast values according to datatype, todo: still handle arrays
…, arrays of values, and arrays of entities.
…ullOutput' is set (#1936)
…hat are for the legacy flow running to use runlegacy task instead
* Remove dummy flow file * Update hubDeployArtifact test to account for default flows as well
aebadirad
changed the title
aebadirad
requested review from
srinathgit,
akshaysonvane and
clockworked247
and removed request for
srinathgit and
clockworked247
srinathgit
approved these changes
Mar 1, 2019
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
No description provided.