[🍒][PLUGIN-1837] Error management for Analytics plugin i.e. GroupByAggregate, Deduplicate, Distinct and Joiner

[psainics]

🍒 [cherrypick]

Commits :

• 11f1ecf

PR:

• [PLUGIN-1837] Error management for Analytics plugin i.e. GroupByAggregate, Deduplicate, Distinct and Joiner #1903 [ Reviewer @itsankit-google ]

---

Jira : PLUGIN-1837

Test [ Distinct Aggregator ]

• Test Case (Enter a field that does not exist in input schema)

Raw Logs

Caused by: io.cdap.cdap.api.exception.WrappedStageException: Stage 'Distinct' encountered : io.cdap.cdap.etl.api.validation.ValidationException: Errors were encountered during validation. Field age_fake does not exist in input schema.
  at io.cdap.cdap.etl.common.plugin.ExceptionWrappingCaller.call(ExceptionWrappingCaller.java:64)
  at io.cdap.cdap.etl.common.plugin.WrappedReduceAggregator.prepareRun(WrappedReduceAggregator.java:80)
  at io.cdap.cdap.etl.common.plugin.WrappedReduceAggregator.prepareRun(WrappedReduceAggregator.java:36)
  at io.cdap.cdap.etl.common.submit.SubmitterPlugin.lambda$prepareRun$2(SubmitterPlugin.java:74)
  at io.cdap.cdap.internal.app.runtime.AbstractContext.lambda$execute$5(AbstractContext.java:558)
  at io.cdap.cdap.data2.transaction.Transactions$CacheBasedTransactional.finishExecute(Transactions.java:234)
  ... 21 common frames omitted
Caused by: io.cdap.cdap.etl.api.validation.ValidationException: Errors were encountered during validation. Field age_fake does not exist in input schema.
  at io.cdap.cdap.etl.validation.DefaultFailureCollector.getOrThrowException(DefaultFailureCollector.java:78)
  at io.cdap.cdap.etl.validation.LoggingFailureCollector.getOrThrowException(LoggingFailureCollector.java:50)
  at io.cdap.plugin.batch.aggregator.DistinctAggregator.prepareRun(DistinctAggregator.java:114)
  at io.cdap.cdap.etl.common.plugin.WrappedReduceAggregator.lambda$prepareRun$3(WrappedReduceAggregator.java:81)
  at io.cdap.cdap.etl.common.plugin.Caller$1.call(Caller.java:30)
  at io.cdap.cdap.etl.common.plugin.ExceptionWrappingCaller.call(ExceptionWrappingCaller.java:62)
  ... 26 common frames omitted

POST v3/namespaces/{namespace-id}/apps/{app-id}/workflows/DataPipelineWorkflow/runs/{run-id}/classify

[
{
  "stageName": "Distinct",
  "errorCategory": "Plugin-'Validation'-'Distinct'",
  "errorReason": "Stage 'Distinct' encountered 1 validation failures.",
  "errorMessage": "Stage 'Distinct' encountered : io.cdap.cdap.etl.api.validation.ValidationException: Errors were encountered during validation. Field age_fake does not exist in input schema.",
  "errorType": "USER",
  "dependency": "false"
}
]