ED-2087: Add OCI support for LernDataproducts #52
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Signed-off-by: Deepak Devadathan <[email protected]>
Signed-off-by: Deepak Devadathan <[email protected]>
Signed-off-by: Deepak Devadathan <[email protected]>
…JAPACCOE-2811-release-5.0.1 Signed-off-by: Deepak Devadathan <[email protected]>
Signed-off-by: Deepak Devadathan <[email protected]>
merging Release 5.0.1 to master
Signed-off-by: Deepak Devadathan <[email protected]>
Signed-off-by: Deepak Devadathan <[email protected]>
Signed-off-by: Deepak Devadathan <[email protected]>
Signed-off-by: Deepak Devadathan <[email protected]>
Signed-off-by: Deepak Devadathan <[email protected]>
Signed-off-by: Deepak Devadathan <[email protected]>
Signed-off-by: Deepak Devadathan <[email protected]>
Signed-off-by: Deepak Devadathan <[email protected]>
added role oci-cloud-storage added instance principal env variable Signed-off-by: Deepak Devadathan <[email protected]>
Signed-off-by: Deepak Devadathan <[email protected]>
Signed-off-by: Deepak Devadathan <[email protected]>
Signed-off-by: Deepak Devadathan <[email protected]>
Signed-off-by: Deepak Devadathan <[email protected]>
Signed-off-by: Deepak Devadathan <[email protected]>
Signed-off-by: Deepak Devadathan <[email protected]>
Signed-off-by: Deepak Devadathan <[email protected]>
Signed-off-by: Deepak Devadathan <[email protected]>
Signed-off-by: Deepak Devadathan <[email protected]>
Signed-off-by: Deepak Devadathan <[email protected]>
Signed-off-by: Deepak Devadathan <[email protected]>
…ci-5.1.0-JAPACCOE-2811-release-5.0.1-s3n Signed-off-by: Deepak Devadathan <[email protected]>
…st-oci-5.1.0-JAPACCOE-2811-release-5.0.1-s3n Signed-off-by: Deepak Devadathan <[email protected]>
Signed-off-by: Deepak Devadathan <[email protected]>
|
I have created this PR combining PR The circle ci build has a dependency with analytics core and core-data-products. Analytics core is already merged with oci changes PR#155 Core-data products PR#172 is not yet merged. I dont see any circle ci failures in core-data-products and no open issue. Can we first merge that and then look into this PR |
AmiableAnil
reviewed
Jun 26, 2023
ansible/roles/lern-data-products-deploy/templates/common.conf.j2
Outdated
Show resolved
Hide resolved
AmiableAnil
reviewed
Jun 26, 2023
lern-data-products/src/main/scala/org/sunbird/core/exhaust/BaseReportsJob.scala
Outdated
Show resolved
Hide resolved
AmiableAnil
reviewed
Jun 26, 2023
lern-data-products/src/main/scala/org/sunbird/core/exhaust/OnDemandExhaustJob.scala
Outdated
Show resolved
Hide resolved
AmiableAnil
reviewed
Jun 26, 2023
lern-data-products/src/main/scala/org/sunbird/lms/job/report/BaseReportsJob.scala
Outdated
Show resolved
Hide resolved
Signed-off-by: Deepak Devadathan <[email protected]>
This was referenced Jun 26, 2023
Closed
Signed-off-by: Deepak Devadathan <[email protected]>
AmiableAnil
added a commit
that referenced
this pull request
Jul 31, 2023
Co-authored-by: Deepak Devadathan <[email protected]>
AmiableAnil
added a commit
that referenced
this pull request
Jul 31, 2023
Co-authored-by: Deepak Devadathan <[email protected]>
AmiableAnil
added a commit
that referenced
this pull request
Jul 31, 2023
Co-authored-by: Deepak Devadathan <[email protected]>
AmiableAnil
added a commit
that referenced
this pull request
Sep 21, 2023
* LR-436 | Old certificate migration data-product added (#36) * LR-436 | Old certificate migration data-product added * Issue #LR-546 merge: PII code implementation for data-products (#38) * LR-546 PII code implementation for data-products * LR-546 code changes for PII in reports * LR-546 code changes for PII in reports * LR-546 removed pom changes * LR-546 removed unnecessary test file changes * LR-546 removed duplicate code * LR-546 tested zip functionality * LR-546 removed token details from conf * LR-546 added test cases * LR-546 removed access-token from request * LR-546 removed unused methods from HttpUtil * LR-546 code changes against review points * LR-546 code changes against review points * LR-546 code changes against review points * LR-546 code changes against review points * LR-546 test-case fix * LR-546 test-case fix-1 * LR-546 test-case fix-2 * LR-546 code fixes for PII changes * LR-546 code fixes for PII changes-1 * LR-546 code fixes for PII changes-2 * LR-546 level codes changed * LR-546 removed level and orgid details from JobRequest * LR-546 removed level and orgid details from JobRequest-1 * LR-546 ignoring test-cases * LR-546 modified Encrypt util * LR-546 expection with tenant preferance endpoint configuration * LR-546 expection with tenant preferance endpoint configuration-1 * LR-546 expection with tenant preferance endpoint configuration-2 * LR-546 expection with tenant preferance endpoint configuration-3 * LR-546 dev env configuration changes for spark * LR-546 added logs * LR-546 added logs-1 * LR-546 added logs-2 * LR-546 added logs-3 * LR-546 added logs-4 * LR-546 added logs-5 * LR-546 added logs-6 * LR-546 added logs-7 * LR-546 added logs-8 * LR-546 L3 level eccryption throwing errors * LR-546 L3 level eccryption throwing errors-1 * LR-546 L3 level eccryption throwing errors-2 * LR-546 config changes * LR-546 commented test-cases * Delete BaseCollectionExhaustJob1.scala * LR-546 ignored test-cases * LR-546 ignored test-cases-1 * LR-546 ignored test-cases-2 * LR-546 ignored test-cases-2 * LR-546 ignored test-cases-3 * LR-546 ignored test-cases-4 * Issue #LR-546 merge: adding newline in the encrypted content (#41) * LR-546 PII code implementation for data-products * LR-546 code changes for PII in reports * LR-546 code changes for PII in reports * LR-546 removed pom changes * LR-546 removed unnecessary test file changes * LR-546 removed duplicate code * LR-546 tested zip functionality * LR-546 removed token details from conf * LR-546 added test cases * LR-546 removed access-token from request * LR-546 removed unused methods from HttpUtil * LR-546 code changes against review points * LR-546 code changes against review points * LR-546 code changes against review points * LR-546 code changes against review points * LR-546 test-case fix * LR-546 test-case fix-1 * LR-546 test-case fix-2 * LR-546 code fixes for PII changes * LR-546 code fixes for PII changes-1 * LR-546 code fixes for PII changes-2 * LR-546 level codes changed * LR-546 removed level and orgid details from JobRequest * LR-546 removed level and orgid details from JobRequest-1 * LR-546 ignoring test-cases * LR-546 modified Encrypt util * LR-546 expection with tenant preferance endpoint configuration * LR-546 expection with tenant preferance endpoint configuration-1 * LR-546 expection with tenant preferance endpoint configuration-2 * LR-546 expection with tenant preferance endpoint configuration-3 * LR-546 dev env configuration changes for spark * LR-546 added logs * LR-546 added logs-1 * LR-546 added logs-2 * LR-546 added logs-3 * LR-546 added logs-4 * LR-546 added logs-5 * LR-546 added logs-6 * LR-546 added logs-7 * LR-546 added logs-8 * LR-546 L3 level eccryption throwing errors * LR-546 L3 level eccryption throwing errors-1 * LR-546 L3 level eccryption throwing errors-2 * LR-546 config changes * LR-546 commented test-cases * Delete BaseCollectionExhaustJob1.scala * LR-546 ignored test-cases * LR-546 ignored test-cases-1 * LR-546 ignored test-cases-2 * LR-546 ignored test-cases-2 * LR-546 ignored test-cases-3 * LR-546 ignored test-cases-4 * LR-546 added new line between ecrypted text and file content * LR-546 L4 level changes (#44) * LR-546 PII code implementation for data-products * LR-546 code changes for PII in reports * LR-546 code changes for PII in reports * LR-546 removed pom changes * LR-546 removed unnecessary test file changes * LR-546 removed duplicate code * LR-546 tested zip functionality * LR-546 removed token details from conf * LR-546 added test cases * LR-546 removed access-token from request * LR-546 removed unused methods from HttpUtil * LR-546 code changes against review points * LR-546 code changes against review points * LR-546 code changes against review points * LR-546 code changes against review points * LR-546 test-case fix * LR-546 test-case fix-1 * LR-546 test-case fix-2 * LR-546 code fixes for PII changes * LR-546 code fixes for PII changes-1 * LR-546 code fixes for PII changes-2 * LR-546 level codes changed * LR-546 removed level and orgid details from JobRequest * LR-546 removed level and orgid details from JobRequest-1 * LR-546 ignoring test-cases * LR-546 modified Encrypt util * LR-546 expection with tenant preferance endpoint configuration * LR-546 expection with tenant preferance endpoint configuration-1 * LR-546 expection with tenant preferance endpoint configuration-2 * LR-546 expection with tenant preferance endpoint configuration-3 * LR-546 dev env configuration changes for spark * LR-546 added logs * LR-546 added logs-1 * LR-546 added logs-2 * LR-546 added logs-3 * LR-546 added logs-4 * LR-546 added logs-5 * LR-546 added logs-6 * LR-546 added logs-7 * LR-546 added logs-8 * LR-546 L3 level eccryption throwing errors * LR-546 L3 level eccryption throwing errors-1 * LR-546 L3 level eccryption throwing errors-2 * LR-546 config changes * LR-546 commented test-cases * Delete BaseCollectionExhaustJob1.scala * LR-546 ignored test-cases * LR-546 ignored test-cases-1 * LR-546 ignored test-cases-2 * LR-546 ignored test-cases-2 * LR-546 ignored test-cases-3 * LR-546 ignored test-cases-4 * LR-546 added new line between ecrypted text and file content * LR-546 L4 level changes * LR-546 L4 level changes-2 * LR-546 L3 level security code fixes (#45) * LR-546 L3 level changes * LR-546 L3 level fixing encrypted text to 32bytes (#46) * LR-546 L3 level fixing encrypted text to 32bytes * LR-546 zip generation in L1 (#47) * LR-546 PII code implementation for data-products * release-5.3.0 circle-ci issue (#51) * Issue #LR-453 merge: Data products readme added (#49) * Issue #LR-491 merge: ML Program UserInfoExhaust Data Product (#40) * Issue #LR-588 merge: checking PII fields with respect to security levels (#50) * fix for the consent provided column is showing as TRUE instead of Yes (#58) * ED-2087: Add OCI support for LernDataproducts (#52) (#63) Co-authored-by: Deepak Devadathan <[email protected]> * Issue #LR-627 merge: Cloud agnostic ansible changes added (#60) * Issue #LR-627 merge: Cloud agnostic code changes (#64) * Issue #LR-626 merge: artifact upload failure issue (#66) * Issue #LR-627 merge: Report verification config fixes added (#67) * Issue #LR-627 merge: cassandra consistency fixes (#68) * Issue #ED-2856 merge: Report upload fixes added (#70) --------- Co-authored-by: Hari-stackroute <[email protected]> Co-authored-by: Shakthieshwari <[email protected]> Co-authored-by: sumanvpacewisdom <[email protected]> Co-authored-by: Anil Gupta <[email protected]> Co-authored-by: Deepak Devadathan <[email protected]>
AmiableAnil
added a commit
that referenced
this pull request
Feb 15, 2024
* LR-436 | Old certificate migration data-product added (#36) * LR-436 | Old certificate migration data-product added * Issue #LR-546 merge: PII code implementation for data-products (#38) * LR-546 PII code implementation for data-products * LR-546 code changes for PII in reports * LR-546 code changes for PII in reports * LR-546 removed pom changes * LR-546 removed unnecessary test file changes * LR-546 removed duplicate code * LR-546 tested zip functionality * LR-546 removed token details from conf * LR-546 added test cases * LR-546 removed access-token from request * LR-546 removed unused methods from HttpUtil * LR-546 code changes against review points * LR-546 code changes against review points * LR-546 code changes against review points * LR-546 code changes against review points * LR-546 test-case fix * LR-546 test-case fix-1 * LR-546 test-case fix-2 * LR-546 code fixes for PII changes * LR-546 code fixes for PII changes-1 * LR-546 code fixes for PII changes-2 * LR-546 level codes changed * LR-546 removed level and orgid details from JobRequest * LR-546 removed level and orgid details from JobRequest-1 * LR-546 ignoring test-cases * LR-546 modified Encrypt util * LR-546 expection with tenant preferance endpoint configuration * LR-546 expection with tenant preferance endpoint configuration-1 * LR-546 expection with tenant preferance endpoint configuration-2 * LR-546 expection with tenant preferance endpoint configuration-3 * LR-546 dev env configuration changes for spark * LR-546 added logs * LR-546 added logs-1 * LR-546 added logs-2 * LR-546 added logs-3 * LR-546 added logs-4 * LR-546 added logs-5 * LR-546 added logs-6 * LR-546 added logs-7 * LR-546 added logs-8 * LR-546 L3 level eccryption throwing errors * LR-546 L3 level eccryption throwing errors-1 * LR-546 L3 level eccryption throwing errors-2 * LR-546 config changes * LR-546 commented test-cases * Delete BaseCollectionExhaustJob1.scala * LR-546 ignored test-cases * LR-546 ignored test-cases-1 * LR-546 ignored test-cases-2 * LR-546 ignored test-cases-2 * LR-546 ignored test-cases-3 * LR-546 ignored test-cases-4 * Issue #LR-546 merge: adding newline in the encrypted content (#41) * LR-546 PII code implementation for data-products * LR-546 code changes for PII in reports * LR-546 code changes for PII in reports * LR-546 removed pom changes * LR-546 removed unnecessary test file changes * LR-546 removed duplicate code * LR-546 tested zip functionality * LR-546 removed token details from conf * LR-546 added test cases * LR-546 removed access-token from request * LR-546 removed unused methods from HttpUtil * LR-546 code changes against review points * LR-546 code changes against review points * LR-546 code changes against review points * LR-546 code changes against review points * LR-546 test-case fix * LR-546 test-case fix-1 * LR-546 test-case fix-2 * LR-546 code fixes for PII changes * LR-546 code fixes for PII changes-1 * LR-546 code fixes for PII changes-2 * LR-546 level codes changed * LR-546 removed level and orgid details from JobRequest * LR-546 removed level and orgid details from JobRequest-1 * LR-546 ignoring test-cases * LR-546 modified Encrypt util * LR-546 expection with tenant preferance endpoint configuration * LR-546 expection with tenant preferance endpoint configuration-1 * LR-546 expection with tenant preferance endpoint configuration-2 * LR-546 expection with tenant preferance endpoint configuration-3 * LR-546 dev env configuration changes for spark * LR-546 added logs * LR-546 added logs-1 * LR-546 added logs-2 * LR-546 added logs-3 * LR-546 added logs-4 * LR-546 added logs-5 * LR-546 added logs-6 * LR-546 added logs-7 * LR-546 added logs-8 * LR-546 L3 level eccryption throwing errors * LR-546 L3 level eccryption throwing errors-1 * LR-546 L3 level eccryption throwing errors-2 * LR-546 config changes * LR-546 commented test-cases * Delete BaseCollectionExhaustJob1.scala * LR-546 ignored test-cases * LR-546 ignored test-cases-1 * LR-546 ignored test-cases-2 * LR-546 ignored test-cases-2 * LR-546 ignored test-cases-3 * LR-546 ignored test-cases-4 * LR-546 added new line between ecrypted text and file content * LR-546 L4 level changes (#44) * LR-546 PII code implementation for data-products * LR-546 code changes for PII in reports * LR-546 code changes for PII in reports * LR-546 removed pom changes * LR-546 removed unnecessary test file changes * LR-546 removed duplicate code * LR-546 tested zip functionality * LR-546 removed token details from conf * LR-546 added test cases * LR-546 removed access-token from request * LR-546 removed unused methods from HttpUtil * LR-546 code changes against review points * LR-546 code changes against review points * LR-546 code changes against review points * LR-546 code changes against review points * LR-546 test-case fix * LR-546 test-case fix-1 * LR-546 test-case fix-2 * LR-546 code fixes for PII changes * LR-546 code fixes for PII changes-1 * LR-546 code fixes for PII changes-2 * LR-546 level codes changed * LR-546 removed level and orgid details from JobRequest * LR-546 removed level and orgid details from JobRequest-1 * LR-546 ignoring test-cases * LR-546 modified Encrypt util * LR-546 expection with tenant preferance endpoint configuration * LR-546 expection with tenant preferance endpoint configuration-1 * LR-546 expection with tenant preferance endpoint configuration-2 * LR-546 expection with tenant preferance endpoint configuration-3 * LR-546 dev env configuration changes for spark * LR-546 added logs * LR-546 added logs-1 * LR-546 added logs-2 * LR-546 added logs-3 * LR-546 added logs-4 * LR-546 added logs-5 * LR-546 added logs-6 * LR-546 added logs-7 * LR-546 added logs-8 * LR-546 L3 level eccryption throwing errors * LR-546 L3 level eccryption throwing errors-1 * LR-546 L3 level eccryption throwing errors-2 * LR-546 config changes * LR-546 commented test-cases * Delete BaseCollectionExhaustJob1.scala * LR-546 ignored test-cases * LR-546 ignored test-cases-1 * LR-546 ignored test-cases-2 * LR-546 ignored test-cases-2 * LR-546 ignored test-cases-3 * LR-546 ignored test-cases-4 * LR-546 added new line between ecrypted text and file content * LR-546 L4 level changes * LR-546 L4 level changes-2 * LR-546 L3 level security code fixes (#45) * LR-546 L3 level changes * LR-546 L3 level fixing encrypted text to 32bytes (#46) * LR-546 L3 level fixing encrypted text to 32bytes * LR-546 zip generation in L1 (#47) * LR-546 PII code implementation for data-products * release-5.3.0 circle-ci issue (#51) * Issue #LR-453 merge: Data products readme added (#49) * Issue #LR-491 merge: ML Program UserInfoExhaust Data Product (#40) * Issue #LR-588 merge: checking PII fields with respect to security levels (#50) * fix for the consent provided column is showing as TRUE instead of Yes (#58) * ED-2087: Add OCI support for LernDataproducts (#52) (#63) Co-authored-by: Deepak Devadathan <[email protected]> * Issue #LR-627 merge: Cloud agnostic ansible changes added (#60) * Issue #LR-627 merge: Cloud agnostic code changes (#64) * Issue #LR-626 merge: artifact upload failure issue (#66) * Issue #LR-627 merge: Report verification config fixes added (#67) * Issue #LR-627 merge: cassandra consistency fixes (#68) * Issue #ED-2856 merge: Report upload fixes added (#70) * Issue $LR-627 merge: Ansible and config changes for Cloud agnostic (#73) * Issue #LR-627 merge: Ansible changes for Cloud agnostic (#74) * Release 5.3.1 uci changes (#85) * Release 5.3.1 uci changes (#87) * Issue #LR-676 chore: Updated the cloud_storage_endpoint regex (#92) * #000 | Unused Dependency removed * #000 | Unused Dependency removed (#94) * #0 | OCI ansible task fixes added * #0 | OCI ansible task fixes added --------- Co-authored-by: Hari-stackroute <[email protected]> Co-authored-by: Shakthieshwari <[email protected]> Co-authored-by: sumanvpacewisdom <[email protected]> Co-authored-by: Anil Gupta <[email protected]> Co-authored-by: Deepak Devadathan <[email protected]>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
This PR is raised after combining PR#42,26,43 into one PR.
Will check if the circleci test pass in this one