LR-546 PII code implementation for data-products #38
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
AmiableAnil
reviewed
May 18, 2023
| @@ -144,7 +144,7 @@ druid.content.consumption.query="{\"query\":\"SELECT COUNT(*) as \\\"play_sessio | |||
|
|
|||
| // TPD Configurations | |||
| org.search.api.url="https://dev.sunbirded.org/api" | |||
AmiableAnil
approved these changes
May 21, 2023
|
SonarCloud Quality Gate failed. |
AmiableAnil
added a commit
that referenced
this pull request
Sep 21, 2023
* LR-436 | Old certificate migration data-product added (#36) * LR-436 | Old certificate migration data-product added * Issue #LR-546 merge: PII code implementation for data-products (#38) * LR-546 PII code implementation for data-products * LR-546 code changes for PII in reports * LR-546 code changes for PII in reports * LR-546 removed pom changes * LR-546 removed unnecessary test file changes * LR-546 removed duplicate code * LR-546 tested zip functionality * LR-546 removed token details from conf * LR-546 added test cases * LR-546 removed access-token from request * LR-546 removed unused methods from HttpUtil * LR-546 code changes against review points * LR-546 code changes against review points * LR-546 code changes against review points * LR-546 code changes against review points * LR-546 test-case fix * LR-546 test-case fix-1 * LR-546 test-case fix-2 * LR-546 code fixes for PII changes * LR-546 code fixes for PII changes-1 * LR-546 code fixes for PII changes-2 * LR-546 level codes changed * LR-546 removed level and orgid details from JobRequest * LR-546 removed level and orgid details from JobRequest-1 * LR-546 ignoring test-cases * LR-546 modified Encrypt util * LR-546 expection with tenant preferance endpoint configuration * LR-546 expection with tenant preferance endpoint configuration-1 * LR-546 expection with tenant preferance endpoint configuration-2 * LR-546 expection with tenant preferance endpoint configuration-3 * LR-546 dev env configuration changes for spark * LR-546 added logs * LR-546 added logs-1 * LR-546 added logs-2 * LR-546 added logs-3 * LR-546 added logs-4 * LR-546 added logs-5 * LR-546 added logs-6 * LR-546 added logs-7 * LR-546 added logs-8 * LR-546 L3 level eccryption throwing errors * LR-546 L3 level eccryption throwing errors-1 * LR-546 L3 level eccryption throwing errors-2 * LR-546 config changes * LR-546 commented test-cases * Delete BaseCollectionExhaustJob1.scala * LR-546 ignored test-cases * LR-546 ignored test-cases-1 * LR-546 ignored test-cases-2 * LR-546 ignored test-cases-2 * LR-546 ignored test-cases-3 * LR-546 ignored test-cases-4 * Issue #LR-546 merge: adding newline in the encrypted content (#41) * LR-546 PII code implementation for data-products * LR-546 code changes for PII in reports * LR-546 code changes for PII in reports * LR-546 removed pom changes * LR-546 removed unnecessary test file changes * LR-546 removed duplicate code * LR-546 tested zip functionality * LR-546 removed token details from conf * LR-546 added test cases * LR-546 removed access-token from request * LR-546 removed unused methods from HttpUtil * LR-546 code changes against review points * LR-546 code changes against review points * LR-546 code changes against review points * LR-546 code changes against review points * LR-546 test-case fix * LR-546 test-case fix-1 * LR-546 test-case fix-2 * LR-546 code fixes for PII changes * LR-546 code fixes for PII changes-1 * LR-546 code fixes for PII changes-2 * LR-546 level codes changed * LR-546 removed level and orgid details from JobRequest * LR-546 removed level and orgid details from JobRequest-1 * LR-546 ignoring test-cases * LR-546 modified Encrypt util * LR-546 expection with tenant preferance endpoint configuration * LR-546 expection with tenant preferance endpoint configuration-1 * LR-546 expection with tenant preferance endpoint configuration-2 * LR-546 expection with tenant preferance endpoint configuration-3 * LR-546 dev env configuration changes for spark * LR-546 added logs * LR-546 added logs-1 * LR-546 added logs-2 * LR-546 added logs-3 * LR-546 added logs-4 * LR-546 added logs-5 * LR-546 added logs-6 * LR-546 added logs-7 * LR-546 added logs-8 * LR-546 L3 level eccryption throwing errors * LR-546 L3 level eccryption throwing errors-1 * LR-546 L3 level eccryption throwing errors-2 * LR-546 config changes * LR-546 commented test-cases * Delete BaseCollectionExhaustJob1.scala * LR-546 ignored test-cases * LR-546 ignored test-cases-1 * LR-546 ignored test-cases-2 * LR-546 ignored test-cases-2 * LR-546 ignored test-cases-3 * LR-546 ignored test-cases-4 * LR-546 added new line between ecrypted text and file content * LR-546 L4 level changes (#44) * LR-546 PII code implementation for data-products * LR-546 code changes for PII in reports * LR-546 code changes for PII in reports * LR-546 removed pom changes * LR-546 removed unnecessary test file changes * LR-546 removed duplicate code * LR-546 tested zip functionality * LR-546 removed token details from conf * LR-546 added test cases * LR-546 removed access-token from request * LR-546 removed unused methods from HttpUtil * LR-546 code changes against review points * LR-546 code changes against review points * LR-546 code changes against review points * LR-546 code changes against review points * LR-546 test-case fix * LR-546 test-case fix-1 * LR-546 test-case fix-2 * LR-546 code fixes for PII changes * LR-546 code fixes for PII changes-1 * LR-546 code fixes for PII changes-2 * LR-546 level codes changed * LR-546 removed level and orgid details from JobRequest * LR-546 removed level and orgid details from JobRequest-1 * LR-546 ignoring test-cases * LR-546 modified Encrypt util * LR-546 expection with tenant preferance endpoint configuration * LR-546 expection with tenant preferance endpoint configuration-1 * LR-546 expection with tenant preferance endpoint configuration-2 * LR-546 expection with tenant preferance endpoint configuration-3 * LR-546 dev env configuration changes for spark * LR-546 added logs * LR-546 added logs-1 * LR-546 added logs-2 * LR-546 added logs-3 * LR-546 added logs-4 * LR-546 added logs-5 * LR-546 added logs-6 * LR-546 added logs-7 * LR-546 added logs-8 * LR-546 L3 level eccryption throwing errors * LR-546 L3 level eccryption throwing errors-1 * LR-546 L3 level eccryption throwing errors-2 * LR-546 config changes * LR-546 commented test-cases * Delete BaseCollectionExhaustJob1.scala * LR-546 ignored test-cases * LR-546 ignored test-cases-1 * LR-546 ignored test-cases-2 * LR-546 ignored test-cases-2 * LR-546 ignored test-cases-3 * LR-546 ignored test-cases-4 * LR-546 added new line between ecrypted text and file content * LR-546 L4 level changes * LR-546 L4 level changes-2 * LR-546 L3 level security code fixes (#45) * LR-546 L3 level changes * LR-546 L3 level fixing encrypted text to 32bytes (#46) * LR-546 L3 level fixing encrypted text to 32bytes * LR-546 zip generation in L1 (#47) * LR-546 PII code implementation for data-products * release-5.3.0 circle-ci issue (#51) * Issue #LR-453 merge: Data products readme added (#49) * Issue #LR-491 merge: ML Program UserInfoExhaust Data Product (#40) * Issue #LR-588 merge: checking PII fields with respect to security levels (#50) * fix for the consent provided column is showing as TRUE instead of Yes (#58) * ED-2087: Add OCI support for LernDataproducts (#52) (#63) Co-authored-by: Deepak Devadathan <[email protected]> * Issue #LR-627 merge: Cloud agnostic ansible changes added (#60) * Issue #LR-627 merge: Cloud agnostic code changes (#64) * Issue #LR-626 merge: artifact upload failure issue (#66) * Issue #LR-627 merge: Report verification config fixes added (#67) * Issue #LR-627 merge: cassandra consistency fixes (#68) * Issue #ED-2856 merge: Report upload fixes added (#70) --------- Co-authored-by: Hari-stackroute <[email protected]> Co-authored-by: Shakthieshwari <[email protected]> Co-authored-by: sumanvpacewisdom <[email protected]> Co-authored-by: Anil Gupta <[email protected]> Co-authored-by: Deepak Devadathan <[email protected]>
AmiableAnil
added a commit
that referenced
this pull request
Feb 15, 2024
* LR-436 | Old certificate migration data-product added (#36) * LR-436 | Old certificate migration data-product added * Issue #LR-546 merge: PII code implementation for data-products (#38) * LR-546 PII code implementation for data-products * LR-546 code changes for PII in reports * LR-546 code changes for PII in reports * LR-546 removed pom changes * LR-546 removed unnecessary test file changes * LR-546 removed duplicate code * LR-546 tested zip functionality * LR-546 removed token details from conf * LR-546 added test cases * LR-546 removed access-token from request * LR-546 removed unused methods from HttpUtil * LR-546 code changes against review points * LR-546 code changes against review points * LR-546 code changes against review points * LR-546 code changes against review points * LR-546 test-case fix * LR-546 test-case fix-1 * LR-546 test-case fix-2 * LR-546 code fixes for PII changes * LR-546 code fixes for PII changes-1 * LR-546 code fixes for PII changes-2 * LR-546 level codes changed * LR-546 removed level and orgid details from JobRequest * LR-546 removed level and orgid details from JobRequest-1 * LR-546 ignoring test-cases * LR-546 modified Encrypt util * LR-546 expection with tenant preferance endpoint configuration * LR-546 expection with tenant preferance endpoint configuration-1 * LR-546 expection with tenant preferance endpoint configuration-2 * LR-546 expection with tenant preferance endpoint configuration-3 * LR-546 dev env configuration changes for spark * LR-546 added logs * LR-546 added logs-1 * LR-546 added logs-2 * LR-546 added logs-3 * LR-546 added logs-4 * LR-546 added logs-5 * LR-546 added logs-6 * LR-546 added logs-7 * LR-546 added logs-8 * LR-546 L3 level eccryption throwing errors * LR-546 L3 level eccryption throwing errors-1 * LR-546 L3 level eccryption throwing errors-2 * LR-546 config changes * LR-546 commented test-cases * Delete BaseCollectionExhaustJob1.scala * LR-546 ignored test-cases * LR-546 ignored test-cases-1 * LR-546 ignored test-cases-2 * LR-546 ignored test-cases-2 * LR-546 ignored test-cases-3 * LR-546 ignored test-cases-4 * Issue #LR-546 merge: adding newline in the encrypted content (#41) * LR-546 PII code implementation for data-products * LR-546 code changes for PII in reports * LR-546 code changes for PII in reports * LR-546 removed pom changes * LR-546 removed unnecessary test file changes * LR-546 removed duplicate code * LR-546 tested zip functionality * LR-546 removed token details from conf * LR-546 added test cases * LR-546 removed access-token from request * LR-546 removed unused methods from HttpUtil * LR-546 code changes against review points * LR-546 code changes against review points * LR-546 code changes against review points * LR-546 code changes against review points * LR-546 test-case fix * LR-546 test-case fix-1 * LR-546 test-case fix-2 * LR-546 code fixes for PII changes * LR-546 code fixes for PII changes-1 * LR-546 code fixes for PII changes-2 * LR-546 level codes changed * LR-546 removed level and orgid details from JobRequest * LR-546 removed level and orgid details from JobRequest-1 * LR-546 ignoring test-cases * LR-546 modified Encrypt util * LR-546 expection with tenant preferance endpoint configuration * LR-546 expection with tenant preferance endpoint configuration-1 * LR-546 expection with tenant preferance endpoint configuration-2 * LR-546 expection with tenant preferance endpoint configuration-3 * LR-546 dev env configuration changes for spark * LR-546 added logs * LR-546 added logs-1 * LR-546 added logs-2 * LR-546 added logs-3 * LR-546 added logs-4 * LR-546 added logs-5 * LR-546 added logs-6 * LR-546 added logs-7 * LR-546 added logs-8 * LR-546 L3 level eccryption throwing errors * LR-546 L3 level eccryption throwing errors-1 * LR-546 L3 level eccryption throwing errors-2 * LR-546 config changes * LR-546 commented test-cases * Delete BaseCollectionExhaustJob1.scala * LR-546 ignored test-cases * LR-546 ignored test-cases-1 * LR-546 ignored test-cases-2 * LR-546 ignored test-cases-2 * LR-546 ignored test-cases-3 * LR-546 ignored test-cases-4 * LR-546 added new line between ecrypted text and file content * LR-546 L4 level changes (#44) * LR-546 PII code implementation for data-products * LR-546 code changes for PII in reports * LR-546 code changes for PII in reports * LR-546 removed pom changes * LR-546 removed unnecessary test file changes * LR-546 removed duplicate code * LR-546 tested zip functionality * LR-546 removed token details from conf * LR-546 added test cases * LR-546 removed access-token from request * LR-546 removed unused methods from HttpUtil * LR-546 code changes against review points * LR-546 code changes against review points * LR-546 code changes against review points * LR-546 code changes against review points * LR-546 test-case fix * LR-546 test-case fix-1 * LR-546 test-case fix-2 * LR-546 code fixes for PII changes * LR-546 code fixes for PII changes-1 * LR-546 code fixes for PII changes-2 * LR-546 level codes changed * LR-546 removed level and orgid details from JobRequest * LR-546 removed level and orgid details from JobRequest-1 * LR-546 ignoring test-cases * LR-546 modified Encrypt util * LR-546 expection with tenant preferance endpoint configuration * LR-546 expection with tenant preferance endpoint configuration-1 * LR-546 expection with tenant preferance endpoint configuration-2 * LR-546 expection with tenant preferance endpoint configuration-3 * LR-546 dev env configuration changes for spark * LR-546 added logs * LR-546 added logs-1 * LR-546 added logs-2 * LR-546 added logs-3 * LR-546 added logs-4 * LR-546 added logs-5 * LR-546 added logs-6 * LR-546 added logs-7 * LR-546 added logs-8 * LR-546 L3 level eccryption throwing errors * LR-546 L3 level eccryption throwing errors-1 * LR-546 L3 level eccryption throwing errors-2 * LR-546 config changes * LR-546 commented test-cases * Delete BaseCollectionExhaustJob1.scala * LR-546 ignored test-cases * LR-546 ignored test-cases-1 * LR-546 ignored test-cases-2 * LR-546 ignored test-cases-2 * LR-546 ignored test-cases-3 * LR-546 ignored test-cases-4 * LR-546 added new line between ecrypted text and file content * LR-546 L4 level changes * LR-546 L4 level changes-2 * LR-546 L3 level security code fixes (#45) * LR-546 L3 level changes * LR-546 L3 level fixing encrypted text to 32bytes (#46) * LR-546 L3 level fixing encrypted text to 32bytes * LR-546 zip generation in L1 (#47) * LR-546 PII code implementation for data-products * release-5.3.0 circle-ci issue (#51) * Issue #LR-453 merge: Data products readme added (#49) * Issue #LR-491 merge: ML Program UserInfoExhaust Data Product (#40) * Issue #LR-588 merge: checking PII fields with respect to security levels (#50) * fix for the consent provided column is showing as TRUE instead of Yes (#58) * ED-2087: Add OCI support for LernDataproducts (#52) (#63) Co-authored-by: Deepak Devadathan <[email protected]> * Issue #LR-627 merge: Cloud agnostic ansible changes added (#60) * Issue #LR-627 merge: Cloud agnostic code changes (#64) * Issue #LR-626 merge: artifact upload failure issue (#66) * Issue #LR-627 merge: Report verification config fixes added (#67) * Issue #LR-627 merge: cassandra consistency fixes (#68) * Issue #ED-2856 merge: Report upload fixes added (#70) * Issue $LR-627 merge: Ansible and config changes for Cloud agnostic (#73) * Issue #LR-627 merge: Ansible changes for Cloud agnostic (#74) * Release 5.3.1 uci changes (#85) * Release 5.3.1 uci changes (#87) * Issue #LR-676 chore: Updated the cloud_storage_endpoint regex (#92) * #000 | Unused Dependency removed * #000 | Unused Dependency removed (#94) * #0 | OCI ansible task fixes added * #0 | OCI ansible task fixes added --------- Co-authored-by: Hari-stackroute <[email protected]> Co-authored-by: Shakthieshwari <[email protected]> Co-authored-by: sumanvpacewisdom <[email protected]> Co-authored-by: Anil Gupta <[email protected]> Co-authored-by: Deepak Devadathan <[email protected]>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Please include a summary of the change and which issue is fixed. Please also include relevant motivation and context. List any dependencies that are required for this change.
Type of change
Please choose appropriate options.
How Has This Been Tested?
Please describe the tests that you ran to verify your changes in the below checkboxes. Provide instructions so we can reproduce. Please also list any relevant details for your test configuration
Test Configuration:
Checklist: