Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Repurpose the bulk MVP functional tests as TTK optional helm tests (8pts left) #2966

Closed
34 of 35 tasks
chris-me-law opened this issue Oct 3, 2022 · 2 comments
Closed
34 of 35 tasks
Assignees
Labels
core-dev-squad oss-bulk Mojaloop bulk implementation and support oss-core This is an issue - story or epic related to a feature on a Mojaloop core service or related to it story

Comments

@chris-me-law
Copy link

chris-me-law commented Oct 3, 2022

Goal:

As a Mojaloop User
I want to ensure that the bulk MVP test collection is readily available to be run as deployment helm tests
so that be sure that my deployment has all the latest bulk functionality tested.

Acceptance Criteria

  • Verify that a new optional helm test is available to run on a deployment testing the bulk MVP functionality.
  • Verify that when the helm option for bulk SDK simulators is enabled that the helm test for on-boarding and functional tests are executed when the helm test is run
  • Verify that when the helm option for bulk SDK simulators is not enabled, that the newly added helm bulk test and on-boarding scripts are not run.

Complexity: <High|Medium|Low> > A short comment to remind the reason for the rating

Uncertainty: <High|Medium|Low> > A short comment to remind the reason for the rating


Tasks:

  • Environment Access
  • Create env file for TTK Tests
  • Redeploy TTK sims with updated rules file
  • Onboard Hub, Sims with TZS currency
  • Onboard few MSISDNs that are env vars for the parties error tests
  • Make the happy path work with the new env file
  • Make changes to the scripts according to the latest changes
  • Fix note field issue in quotes @kleyow
  • Fix note field issue in transfers @kleyow
  • Fix issues withNDC case @kleyow
  • Fix issue with timeout - parties @kleyow
  • Make one Parties error test case to run successfully in switch env
  • Make rest of Parties error test cases to run successfully in switch env
  • Make one Quotes error test case to run successfully in switch env
  • Make rest of Quotes error test cases to run successfully in switch env
  • Make one Transfers error test case to run successfully in switch env
  • Make rest of Transfers error test cases to run successfully in switch env
  • Run the regression on each fix [Inprogress]
  • Run tests with TZS currency for 100% pass
  • Redeploy the env with "ml-ttk-test-val-sdk-bulk.tests.enabled" and test "helm test [@vijayg10 ]
  • Verify that when the helm option for bulk SDK simulators is not enabled, that the newly added helm bulk test and on-boarding scripts are not run. [@vijayg10 ]
  • Enable CICD to run bulk TTK tests (This is removed as it is going to be a new story)

Done

  • Acceptance Criteria pass
  • Designs are up-to date
  • Unit Tests pass
  • Integration Tests pass
  • Code Style & Coverage meets standards
  • Changes made to config (default.json) are broadcast to team and follow-up tasks added to update helm charts and other deployment config.
  • TBD

Pull Requests:

Follow-up:

  • N/A

Dependencies:

  • N/A

Accountability:

  • Owner: TBC
  • QA/Review: TBC
@chris-me-law chris-me-law added story oss-core This is an issue - story or epic related to a feature on a Mojaloop core service or related to it oss-bulk Mojaloop bulk implementation and support labels Oct 3, 2022
@PaulGregoryBaker PaulGregoryBaker changed the title Repurpose the bulk MVP functional tests as TTK optional helm tests Repurpose the bulk MVP functional tests as TTK optional helm tests (2pts left) Oct 31, 2022
@elnyry-sam-k elnyry-sam-k changed the title Repurpose the bulk MVP functional tests as TTK optional helm tests (2pts left) Repurpose the bulk MVP functional tests as TTK optional helm tests (8pts left) Nov 9, 2022
@vijayg10 vijayg10 self-assigned this Nov 10, 2022
@vijayg10
Copy link

Deployed the mojaloop helm chart in an environment with bulk and sdk-bulk-tests enabled.
helm test command produced the following output

--------------------FINAL REPORT--------------------

Test Suite:SDK Bulk Tests
Environment:moja4.test.mojaloop.live
┌───────────────────────────────────────────────────┐
│                      SUMMARY                      │
├───────────────────┬───────────────────────────────┤
│ Total assertions  │ 195                           │
├───────────────────┼───────────────────────────────┤
│ Passed assertions │ 194                           │
├───────────────────┼───────────────────────────────┤
│ Failed assertions │ 1                             │
├───────────────────┼───────────────────────────────┤
│ Total requests    │ 33                            │
├───────────────────┼───────────────────────────────┤
│ Total test cases  │ 18                            │
├───────────────────┼───────────────────────────────┤
│ Passed percentage │ 99.49%                        │
├───────────────────┼───────────────────────────────┤
│ Started time      │ Fri, 11 Nov 2022 18:14:38 GMT │
├───────────────────┼───────────────────────────────┤
│ Completed time    │ Fri, 11 Nov 2022 18:17:19 GMT │
├───────────────────┼───────────────────────────────┤
│ Runtime duration  │ 161214 ms                     │
└───────────────────┴───────────────────────────────┘
TTK-Assertion-Report-multi-2022-11-11T18:17:19.915Z.html was generated
Terminate with exit code 1
npm notice 
npm notice New major version of npm available! 8.5.5 -> 9.1.1

@kleyow kleyow self-assigned this Nov 12, 2022
@mdebarros
Copy link
Member

Testing Toolkit Report
Test Result: PASSED
Test Suite: SDK Bulk Tests
Environment: moja4.test.mojaloop.live
Total assertions: 195
Passed assertions: 195
Failed assertions: 0
Total requests: 33
Total test cases: 18
Passed percentage: 100.00%
Started time: Mon, 14 Nov 2022 12:57:31 GMT
Completed time: Mon, 14 Nov 2022 12:59:41 GMT
Runtime duration: 129317 ms

View Report

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
core-dev-squad oss-bulk Mojaloop bulk implementation and support oss-core This is an issue - story or epic related to a feature on a Mojaloop core service or related to it story
Projects
None yet
Development

No branches or pull requests

7 participants