Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Testing - tern fix for analysis function refactor bugs #189

Open
wants to merge 3 commits into
base: main
Choose a base branch
from

Conversation

edelarua
Copy link
Contributor

@edelarua edelarua commented Mar 6, 2025

@edelarua edelarua added the sme label Mar 6, 2025
Copy link
Contributor

github-actions bot commented Mar 6, 2025

Unit Tests Summary

  1 files  111 suites   3m 16s ⏱️
245 tests 214 ✅  31 💤 0 ❌
479 runs  236 ✅ 243 💤 0 ❌

Results for commit 062247b.

♻️ This comment has been updated with latest results.

Copy link
Contributor

github-actions bot commented Mar 6, 2025

Unit Test Performance Difference

Test Suite $Status$ Time on main $±Time$ $±Tests$ $±Skipped$ $±Failures$ $±Errors$
pagination_table 💔 $12.21$ $+1.95$ $+9$ $-6$ $0$ $0$
table_aet03 💔 $1.58$ $+3.31$ $+4$ $-1$ $0$ $0$
table_aet04 💔 $6.41$ $+5.81$ $+14$ $-8$ $0$ $0$
table_lbt14 💚 $28.54$ $-1.24$ $0$ $-5$ $0$ $0$
table_pkct01 💔 $1.55$ $+1.76$ $+6$ $-2$ $0$ $0$
Additional test case details
Test Suite $Status$ Time on main $±Time$ Test Case
pagination_table 💔 $1.55$ $+2.12$ Pagination_works_for_page_types
table_aet03 💔 $1.58$ $+3.31$ AET03_variant_1_is_produced_correctly
table_pkct01 💔 $1.20$ $+1.54$ Specific_PKCT01_features_are_present

Results for commit 0012b89

♻️ This comment has been updated with latest results.

@edelarua
Copy link
Contributor Author

edelarua commented Mar 6, 2025

The snapshot update is not related to tern - it comes from the data.

I'm not sure when the data was changed, but the change to the LBT03 snapshot reflects the expected result as all CHG values are NA when AVISIT == "Baseline", so this change should be merged in.

pharmaverseadam::adlb |> 
  dplyr::filter(AVISIT == "Baseline") |> 
  dplyr::pull(CHG) |> 
  unique()
#> [1] NA

Created on 2025-03-06 with reprex v2.1.1

Comment on lines -10 to -13
n 86 84 82
Mean (SD) 17.57 (9.22) 19.20 (10.05) 17.96 (8.72)
Median 15.00 16.00 17.00
Min - Max 7.00 - 69.00 6.00 - 64.00 5.00 - 70.00
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I would like to follow up on this, joining thread

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@shajoezhu
Copy link
Contributor

The snapshot update is not related to tern - it comes from the data.

I'm not sure when the data was changed, but the change to the LBT03 snapshot reflects the expected result as all CHG values are NA when AVISIT == "Baseline", so this change should be merged in.

pharmaverseadam::adlb |> 
  dplyr::filter(AVISIT == "Baseline") |> 
  dplyr::pull(CHG) |> 
  unique()
#> [1] NA

Created on 2025-03-06 with reprex v2.1.1

this is really odd. lets follow up, @edelarua , I was wondeing when updating the snapshot, are you updating it locally on your machine?

@edelarua
Copy link
Contributor Author

edelarua commented Mar 7, 2025

The snapshot update is not related to tern - it comes from the data.
I'm not sure when the data was changed, but the change to the LBT03 snapshot reflects the expected result as all CHG values are NA when AVISIT == "Baseline", so this change should be merged in.

pharmaverseadam::adlb |> 
  dplyr::filter(AVISIT == "Baseline") |> 
  dplyr::pull(CHG) |> 
  unique()
#> [1] NA

Created on 2025-03-06 with reprex v2.1.1

this is really odd. lets follow up, @edelarua , I was wondeing when updating the snapshot, are you updating it locally on your machine?

Yes, it happens locally and in the integration tests. The updated results make sense since the change from baseline values at the baseline visit should be 0/NA, not what we had previously.

@shajoezhu
Copy link
Contributor

The snapshot update is not related to tern - it comes from the data.
I'm not sure when the data was changed, but the change to the LBT03 snapshot reflects the expected result as all CHG values are NA when AVISIT == "Baseline", so this change should be merged in.

pharmaverseadam::adlb |> 
  dplyr::filter(AVISIT == "Baseline") |> 
  dplyr::pull(CHG) |> 
  unique()
#> [1] NA

Created on 2025-03-06 with reprex v2.1.1

this is really odd. lets follow up, @edelarua , I was wondeing when updating the snapshot, are you updating it locally on your machine?

Yes, it happens locally and in the integration tests. The updated results make sense since the change from baseline values at the baseline visit should be 0/NA, not what we had previously.

I would like to check the computation in tern again, perhaps we caught a bug that was not found before. The data change happened for some time already, but we have been refactoring the computation.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants