Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

refactor: retry unit test step in build pipeline #710

Merged
merged 1 commit into from
Jan 12, 2025

Conversation

vbreuss
Copy link
Member

@vbreuss vbreuss commented Jan 12, 2025

Unit tests against the real file or time system sometimes fail. Therefore retry a failed unit test step once in the build pipeline.

@vbreuss vbreuss added the refactor A change or improvement without functional impact label Jan 12, 2025
@vbreuss vbreuss self-assigned this Jan 12, 2025
@vbreuss vbreuss force-pushed the topic/retry-unit-tests branch from 45166bd to ebb3de5 Compare January 12, 2025 10:56
@vbreuss vbreuss enabled auto-merge (squash) January 12, 2025 10:57
Copy link

github-actions bot commented Jan 12, 2025

👽 Mutation Results

Mutation testing badge

Testably.Abstractions.Testing

Details
File Score Killed Survived Timeout No Coverage Ignored Compile Errors Total Detected Total Undetected Total Mutants

The final mutation score is NaN%

Coverage Thresholds: high:80 low:60 break:0

Testably.Abstractions.AccessControl

Details
File Score Killed Survived Timeout No Coverage Ignored Compile Errors Total Detected Total Undetected Total Mutants

The final mutation score is NaN%

Coverage Thresholds: high:80 low:60 break:0

Testably.Abstractions.Compression

Details
File Score Killed Survived Timeout No Coverage Ignored Compile Errors Total Detected Total Undetected Total Mutants

The final mutation score is NaN%

Coverage Thresholds: high:80 low:60 break:0

Testably.Abstractions

Details
File Score Killed Survived Timeout No Coverage Ignored Compile Errors Total Detected Total Undetected Total Mutants

The final mutation score is NaN%

Coverage Thresholds: high:80 low:60 break:0

@vbreuss vbreuss merged commit c1b3a23 into main Jan 12, 2025
15 checks passed
@vbreuss vbreuss deleted the topic/retry-unit-tests branch January 12, 2025 11:26
Copy link

Test Results

     46 files  ±0       46 suites  ±0   21m 56s ⏱️ -7s
 55 195 tests +3   52 221 ✅ +3   2 974 💤 ±0  0 ❌ ±0 
114 806 runs  ±0  102 505 ✅ ±0  12 301 💤 ±0  0 ❌ ±0 

Results for commit ebb3de5. ± Comparison against base commit 3493a95.

This pull request removes 47539 and adds 47542 tests. Note that renamed tests count towards both.
Testably.Abstractions.AccessControl.Tests.DirectoryInfoAclExtensionsTests.MockFileSystemTests ‑ SetAccessControl_ShouldNotUpdateTimes(path: "path2d44a3b9-726f-4fc3-8618-8fbba6bad5b6")
Testably.Abstractions.AccessControl.Tests.DirectoryInfoAclExtensionsTests.MockFileSystemTests ‑ SetAccessControl_ShouldNotUpdateTimes(path: "path385c2898-0292-429b-acd3-f0b639fb4278")
Testably.Abstractions.AccessControl.Tests.DirectoryInfoAclExtensionsTests.MockFileSystemTests ‑ SetAccessControl_ShouldNotUpdateTimes(path: "path62183b48-152e-4b41-a940-475d5847a1c5")
Testably.Abstractions.AccessControl.Tests.DirectoryInfoAclExtensionsTests.MockFileSystemTests ‑ SetAccessControl_ShouldNotUpdateTimes(path: "path9b5b1bfc-a938-45c8-863e-9858d08706ea")
Testably.Abstractions.AccessControl.Tests.DirectoryInfoAclExtensionsTests.MockFileSystemTests ‑ SetAccessControl_ShouldNotUpdateTimes(path: "pathad842b94-bf76-472f-92da-036ba371f3a8")
Testably.Abstractions.AccessControl.Tests.DirectoryInfoAclExtensionsTests.MockFileSystemTests ‑ SetAccessControl_ShouldNotUpdateTimes(path: "pathae1d050c-6c9e-4d03-9b76-7c21e438c9c6")
Testably.Abstractions.AccessControl.Tests.DirectoryInfoAclExtensionsTests.MockFileSystemTests ‑ SetAccessControl_ShouldNotUpdateTimes(path: "pathaf9d9cdc-4e95-405d-aade-5593a9422986")
Testably.Abstractions.AccessControl.Tests.DirectoryInfoAclExtensionsTests.MockFileSystemTests ‑ SetAccessControl_ShouldNotUpdateTimes(path: "pathbadca43b-6fd0-4a80-b736-656595ab024f")
Testably.Abstractions.AccessControl.Tests.DirectoryInfoAclExtensionsTests.MockFileSystemTests ‑ SetAccessControl_ShouldNotUpdateTimes(path: "pathc1e0c745-b705-45ac-aaa9-dfc569c915b6")
Testably.Abstractions.AccessControl.Tests.DirectoryInfoAclExtensionsTests.RealFileSystemTests ‑ SetAccessControl_ShouldNotUpdateTimes(path: "path195bea96-6dd3-4286-90cf-a62eaf0918e0")
…
Testably.Abstractions.AccessControl.Tests.DirectoryInfoAclExtensionsTests.MockFileSystemTests ‑ SetAccessControl_ShouldNotUpdateTimes(path: "path2fde4d4f-9ec0-4c32-9d28-886be65707aa")
Testably.Abstractions.AccessControl.Tests.DirectoryInfoAclExtensionsTests.MockFileSystemTests ‑ SetAccessControl_ShouldNotUpdateTimes(path: "path2ff6437b-99db-4e60-befe-36732a51bcb7")
Testably.Abstractions.AccessControl.Tests.DirectoryInfoAclExtensionsTests.MockFileSystemTests ‑ SetAccessControl_ShouldNotUpdateTimes(path: "path3c3bb2f9-30e7-4b91-b7a9-cbd1375d4c05")
Testably.Abstractions.AccessControl.Tests.DirectoryInfoAclExtensionsTests.MockFileSystemTests ‑ SetAccessControl_ShouldNotUpdateTimes(path: "path3f6727a6-1d19-44cc-8895-fa7e8c377b88")
Testably.Abstractions.AccessControl.Tests.DirectoryInfoAclExtensionsTests.MockFileSystemTests ‑ SetAccessControl_ShouldNotUpdateTimes(path: "path424227fd-6e48-4258-94ef-d7412a9ed1ad")
Testably.Abstractions.AccessControl.Tests.DirectoryInfoAclExtensionsTests.MockFileSystemTests ‑ SetAccessControl_ShouldNotUpdateTimes(path: "path596d7c7c-dc9f-4d39-950d-4fedd8ce6209")
Testably.Abstractions.AccessControl.Tests.DirectoryInfoAclExtensionsTests.MockFileSystemTests ‑ SetAccessControl_ShouldNotUpdateTimes(path: "path8d76f366-b485-429d-8470-348ee28ed5b6")
Testably.Abstractions.AccessControl.Tests.DirectoryInfoAclExtensionsTests.MockFileSystemTests ‑ SetAccessControl_ShouldNotUpdateTimes(path: "patha1f482ca-3181-4a99-bd85-b2a034015bb1")
Testably.Abstractions.AccessControl.Tests.DirectoryInfoAclExtensionsTests.MockFileSystemTests ‑ SetAccessControl_ShouldNotUpdateTimes(path: "pathe927e372-e03e-41b3-b4f0-925b03d0ebc5")
Testably.Abstractions.AccessControl.Tests.DirectoryInfoAclExtensionsTests.RealFileSystemTests ‑ SetAccessControl_ShouldNotUpdateTimes(path: "path13178d7e-8d7a-4a40-9221-82816358abfa")
…
This pull request removes 2351 skipped tests and adds 2351 skipped tests. Note that renamed tests count towards both.
Testably.Abstractions.AccessControl.Tests.DirectoryInfoAclExtensionsTests.MockFileSystemTests ‑ SetAccessControl_ShouldNotUpdateTimes(path: "path2d44a3b9-726f-4fc3-8618-8fbba6bad5b6")
Testably.Abstractions.AccessControl.Tests.DirectoryInfoAclExtensionsTests.MockFileSystemTests ‑ SetAccessControl_ShouldNotUpdateTimes(path: "path385c2898-0292-429b-acd3-f0b639fb4278")
Testably.Abstractions.AccessControl.Tests.DirectoryInfoAclExtensionsTests.MockFileSystemTests ‑ SetAccessControl_ShouldNotUpdateTimes(path: "pathae1d050c-6c9e-4d03-9b76-7c21e438c9c6")
Testably.Abstractions.AccessControl.Tests.DirectoryInfoAclExtensionsTests.MockFileSystemTests ‑ SetAccessControl_ShouldNotUpdateTimes(path: "pathaf9d9cdc-4e95-405d-aade-5593a9422986")
Testably.Abstractions.AccessControl.Tests.DirectoryInfoAclExtensionsTests.MockFileSystemTests ‑ SetAccessControl_ShouldNotUpdateTimes(path: "pathbadca43b-6fd0-4a80-b736-656595ab024f")
Testably.Abstractions.AccessControl.Tests.DirectoryInfoAclExtensionsTests.MockFileSystemTests ‑ SetAccessControl_ShouldNotUpdateTimes(path: "pathc1e0c745-b705-45ac-aaa9-dfc569c915b6")
Testably.Abstractions.AccessControl.Tests.DirectoryInfoAclExtensionsTests.RealFileSystemTests ‑ SetAccessControl_ShouldNotUpdateTimes(path: "path195bea96-6dd3-4286-90cf-a62eaf0918e0")
Testably.Abstractions.AccessControl.Tests.DirectoryInfoAclExtensionsTests.RealFileSystemTests ‑ SetAccessControl_ShouldNotUpdateTimes(path: "path8a22e262-94b5-4e72-b397-23ed21e8173c")
Testably.Abstractions.AccessControl.Tests.DirectoryInfoAclExtensionsTests.RealFileSystemTests ‑ SetAccessControl_ShouldNotUpdateTimes(path: "path96f31020-9a63-463f-915c-dab01633fb2c")
Testably.Abstractions.AccessControl.Tests.DirectoryInfoAclExtensionsTests.RealFileSystemTests ‑ SetAccessControl_ShouldNotUpdateTimes(path: "path9881f28c-0c9e-4a13-bd85-cd35d175c678")
…
Testably.Abstractions.AccessControl.Tests.DirectoryInfoAclExtensionsTests.MockFileSystemTests ‑ SetAccessControl_ShouldNotUpdateTimes(path: "path2fde4d4f-9ec0-4c32-9d28-886be65707aa")
Testably.Abstractions.AccessControl.Tests.DirectoryInfoAclExtensionsTests.MockFileSystemTests ‑ SetAccessControl_ShouldNotUpdateTimes(path: "path2ff6437b-99db-4e60-befe-36732a51bcb7")
Testably.Abstractions.AccessControl.Tests.DirectoryInfoAclExtensionsTests.MockFileSystemTests ‑ SetAccessControl_ShouldNotUpdateTimes(path: "path3c3bb2f9-30e7-4b91-b7a9-cbd1375d4c05")
Testably.Abstractions.AccessControl.Tests.DirectoryInfoAclExtensionsTests.MockFileSystemTests ‑ SetAccessControl_ShouldNotUpdateTimes(path: "path424227fd-6e48-4258-94ef-d7412a9ed1ad")
Testably.Abstractions.AccessControl.Tests.DirectoryInfoAclExtensionsTests.MockFileSystemTests ‑ SetAccessControl_ShouldNotUpdateTimes(path: "path8d76f366-b485-429d-8470-348ee28ed5b6")
Testably.Abstractions.AccessControl.Tests.DirectoryInfoAclExtensionsTests.MockFileSystemTests ‑ SetAccessControl_ShouldNotUpdateTimes(path: "patha1f482ca-3181-4a99-bd85-b2a034015bb1")
Testably.Abstractions.AccessControl.Tests.DirectoryInfoAclExtensionsTests.RealFileSystemTests ‑ SetAccessControl_ShouldNotUpdateTimes(path: "path13178d7e-8d7a-4a40-9221-82816358abfa")
Testably.Abstractions.AccessControl.Tests.DirectoryInfoAclExtensionsTests.RealFileSystemTests ‑ SetAccessControl_ShouldNotUpdateTimes(path: "path3762c7db-2c71-4e65-b2ce-97a3ce827134")
Testably.Abstractions.AccessControl.Tests.DirectoryInfoAclExtensionsTests.RealFileSystemTests ‑ SetAccessControl_ShouldNotUpdateTimes(path: "path6e7b559d-a233-4479-8ea9-e6b88fb6af44")
Testably.Abstractions.AccessControl.Tests.DirectoryInfoAclExtensionsTests.RealFileSystemTests ‑ SetAccessControl_ShouldNotUpdateTimes(path: "pathb45ab712-b4ab-4ca9-934e-66c3203acaff")
…

Copy link

github-actions bot commented Feb 1, 2025

This is addressed in release v4.0.0.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
refactor A change or improvement without functional impact state: released
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant