Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

macOS tests are crashing regularly #70233

Closed
jjonescz opened this issue Oct 4, 2023 · 4 comments
Closed

macOS tests are crashing regularly #70233

jjonescz opened this issue Oct 4, 2023 · 4 comments
Labels
Area-Infrastructure Bug Test Test failures in roslyn-CI untriaged Issues and PRs which have not yet been triaged by a lead

Comments

@jjonescz
Copy link
Member

jjonescz commented Oct 4, 2023

main rolling CI has failures in macOS tests: https://dev.azure.com/dnceng-public/public/_build?definitionId=95&_a=summary&branchFilter=319%2C319%2C319

It's not always the same test, but the output is usually similar to:

The active Test Run was aborted because the host process exited unexpectedly. Please inspect the call stack above, if available, to get more information about where the exception originated from.
The test running when the crash occurred: 
Microsoft.CodeAnalysis.UnitTests.EditorConfigTests.QuestionMatch

This test may, or may not be the source of the crash.

Unfortunately, the dump is not uploaded, so I don't know how to investigate this further:

- ⚠DumpFileToLarge: The dump /cores/dotnet_64534_1696393772_crashdump.dmp is 4647264760 bytes, which is larger than the supported 1610612736.0, so was not uploaded.
- ⚠DumpFileToLarge: The dump /cores/core.64534 is 7361921024 bytes, which is larger than the supported 1610612736.0, so was not uploaded.

cc @RikkiGibson

@jjonescz jjonescz added Bug Area-Infrastructure Test Test failures in roslyn-CI labels Oct 4, 2023
@dotnet-issue-labeler dotnet-issue-labeler bot added the untriaged Issues and PRs which have not yet been triaged by a lead label Oct 4, 2023
@RikkiGibson
Copy link
Contributor

Thanks for investigating here. The test really does not seem very complex/intensive so would find it surprising if it really were the source of the crash.

We'll want to talk to core-eng about how we can get dumps for these runs. There might be a max size variable we can adjust while we try to triage here. Also, I'm assuming that local runs of this will pass. I can try on my Mac later potentially.

@jaredpar
Copy link
Member

jaredpar commented Jan 2, 2024

@dibarbet we need to pull a Mac OS machine off of the internal queue to try and debug this. The only other option is trying to figure out the correct ulimit flags to get the dumps to be reasonable size. The discussions I saw on that didn't have any firm conclusions.

@jjonescz
Copy link
Member Author

jjonescz commented Jan 19, 2024

@jjonescz
Copy link
Member Author

jjonescz commented Jun 3, 2024

Looks like this stopped when we updated to .NET 9 in #73408.

@jjonescz jjonescz closed this as completed Jun 3, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Area-Infrastructure Bug Test Test failures in roslyn-CI untriaged Issues and PRs which have not yet been triaged by a lead
Projects
None yet
Development

No branches or pull requests

3 participants