Error in CI `Mono llvmfullaot Pri0 Runtime Tests Run Linux arm64 release`

[BruceForstall]

in LLVM AOT cross-compile CoreCLR tests

Error message:
##[error]Exit code 137 returned from process: file name '/usr/bin/docker', arguments 'exec -i -u 1000 -w /home/cloudtest_azpcontainer 12e65458950cdcacb35a892c9bd140157953823f62a984dfc4c13e1632863c42 /__a/externals/node/bin/node /__w/_temp/containerHandlerInvoker.js'.

https://dev.azure.com/dnceng/public/_build/results?buildId=1411090&view=logs&j=b40c4ee0-d59d-50cb-cee3-6c499edc769b&t=24038e5f-e5d5-5f4a-9cc0-31eac914e6d6

Is this a real error or infrastructure/random? Is it known? What is the actual problem?

@dotnet/runtime-infrastructure

Runfo Tracking Issue: LLVM AOT build gets killed under docker

Definition	Build	Kind	Job Name
runtime	1569424	PR 63800	Mono llvmfullaot Pri0 Runtime Tests Run Linux arm64 release
runtime	1553349	PR 63800	Mono llvmfullaot Pri0 Runtime Tests Run Linux arm64 release
runtime	1551116	PR 63689	Mono llvmfullaot Pri0 Runtime Tests Run Linux arm64 release

Build Result Summary

Day Hit Count	Week Hit Count	Month Hit Count
1	1	3

Tagging subscribers to this area: @directhex
See info in area-owners.md if you want to be subscribed.

Issue Details

---

in LLVM AOT cross-compile CoreCLR tests

Error message:
##[error]Exit code 137 returned from process: file name '/usr/bin/docker', arguments 'exec -i -u 1000 -w /home/cloudtest_azpcontainer 12e65458950cdcacb35a892c9bd140157953823f62a984dfc4c13e1632863c42 /__a/externals/node/bin/node /__w/_temp/containerHandlerInvoker.js'.

https://dev.azure.com/dnceng/public/_build/results?buildId=1411090&view=logs&j=b40c4ee0-d59d-50cb-cee3-6c499edc769b&t=24038e5f-e5d5-5f4a-9cc0-31eac914e6d6

Is this a real error or infrastructure/random? Is it known? What is the actual problem?

@dotnet/runtime-infrastructure

Author:	BruceForstall
Assignees:	-
Labels:	area-Infrastructure-mono
Milestone:	-

[BruceForstall]

Failure from this PR: #60192

[agocke]

This is failing almost every runtime build @directhex @steveisok

[steveisok]

I've seen this pop up w/ wasm runs. Most likely some kind of OOM. We should take the leg down until we come up with a fix/workaround.

[lambdageek]

The last 3 (as of right now) (and some randomly clicked older) runs from the runfo list all fail when AOTing Microsoft.Diagnostics.Tracing.TraceEvent.dll

aot-compile: compiling /__w/2/s/artifacts/tests/coreclr/Linux.arm64.Release/Tests/Core_Root/Microsoft.Diagnostics.Tracing.TraceEvent.dll; MONO_PATH: /__w/2/s/artifacts/tests/coreclr/Linux.arm64.Release/Tests/Core_Root:/__w/2/s/artifacts/tests/coreclr/Linux.arm64.Release/Tests/Core_Root

Is that one unexpectedly large?

[hoyosjs]

cc: @josalem for AOT of TraceEvent