Use XHarnessAppBundleToTest to create helix work items when runtime tests run on iOSSimulator

[fanyang-mono]

2709 runtime tests were enabled to run with iOSSimulator x64.

[ghost]

I couldn't figure out the best area label to add to this PR. If you have write-permissions please help me learn by adding exactly one area label.

[fanyang-mono]

This PR can only be merged, after #58999 being merged. And an Arcade issue was exposed by the iOSSimulator run dotnet/arcade#7900, which I don't think is a blocker for this PR, however, @premun was a little worried and would like to fix it before merging this PR.

[fanyang-mono]

Currently, I am working on disabling failed tests and long running tests on iOSSimulator to get the lane green.

[fanyang-mono]

@trylek Some work items took too long to finish when running on iOS Simulator. Therefore, I further split them. So far, they are JIT.Regression, JIT.HardwareIntrinsics and JIT. I'd like to get your opinion on the corresponding change. :)

[trylek]

Splitting the test groups looks good to me but I would prefer someone more familiar with Mono to review the Mono-specific changes. Am I right to understand that commenting out parts of the YAML scripts is just instrumentation you're using to speed up your testing inner loop and will be reverted before merging in?

[fanyang-mono]

Splitting the test groups looks good to me but I would prefer someone more familiar with Mono to review the Mono-specific changes. Am I right to understand that commenting out parts of the YAML scripts is just instrumentation you're using to speed up your testing inner loop and will be reverted before merging in?

Thanks for reviewing. The mono-specific changes will be reviewed by Premek. He is very familiar with those change. Yes, the YAML scripts change will be reverted before merging.

[fanyang-mono]

Currently, runtime tests are failing randomly on iOS Simulator. And I can't see the failure logs without the fix to dotnet/arcade#7900. @premun just got it fixed this morning, and he will bump the arcade version for my PR tmr.

[fanyang-mono]

After fixing dotnet/arcade#7900, somehow the test logs were all gone. I created a new issue for @premun to investigate (dotnet/arcade#7943).

Yesterday, XHarness Telemetry was enabled in this PR, @premun got more insight data. He noticed that the app installation on some machines from yesterday's run could take more than 30 minutes. He is working on a work around for it (dotnet/arcade#7944). Once that's fixed, we should be able to see more stable run times. He's aiming at getting that change in either the end of this week or early next week.

[premun]

Can you also please bump XHarness and Arcade in your branch again?

The new Arcade will soon be in main but meanwhile you can call:

darc update-dependencies --source-repo=dotnet/arcade --channel ".NET Eng - Latest"

and

darc update-dependencies --source-repo=dotnet/xharness --channel ".NET Eng - Latest"

[premun]

@fanyang-mono can we merge main in this PR and test whether the logs are showing now?