iOS runtime tests should use just-run xharness command instead of run

[akoeplinger]

I recently noticed that we're using the xharness apple run command to run iOS runtime tests when building on Helix:

runtime/src/tests/build.proj

Line 392 in 3b61ad9

string output = lastLine.Replace("apple test", "apple run").Replace("--signal-app-end", $"--expected-exit-code=100 --set-env=MONO_APPLE_APP_ENTRY_POINT_LIB_NAME={value} --set-env=MONO_APPLE_APP_ASSEMBLY_LOAD_PREFIX={value.Split('/')[0]}") + "&& echo \"Test passed\" || { echo \"Test failed\"; exit 1; }";

This is different to how we're doing it locally and what is supposed to happen, i.e. using apple just-run:

runtime/src/tests/Common/CLRTest.Execute.Bash.targets

Line 477 in 3b61ad9

$__Command $HARNESS_RUNNER apple just-run %5c

---

The result is that we're installing the app over and over again for each run of a test assembly instead of just once at the beginning which takes a lot of time.

The expected workflow is

1. apple install
2. apple just-run for each test assembly
3. apple uninstall.

The install/uninstall part was handled by https://github.com/dotnet/runtime/blob/main/src/tests/Common/Coreclr.TestWrapper/MobileAppHandler.cs originally when using the runtime tests infrastructure.

Tagging subscribers to this area: @directhex
See info in area-owners.md if you want to be subscribed.

Issue Details

---

I recently noticed that we're using the xharness apple run command to run iOS runtime tests when building on Helix:

runtime/src/tests/build.proj

Line 392 in 3b61ad9

string output = lastLine.Replace("apple test", "apple run").Replace("--signal-app-end", $"--expected-exit-code=100 --set-env=MONO_APPLE_APP_ENTRY_POINT_LIB_NAME={value} --set-env=MONO_APPLE_APP_ASSEMBLY_LOAD_PREFIX={value.Split('/')[0]}") + "&& echo \"Test passed\" || { echo \"Test failed\"; exit 1; }";

This is different to how we're doing it locally and what is supposed to happen, i.e. using apple just-run:

runtime/src/tests/Common/CLRTest.Execute.Bash.targets

Line 477 in 3b61ad9

$__Command $HARNESS_RUNNER apple just-run %5c

---

The result is that we're installing the app over and over again for each run of a test assembly instead of just once at the beginning which takes a lot of time.

The expected workflow is 1) apple install 2) apple just-run for each test assembly 3) apple uninstall.

The install/uninstall part was handled by https://github.com/dotnet/runtime/blob/main/src/tests/Common/Coreclr.TestWrapper/MobileAppHandler.cs originally when using the runtime tests infrastructure.

Author:	akoeplinger
Assignees:	kotlarmilos
Labels:	area-Infrastructure-mono, os-ios
Milestone:	9.0.0

[kotlarmilos]

According to preliminary measurements, the tests execution with apple just-run is approx. 50% faster compared to apple run, including apple install/uninstall.