Skip to content

how can I run runtime tests with monovm on ios? #85160

Closed
Closed
how can I run runtime tests with monovm on ios?#85160
Assignees
kotlarmilos
Labels
area-Infrastructure-monoos-iosApple iOS
Milestone
8.0.0

Description

@srxqds
srxqds
opened on Apr 21, 2023
No description provided.

Activity

  1. ghost added
    area-Infrastructure-mono
    on Apr 21, 2023
  2. ghost added
    untriagedNew issue has not been triaged by the area owner
    on Apr 21, 2023

  4. steveisok commented on Apr 21, 2023

    @steveisok
    steveisok
    on Apr 21, 2023
    Member

    /cc @SamMonoRT

  5. steveisok
    added
    os-iosApple iOS
    on Apr 21, 2023
  7. SamMonoRT
    assigned
    kotlarmilos
    on Apr 24, 2023
  8. SamMonoRT
    removed
    untriagedNew issue has not been triaged by the area owner
    on Apr 24, 2023
  9. SamMonoRT
    added this to the 8.0.0 milestone on Apr 24, 2023

  10. SamMonoRT commented on Apr 24, 2023

    @SamMonoRT
    SamMonoRT
    on Apr 24, 2023
    Member

    @srxqds - please follow instructions in https://github.com/dotnet/runtime/blob/main/docs/workflow/README.md and let us know if you have any questions.
    @kotlarmilos - if there are limitation based on feedback, please update the documentation as needed

  11. JamboWu2 commented on Apr 25, 2023

    @JamboWu2
    JamboWu2
    on Apr 25, 2023

    The instruction what I follow is https://github.com/dotnet/runtime/blob/main/docs/workflow/testing/mono/testing.md
    but the instruction do not have any information about iOS device or iOSSimulation testing, just have Android testing

    I try to build the runtime tests for iOSSimulation use command in src/tests

    ./build.sh -mono os iOSSimulation arm64 release

    It will pass but the test will crash while running

    build the runtime tests for iOS device use command

    ./build.sh -mono os iOS arm64 release

    It will throw many exceptions: Need list of AOT files for device builds.

  12. kotlarmilos commented on Apr 26, 2023

    @kotlarmilos
    kotlarmilos
    on Apr 26, 2023
    Member

    The instruction what I follow is https://github.com/dotnet/runtime/blob/main/docs/workflow/testing/mono/testing.md but the instruction do not have any information about iOS device or iOSSimulation testing, just have Android testing

    Check out the following instructions https://github.com/dotnet/runtime/blob/main/docs/workflow/testing/libraries/testing-apple.md. They are for the library tests, but could be useful.

    I try to build the runtime tests for iOSSimulation use command in src/tests

    ./build.sh -mono os iOSSimulation arm64 release

    First, run the following command from the root directory to build the runtime:

    ./build.sh -arch arm64 -os ios -s mono+libs -c Release

    Second, run the following command from src/tests to AOT the runtime tests:

    ./build.sh os ios arm64 Release -mono tree tracing/eventpipe /p:LibrariesConfiguration=Release

    Please note that a subset of runtime tests is supported currently. We will introduce more tests in the future.

    It will pass but the test will crash while running

    build the runtime tests for iOS device use command

    ./build.sh -mono os iOS arm64 release

    It will throw many exceptions: Need list of AOT files for device builds.

    Such error is usually happening when AOT compilation was disabled and AppleAppBuilderTask didn't get any AOT-ed assemblies. If you are running a HelloiOS sample app, make sure to set ForceAOT parameter to TRUE. Additionally, if you have an example, feel free to provide it here, so we can help you with the compilation and identify what is missing in the build process.

  13. JamboWu2 commented on Apr 27, 2023

    @JamboWu2
    JamboWu2
    on Apr 27, 2023

    ./build.sh -mono os iOS arm64 release /p:DevTeamProvisioning=ZF3Z3HS5W2 /p:ForceAOT=True /p:LibrariesConfiguration=Release

    The problam still exists
    Need list of AOT files for device builds.

  14. kotlarmilos commented on Apr 27, 2023

    @kotlarmilos
    kotlarmilos
    on Apr 27, 2023
    Member

    Can you share the error logs?

    Parameter /p:ForceAOT=True is only required while running a HelloiOS sample app. If you want to run runtime tests, it is not necessary.

  15. JamboWu2 commented on Apr 27, 2023

    @JamboWu2
    JamboWu2
    on Apr 27, 2023

    There is a error:

    xcrun simctl install 15ED0483-DDCB-4C06-B4E8-5230AB119F52 ./artifacts/tests/coreclr/iOSSimulator.arm64.Release/JIT/Math/JIT_Math.app
    xcrun simctl launch --console booted net.dot.JIT_Math===========Apple builder build:==bindir:================/Users/game-netease/dotnet/runtime/artifacts/tests/coreclr/obj/iOS.arm64.Release/Managed/./build/iOSApps/Interop_ICustomMarshaler/bin-Interop_ICustomMarshaler-arm64 False
    /Users/game-netease/dotnet/runtime/src/tests/build.proj(330,5): error MSB4018: “AppleAppBuilderTask”任务意外失败。
    /Users/game-netease/dotnet/runtime/src/tests/build.proj(330,5): error MSB4018: System.InvalidOperationException: Need list of AOT files for device builds.
    /Users/game-netease/dotnet/runtime/src/tests/build.proj(330,5): error MSB4018: at AppleAppBuilderTask.Execute() in /Users/game-netease/dotnet/runtime/src/tasks/AppleAppBuilder/AppleAppBuilder.cs:line 233
    /Users/game-netease/dotnet/runtime/src/tests/build.proj(330,5): error MSB4018: at Microsoft.Build.BackEnd.TaskExecutionHost.Microsoft.Build.BackEnd.ITaskExecutionHost.Execute()
    /Users/game-netease/dotnet/runtime/src/tests/build.proj(330,5): error MSB4018: at Microsoft.Build.BackEnd.TaskBuilder.ExecuteInstantiatedTask(ITaskExecutionHost taskExecutionHost, TaskLoggingContext taskLoggingContext, TaskHost taskHost, ItemBucket bucket, TaskExecutionMode howToExecuteTask)

    the following output is the code I add in AppleAppBuilder.cs execute function
    ===========Apple builder build:==bindir:================/Users/game-netease/dotnet/runtime/artifacts/tests/coreclr/obj/iOS.arm64.Release/Managed/./build/iOSApps/Interop_ICustomMarshaler/bin-Interop_ICustomMarshaler-arm64 False

  16. kotlarmilos commented on Apr 27, 2023

    @kotlarmilos
    kotlarmilos
    on Apr 27, 2023
    Member

    Thank you. According to the logs, there are artifacts built for iOSSimulator.arm64.Release configuration. I suggest removing ./artifacts directory and building the runtime for ios-arm64 only. Additionally, please note that only tracing/eventpipe subset of runtime tests is enabled on iOS, so make sure to have -mono tree tracing/eventpipe parameter included.

    The steps should be:

    rm -rf ./artifacts
./build.sh -arch arm64 -os ios -s mono+libs -c Release
./src/tests/build.sh os ios arm64 Release -mono tree tracing/eventpipe /p:LibrariesConfiguration=Release

    Also, I would recommend trying HelloiOS sample app to get familiar with the process, and to verify if the runtime is built correctly. To run the HelloiOS sample app, configure parameters in the Makefile and run make all.

  17. JamboWu2 commented on Apr 27, 2023

    @JamboWu2
    JamboWu2
    on Apr 27, 2023

    So follow your instructions :
    (in Runtime directory)
    1: ./build.sh mono+libs -os ios -a arm64 -c Release
    2: cd src/tests
    3: ./build.sh os iOS arm64 Release -mono tree:tracing/eventpipe /p:DevTeamProvisioning=ZF3Z3HS5W2 /p:LibrariesConfiguration=Release

    then still the same error:

    ===========Apple builder build:==bindir:================/Users/game-netease/dotnet/runtime/artifacts/tests/coreclr/obj/iOS.arm64.Release/Managed/./build/iOSApps/tracing_eventpipe/bin-tracing_eventpipe-arm64 False
    /Users/game-netease/dotnet/runtime/src/tests/build.proj(330,5): error MSB4018: “AppleAppBuilderTask”任务意外失败。
    /Users/game-netease/dotnet/runtime/src/tests/build.proj(330,5): error MSB4018: System.InvalidOperationException: Need list of AOT files for device builds.
    /Users/game-netease/dotnet/runtime/src/tests/build.proj(330,5): error MSB4018: at AppleAppBuilderTask.Execute() in /Users/game-netease/dotnet/runtime/src/tasks/AppleAppBuilder/AppleAppBuilder.cs:line 233
    /Users/game-netease/dotnet/runtime/src/tests/build.proj(330,5): error MSB4018: at Microsoft.Build.BackEnd.TaskExecutionHost.Microsoft.Build.BackEnd.ITaskExecutionHost.Execute()
    /Users/game-netease/dotnet/runtime/src/tests/build.proj(330,5): error MSB4018: at Microsoft.Build.BackEnd.TaskBuilder.ExecuteInstantiatedTask(ITaskExecutionHost taskExecutionHost, TaskLoggingContext taskLoggingContext, TaskHost taskHost, ItemBucket bucket, TaskExecutionMode howToExecuteTask)

    ==================
    HelloiOS sample app is OK, It can make succeed and run normally on the device

  18. kotlarmilos commented on Apr 27, 2023

    @kotlarmilos
    kotlarmilos
    on Apr 27, 2023
    Member

    The provided command appears to have an invalid tree parameter. To fix this, try using tree tracing/eventpipe instead of tree:tracing/eventpipe. The current invalid parameter is causing the script to build all runtime tests on iOS, instead of only the supported subset.

  19. JamboWu2 commented on Apr 28, 2023

    @JamboWu2
    JamboWu2
    on Apr 28, 2023

    ./build.sh os iOS arm64 Release -mono tree tracing/eventpipe /p:DevTeamProvisioning=ZF3Z3HS5W2 /p:LibrariesConfiguration=Release

    The command is invalid,the errors below:

    The switch that responds to file appends:
    switch:tracing/eventpipe

  20. kotlarmilos commented on Apr 28, 2023

    @kotlarmilos
    kotlarmilos
    on Apr 28, 2023
    Member

    Could you check if you are using the latest version from the main branch?

    If you are using the latest version and the issues still persists, I suggest you zip and share your local version of the runtime repository here, so I can try to reproduce the issue locally.

    Thank you.

  21. JamboWu2 commented on Apr 28, 2023

    @JamboWu2
    JamboWu2
    on Apr 28, 2023

    The branch what I used is release/7.0 instead of main, is that OK?

  22. kotlarmilos commented on Apr 28, 2023

    @kotlarmilos
    kotlarmilos
    on Apr 28, 2023
    Member

    The iOS runtime tests have been introduced recently, in #79169. Please try with the main branch.

  23. JamboWu2 commented on Apr 28, 2023

    @JamboWu2
    JamboWu2
    on Apr 28, 2023

    Ok, I will check out main branch and try it, thank you

    anyway,why we must focus on tracing/eventpipe? what about the other tests? Like JIT/Math, GC... and so on?

  24. kotlarmilos commented on Apr 28, 2023

    @kotlarmilos
    kotlarmilos
    on Apr 28, 2023
    Member

    We plan to include other testing groups that could be executed on iOS/iOSSimulator in the future. It may be possible to filter other testing groups for execution, but they have not been tested yet.

    If you find that certain groups can be run on a device without any modifications, we encourage you to contribute by opening a PR, or providing details here.

  25. JamboWu2 commented on Apr 28, 2023

    @JamboWu2
    JamboWu2
    on Apr 28, 2023

    Ok, thank you for help!

  26. kotlarmilos commented on Apr 28, 2023

    @kotlarmilos
    kotlarmilos
    on Apr 28, 2023
    Member

    Thanks! I will close this issue, but feel free to reopen it if you have further questions.

  27. kotlarmilos
    closed this as completedon Apr 28, 2023
  28. ghost locked as resolved and limited conversation to collaborators on May 28, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Labels

area-Infrastructure-monoos-iosApple iOS

Type

No type

Projects

No projects

    Milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions