Skip to content

[MacCatalyst][libraries] Test suites flake with App Crash on CI #53624

Open

Description

@mdh1418

In #53197, a few test suites were flaking on CI with App Crash

All of the crashes are of the same form

Architecture x64
Microsoft.CSharp.Tests - Passes locally but not ran on CI
System.Diagnostics.Tracing.Tests - Still crashed
System.Dynamic.Runtime.Tests - Still crashed
System.Linq.Expressions.Tests - Still crashed
System.Linq.Parallel.Tests - Passed on CI
System.Text.Json.Tests - Still crashed

Architecture Arm64
System.IO.FileSystem.Watcher.Tests - Didn't crash on run 1
System.Net.WebSockets.Client.Tests - Didn't crash on run 1

Activity

  1. added this to the 6.0.0 milestone on Jun 2, 2021
  2. ghost added
    untriagedNew issue has not been triaged by the area owner
    on Jun 2, 2021
  3. removed
    untriagedNew issue has not been triaged by the area owner
    on Jun 28, 2021
  4. steveisok commented on Jun 28, 2021

    @steveisok
    Member

    @mdh1418 the logs don't tell us much. This isn't high priority, but when you have a moment, try to run this locally through xcode and see what it says there.

  5. steveisok commented on Aug 16, 2021

    @steveisok
    Member

    @premun @mandel-macaque The apps reliably crash on CI really early on. It doesn't seem like they even execute and mlaunch core dumps. If you pull the same app file used on helix and run it local, there is no problem.

    @mdh1418 The same crashes seem to happen for iOS and tvOS. Can you please disable for all?

  6. modified the milestones: 6.0.0, 7.0.0 on Aug 16, 2021
  7. premun commented on Aug 17, 2021

    @premun
    Member

    @steveisok I will have a look at the app (probably tomorrow). Do you know - did you try locally on the same Xcode/iOS version?

    I have already seen one BCL app before that would:

    • Crash on iOS 13.5
    • Time out on iOS 14.2
    • Succeed on iOS 14.4
      (which is kind of surprising, I would have thought we won't be iOS version sensitive much)
  8. steveisok commented on Aug 18, 2021

    @steveisok
    Member

    I didn't match the xcode version w/ whatever is on CI.

    On the app you saw crash, did it actually execute or did mlaunch bail earlier?

  9. premun commented on Aug 18, 2021

    @premun
    Member

    I am tracking the investigation here - dotnet/xharness#692 - as it was already referenced in couple of places

  10. lambdageek commented on Sep 17, 2021

    @lambdageek
    Member

    #59182 may help with System.Text.Json tests

  11. 11 remaining items

  12. added 3 commits that reference this issue on Jul 26, 2022
  13. modified the milestones: 7.0.0, 8.0.0 on Jul 28, 2022
  14. mkhamoyan commented on Jul 28, 2022

    @mkhamoyan
    Contributor

    Only failing tests that are still disabled are System.Net.Security and System.Net.Requests.
    They are failing with following exception.
    certificate
    .

  15. modified the milestones: 8.0.0, Future on Aug 8, 2023
  16. removed their assignment
    on Jun 25, 2024
  17. mkhamoyan commented on Jun 25, 2024

    @mkhamoyan
    Contributor
  18. vitek-karas commented on Jun 25, 2024

    @vitek-karas
    Member
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Type

No type

Projects

No projects

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions