Skip to content

System.Diagnostics.Tests.ProcessTests.TestCheckChildProcessUserAndGroupIds failing Subset assertion #92944

Closed as not planned

Description

@ericstj

Build Information

Build: https://dev.azure.com/dnceng-public/cbb18261-c48f-4abb-8651-8cdcb5474649/_build/results?buildId=425348
Build error leg or test failing: System.Diagnostics.Tests.ProcessTests.TestCheckChildProcessUserAndGroupIds
Pull request: #92730

Error Message

Similar issue reported in past as #28922

Child exception:
  Xunit.Sdk.SubsetException: Assert.Subset() Failure
Expected: HashSet<UInt32> [12, 33, 61, 80, 98, ...]
Actual:   HashSet<UInt32> [80, 12, 20, 61, 701, ...]
   at System.Diagnostics.Tests.ProcessTests.CheckUserAndGroupIds(String userId, String groupId, String groupIdsJoined, String checkGroupsExact) in /_/src/libraries/System.Diagnostics.Process/tests/ProcessTests.Unix.cs:line 571
   at System.Reflection.MethodBaseInvoker.InterpretedInvoke_Method(Object obj, IntPtr* args) in /_/src/mono/System.Private.CoreLib/src/System/Reflection/MethodBaseInvoker.Mono.cs:line 22
   at System.Reflection.MethodBaseInvoker.InvokeDirectByRefWithFewArgs(Object obj, Span`1 copyOfArgs, BindingFlags invokeAttr) in /_/src/libraries/System.Private.CoreLib/src/System/Reflection/MethodBaseInvoker.cs:line 178

Child process:
  System.Diagnostics.Process.Tests, Version=8.0.0.0, Culture=neutral, PublicKeyToken=cc7b13ffcd2ddd51 System.Diagnostics.Tests.ProcessTests Int32 CheckUserAndGroupIds(System.String, System.String, System.String, System.String)

Child arguments:
  504, 80, 12,33,61,80,98,100,204,250,395,398,399,400,701,702,703, False

Fill the error message using step by step known issues guidance.

{
  "ErrorMessage": "",
  "ErrorPattern": "at System.Diagnostics.Tests.ProcessTests.CheckUserAndGroupIds.String userId",
  "BuildRetry": false,
  "ExcludeConsoleLog": true
}

Known issue validation

Build: 🔎 https://dev.azure.com/dnceng-public/public/_build/results?buildId=426977
Error message validated: at System.Diagnostics.Tests.ProcessTests.CheckUserAndGroupIds.String userId
Result validation: ✅ Known issue matched with the provided build.
Validation performed at: 10/4/2023 7:30:00 PM UTC

Report

Summary

24-Hour Hit Count 7-Day Hit Count 1-Month Count
0 0 0

Activity

  1. added
    blocking-clean-ciBlocking PR or rolling runs of 'runtime' or 'runtime-extra-platforms'
    Known Build ErrorUse this to report build issues in the .NET Helix tab
    on Oct 3, 2023
  2. ghost added
    untriagedNew issue has not been triaged by the area owner
    on Oct 3, 2023
  3. carlossanlop commented on Oct 3, 2023

    @carlossanlop
    Contributor

    Hit this in 8.0. Not sure why KnownBuildError isn't linking the PRs:

    Expand
    ===========================================================================================================
    /private/tmp/helix/working/B1790977/w/A4B20994/e /private/tmp/helix/working/B1790977/w/A4B20994/e
      Discovering: System.Diagnostics.Process.Tests (method display = ClassAndMethod, method display options = None)
      Discovered:  System.Diagnostics.Process.Tests (found 250 of 322 test cases)
      Starting:    System.Diagnostics.Process.Tests (parallel test collections = on, max threads = 12)
        System.Diagnostics.Tests.ProcessStartInfoTests.ShellExecute_Nano_Fails_Start [SKIP]
          Condition(s) not met: "IsWindowsNanoServer"
    Darwin
        System.Diagnostics.Tests.ProcessTests.TestBasePriorityOnUnix [SKIP]
          Condition(s) not met: "IsPrivilegedProcess"
    Unhandled exception. Xunit.Sdk.SubsetException: Assert.Subset() Failure
    Expected: HashSet<UInt32> [12, 33, 61, 80, 98, ...]
    Actual:   HashSet<UInt32> [80, 12, 20, 61, 703, ...]
       at Xunit.Assert.Subset[T](ISet`1 expectedSuperset, ISet`1 actual) in /_/src/xunit.assert/Asserts/SetAsserts.cs:line 71
       at System.Diagnostics.Tests.ProcessTests.CheckUserAndGroupIds(String userId, String groupId, String groupIdsJoined, String checkGroupsExact) in /_/src/libraries/System.Diagnostics.Process/tests/ProcessTests.Unix.cs:line 571
       at System.RuntimeMethodHandle.InvokeMethod(Object target, Void** arguments, Signature sig, Boolean isConstructor)
       at System.Reflection.MethodBaseInvoker.InterpretedInvoke_Method(Object obj, IntPtr* args) in /_/src/coreclr/System.Private.CoreLib/src/System/Reflection/MethodBaseInvoker.CoreCLR.cs:line 36
       at System.Reflection.MethodBaseInvoker.InvokeDirectByRefWithFewArgs(Object obj, Span`1 copyOfArgs, BindingFlags invokeAttr) in /_/src/libraries/System.Private.CoreLib/src/System/Reflection/MethodBaseInvoker.cs:line 178
    --- End of stack trace from previous location ---
       at Microsoft.DotNet.RemoteExecutor.Program.Main(String[] args) in /_/src/Microsoft.DotNet.RemoteExecutor/src/Program.cs:line 97
        System.Diagnostics.Tests.ProcessTests.TestCheckChildProcessUserAndGroupIds [FAIL]
          Microsoft.DotNet.RemoteExecutor.RemoteExecutionException : Remote process failed with an unhandled exception.
          Stack Trace:
            
            Child exception:
              Xunit.Sdk.SubsetException: Assert.Subset() Failure
            Expected: HashSet<UInt32> [12, 33, 61, 80, 98, ...]
            Actual:   HashSet<UInt32> [80, 12, 20, 61, 703, ...]
            /_/src/libraries/System.Diagnostics.Process/tests/ProcessTests.Unix.cs(571,0): at System.Diagnostics.Tests.ProcessTests.CheckUserAndGroupIds(String userId, String groupId, String groupIdsJoined, String checkGroupsExact)
               at System.RuntimeMethodHandle.InvokeMethod(Object target, Void** arguments, Signature sig, Boolean isConstructor)
            /_/src/coreclr/System.Private.CoreLib/src/System/Reflection/MethodBaseInvoker.CoreCLR.cs(36,0): at System.Reflection.MethodBaseInvoker.InterpretedInvoke_Method(Object obj, IntPtr* args)
            /_/src/libraries/System.Private.CoreLib/src/System/Reflection/MethodBaseInvoker.cs(178,0): at System.Reflection.MethodBaseInvoker.InvokeDirectByRefWithFewArgs(Object obj, Span`1 copyOfArgs, BindingFlags invokeAttr)
            
            Child process:
              System.Diagnostics.Process.Tests, Version=8.0.0.0, Culture=neutral, PublicKeyToken=cc7b13ffcd2ddd51 System.Diagnostics.Tests.ProcessTests Int32 CheckUserAndGroupIds(System.String, System.String, System.String, System.String)
            
            Child arguments:
              504, 80, 12,33,61,80,98,100,204,250,395,398,399,400,701,702,703, False
            
        System.Diagnostics.Tests.ProcessTests.TestPriorityClassUnix [SKIP]
          Condition(s) not met: "IsPrivilegedProcess"
        System.Diagnostics.Tests.ProcessTests.TestProcessRecycledPid [SKIP]
          Condition(s) not met: "IsStressModeEnabledAndRemoteExecutorSupported"
        System.Diagnostics.Tests.ProcessTests.TestCheckChildProcessUserAndGroupIdsElevated [SKIP]
          Condition(s) not met: "IsRemoteExecutorSupportedAndPrivilegedProcess"
      Finished:    System.Diagnostics.Process.Tests
    === TEST EXECUTION SUMMARY ===
       System.Diagnostics.Process.Tests  Total: 306, Errors: 0, Failed: 1, Skipped: 5, Time: 24.023s
    /private/tmp/helix/working/B1790977/w/A4B20994/e
    ----- end Mon Oct 2 19:19:37 EDT 2023 ----- exit code 1 ----------------------------------------------------------
    
  4. buyaa-n commented on Oct 3, 2023

    @buyaa-n
    Contributor

    Same failure found in #92846, Build Analysis might link this issue automatically if we remove the ProcessTests.Unix.cs(571,0): part from the "ErrorMessage" as that part is not visible in the Build Analysis tab:

    UPDATE: looks it was originally: "ErrorMessage": "at System.Diagnostics.Tests.ProcessTests.CheckUserAndGroupIds(String userId, String groupId, String groupIdsJoined, String checkGroupsExact)", and apparently the automation still did not work

  5. added
    Known Build ErrorUse this to report build issues in the .NET Helix tab
    and removed
    Known Build ErrorUse this to report build issues in the .NET Helix tab
    on Oct 4, 2023
  6. carlossanlop commented on Oct 4, 2023

    @carlossanlop
    Contributor

    Hit in 7.0:

    Unhandled Exception:
    Xunit.Sdk.SubsetException: Assert.Subset() Failure
    Expected: HashSet<UInt32> [12, 33, 61, 80, 98, ...]
    Actual:   HashSet<UInt32> [80, 12, 20, 61, 701, ...]
       at Xunit.Assert.Subset[UInt32](ISet`1 expectedSuperset, ISet`1 actual) in /_/src/xunit.assert/Asserts/SetAsserts.cs:line 72
       at System.Diagnostics.Tests.ProcessTests.CheckUserAndGroupIds(String userId, String groupId, String groupIdsJoined, String checkGroupsExact) in /_/src/libraries/System.Diagnostics.Process/tests/ProcessTests.Unix.cs:line 568
       at Microsoft.DotNet.RemoteExecutor.Program.Main(String[] args) in /_/src/Microsoft.DotNet.RemoteExecutor/src/Program.cs:line 97
    [ERROR] FATAL UNHANDLED EXCEPTION: Xunit.Sdk.SubsetException: Assert.Subset() Failure
    Expected: HashSet<UInt32> [12, 33, 61, 80, 98, ...]
    Actual:   HashSet<UInt32> [80, 12, 20, 61, 701, ...]
       at Xunit.Assert.Subset[UInt32](ISet`1 expectedSuperset, ISet`1 actual) in /_/src/xunit.assert/Asserts/SetAsserts.cs:line 72
       at System.Diagnostics.Tests.ProcessTests.CheckUserAndGroupIds(String userId, String groupId, String groupIdsJoined, String checkGroupsExact) in /_/src/libraries/System.Diagnostics.Process/tests/ProcessTests.Unix.cs:line 568
       at Microsoft.DotNet.RemoteExecutor.Program.Main(String[] args) in /_/src/Microsoft.DotNet.RemoteExecutor/src/Program.cs:line 97
        System.Diagnostics.Tests.ProcessTests.TestCheckChildProcessUserAndGroupIds [FAIL]
          Microsoft.DotNet.RemoteExecutor.RemoteExecutionException : Remote process failed with an unhandled exception.
          Stack Trace:
            
            Child exception:
              Xunit.Sdk.SubsetException: Assert.Subset() Failure
            Expected: HashSet<UInt32> [12, 33, 61, 80, 98, ...]
            Actual:   HashSet<UInt32> [80, 12, 20, 61, 701, ...]
            /_/src/libraries/System.Diagnostics.Process/tests/ProcessTests.Unix.cs(568,0): at System.Diagnostics.Tests.ProcessTests.CheckUserAndGroupIds(String userId, String groupId, String groupIdsJoined, String checkGroupsExact)
            /_/src/mono/System.Private.CoreLib/src/System/Reflection/MethodInvoker.Mono.cs(33,0): at System.Reflection.MethodInvoker.InterpretedInvoke(Object obj, Span`1 args, BindingFlags invokeAttr)
            
            Child process:
              System.Diagnostics.Process.Tests, Version=7.0.0.0, Culture=neutral, PublicKeyToken=cc7b13ffcd2ddd51 System.Diagnostics.Tests.ProcessTests Int32 CheckUserAndGroupIds(System.String, System.String, System.String, System.String)
            
            Child arguments:
              504, 80, 12,33,61,80,98,100,204,250,395,398,399,400,701,702,703, False
    
  7. 5 remaining items

  8. ericstj commented on Oct 4, 2023

    @ericstj
    MemberAuthor

    I see - seems like that happened after the search string was changed earlier today:
    image

    This was working before - seems like the issue table insertion and PR linking is not though.

  9. radical commented on Oct 4, 2023

    @radical
    Member

    This was working before - seems like the issue table insertion and PR linking is not though.

    Yeah, I'm seeing the same issue in #93023 . It should have had 2 chances by now to do that (8, and 9pm UTC).
    @missymessa any clues?

  10. added this to the 9.0.0 milestone on Oct 20, 2023
  11. ghost removed
    untriagedNew issue has not been triaged by the area owner
    on Oct 20, 2023
  12. removed this from the 9.0.0 milestone on Nov 15, 2023
  13. ghost added
    untriagedNew issue has not been triaged by the area owner
    on Nov 15, 2023
  14. added this to the 9.0.0 milestone on Nov 24, 2023
  15. ghost removed
    untriagedNew issue has not been triaged by the area owner
    on Nov 24, 2023
  16. removed
    blocking-clean-ciBlocking PR or rolling runs of 'runtime' or 'runtime-extra-platforms'
    on Feb 16, 2024
  17. jeffschwMSFT commented on Feb 16, 2024

    @jeffschwMSFT
    Member

    removing blocking-clean-ci as it has not been hit in 30 days

    24-Hour Hit Count 7-Day Hit Count 1-Month Count
    0 0 0
  18. modified the milestones: 9.0.0, Future on Jul 22, 2024
  19. akoeplinger commented on Jul 18, 2025

    @akoeplinger
    Member

    Closing, this hasn't been hit in a long time.

  20. locked and limited conversation to collaborators on Aug 18, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions