Test failure: readytorun/coreroot_determinism/coreroot_determinism/coreroot_determinism.sh #45326

Activity

1. Dotnet-GitSync-Bot

   added

   area-ReadyToRun

   untriagedNew issue has not been triaged by the area ownerNew issue has not been triaged by the area owner

   on Nov 30, 2020
2. sandreenko

   added

   blocking-outerloopBlocking the 'runtime-coreclr outerloop' and 'runtime-libraries-coreclr outerloop' runsBlocking the 'runtime-coreclr outerloop' and 'runtime-libraries-coreclr outerloop' runs

   on Dec 17, 2020
3. sandreenko commented on Dec 17, 2020

   

   sandreenko

   on Dec 17, 2020

   Contributor

   More actions

   PTAL @dotnet/crossgen-contrib
4. mangod9

   removed

   untriagedNew issue has not been triaged by the area ownerNew issue has not been triaged by the area owner

   on Dec 17, 2020
5. mangod9

   added this to the 6.0.0 milestone on Dec 17, 2020
6. mangod9

   assigned

   trylek

   on Dec 17, 2020
7. sandreenko commented on Dec 23, 2020

   

   sandreenko

   on Dec 23, 2020

   Contributor

   More actions

   disabled in #46350
8. briansull commented on Feb 23, 2021

   

   briansull

   on Feb 23, 2021

   Last edited by briansull

   Contributor

   More actions

   Seeing this test fail:
   CoreCLR Pri0 Runtime Tests Run windows x86 checked failed
   https://helixre8s23ayyeko0k025g8.blob.core.windows.net/dotnet-runtime-refs-pull-48503-merge-207a8f793fe04202a9/PayloadGroup0/console.ea9e278d.log?sv=2019-07-07&se=2021-03-14T23%3A17%3A41Z&sr=c&sp=rl&sig=7xSihSCdtFD9g58mtQMlPSn4DnFqJJMa6iU9JSiVyhM%3D

       readytorun\coreroot_determinism\coreroot_determinism\coreroot_determinism.cmd [FAIL]
         1 / 1 (100%, 1 failed): failed in 34712 msecs, exit code -1073740286 = 0xC0000602, expected 0: corerun.exe C:\h\w\ACFF09DC\p\crossgen2\crossgen2.dll @C:\h\w\ACFF09DC\w\A4000920\e\readytorun\coreroot_determinism\coreroot_determinism\seed2\CPAOT-ret.out\System.Private.CoreLib.dll.rsp
         !! Assert failure(PID 7736 [0x00001e38], Thread: 7740 [0x1e3c]): CONTRACT VIOLATION by Thread::SetFrame at "D:\workspace\_work\1\s\src\coreclr\vm\threads.cpp" @ 212
         !! MODE_COOPERATIVE encountered while thread is in preemptive state.
         !!                         CONTRACT in Thread::SetFrame at "D:\workspace\_work\1\s\src\coreclr\vm\threads.cpp" @ 212
         !!                         CONTRACT in HijackFrame::HijackFrame at "D:\workspace\_work\1\s\src\coreclr\vm\threadsuspend.cpp" @ 4970
         !!                         CONTRACT in OnHijackWorker at "D:\workspace\_work\1\s\src\coreclr\vm\threadsuspend.cpp" @ 4984
         !!                         CONTRACT in MethodDescCallSite::CallTargetWorker at "D:\workspace\_work\1\s\src\coreclr\vm\callhelpers.cpp" @ 287
         !!                         GCX_COOP in Assembly::ExecuteMainMethod at "D:\workspace\_work\1\s\src\coreclr\vm\assembly.cpp" @ 1670
         !!                         CONTRACT in Assembly::ExecuteMainMethod at "D:\workspace\_work\1\s\src\coreclr\vm\assembly.cpp" @ 1654
         !!                         GCX_COOP in CorHost2::ExecuteAssembly at "D:\workspace\_work\1\s\src\coreclr\vm\corhost.cpp" @ 357
         !!                         CONTRACT in CorHost2::ExecuteAssembly at "D:\workspace\_work\1\s\src\coreclr\vm\corhost.cpp" @ 306
         !! We can't find the violated contract. Look for an old-style non-holder-based contract.
         !! CORECLR! CONTRACT_ASSERT + 0x2C8 (0x70164cf9)
         !! CORECLR! EEContract::DoChecks + 0x144 (0x70403d0e)
         !! CORECLR! Thread::SetFrame + 0x208 (0x70378430)
         !! CORECLR! HijackFrame::HijackFrame + 0xD8 (0x70552d09)
         !! CORECLR! OnHijackWorker + 0xBF (0x7055b34e)
         !! CORECLR! OnHijackTripThread + 0x11 (0x7069b9ee)
         !! CLRJIT_WIN_X86_X86! Compiler::eeGetMethodName + 0x102 (0x6f1fa356)
         !! CLRJIT_WIN_X86_X86! Compiler::compCompile + 0x3F5 (0x6f1f30bb)
         !! CLRJIT_WIN_X86_X86! ``jitNativeCode'::`8'::__Body::Run'::`5'::__Body::Run + 0xC5 (0x6f1f1c08)
         !! CLRJIT_WIN_X86_X86! `jitNativeCode'::`8'::__Body::Run + 0x38 (0x6f1f1c48)
         !!     File: D:\workspace\_work\1\s\src\coreclr\vm\threads.cpp Line: 212
         !!     Image: C:\h\w\ACFF09DC\p\corerun.exe
   
9. trylek commented on Feb 23, 2021

   

   trylek

   on Feb 23, 2021

   Member

   More actions

   I'm afraid that the only person capable of understanding all the gory details of this issue - JanV - is right now busy celebrating the birth of his sixth baby ;-).
10. hoyosjs

    added

    blocking-clean-ciBlocking PR or rolling runs of 'runtime' or 'runtime-extra-platforms'Blocking PR or rolling runs of 'runtime' or 'runtime-extra-platforms'

    on Feb 24, 2021
11. BruceForstall commented on Mar 2, 2021

    

    BruceForstall

    on Mar 2, 2021

    Contributor

    More actions

    @trylek : @sandreenko disabled this in #46350 but just for jitstress. Can we just disable it for all runs for now?
12. jkotas commented on Mar 2, 2021

    

    jkotas

    on Mar 2, 2021

    Last edited by jkotas

    Member

    More actions

    The x86 SetFrame crash is regression introduced by #46238.

    The problem is that EECodeManager::GetReturnAddressHijackInfo is missing return false for reverse PInvoke methods on x86.

    @jkoritzinsky Could you please take a look?
13. jkoritzinsky commented on Mar 2, 2021

    

    jkoritzinsky

    on Mar 2, 2021

    Member

    More actions

    I'll take a look tomorrow.
14. ghost added

    in-prThere is an active PR which will close this issue when it is mergedThere is an active PR which will close this issue when it is merged

    on Mar 3, 2021
15. 5 remaining items

    Load more
16. ghost removed

    in-prThere is an active PR which will close this issue when it is mergedThere is an active PR which will close this issue when it is merged

    on Mar 5, 2021
17. jkotas commented on Mar 5, 2021

    

    jkotas

    on Mar 5, 2021

    Member

    More actions

    #49066 fixed the x86-specific failure. The test is still disabled for JitStress against this issue.
18. jkotas

    reopened this on Mar 5, 2021
19. jkotas

    removed

    blocking-clean-ciBlocking PR or rolling runs of 'runtime' or 'runtime-extra-platforms'Blocking PR or rolling runs of 'runtime' or 'runtime-extra-platforms'

    blocking-outerloopBlocking the 'runtime-coreclr outerloop' and 'runtime-libraries-coreclr outerloop' runsBlocking the 'runtime-coreclr outerloop' and 'runtime-libraries-coreclr outerloop' runs

    on Mar 5, 2021
20. ghost added

    in-prThere is an active PR which will close this issue when it is mergedThere is an active PR which will close this issue when it is merged

    on Apr 3, 2021
21. ghost closed this as completedin #50676on Apr 3, 2021
22. ghost removed

    in-prThere is an active PR which will close this issue when it is mergedThere is an active PR which will close this issue when it is merged

    on Apr 3, 2021
23. ghost locked as resolved and limited conversation to collaborators on May 12, 2021
24. VincentBu commented on Jun 25, 2021

    

    VincentBu

    on Jun 25, 2021

    Contributor

    More actions

    Failed again in runtime-coreclr jitstress 20210623.2

    Failed test:

    CoreCLR windows x86 Checked jitstress1 @ Windows.10.Amd64.Open
    
    - readytorun\\coreroot_determinism\\coreroot_determinism\\coreroot_determinism.cmd
    
    

    Error message:

    1 / 1 (100%, 1 failed): failed in 51020 msecs, exit code -1073740286 = 0xC0000602, expected 0: corerun.exe C:\h\w\B28D0968\p\crossgen2\crossgen2.dll @C:\h\w\B28D0968\w\BFBC0A5A\e\readytorun\coreroot_determinism\coreroot_determinism\seed2\CPAOT-ret.out\System.Private.CoreLib.dll.rsp
    !! Assert failure(PID 6716 [0x00001a3c], Thread: 7148 [0x1bec]): !PreemptiveGCDisabled()
    !! CORECLR! Thread::DetachThread + 0xCF (0x70699d7d)
    !! CORECLR! TlsDestructionMonitor::~TlsDestructionMonitor + 0x8A (0x70b37920)
    !! CORECLR! _dyn_tls_dtor + 0x86 (0x70b496e6)
    !! NTDLL! RtlDecompressBuffer + 0xDE (0x7763ea4e)
    !! NTDLL! LdrShutdownThread + 0x386 (0x7760eea6)
    !! NTDLL! LdrSetAppCompatDllRedirectionCallback + 0x1052A (0x77663c5a)
    !! NTDLL! LdrShutdownProcess + 0x15F (0x77622d7f)
    !! NTDLL! RtlExitUserProcess + 0x96 (0x77623886)
    !! KERNEL32! ExitProcess + 0x13 (0x7747b3e3)
    !! CORECLR! exit_or_terminate_process + 0x38 (0x70b7f0e8)
    !!     File: D:\workspace_work\1\s\src\coreclr\vm\threads.cpp Line: 981
    !!     Image: C:\h\w\B28D0968\p\corerun.exe
    
    Return code:      1
    Raw output file:      C:\h\w\B28D0968\w\BFBC0A5A\uploads\Reports\readytorun.coreroot_determinism\coreroot_determinism\coreroot_determinism.output.txt
    Raw output:
    BEGIN EXECUTION
    "C:\h\w\B28D0968\p\corerun.exe"  coreroot_determinism.dll
    ================================== Compiling with seed 1 ==================================
    Locating output folder C:\h\w\B28D0968\w\BFBC0A5A\e\readytorun\coreroot_determinism\coreroot_determinism\seed1
    Deleting 0 output folders
    Successfully deleted 0 output folders in 164 msecs
    Using dotnet: C:\h\w\B28D0968\p\corerun.exe
    1 / 1 (0%, 0 failed): launching: C:\h\w\B28D0968\p\corerun.exe C:\h\w\B28D0968\p\crossgen2\crossgen2.dll @C:\h\w\B28D0968\w\BFBC0A5A\e\readytorun\coreroot_determinism\coreroot_determinism\seed1\CPAOT-ret.out\System.Private.CoreLib.dll.rsp
    1 / 1 (100%, 0 failed): succeeded in 51009 msecs: corerun.exe C:\h\w\B28D0968\p\crossgen2\crossgen2.dll @C:\h\w\B28D0968\w\BFBC0A5A\e\readytorun\coreroot_determinism\coreroot_determinism\seed1\CPAOT-ret.out\System.Private.CoreLib.dll.rsp
    ================================== Compiling with seed 2 ==================================
    Locating output folder C:\h\w\B28D0968\w\BFBC0A5A\e\readytorun\coreroot_determinism\coreroot_determinism\seed2
    Deleting 0 output folders
    Successfully deleted 0 output folders in 181 msecs
    Using dotnet: C:\h\w\B28D0968\p\corerun.exe
    1 / 1 (0%, 0 failed): launching: C:\h\w\B28D0968\p\corerun.exe C:\h\w\B28D0968\p\crossgen2\crossgen2.dll @C:\h\w\B28D0968\w\BFBC0A5A\e\readytorun\coreroot_determinism\coreroot_determinism\seed2\CPAOT-ret.out\System.Private.CoreLib.dll.rsp
    Compilation failed. C:\h\w\B28D0968\p\corerun.exe C:\h\w\B28D0968\p\R2RTest\R2RTest.dll compile-directory -cr C:\h\w\B28D0968\p -in TestAssemblies --nojit --noexe --large-bubble --release --nocleanup -out seed2 failed with exit code 1
    Expected: 100
    Actual: 1
    END EXECUTION - FAILED
    FAILED
    Test Harness Exitcode is : 1
    To run the test:
    
    set CORE_ROOT=C:\h\w\B28D0968\p
    C:\h\w\B28D0968\w\BFBC0A5A\e\readytorun\coreroot_determinism\coreroot_determinism\coreroot_determinism.cmd
    Expected: True
    Actual:   False
    
    
    Stack trace
       at readytorun_coreroot_determinism._coreroot_determinism_coreroot_determinism_._coreroot_determinism_coreroot_determinism_cmd() in readytorun.coreroot_determinism.XUnitWrapper.dll:token 0x6000004+0x284
    
25. davidwrighton

    reopened this on Jul 1, 2021
26. davidwrighton commented on Jul 1, 2021

    

    davidwrighton

    on Jul 1, 2021

    Member

    More actions

    I've identified the Windows X86 assert here. It is an assert caused by incorrect handling of stack_limit. See upcoming PR for details
27. davidwrighton commented on Jul 1, 2021

    

    davidwrighton

    on Jul 1, 2021

    Member

    More actions

    PR to fix the intermittent failure is #54986
28. davidwrighton commented on Jul 8, 2021

    

    davidwrighton

    on Jul 8, 2021

    Member

    More actions

    I've checked in #54986 which should fix the intermittent assertion failure seen on x86, and hopefully some of the intemittent failures seen on other architectures.
29. davidwrighton

    closed this as completedon Jul 8, 2021