Test failure readytorun/JittedMethodsCountingTest/JittedMethodsCountingTest/JittedMethodsCountingTest.sh #93163

Activity

1. v-wenyuxu

   added

   arch-arm64

   os-linuxLinux OS (any supported distro)Linux OS (any supported distro)

   JitStressCLR JIT issues involving JIT internal stress modesCLR JIT issues involving JIT internal stress modes

   on Oct 7, 2023
2. ghost added

   area-CodeGen-coreclrCLR JIT compiler in src/coreclr/src/jit and related components such as SuperPMICLR JIT compiler in src/coreclr/src/jit and related components such as SuperPMI

   on Oct 7, 2023
3. ghost added

   untriagedNew issue has not been triaged by the area ownerNew issue has not been triaged by the area owner

   on Oct 7, 2023
5. v-wenyuxu

   added

   os-macosmacOS aka OSXmacOS aka OSX

   os-windows

   on Oct 7, 2023
6. jkotas commented on Oct 7, 2023

   

   jkotas

   on Oct 7, 2023

   Member

   More actions

   Introduced by #91235. @ivdiazsa Could you please take a look?
7. jkotas

   assigned

   ivdiazsa

   on Oct 7, 2023
8. JulieLeeMSFT

   added this to the 9.0.0 milestone on Oct 9, 2023
9. ghost removed

   untriagedNew issue has not been triaged by the area ownerNew issue has not been triaged by the area owner

   on Oct 9, 2023
10. ivdiazsa commented on Oct 9, 2023

    

    ivdiazsa

    on Oct 9, 2023

    Contributor

    More actions

    Introduced by #91235. @ivdiazsa Could you please take a look?

    Taking a look right now
11. ivdiazsa commented on Oct 9, 2023

    

    ivdiazsa

    on Oct 9, 2023

    Contributor

    More actions

    Ok so, with the Hardware Intrinsics disabled (i.e. setting DOTNET_EnableHWIntrinsic=0), we get a much larger JIT activity, which results in a much higher number of jitted methods, thus making the test fail. We have two options here:

    • Disable the test for when Hardware Intrinsics are disabled
    • Adjust the test to both modes, so that it has a higher limit in the non-HW-Intrinsics mode.

    Also, I just found out that as part of the migration to the new test system, this test ended up floating around in such a way that it is always skipped. Will fix that as well.
12. ivdiazsa commented on Oct 9, 2023

    

    ivdiazsa

    on Oct 9, 2023

    Contributor

    More actions

    Closing in favor of #93261.
13. ivdiazsa

    closed this as completedon Oct 9, 2023
14. JulieLeeMSFT

    added

    arch-x86

    on Oct 31, 2023
15. JulieLeeMSFT commented on Oct 31, 2023

    

    JulieLeeMSFT

    on Oct 31, 2023

    Member

    More actions

    Failed in runtime-coreclr jitstress-isas-x86.

    Return code:      1
    Raw output file:      /datadisks/disk1/work/BE320A35/w/AC9C0998/uploads/JittedMethodsCountingTest/JittedMethodsCountingTest/output.txt
    Raw output:
    BEGIN EXECUTION
    /datadisks/disk1/work/BE320A35/p/corerun -p System.Reflection.Metadata.MetadataUpdater.IsSupported=false -p System.Runtime.Serialization.EnableUnsafeBinaryFormatterSerialization=true JittedMethodsCountingTest.dll ''
    
    Hello World from Jitted Methods Counting Test!
    Number of Jitted Methods in App: 238 - Max Threshold: 70
    
    Xunit.Sdk.EqualException: Assert.Equal() Failure: Values differ
    Expected: 100
    Actual:   101
       at Xunit.Assert.Equal[T](T expected, T actual, IEqualityComparer`1 comparer) in /_/src/Microsoft.DotNet.XUnitAssert/src/EqualityAsserts.cs:line 139
       at __GeneratedMainWrapper.Main()
    Expected: 100
    Actual: 101
    END EXECUTION - FAILED
    Test failed. Trying to see if dump file was created in /home/helixbot/dotnetbuild/dumps since 10/28/2023 9:20:46 PM
    Test Harness Exitcode is : 1
    To run the test:
    Set up CORE_ROOT and run.
    > /datadisks/disk1/work/BE320A35/w/AC9C0998/e/readytorun/readytorun/../JittedMethodsCountingTest/JittedMethodsCountingTest/JittedMethodsCountingTest.sh
    Xunit.Sdk.TrueException: 
    Return code:      1
    Raw output file:      /datadisks/disk1/work/BE320A35/w/AC9C0998/uploads/JittedMethodsCountingTest/JittedMethodsCountingTest/output.txt
    Raw output:
    BEGIN EXECUTION
    /datadisks/disk1/work/BE320A35/p/corerun -p System.Reflection.Metadata.MetadataUpdater.IsSupported=false -p System.Runtime.Serialization.EnableUnsafeBinaryFormatterSerialization=true JittedMethodsCountingTest.dll ''
    
    Hello World from Jitted Methods Counting Test!
    Number of Jitted Methods in App: 238 - Max Threshold: 70
    
    Xunit.Sdk.EqualException: Assert.Equal() Failure: Values differ
    Expected: 100
    Actual:   101
       at Xunit.Assert.Equal[T](T expected, T actual, IEqualityComparer`1 comparer) in /_/src/Microsoft.DotNet.XUnitAssert/src/EqualityAsserts.cs:line 139
       at __GeneratedMainWrapper.Main()
    Expected: 100
    Actual: 101
    END EXECUTION - FAILED
    Test failed. Trying to see if dump file was created in /home/helixbot/dotnetbuild/dumps since 10/28/2023 9:20:46 PM
    Test Harness Exitcode is : 1
    To run the test:
    Set up CORE_ROOT and run.
    > /datadisks/disk1/work/BE320A35/w/AC9C0998/e/readytorun/readytorun/../JittedMethodsCountingTest/JittedMethodsCountingTest/JittedMethodsCountingTest.sh
       at Xunit.Assert.True(Nullable`1 condition, String userMessage) in /_/src/Microsoft.DotNet.XUnitAssert/src/BooleanAsserts.cs:line 146
       at TestLibrary.OutOfProcessTest.RunOutOfProcessTest(String assemblyPath)
       at Program.<<Main>$>g__TestExecutor16|0_17(StreamWriter tempLogSw, StreamWriter statsCsvSw, <>c__DisplayClass0_0&)
    21:20:49.322 Failed test: readytorun/JittedMethodsCountingTest/JittedMethodsCountingTest/JittedMethodsCountingTest.cmd
    
16. JulieLeeMSFT

    reopened this on Oct 31, 2023
17. JulieLeeMSFT commented on Nov 3, 2023

    

    JulieLeeMSFT

    on Nov 3, 2023

    Member

    More actions

    @ivdiazsa, PTAL this test failure. Thanks.
18. JulieLeeMSFT

    added

    blocking-clean-ci-optionalBlocking optional rolling runsBlocking optional rolling runs

    on Nov 3, 2023
19. ivdiazsa commented on Nov 3, 2023

    

    ivdiazsa

    on Nov 3, 2023

    Contributor

    More actions

    This test should not be run when DOTNET_EnableSSE2=0 is set. I'll send a PR addressing this.

    👍React with 👍1Reacted by Julie Lee
20. ghost added

    in-prThere is an active PR which will close this issue when it is mergedThere is an active PR which will close this issue when it is merged

    on Nov 3, 2023
21. ivdiazsa

    closed this as completedin #94362on Nov 6, 2023
22. ghost removed

    in-prThere is an active PR which will close this issue when it is mergedThere is an active PR which will close this issue when it is merged

    on Nov 6, 2023
23. ghost locked as resolved and limited conversation to collaborators on Dec 7, 2023