RequestDuration_EnrichmentHandler_Success_Recorded fails with System.Net.Quic.QuicException : Stream aborted by peer  #93250

Activity

1. ericstj

   added

   blocking-clean-ciBlocking PR or rolling runs of 'runtime' or 'runtime-extra-platforms'Blocking PR or rolling runs of 'runtime' or 'runtime-extra-platforms'

   Known Build ErrorUse this to report build issues in the .NET Helix tabUse this to report build issues in the .NET Helix tab

   on Oct 9, 2023
2. ghost added

   area-System.Net.Http

   on Oct 9, 2023
3. ghost added

   untriagedNew issue has not been triaged by the area ownerNew issue has not been triaged by the area owner

   on Oct 9, 2023
5. rzikm

   added this to the 9.0.0 milestone on Oct 10, 2023
6. ghost removed

   untriagedNew issue has not been triaged by the area ownerNew issue has not been triaged by the area owner

   on Oct 10, 2023
7. carlossanlop commented on Oct 12, 2023

   

   carlossanlop

   on Oct 12, 2023

   Contributor

   More actions

   @dotnet/ncl I'm seeing a spike of hits of this failure in release/8.0 PRs. Can someone please take a look?

   Here's a recent example:

   • Affected 8.0 PR: [release/8.0] Handle binding to initialized abstract members #93120
   • Queue: Libraries Test Run release coreclr linux x64 Debug
   • Build: https://dev.azure.com/dnceng-public/public/_build/results?buildId=429885&view=logs&j=bc8f69e2-91b3-518c-84f8-466a04c1af40&t=0864dbdb-cb3f-5f82-b0b6-057b78db53e2&l=86
   • Log: https://helixre107v0xd1eu3ibi6ka.blob.core.windows.net/dotnet-runtime-refs-pull-93120-merge-47197dce91b04dbf87/System.Net.Http.Functional.Tests/3/console.e4e6d7cd.log?helixlogtype=result
   • Callstack:

         System.Net.Quic.QuicException : Stream aborted by peer (268).
         Stack Trace:
           /_/src/libraries/System.Net.Quic/src/System/Net/Quic/Internal/ResettableValueTaskSource.cs(169,0): at System.Net.Quic.ResettableValueTaskSource.TryComplete(Exception exception, Boolean final)
           /_/src/libraries/System.Net.Quic/src/System/Net/Quic/Internal/ResettableValueTaskSource.cs(233,0): at System.Net.Quic.ResettableValueTaskSource.TrySetException(Exception exception, Boolean final)
           /_/src/libraries/System.Net.Quic/src/System/Net/Quic/QuicStream.cs(559,0): at System.Net.Quic.QuicStream.HandleEventPeerReceiveAborted(_PEER_RECEIVE_ABORTED_e__Struct& data)
           /_/src/libraries/System.Net.Quic/src/System/Net/Quic/QuicStream.cs(609,0): at System.Net.Quic.QuicStream.HandleStreamEvent(QUIC_STREAM_EVENT& streamEvent)
           /_/src/libraries/System.Net.Quic/src/System/Net/Quic/QuicStream.cs(640,0): at System.Net.Quic.QuicStream.NativeCallback(QUIC_HANDLE* connection, Void* context, QUIC_STREAM_EVENT* streamEvent)
           --- End of stack trace from previous location ---
           /_/src/libraries/System.Net.Quic/src/System/Net/Quic/Internal/ResettableValueTaskSource.cs(279,0): at System.Net.Quic.ResettableValueTaskSource.System.Threading.Tasks.Sources.IValueTaskSource.GetResult(Int16 token)
           /_/src/libraries/Common/tests/System/Net/Http/Http3LoopbackStream.cs(165,0): at System.Net.Test.Common.Http3LoopbackStream.SendFrameAsync(Int64 frameType, ReadOnlyMemory`1 framePayload)
           /_/src/libraries/Common/tests/System/Net/Http/Http3LoopbackStream.cs(120,0): at System.Net.Test.Common.Http3LoopbackStream.SendHeadersFrameAsync(Nullable`1 statusCode, IEnumerable`1 headers, Boolean qpackEncodeStatus)
           /_/src/libraries/Common/tests/System/Net/Http/Http3LoopbackStream.cs(261,0): at System.Net.Test.Common.Http3LoopbackStream.SendResponseHeadersAsync(Nullable`1 statusCode, IEnumerable`1 headers)
           /_/src/libraries/Common/tests/System/Net/Http/Http3LoopbackStream.cs(244,0): at System.Net.Test.Common.Http3LoopbackStream.SendResponseAsync(HttpStatusCode statusCode, IList`1 headers, String content, Boolean isFinal)
           /_/src/libraries/Common/tests/System/Net/Http/Http3LoopbackConnection.cs(255,0): at System.Net.Test.Common.Http3LoopbackConnection.HandleRequestAsync(HttpStatusCode statusCode, IList`1 headers, String content)
           /_/src/libraries/Common/tests/System/Net/Http/Http3LoopbackServer.cs(98,0): at System.Net.Test.Common.Http3LoopbackServer.HandleRequestAsync(HttpStatusCode statusCode, IList`1 headers, String content)
           /_/src/libraries/Common/tests/System/Net/Http/Http3LoopbackServer.cs(98,0): at System.Net.Test.Common.Http3LoopbackServer.HandleRequestAsync(HttpStatusCode statusCode, IList`1 headers, String content)
           /_/src/libraries/System.Net.Http/tests/FunctionalTests/MetricsTest.cs(473,0): at System.Net.Http.Functional.Tests.HttpMetricsTest.<>c__DisplayClass15_0.<<RequestDuration_EnrichmentHandler_Success_Recorded>b__1>d.MoveNext()
           --- End of stack trace from previous location ---
           /_/src/libraries/Common/tests/System/Threading/Tasks/TaskTimeoutExtensions.cs(120,0): at System.Threading.Tasks.TaskTimeoutExtensions.GetRealException(Task task)
           --- End of stack trace from previous location ---
           /_/src/libraries/Common/tests/System/Threading/Tasks/TaskTimeoutExtensions.cs(90,0): at System.Threading.Tasks.TaskTimeoutExtensions.WhenAllOrAnyFailed(Task[] tasks)
           /_/src/libraries/Common/tests/System/Net/Http/GenericLoopbackServer.cs(44,0): at System.Net.Test.Common.LoopbackServerFactory.<>c__DisplayClass6_0.<<CreateClientAndServerAsync>b__0>d.MoveNext()
           --- End of stack trace from previous location ---
           /_/src/libraries/Common/tests/System/Net/Http/Http3LoopbackServer.cs(116,0): at System.Net.Test.Common.Http3LoopbackServerFactory.CreateServerAsync(Func`3 funcAsync, Int32 millisecondsTimeout, GenericLoopbackOptions options)
           /_/src/libraries/System.Net.Http/tests/FunctionalTests/MetricsTest.cs(452,0): at System.Net.Http.Functional.Tests.HttpMetricsTest.RequestDuration_EnrichmentHandler_Success_Recorded(HttpCompletionOption completionOption, ResponseContentType responseContentType)
           --- End of stack trace from previous location ---
   
8. karelz commented on Oct 12, 2023

   

   karelz

   on Oct 12, 2023

   Member

   More actions

   @rzikm can you please check 8.0 frequency in your Thu CI report for 8.0?

   5 hits per day in main should be prioritized for main anyway - @ManickaP any thoughts here?
9. ManickaP commented on Oct 12, 2023

   

   ManickaP

   on Oct 12, 2023

   Member

   More actions

   This is a test bug, client doesn't drain the response and based on timing closes the stream faster than the server can send the full reply. I'll put up a fix in main, we can then backport it to 8.0 if we decide to.

   ❤️React with ❤️1Reacted by Karel Zikmund
10. ManickaP

    self-assigned this

    on Oct 12, 2023
11. ghost added

    in-prThere is an active PR which will close this issue when it is mergedThere is an active PR which will close this issue when it is merged

    on Oct 12, 2023
12. rzikm commented on Oct 12, 2023

    

    rzikm

    on Oct 12, 2023

    Member

    More actions

    The test in question has 1 failure in last 30 days in 8.0, and about 30 PassedOnRerun. Since it is a test-only change with low risk I think we should backport it to stabilize CI

    👍React with 👍1Reacted by Karel Zikmund
13. ManickaP

    closed this as completedin #93379on Oct 12, 2023
14. ghost removed

    in-prThere is an active PR which will close this issue when it is mergedThere is an active PR which will close this issue when it is merged

    on Oct 12, 2023
15. ManickaP commented on Oct 12, 2023

    

    ManickaP

    on Oct 12, 2023

    Member

    More actions

    Re-opening for 8.0 backport
16. ManickaP

    reopened this on Oct 12, 2023
17. ManickaP

    modified the milestones: 9.0.0, 8.0.0 on Oct 12, 2023
18. ghost added

    in-prThere is an active PR which will close this issue when it is mergedThere is an active PR which will close this issue when it is merged

    on Oct 12, 2023
19. ghost removed

    in-prThere is an active PR which will close this issue when it is mergedThere is an active PR which will close this issue when it is merged

    on Oct 12, 2023
20. ManickaP commented on Oct 18, 2023

    

    ManickaP

    on Oct 18, 2023

    Member

    More actions

    #93381 is merged, closing.
21. ManickaP

    closed this as completedon Oct 18, 2023
22. karelz

    added

    test-bugProblem in test source code (most likely)Problem in test source code (most likely)

    on Oct 18, 2023
23. karelz commented on Oct 18, 2023

    

    karelz

    on Oct 18, 2023

    Member

    More actions

    Fixed in main (9.0) in PR #93379 and in 8.0 (GA) in PR #93381
24. ghost locked as resolved and limited conversation to collaborators on Nov 17, 2023
25. dotnet-policy-service

    added

    in-prThere is an active PR which will close this issue when it is mergedThere is an active PR which will close this issue when it is merged

    on Dec 12, 2024