Repository navigation
Test failure tracing/eventpipe/providervalidation/providervalidation/providervalidation.sh #59296
Description
Run: runtime 20210917.69
Failed test:
Mono OSX x64 Release no_tiered_compilation @ OSX.1014.Amd64.Open
- tracing/eventpipe/providervalidation/providervalidation/providervalidation.sh
Error message:
cmdLine:/private/tmp/helix/working/A9650978/w/9D2F08BB/e/tracing/eventpipe/providervalidation/providervalidation/providervalidation.sh Timed Out (timeout in milliseconds: 600000 from variable __TestTimeout, start: 9/17/2021 4:28:20 PM, end: 9/17/2021 4:38:20 PM)
Return code: -100
Raw output file: /tmp/helix/working/A9650978/w/9D2F08BB/uploads/Reports/tracing.eventpipe/providervalidation/providervalidation/providervalidation.output.txt
Raw output:
BEGIN EXECUTION
/tmp/helix/working/A9650978/p/corerun -p System.Reflection.Metadata.MetadataUpdater.IsSupported=false providervalidation.dll ''
0.0s: ==TEST STARTING==
0.2s: Attempting to delete the zombied pipe: /var/folders/1l/16vrmj3n79bf3v35y4tn2_740000gy/T/dotnet-diagnostic-87918-1631914792-socket
0.2s: Deleted
0.2s: Attempting to delete the zombied pipe: /var/folders/1l/16vrmj3n79bf3v35y4tn2_740000gy/T/dotnet-diagnostic-9161-1631920607-socket
0.2s: Deleted
0.2s: Attempting to delete the zombied pipe: /var/folders/1l/16vrmj3n79bf3v35y4tn2_740000gy/T/dotnet-diagnostic-97399-1631917987-socket
0.2s: Deleted
0.2s: Attempting to delete the zombied pipe: /var/folders/1l/16vrmj3n79bf3v35y4tn2_740000gy/T/dotnet-diagnostic-9405-1631920756-socket
0.2s: Deleted
0.2s: Attempting to delete the zombied pipe: /var/folders/1l/16vrmj3n79bf3v35y4tn2_740000gy/T/dotnet-diagnostic-93688-1631916093-socket
0.2s: Deleted
0.2s: Attempting to delete the zombied pipe: /var/folders/1l/16vrmj3n79bf3v35y4tn2_740000gy/T/dotnet-diagnostic-77966-1631909899-socket
0.2s: Deleted
0.2s: Attempting to delete the zombied pipe: /var/folders/1l/16vrmj3n79bf3v35y4tn2_740000gy/T/dotnet-diagnostic-82885-1631912712-socket
0.2s: Deleted
0.2s: Attempting to delete the zombied pipe: /var/folders/1l/16vrmj3n79bf3v35y4tn2_740000gy/T/dotnet-diagnostic-87780-1631914677-socket
0.2s: Deleted
0.2s: Attempting to delete the zombied pipe: /var/folders/1l/16vrmj3n79bf3v35y4tn2_740000gy/T/dotnet-diagnostic-87286-1631914493-socket
0.2s: Deleted
0.2s: Attempting to delete the zombied pipe: /var/folders/1l/16vrmj3n79bf3v35y4tn2_740000gy/T/dotnet-diagnostic-9771-1631920964-socket
0.2s: Deleted
0.2s: Attempting to delete the zombied pipe: /var/folders/1l/16vrmj3n79bf3v35y4tn2_740000gy/T/dotnet-diagnostic-87249-1631914489-socket
0.2s: Deleted
0.2s: Attempting to delete the zombied pipe: /var/folders/1l/16vrmj3n79bf3v35y4tn2_740000gy/T/dotnet-diagnostic-93691-1631916093-socket
0.2s: Deleted
0.2s: Attempting to delete the zombied pipe: /var/folders/1l/16vrmj3n79bf3v35y4tn2_740000gy/T/dotnet-diagnostic-78800-1631910942-socket
0.3s: Deleted
0.3s: Attempting to delete the zombied pipe: /var/folders/1l/16vrmj3n79bf3v35y4tn2_740000gy/T/dotnet-diagnostic-87347-1631914498-socket
0.3s: Deleted
0.3s: Attempting to delete the zombied pipe: /var/folders/1l/16vrmj3n79bf3v35y4tn2_740000gy/T/dotnet-diagnostic-87258-1631914490-socket
0.3s: Deleted
0.3s: Attempting to delete the zombied pipe: /var/folders/1l/16vrmj3n79bf3v35y4tn2_740000gy/T/dotnet-diagnostic-87829-1631914730-socket
0.3s: Deleted
0.3s: Attempting to delete the zombied pipe: /var/folders/1l/16vrmj3n79bf3v35y4tn2_740000gy/T/dotnet-diagnostic-97728-1631918247-socket
0.3s: Deleted
0.3s: Attempting to delete the zombied pipe: /var/folders/1l/16vrmj3n79bf3v35y4tn2_740000gy/T/dotnet-diagnostic-86874-1631914214-socket
0.3s: Deleted
0.3s: Attempting to delete the zombied pipe: /var/folders/1l/16vrmj3n79bf3v35y4tn2_740000gy/T/dotnet-diagnostic-87266-1631914491-socket
0.3s: Deleted
0.3s: Attempting to delete the zombied pipe: /var/folders/1l/16vrmj3n79bf3v35y4tn2_740000gy/T/dotnet-diagnostic-98012-1631918835-socket
0.3s: Deleted
0.3s: Attempting to delete the zombied pipe: /var/folders/1l/16vrmj3n79bf3v35y4tn2_740000gy/T/dotnet-diagnostic-97328-1631917929-socket
0.3s: Deleted
0.3s: Attempting to delete the zombied pipe: /var/folders/1l/16vrmj3n79bf3v35y4tn2_740000gy/T/dotnet-diagnostic-80870-1631911637-socke
Stack trace
at tracing_eventpipe._providervalidation_providervalidation_providervalidation_._providervalidation_providervalidation_providervalidation_sh()
Runfo Tracking Issue: tracing/eventpipe/providervalidation/providervalidation/providervalidation.sh
| Build | Definition | Kind | Run Name | Console | Core Dump | Test Results | Run Client |
|---|---|---|---|---|---|---|---|
| 1892535 | runtime | PR 72517 | Mono Browser wasm Release @ Ubuntu.1804.Amd64.Open | console.log | runclient.py | ||
| 1858712 | runtime | PR 71567 | coreclr Linux arm Checked no_tiered_compilation @ (Ubuntu.1804.Arm32.Open)Ubuntu.1804.Armarch.Open@mcr.microsoft.com/dotnet-buildtools/prereqs:ubuntu-18.04-helix-arm32v7-bfcd90a-20200121150440 | console.log | core dump | runclient.py | |
| 1857672 | runtime | PR 71567 | coreclr Linux arm Checked no_tiered_compilation @ (Ubuntu.1804.Arm32.Open)Ubuntu.1804.Armarch.Open@mcr.microsoft.com/dotnet-buildtools/prereqs:ubuntu-18.04-helix-arm32v7-bfcd90a-20200121150440 | console.log | core dump | runclient.py |
Build Result Summary
| Day Hit Count | Week Hit Count | Month Hit Count |
|---|---|---|
| 1 | 1 | 3 |
Activity
tommcdon commentedon Sep 18, 2021
@josalem
josalem commentedon Sep 20, 2021
@mikem8361 there is an interesting error in the logs from when it tried to grab a dump:
Any idea what happened?
There is not dump or artifact besides the logs indicating a timeout. I'll see if I can repro this locally and do a quick search in the Helix data to see if this a one-off failure.
mikem8361 commentedon Sep 20, 2021
I have no idea what happened here. This error is returned when the DAC initialization fails for various reasons usually because it can't find/get/initialize the global dac table in the runtime.
ViktorHofer commentedon Sep 30, 2021
Happened again in https://helixre8s23ayyeko0k025g8.blob.core.windows.net/dotnet-runtime-refs-heads-main-73c8eaa6550548838f/PayloadGroup0/1/console.9fc84ee3.log?sv=2019-07-07&se=2021-10-19T02%3A05%3A20Z&sr=c&sp=rl&sig=hxpfG5LpGISdKlhNcs%2Bu2acZBF6hb8EdJEqA7bpPYDM%3D
Build: https://dev.azure.com/dnceng/public/_build/results?buildId=1391966&view=results
ViktorHofer commentedon Sep 30, 2021
Converted to a runfo live issue, happened 6 times this week.
2 remaining items
krwq commentedon Oct 5, 2021
@josalem consider disabling test while investigation is pending
lateralusX commentedon Oct 5, 2021
I can do that during the day.
lateralusX commentedon Jul 19, 2022
Investigating, having repro on OSX, only reproduce very infrequently (on release builds), been able to track it down to be related to the file streaming stack hash map and duplications of entries not correctly detected for this specific hash map (using custom hash key and compare functions). Hash map implementation is runtime specific, so likely a Mono specific issue.
Fix infrequent infinite loop on Mono EventPipe streaming thread.
[Mono]: Fix infrequent infinite loop on Mono EventPipe streaming thre…