Bundle_Is_Extracted test failing intermittently on Linux #43316

Activity

1. Dotnet-GitSync-Bot

   added

   area-Tracing-coreclr

   untriagedNew issue has not been triaged by the area ownerNew issue has not been triaged by the area owner

   on Oct 12, 2020
2. jkoritzinsky

   added

   area-Single-File

   blocking-clean-ciBlocking PR or rolling runs of 'runtime' or 'runtime-extra-platforms'Blocking PR or rolling runs of 'runtime' or 'runtime-extra-platforms'

   and removed

   area-Tracing-coreclr

   untriagedNew issue has not been triaged by the area ownerNew issue has not been triaged by the area owner

   on Oct 12, 2020
4. agocke

   added this to the 6.0.0 milestone on Oct 19, 2020
5. stephentoub commented on Nov 17, 2020

   

   stephentoub

   on Nov 17, 2020

   Member

   More actions

   Failed again here:
   https://dev.azure.com/dnceng/public/_build/results?buildId=888977&view=ms.vss-test-web.build-test-results-tab&runId=28428970&resultId=100011&paneView=debug

   
   Error message
   System.ComponentModel.Win32Exception : Text file busy
   
   
   Stack trace
      at System.Diagnostics.Process.ForkAndExecProcess(String filename, String[] argv, String[] envp, String cwd, Boolean redirectStdin, Boolean redirectStdout, Boolean redirectStderr, Boolean setCredentials, UInt32 userId, UInt32 groupId, UInt32[] groups, Int32& stdinFd, Int32& stdoutFd, Int32& stderrFd, Boolean usesTerminal, Boolean throwOnNoExec)
      at System.Diagnostics.Process.StartCore(ProcessStartInfo startInfo)
      at System.Diagnostics.Process.Start()
      at Microsoft.DotNet.Cli.Build.Framework.Command.Start() in /_/src/installer/tests/TestUtils/Command.cs:line 199
      at Microsoft.DotNet.Cli.Build.Framework.Command.Execute(Boolean fExpectedToFail) in /_/src/installer/tests/TestUtils/Command.cs:line 239
      at Microsoft.DotNet.Cli.Build.Framework.Command.Execute() in /_/src/installer/tests/TestUtils/Command.cs:line 171
      at AppHost.Bundle.Tests.NetCoreApp3CompatModeTests.Bundle_Is_Extracted() in /_/src/installer/tests/Microsoft.NET.HostModel.Tests/AppHost.Bundle.Tests/NetCoreApp3CompatModeTests.cs:line 33
   
6. agocke commented on Nov 17, 2020

   

   agocke

   on Nov 17, 2020

   Member

   More actions

   I'll take a look at this
7. stephentoub commented on Nov 17, 2020

   

   stephentoub

   on Nov 17, 2020

   Member

   More actions

   Thanks, Andy
8. agocke

   self-assigned this

   on Nov 30, 2020
9. agocke

   added a commit that references this issue on Dec 3, 2020

   Share SingleFileTest publishing between test classes

   ...

   This issue will close once commit d925205 is merged into the 'bazel' branch.

   d925205
10. agocke

    closed this as completedin #45523on Dec 8, 2020
11. agocke

    added a commit that references this issue on Dec 8, 2020

    Change temp folder name used in installer tests (#45523)

    ...

    This issue will close once commit cbc10fa is merged into the 'main' branch.

    cbc10fa
12. ViktorHofer commented on Dec 10, 2020

    

    ViktorHofer

    on Dec 10, 2020

    Last edited by ViktorHofer

    Member

    More actions

    Failed again: https://dev.azure.com/dnceng/public/_build/results?buildId=912265&view=ms.vss-test-web.build-test-results-tab&runId=29055812&resultId=100011&paneView=debug on Installer-coreclr-Linux_x64-Release
13. ViktorHofer

    reopened this on Dec 10, 2020
14. hoyosjs commented on Mar 15, 2021

    

    hoyosjs

    on Mar 15, 2021

    Member

    More actions

    Closing this until this happens again. FYI @agocke
15. hoyosjs

    closed this as completedon Mar 15, 2021
16. ghost locked as resolved and limited conversation to collaborators on May 12, 2021
17. radical commented on May 28, 2021

    

    radical

    on May 28, 2021

    Member

    More actions

    Failed again on https://github.com/dotnet/runtime/pull/53280/checks?check_run_id=2690948600, build: https://dev.azure.com/dnceng/public/_build/results?buildId=1160943&view=logs&jobId=fcbd3ad6-b1a4-55f2-40cc-7db598750d43&j=fcbd3ad6-b1a4-55f2-40cc-7db598750d43&t=0fc7de3b-e85e-5109-ff09-70d9e625d9be

    System.ComponentModel.Win32Exception : Text file busy
    
    Stack trace
       at System.Diagnostics.Process.ForkAndExecProcess(String filename, String[] argv, String[] envp, String cwd, Boolean redirectStdin, Boolean redirectStdout, Boolean redirectStderr, Boolean setCredentials, UInt32 userId, UInt32 groupId, UInt32[] groups, Int32& stdinFd, Int32& stdoutFd, Int32& stderrFd, Boolean usesTerminal, Boolean throwOnNoExec)
       at System.Diagnostics.Process.StartCore(ProcessStartInfo startInfo)
       at System.Diagnostics.Process.Start()
       at Microsoft.DotNet.Cli.Build.Framework.Command.Start() in /_/src/installer/tests/TestUtils/Command.cs:line 199
       at Microsoft.DotNet.Cli.Build.Framework.Command.Execute(Boolean fExpectedToFail) in /_/src/installer/tests/TestUtils/Command.cs:line 239
       at Microsoft.DotNet.Cli.Build.Framework.Command.Execute() in /_/src/installer/tests/TestUtils/Command.cs:line 171
       at AppHost.Bundle.Tests.NetCoreApp3CompatModeTests.Bundle_Is_Extracted() in /_/src/installer/tests/Microsoft.NET.HostModel.Tests/AppHost.Bundle.Tests/NetCoreApp3CompatModeTests.cs:line 33
    
18. radical

    reopened this on May 28, 2021
19. ViktorHofer commented on Aug 20, 2021

    

    ViktorHofer

    on Aug 20, 2021

    Member

    More actions

    Still failing every day in CI but likely with different causes?

    System.AggregateException : One or more errors occurred. (Command failed with exit code 1: /root/runtime/.dotnet/dotnet publish /bl:PublishProject.binlog --no-restore --runtime linux-musl-x64 --framework net6.0 /p:NetCoreAppCurrent=net6.0 -o /root/runtime/artifacts/tests/Release/ahb/smlum2yw.yee/SingleFileApiTests/publish /p:TestTargetRid=linux-musl-x64 /p:MNAVersion=7.0.0-ci /p:AddFile=/root/runtime/artifacts/bin/linux-musl-x64.Release/corehost_test/libmockcoreclr.so\nStandard Output:\nMicrosoft (R) Build Engine version 17.0.0-preview-21411-04+6ca861613 for .NET\nCopyright (C) Microsoft Corporation. All rights reserved.\n\n/root/runtime/.dotnet/sdk/6.0.100-rc.1.21411.28/MSBuild.dll -maxcpucount -property:NetCoreAppCurrent=net6.0 -property:TestTargetRid=linux-musl-x64 -property:MNAVersion=7.0.0-ci -property:AddFile=/root/runtime/artifacts/bin/linux-musl-x64.Release/corehost_test/libmockcoreclr.so -property:PublishDir=/root/runtime/artifacts/tests/Release/ahb/smlum2yw.yee/SingleFileApiTests/publish -property:TargetFramework=net6.0 -property:RuntimeIdentifier=linux-musl-x64 -property:_CommandLineDefinedRuntimeIdentifier=true -target:Publish -verbosity:m /bl:PublishProject.binlog ./SingleFileApiTests.csproj\n/root/runtime/.dotnet/sdk/6.0.100-rc.1.21411.28/Current/Microsoft.Common.props(33,3): error MSB4024: The imported project file "/root/runtime/artifacts/tests/Release/ahb/Directory.Build.props" could not be loaded. Root element is missing. [/root/runtime/artifacts/tests/Release/ahb/smlum2yw.yee/SingleFileApiTests/SingleFileApiTests.csproj]\n\n) (The following constructor parameters did not have matching fixture data: SingleFileSharedState fixture)\n---- Microsoft.DotNet.Cli.Build.Framework.BuildFailureException : Command failed with exit code 1: /root/runtime/.dotnet/dotnet publish /bl:PublishProject.binlog --no-restore --runtime linux-musl-x64 --framework net6.0 /p:NetCoreAppCurrent=net6.0 -o /root/runtime/artifacts/tests/Release/ahb/smlum2yw.yee/SingleFileApiTests/publish /p:TestTargetRid=linux-musl-x64 /p:MNAVersion=7.0.0-ci /p:AddFile=/root/runtime/artifacts/bin/linux-musl-x64.Release/corehost_test/libmockcoreclr.so\nStandard Output:\nMicrosoft (R) Build Engine version 17.0.0-preview-21411-04+6ca861613 for .NET\nCopyright (C) Microsoft Corporation. All rights reserved.\n\n/root/runtime/.dotnet/sdk/6.0.100-rc.1.21411.28/MSBuild.dll -maxcpucount -property:NetCoreAppCurrent=net6.0 -property:TestTargetRid=linux-musl-x64 -property:MNAVersion=7.0.0-ci -property:AddFile=/root/runtime/artifacts/bin/linux-musl-x64.Release/corehost_test/libmockcoreclr.so -property:PublishDir=/root/runtime/artifacts/tests/Release/ahb/smlum2yw.yee/SingleFileApiTests/publish -property:TargetFramework=net6.0 -property:RuntimeIdentifier=linux-musl-x64 -property:_CommandLineDefinedRuntimeIdentifier=true -target:Publish -verbosity:m /bl:PublishProject.binlog ./SingleFileApiTests.csproj\n/root/runtime/.dotnet/sdk/6.0.100-rc.1.21411.28/Current/Microsoft.Common.props(33,3): error MSB4024: The imported project file "/root/runtime/artifacts/tests/Release/ahb/Directory.Build.props" could not be loaded. Root element is missing. [/root/runtime/artifacts/tests/Release/ahb/smlum2yw.yee/SingleFileApiTests/SingleFileApiTests.csproj]\n\n\n---- The following constructor parameters did not have matching fixture data: SingleFileSharedState fixture
    ----- Inner Stack Trace #1 (Microsoft.DotNet.Cli.Build.Framework.BuildFailureException) -----
       at Microsoft.DotNet.Cli.Build.Framework.CommandResult.EnsureSuccessful(Boolean suppressOutput) in /_/src/installer/tests/TestUtils/CommandResult.cs:line 46
       at Microsoft.DotNet.CoreSetup.Test.TestProjectFixture.PublishProject(DotNetCli dotnet, String runtime, String framework, Nullable`1 selfContained, String outputDirectory, Boolean singleFile, Boolean restore, String[] extraArgs) in /_/src/installer/tests/TestUtils/TestProjectFixture.cs:line 317
       at AppHost.Bundle.Tests.BundleTestBase.SharedTestStateBase.PreparePublishedSelfContainedTestProject(String projectName, String[] extraArgs) in /_/src/installer/tests/Microsoft.NET.HostModel.Tests/AppHost.Bundle.Tests/BundleTestBase.cs:line 83
       at AppHost.Bundle.Tests.SingleFileSharedState..ctor() in /_/src/installer/tests/Microsoft.NET.HostModel.Tests/AppHost.Bundle.Tests/SingleFileSharedState.cs:line 21
    ----- Inner Stack Trace #2 (Xunit.Sdk.TestClassException) -----
    

    @agocke can you please take a look?

    Example build: https://dev.azure.com/dnceng/public/_build/results?buildId=1303326&view=ms.vss-test-web.build-test-results-tab&runId=38393040&resultId=100001&paneView=debug
20. agocke commented on Aug 20, 2021

    

    agocke

    on Aug 20, 2021

    Member

    More actions

    Yup, I'm actively investigating this. Currently trying to repro the latest version. It still seems like a race condition
21. agocke commented on Aug 23, 2021

    

    agocke

    on Aug 23, 2021

    Member

    More actions

    Dup of #53587
22. agocke

    closed this as completedon Aug 23, 2021
23. ViktorHofer commented on Aug 23, 2021

    

    ViktorHofer

    on Aug 23, 2021

    Member

    More actions

    @agocke isn't that a different cause? In the log above (in my post) I don't see a text file is busy mention.
24. agocke commented on Aug 23, 2021

    

    agocke

    on Aug 23, 2021

    Last edited by agocke

    Member

    More actions

    I think there's some race condition in the publishing, and they might be the same one. ~~From that build in particular, there were dozens of different failures from different tests and I'm not sure that it should be even be categorized as the same failure. ~~

    Nvm, was looking at the wrong build. For this one, I think it's still a race in publishing the test, since it looks like the file hasn't been completely written. I think the same thing is probably causing this failure as the others. We can re-asses if we can't find a similar root cause.