Repository navigation
System.Security.Cryptography.X509Certificates.Tests.CollectionTests "Assert.Equal() Failure: Values differ" #112738
Description
Widespread failures in System.Security.Cryptography.X509Certificates.Tests.CollectionTests.* tests
Assert.Equal() Failure: Values differ
Expected: 2
Actual: 0
at System.Security.Cryptography.X509Certificates.Tests.CollectionTests.ExportPkcs12_PbeParameters_TwoCerts(PbeEncryptionAlgorithm encryptionAlgorithm, String hashAlgorithm, Int32 iterations) in /_/src/libraries/System.Security.Cryptography/tests/X509Certificates/CollectionTests.cs:line 1694
at InvokeStub_CollectionTests.ExportPkcs12_PbeParameters_TwoCerts(Object, Span`1)
at System.Reflection.MethodBaseInvoker.InvokeWithFewArgs(Object obj, BindingFlags invokeAttr, Binder binder, Object[] parameters, CultureInfo culture) in /_/src/libraries/System.Private.CoreLib/src/System/Reflection/MethodBaseInvoker.cs:line 136
Build Information
Build: https://dev.azure.com/dnceng-public/cbb18261-c48f-4abb-8651-8cdcb5474649/_build/results?buildId=957657
Build error leg or test failing: System.Security.Cryptography.X509Certificates.Tests.CollectionTests.ExportPkcs12_PbeParameters_CertOnly
Pull request: #112717
Error Message
Fill the error message using step by step known issues guidance.
{
"ErrorPattern": "System\\.Security\\.Cryptography\\.X509Certificates\\.Tests\\.(ExportTests|CollectionTests)\\.ExportPkcs12_",
"BuildRetry": false,
"ExcludeConsoleLog": false
}Known issue validation
Build: 🔎 https://dev.azure.com/dnceng-public/public/_build/results?buildId=957657
Error message validated: [System.Security.Cryptography.X509Certificates.Tests.CollectionTests]
Result validation: ✅ Known issue matched with the provided build.
Validation performed at: 2/20/2025 1:41:41 PM UTC
Report
| Build | Definition | Test | Pull Request |
|---|---|---|---|
| 957657 | dotnet/runtime | System.Security.Cryptography.X509Certificates.Tests.ExportTests.ExportPkcs12_PbeParameters | #112717 |
Summary
| 24-Hour Hit Count | 7-Day Hit Count | 1-Month Count |
|---|---|---|
| 1 | 1 | 1 |
Known issue validation
Build: 🔎 https://dev.azure.com/dnceng-public/public/_build/results?buildId=957657
Error message validated: [System\.Security\.Cryptography\.X509Certificates\.Tests\.(ExportTests|CollectionTests)\.ExportPkcs12_]
Result validation: ✅ Known issue matched with the provided build.
Validation performed at: 2/20/2025 2:48:52 PM UTC
Report
| Build | Definition | Test | Pull Request |
|---|---|---|---|
| 957657 | dotnet/runtime | System.Security.Cryptography.X509Certificates.Tests.ExportTests.ExportPkcs12_PbeParameters | #112717 |
Summary
| 24-Hour Hit Count | 7-Day Hit Count | 1-Month Count |
|---|---|---|
| 1 | 1 | 1 |
Report
Summary
| 24-Hour Hit Count | 7-Day Hit Count | 1-Month Count |
|---|---|---|
| 0 | 22 | 22 |
Activity
dotnet-policy-service commentedon Feb 20, 2025
Tagging subscribers to this area: @dotnet/area-system-security, @bartonjs, @vcsjones
See info in area-owners.md if you want to be subscribed.
EgorBo commentedon Feb 20, 2025
Seems to be #112569 cc @vcsjones
vcsjones commentedon Feb 20, 2025
This is yet another example of a failing test being merged because System.Security.Cryptography, by default, does not run against Windows 10, but CLR tests do, and crypto tends to be sensitive to OS differences.
vcsjones commentedon Feb 20, 2025
The PR to address this has been merged; I am going to leave this issue open for a bit to see the hit count settle down.
vcsjones commentedon Feb 24, 2025
Hits are zero, and I've seen a couple of PRs pass that would have hit this, so I am going to close this out.