Repository navigation
[CI]: Epic: fix everything #4120
Description
Currently known flaky tests (could be a test issue or a nerdctl issue)
New entrants:
- [CI]: TestNetworkInspect is flaky in windows #4322
- [CI]: Alma extended attributes getting lost (with nydus convert) (help needed) #4332
- [CI]: TestContainerRmIptables fails binding on port #4347
- [CI] Canary is hanging-up #4363
- [CI] CI runs should output containerd / buildkitd logs #4365
- [CI] Run a local rekor instead of depending on availability of public service #4366
Third-party:
- P0: advanced: [CI]: Windows failure on pull:
UtilityVM: Incorrect function.: unknown#3524 - P0: [CI]: buildkit
Internal: not found#4142
Possibly EL8 / slow environments specific:
- P1: [LEGACY] [CI]: ipfs /root/.ipfs/api not available #4118
- P1: [LEGACY] [CI]: TestRestartWithSignal does not seem to (always?) work correctly (EL8 only?) #4068
- P1: [LEGACY] [CI]: NoneNetworkManager is presumably flaky wrt hostname #3971
Kube specific:
- P1 (minor, but annoying): [CI]: Kube failure on commit + save #4106
- to be confirmed this is still happening with containerd v2
Test currently disabled (link to documented issue):
- [URGENT] Regression? TestRunWithTtyAndDetached on windows appears broken on main #3437
- Is IPFS+estargz working? #3475
- see TestNetworkInspect (none and host inspection)
"Retry-them" tests that are clearly broken:
- [CI]: Syslog is flaky: TestSyslogNetwork TestSyslogFacilities #4141
- [CI]: OCI runtime start failed: cannot start a container that has stopped: unknown #4143
- [CI]: TestComposeUpWithExternalNetwork network failure #4146
- [CI]: TestLogsWithoutNewlineOrEOF flaky #4147
Others:
To confirm:
CI structural issues
- P1: [CI]: github cache is too aggressive on limiting requests (429) #3733
- P2: Tests that require
not-rootlessare getting skipped withtarget=docker(where the cli is not run as root) #3453
Tests to add
- Test login, push (and authenticated pull) against docker hub #3494
- Expert: Add testing for OCI hooks #3156
-v SRC:DST:rro,rprivateshould be tested in the CI #1989- CI: test the CRI log viewer #1957
- CI: add test for compose + restart #178
Enhancements: tigron
- [CI/tigron]: investigate file descriptor leak detection as a testing feature #4029
- [CI/tigron]: investigate go routine leak detection as a testing feature #4028
- [Tigron]: roadmap and tracking epic for work on test tooling #3448
Enhancements: generic
- dockerfile specific: [CI]: git clone revamp, part II #4031
- dockerfile specific: [CI] Epic: possible enhancements to current Dockerfile #4021
- [CI]: Discussion: should we drop testing inside a container? #3858
- [CI]: ghcr.io/containerd/stargz-snapshotter:0.15.1-kind needs an arm64 variant #3845
- We should have a publish scripts for the testing images we need, and we should not depend on third party images #3480
- [CI]: Disable test retries #3303
- Add harbor to our integration testing suite? #3257
- fix unit tests so that we can
racethem
Performance tracking
- Latest major disruption: [CI]: State of the CI #3924
- [CI]: Tracking status #3577
Ongoing work
Evergreen playground:
CI work in progress:
Reacted by Hayato Kiwata
Activity
apostasie commentedon Apr 17, 2025
@AkihiroSuda could we label
area CIandhelp wanted?apostasie commentedon Apr 17, 2025
@AkihiroSuda the following are ready (in order), at your convenience.
apostasie commentedon May 15, 2025
New round of CI PRs:
Shubhranshu153 commentedon Jun 17, 2025
Can we add this issue to the epic: #4322
apostasie commentedon Jun 17, 2025
Done.