overview / findings / pallets/click
Each entry is a real fix from the project's own history. Apply its patch and run the project's own suite, and the tests written in that same upstream commit fall.
| language | tests | green run, s | flaky runs | test files locked |
|---|---|---|---|---|
| python | 1,965 | 17.93 | 0/10 | 46 |
One of the pinned external suites the repair arbiter was run against, as listed on the benchmarks page (fixed values in site/build.py).
7 source line(s), 2 test(s) fall, deterministic over three runs. upstream fix 762c97eef7c1. the test that catches it was written by the same engineer in the same commit and was never touched.
file src/click/core.py · status reported · 2026-08-01
6 source line(s), 3 test(s) fall, deterministic over three runs. upstream fix 1241abaed4e4. the test that catches it was written by the same engineer in the same commit and was never touched.
file src/click/exceptions.py · status reported · 2026-08-01
2 source line(s), 1 test(s) fall, deterministic over three runs. upstream fix d340b0c12022. the test that catches it was written by the same engineer in the same commit and was never touched.
file src/click/core.py · status reported · 2026-08-01
8 source line(s), 7 test(s) fall, deterministic over three runs. upstream fix 0551bf53588a. the test that catches it was written by the same engineer in the same commit and was never touched.
file src/click/formatting.py · status reported · 2026-08-01