overview / findings / pallets/markupsafe

pallets/markupsafe: 4 upstream defects

Each entry is a real fix from the project's own history. Apply its patch and run the project's own suite, and the tests written in that same upstream commit fall.

the suite it was checked against

language	tests	green run, s	flaky runs	test files locked
python	80	0.96	0/10	7

One of the pinned external suites the repair arbiter was run against, as listed on the benchmarks page (fixed values in site/build.py).

the defects

raise error on missing single placeholder

7 source line(s), 2 test(s) fall, deterministic over three runs. upstream fix 3d809aed7b7b. the test that catches it was written by the same engineer in the same commit and was never touched.

file src/markupsafe/__init__.py · status reported · 2026-08-01

git apply bench/evidence/2026-08-01-real-defect-mine/patches/markupsafe-mod-single-placeholder.patch && <the project's own suite>

relax speedups str check

2 source line(s), 1 test(s) fall, deterministic over three runs. upstream fix 8cb1691ca038. the test that catches it was written by the same engineer in the same commit and was never touched.

file src/markupsafe/_speedups.c · status reported · 2026-08-01

git apply bench/evidence/2026-08-01-real-defect-mine/patches/markupsafe-speedups-str-subclass-check.patch && <the project's own suite>

collapse spaces after stripping tags

5 source line(s), 1 test(s) fall, deterministic over three runs. upstream fix 0b6bee071fbd. the test that catches it was written by the same engineer in the same commit and was never touched.

file src/markupsafe/__init__.py · status reported · 2026-08-01

git apply bench/evidence/2026-08-01-real-defect-mine/patches/markupsafe-striptags-collapse-spaces.patch && <the project's own suite>

match newlines when stripping tags

4 source line(s), 1 test(s) fall, deterministic over three runs. upstream fix e49d257126d0. the test that catches it was written by the same engineer in the same commit and was never touched.

file src/markupsafe/__init__.py · status reported · 2026-08-01

git apply bench/evidence/2026-08-01-real-defect-mine/patches/markupsafe-striptags-dotall-newlines.patch && <the project's own suite>