PDF benchmark v0.1.1 / PDF Redaction
PDF Redaction on extraction-conditions-1
Web app · published by Mykola Melnyk (Redaction Tools)
Leak rate
22.2%
95% interval 13.2–34.9% · n = 54
Self-scored · verifiedLeaked 12 of 54 sensitive values (22.2%).
- Over-redaction
- —
- Text kept (worst case)
- 93.2%
- Cases covered
- 1 of 1 cases
- Document damaged
- None
Where the leaks are
| Layer | Leaked here | Only here | If it survives |
|---|---|---|---|
| ocr high | 9.3%4.0–19.9% 5 of 54 | 0.0%0.0–6.6% 0 of 54 | catches translucent or hairline covers |
| metadata high | 0.0%0.0–6.6% 0 of 54 | 0.0%0.0–6.6% 0 of 54 | invisible, survives forwarding |
| annotation high | 0.0%0.0–6.6% 0 of 54 | 0.0%0.0–6.6% 0 of 54 | shown by many viewers |
| attachment high | 0.0%0.0–6.6% 0 of 54 | 0.0%0.0–6.6% 0 of 54 | one toggle away |
| font_subset low | 0.0%0.0–6.6% 0 of 54 | 0.0%0.0–6.6% 0 of 54 | narrows the value; partial disclosure |
| image_xobject critical | 0.0%0.0–6.6% 0 of 54 | 0.0%0.0–6.6% 0 of 54 | a crop is a view, not a deletion |
| content_stream critical | 3.7%1.0–12.5% 2 of 54 | 0.0%0.0–6.6% 0 of 54 | copy-paste, pdftotext, any parser |
| prior_revision critical | 0.0%0.0–6.6% 0 of 54 | 0.0%0.0–6.6% 0 of 54 | 'save' instead of export; trivially recovered |
| rendered_pixels critical | 22.2%13.2–34.9% 12 of 54 | 11.1%5.2–22.2% 6 of 54 | visible to anyone who opens the file |
| optional_content high | 0.0%0.0–6.6% 0 of 54 | 0.0%0.0–6.6% 0 of 54 | one toggle away |
By category
| category | Leak rate | Over-redaction |
|---|---|---|
| PERSON | 22.2%13.2–34.9% 12 of 54 | — not measured |
By severity
| severity | Leak rate | Over-redaction |
|---|---|---|
| high | 22.2%13.2–34.9% 12 of 54 | — not measured |
By trap
| trap | Leak rate | Over-redaction |
|---|---|---|
| nan | 22.2%13.2–34.9% 12 of 54 | — not measured |
Removed, by where the value lives
- image_text
- 70.4%51.5–84.1%
19 of 27
- text_layer
- 85.2%67.5–94.1%
23 of 27
What was not measured
Every layer was read in every run.
Provenance
- Scored with
- pdfredeval (submitter’s copy)
- Engines
- ocr tesseract · pypdf 6.19.0 · pdfium 153.0.7999.0 · renderer pypdfium2 · pypdfium2 5.13.0 · tesseract tesseract 5.5.2
- Alignment
- fiducial, residual 0.348 px
- Run id
- 20260925T081446-pdf-redaction-web-extraction-conditions-1-a1-21dbff