Redaction Tools

PDF benchmark v0.1.1 / AI-Redact

AI-Redact on extraction-conditions-1

Web app · published by Mykola Melnyk (Redaction Tools)

Leak rate

44.4%

95% interval 32.0–57.6% · n = 54

Self-scored · verified

Leaked 24 of 54 sensitive values (44.4%).

Over-redaction: —
Text kept (worst case): 95.1%
Cases covered: 1 of 1 cases
Document damaged: None

Where the leaks are

Layer	Leaked here	Only here	If it survives
ocr high	22.2%13.2–34.9% 12 of 54	0.0%0.0–6.6% 0 of 54	catches translucent or hairline covers
metadata high	0.0%0.0–6.6% 0 of 54	0.0%0.0–6.6% 0 of 54	invisible, survives forwarding
annotation high	0.0%0.0–6.6% 0 of 54	0.0%0.0–6.6% 0 of 54	shown by many viewers
attachment high	0.0%0.0–6.6% 0 of 54	0.0%0.0–6.6% 0 of 54	one toggle away
font_subset low	0.0%0.0–6.6% 0 of 54	0.0%0.0–6.6% 0 of 54	narrows the value; partial disclosure
image_xobject critical	0.0%0.0–6.6% 0 of 54	0.0%0.0–6.6% 0 of 54	a crop is a view, not a deletion
content_stream critical	16.7%9.0–28.7% 9 of 54	0.0%0.0–6.6% 0 of 54	copy-paste, pdftotext, any parser
prior_revision critical	0.0%0.0–6.6% 0 of 54	0.0%0.0–6.6% 0 of 54	'save' instead of export; trivially recovered
rendered_pixels critical	44.4%32.0–57.6% 24 of 54	18.5%10.4–30.8% 10 of 54	visible to anyone who opens the file
optional_content high	0.0%0.0–6.6% 0 of 54	0.0%0.0–6.6% 0 of 54	one toggle away

By category

category	Leak rate	Over-redaction
PERSON	44.4%32.0–57.6% 24 of 54	— not measured

By severity

severity	Leak rate	Over-redaction
high	44.4%32.0–57.6% 24 of 54	— not measured

By trap

trap	Leak rate	Over-redaction
nan	44.4%32.0–57.6% 24 of 54	— not measured

Removed, by where the value lives

image_text: 63.0%44.2–78.5%
17 of 27
text_layer: 48.1%30.7–66.0%
13 of 27

What was not measured

Every layer was read in every run.

Provenance

Scored with: pdfredeval (submitter’s copy)
Engines: ocr tesseract · pypdf 6.19.0 · pdfium 153.0.7999.0 · renderer pypdfium2 · pypdfium2 5.13.0 · tesseract tesseract 5.5.2
Alignment: fiducial, residual 0 px
Run id: 20260925T081446-ai-redact-web-extraction-conditions-1-a1-60bfda