Fact retention test


On 9 November 2026, Ink Balanced changed or dropped a checked fact in 5 of 20 eligible documents using the checker from Wang, Zhu and Chen (2026).

Documents with a fact changed or dropped

Lower is better
Documents with a fact changed or dropped. Lower is better. Wilson 95% intervals.
ToolChanged or dropped / eligible documents, percentage (Wilson 95% interval)
Ink Balanced5/20, 25.0% (11.2% to 46.9%)
HIX Bypass7/20, 35.0% (18.1% to 56.7%)
Superhumanizer7/20, 35.0% (18.1% to 56.7%)
UndetectedGPT7/20, 35.0% (18.1% to 56.7%)
Smart Humanizer8/20, 40.0% (21.9% to 61.3%)
GPTinf9/20, 45.0% (25.8% to 65.8%)
Rehumanize9/20, 45.0% (25.8% to 65.8%)
Clever AI Humanizer10/20, 50.0% (29.9% to 70.1%)
StealthGPT11/20, 55.0% (34.2% to 74.2%)
Undetectable AI11/20, 55.0% (34.2% to 74.2%)
AIHumanize13/20, 65.0% (43.3% to 81.9%)
WriteHuman13/20, 65.0% (43.3% to 81.9%)
Fig. 1. Ink tested 9 November 2026, other tools October 2026, on the same 20 documents. The intervals overlap. Wilson 95% intervals.

Facts and meaning

Facts and meaning. Lower fact-change rates and higher meaning scores are better.
ToolMeaning scoreShare of documents with a fact changed or dropped
AIHumanize0.91608484848484840.65
Clever AI Humanizer0.9137393939393940.5
GPTinf0.92087575757575760.45
HIX Bypass0.94478181818181820.35
Ink Balanced0.91894766064536240.25
Ink Light0.92289501469243880.15
Ink Strong0.89798817979977310.2
Rehumanize0.92171212121212120.45
Smart Humanizer0.95735757575757560.4
StealthGPT0.91926363636363640.55
Superhumanizer0.93795454545454560.35
Undetectable AI0.93234545454545440.55
UndetectedGPT0.9434212121212120.35
WriteHuman0.88310303030303030.65
Fig. 2. Meaning scores measure closeness to the source wording, which favours light edits. They do not measure accuracy. Intervals are in Fig. 1 and the tables. Closely spaced dots are separated slightly for readability.

Ink strengths: documents with a fact changed or dropped

Lower is better
Documents with a fact changed or dropped. Lower is better. Wilson 95% intervals.
ToolChanged or dropped / eligible documents, percentage (Wilson 95% interval)
Ink Light3/20, 15.0% (5.2% to 36.0%)
Ink Balanced5/20, 25.0% (11.2% to 46.9%)
Ink Strong4/20, 20.0% (8.1% to 41.6%)
Fig. 3. Light, Balanced and Strong on the same 20 eligible documents. Wilson 95% intervals.

What this measures

The paper’s checker looks for numbers and dates, names of people and organisations, and quotes of three words or more. A document passes only if every checked item survives. Results for the other tools come from the outputs the paper published.

How the check works

Source
Maya Chen said “the doors open tomorrow” before 24 guests arrived.

Rewrite
Before 24 42 guests arrived, Maya Chen said “the doors open tomorrow”.

Underlined: kept. Struck and replaced: changed number.

Fig. 4. Illustrative example, not Ink output.

Limits

Sources

Technical details
Documents with a fact changed or dropped. Lower is better. Wilson 95% intervals.
ToolChanged or dropped / eligible documents
Ink Balanced5/20, 25.0% (11.2% to 46.9%)
HIX Bypass7/20, 35.0% (18.1% to 56.7%)
Superhumanizer7/20, 35.0% (18.1% to 56.7%)
UndetectedGPT7/20, 35.0% (18.1% to 56.7%)
Smart Humanizer8/20, 40.0% (21.9% to 61.3%)
GPTinf9/20, 45.0% (25.8% to 65.8%)
Rehumanize9/20, 45.0% (25.8% to 65.8%)
Clever AI Humanizer10/20, 50.0% (29.9% to 70.1%)
StealthGPT11/20, 55.0% (34.2% to 74.2%)
Undetectable AI11/20, 55.0% (34.2% to 74.2%)
AIHumanize13/20, 65.0% (43.3% to 81.9%)
WriteHuman13/20, 65.0% (43.3% to 81.9%)

Meaning score

How close each rewrite stays to the source wording, by embedding similarity. Higher is closer, which favours light edits. It does not measure accuracy.

Mean across 33 documents.
Tool or runMeaning score
Smart Humanizer0.957
HIX Bypass0.945
UndetectedGPT0.943
Superhumanizer0.938
Undetectable AI0.932
Ink Light0.923
Rehumanize0.922
GPTinf0.921
StealthGPT0.919
Ink Balanced0.919
AIHumanize0.916
Clever AI Humanizer0.914
Ink Strong0.898
WriteHuman0.883

Retention and delivery

Delivered: completed, completed_with_warnings and needs_review, including unchanged source sections. Conservative: all source-eligible documents, missing output receives no credit. Unchanged output raises retention without showing rewriting quality. Kept-source markers do not prove every section was rewritten or identify affected units; needs_review always requires review.

Retention; rewritten-only alteration excludes identical outputs.
RunDelivered documentsConservative documentsDelivered unitsIdentical outputsDocuments with a fact changed or dropped among changed eligible documents. Lower is better.
Balanced (API default)15/20, 75.0% (53.1% to 88.8%)15/20, 75.0% (53.1% to 88.8%)79/94, 84.0% (75.3% to 90.1%)0/33 overall; 0/20 eligible5/20, 25.0% (11.2% to 46.9%)
Light17/20, 85.0% (64.0% to 94.8%)17/20, 85.0% (64.0% to 94.8%)88/94, 93.6% (86.8% to 97.0%)0/33 overall; 0/20 eligible3/20, 15.0% (5.2% to 36.0%)
Strong16/20, 80.0% (58.4% to 91.9%)16/20, 80.0% (58.4% to 91.9%)89/94, 94.7% (88.1% to 97.7%)2/33 overall; 2/20 eligible4/18, 22.2% (9.0% to 45.2%)
All 33 documents per run; warnings counts documents with warnings.
RunDeliveredneeds_reviewWarningsKept-source documents / sectionsIdentical outputsMissing output
Balanced (API default)33/3314120 / 000
Light33/3313110 / 000
Strong33/336115 / 3420

Commercial and strength runs

Documents with a fact changed or dropped, and altered units. Lower is better. Wilson 95% intervals.
ToolDocuments with a fact changed or droppedNumber/date unitsName unitsQuoted units
AIHumanize13/20, 65.0% (43.3% to 81.9%)11/56, 19.6% (11.3% to 31.8%)2/23, 8.7% (2.4% to 26.8%)15/15, 100.0% (79.6% to 100.0%)
Clever AI Humanizer10/20, 50.0% (29.9% to 70.1%)7/56, 12.5% (6.2% to 23.6%)5/23, 21.7% (9.7% to 41.9%)14/15, 93.3% (70.2% to 98.8%)
GPTinf9/20, 45.0% (25.8% to 65.8%)8/56, 14.3% (7.4% to 25.7%)1/23, 4.3% (0.8% to 21.0%)15/15, 100.0% (79.6% to 100.0%)
HIX Bypass7/20, 35.0% (18.1% to 56.7%)3/56, 5.4% (1.8% to 14.6%)0/23, 0.0% (0.0% to 14.3%)11/15, 73.3% (48.0% to 89.1%)
Ink (Balanced, API default)5/20, 25.0% (11.2% to 46.9%)7/56, 12.5% (6.2% to 23.6%)1/23, 4.3% (0.8% to 21.0%)7/15, 46.7% (24.8% to 69.9%)
Ink (Light)3/20, 15.0% (5.2% to 36.0%)1/56, 1.8% (0.3% to 9.4%)0/23, 0.0% (0.0% to 14.3%)5/15, 33.3% (15.2% to 58.3%)
Ink (Strong)4/20, 20.0% (8.1% to 41.6%)3/56, 5.4% (1.8% to 14.6%)2/23, 8.7% (2.4% to 26.8%)0/15, 0.0% (0.0% to 20.4%)
Rehumanize9/20, 45.0% (25.8% to 65.8%)4/56, 7.1% (2.8% to 17.0%)2/23, 8.7% (2.4% to 26.8%)12/15, 80.0% (54.8% to 93.0%)
Smart Humanizer8/20, 40.0% (21.9% to 61.3%)2/56, 3.6% (1.0% to 12.1%)8/23, 34.8% (18.8% to 55.1%)13/15, 86.7% (62.1% to 96.3%)
StealthGPT11/20, 55.0% (34.2% to 74.2%)13/56, 23.2% (14.1% to 35.8%)6/23, 26.1% (12.5% to 46.5%)14/15, 93.3% (70.2% to 98.8%)
Superhumanizer7/20, 35.0% (18.1% to 56.7%)2/56, 3.6% (1.0% to 12.1%)2/23, 8.7% (2.4% to 26.8%)14/15, 93.3% (70.2% to 98.8%)
Undetectable AI11/20, 55.0% (34.2% to 74.2%)5/56, 8.9% (3.9% to 19.3%)1/23, 4.3% (0.8% to 21.0%)12/15, 80.0% (54.8% to 93.0%)
UndetectedGPT7/20, 35.0% (18.1% to 56.7%)7/56, 12.5% (6.2% to 23.6%)1/23, 4.3% (0.8% to 21.0%)13/15, 86.7% (62.1% to 96.3%)
WriteHuman13/20, 65.0% (43.3% to 81.9%)13/56, 23.2% (14.1% to 35.8%)8/23, 34.8% (18.8% to 55.1%)15/15, 100.0% (79.6% to 100.0%)

Method and reproduction

Corpus: 56 number/date units, 23 name units, 15 quoted spans; 19 documents with numbers or names, six with quotes. Quoted examples count alongside reported speech; rewording can trigger the checker without making a statement false.

Wilson intervals: z = 1.96; units can depend on each other. Public English corpus: training overlap unknown. Federal corpus: pending, excluded.

Meaning: text-embedding-3-large cosine similarity, clipped to 0 to 1. Reproduction: 12 published rows; maximum absolute difference 0.001089.

Fact reproduction: all eleven commercial tools’ counts matched before live runs. Counts and intervals recomputed from committed text-free records. CSV commercial dates: month precision for October outputs.

Settings and run records

Balanced: standard customer path after staff-only test path disabled; no settings sent. Expected: Balanced, General context, Auto formality, shared profile, rewrite mode. Light and Strong: only strength set. API: no effective-settings attestation or model, deployment or API-version identifier. Unmodified checker: v1; spaCy 3.8.7, en_core_web_sm 3.8.0.

  • Balanced (API default): 9 November 2026, 12:17 to 12:25 UTC; eval/results/facts/2026-11-09-balanced.json
  • Light: 9 November 2026, 10:32 to 10:37 UTC; eval/results/facts/2026-11-09-light.json
  • Strong: 9 November 2026, 10:37 to 10:43 UTC; eval/results/facts/2026-11-09-strong.json

Balanced (API default): groups and categories

Completed without warnings or observed kept sections: 18 documents; retention 8/8, 100.0% (67.6% to 100.0%) (selected cohort).

  • All checked items: documents 15/20, 75.0% (53.1% to 88.8%); units 79/94, 84.0% (75.3% to 90.1%).
  • Numbers and dates: documents 10/13, 76.9% (49.7% to 91.8%); units 49/56, 87.5% (76.4% to 93.8%).
  • Names: documents 10/11, 90.9% (62.3% to 98.4%); units 22/23, 95.7% (79.0% to 99.2%).
  • Quoted spans: documents 3/6, 50.0% (18.8% to 81.2%); units 8/15, 53.3% (30.1% to 75.2%).
  • Numbers and names only: documents 15/19, 78.9% (56.7% to 91.5%); units 71/79, 89.9% (81.3% to 94.8%).
  • academic essay: documents 1/1, 100.0% (20.7% to 100.0%); units 1/1, 100.0% (20.7% to 100.0%).
  • application essay: documents 3/4, 75.0% (30.1% to 95.4%); units 5/8, 62.5% (30.6% to 86.3%).
  • blog post: documents 5/6, 83.3% (43.6% to 97.0%); units 37/45, 82.2% (68.7% to 90.7%).
  • business email: documents 1/3, 33.3% (6.1% to 79.2%); units 4/7, 57.1% (25.0% to 84.2%).
  • discussion board: documents 1/1, 100.0% (20.7% to 100.0%); units 3/3, 100.0% (43.8% to 100.0%).
  • marketing copy: documents 3/3, 100.0% (43.8% to 100.0%); units 6/6, 100.0% (61.0% to 100.0%).
  • news article: documents 1/2, 50.0% (9.5% to 90.5%); units 23/24, 95.8% (79.8% to 99.3%).

Light: groups and categories

Completed without warnings or observed kept sections: 18 documents; retention 8/8, 100.0% (67.6% to 100.0%) (selected cohort).

  • All checked items: documents 17/20, 85.0% (64.0% to 94.8%); units 88/94, 93.6% (86.8% to 97.0%).
  • Numbers and dates: documents 12/13, 92.3% (66.7% to 98.6%); units 55/56, 98.2% (90.6% to 99.7%).
  • Names: documents 11/11, 100.0% (74.1% to 100.0%); units 23/23, 100.0% (85.7% to 100.0%).
  • Quoted spans: documents 4/6, 66.7% (30.0% to 90.3%); units 10/15, 66.7% (41.7% to 84.8%).
  • Numbers and names only: documents 18/19, 94.7% (75.4% to 99.1%); units 78/79, 98.7% (93.2% to 99.8%).
  • academic essay: documents 1/1, 100.0% (20.7% to 100.0%); units 1/1, 100.0% (20.7% to 100.0%).
  • application essay: documents 4/4, 100.0% (51.0% to 100.0%); units 8/8, 100.0% (67.6% to 100.0%).
  • blog post: documents 4/6, 66.7% (30.0% to 90.3%); units 40/45, 88.9% (76.5% to 95.2%).
  • business email: documents 3/3, 100.0% (43.8% to 100.0%); units 7/7, 100.0% (64.6% to 100.0%).
  • discussion board: documents 1/1, 100.0% (20.7% to 100.0%); units 3/3, 100.0% (43.8% to 100.0%).
  • marketing copy: documents 3/3, 100.0% (43.8% to 100.0%); units 6/6, 100.0% (61.0% to 100.0%).
  • news article: documents 1/2, 50.0% (9.5% to 90.5%); units 23/24, 95.8% (79.8% to 99.3%).

Strong: groups and categories

Completed without warnings or observed kept sections: 22 documents; retention 8/9, 88.9% (56.5% to 98.0%) (selected cohort).

  • All checked items: documents 16/20, 80.0% (58.4% to 91.9%); units 89/94, 94.7% (88.1% to 97.7%).
  • Numbers and dates: documents 11/13, 84.6% (57.8% to 95.7%); units 53/56, 94.6% (85.4% to 98.2%).
  • Names: documents 9/11, 81.8% (52.3% to 94.9%); units 21/23, 91.3% (73.2% to 97.6%).
  • Quoted spans: documents 6/6, 100.0% (61.0% to 100.0%); units 15/15, 100.0% (79.6% to 100.0%).
  • Numbers and names only: documents 15/19, 78.9% (56.7% to 91.5%); units 74/79, 93.7% (86.0% to 97.3%).
  • academic essay: documents 1/1, 100.0% (20.7% to 100.0%); units 1/1, 100.0% (20.7% to 100.0%).
  • application essay: documents 4/4, 100.0% (51.0% to 100.0%); units 8/8, 100.0% (67.6% to 100.0%).
  • blog post: documents 4/6, 66.7% (30.0% to 90.3%); units 42/45, 93.3% (82.1% to 97.7%).
  • business email: documents 3/3, 100.0% (43.8% to 100.0%); units 7/7, 100.0% (64.6% to 100.0%).
  • discussion board: documents 1/1, 100.0% (20.7% to 100.0%); units 3/3, 100.0% (43.8% to 100.0%).
  • marketing copy: documents 1/3, 33.3% (6.1% to 79.2%); units 4/6, 66.7% (30.0% to 90.3%).
  • news article: documents 2/2, 100.0% (34.2% to 100.0%); units 24/24, 100.0% (86.2% to 100.0%).