Northstar Mutual · Evidence-backed evaluationWork stays in this browser.
Evaluate field proposals
Compare proposed fields with their exact sources before a person reviews the claim.
Step 1: Inspect proposal
01 · A CITATION IS A START
Does the evidence support this field?
The reference facts and spans are authored labels for these fixtures. The checks do not establish general semantic entailment. Source supersession is explicit metadata, not an inferred resolution of a disagreement.
A 0.99 self-reported confidence does not make 5,400 supported by a quote saying 540.
cedar · C-201 · source revision 0. Confidence values are self-reported examples, not calibrated probabilities.
Available source evidence
claim-form · Submitted claim form
C-201 reports a claimed amount of 540.
estimate · Supporting estimate
The synthetic estimate totals 540. An adjuster must still review the fields. There is no coverage or settlement decision in this exercise.
Offsets count Unicode code points. A missing required source is not replaced by a confident proposal.
The proposed fields
claimId: C-201
Self-reported confidence: 0.92
cedar / claim-form · [0, 5)
amount: 5400
Self-reported confidence: 0.99
cedar / claim-form · [34, 37)
02 · KEEP FALSE ACCEPTS VISIBLE
What does a green result hide?
Compare the policies on the same hand-picked fixture set. Reference-ready means supported, complete fields with eligible evidence; confidence is not part of that reference label. A confidence threshold can still hold a reference-ready case.
3/13sent to human review
0false accepts against the reference
1reference-ready proposals held
Coverage: 23.1%. Precision among accepted cases: 100.0%. These fixture proportions are not production accuracy or population estimates.
Current policy guarded · threshold 0.8 · all
Case
Reference-ready
Current route
Assessment
E1
Yes
human_review
Matches reference disposition
E2
No
hold
Matches reference disposition
E3
No
hold
Matches reference disposition
E4
No
hold
Matches reference disposition
E5
No
hold
Matches reference disposition
E6
No
hold
Matches reference disposition
E7
Yes
human_review
Matches reference disposition
E8
No
hold
Matches reference disposition
E9
No
hold
Matches reference disposition
E10
Yes
hold
Supported proposal held
E11
No
hold
Matches reference disposition
E12
No
hold
Matches reference disposition
E13
Yes
human_review
Matches reference disposition
03 · EXECUTE THE SAME CHECKS
A proposal stays outside the claim record.
The updated local project has the same authored corpus, a Python evaluator, a guarded proposal API, and proposal controls in the review UI. Confidence-only and document-ID policies are comparison illustrations; the API always uses guarded checks at 0.8.
Open http://127.0.0.1:8000/review. Evaluate a proposal, inspect the source quotes, and complete human review separately. A changed source revision rejects a new stale proposal; earlier evaluations remain inspectable and are marked no longer current. No proposed value is automatically written into the claim.
Exercise results and exports stay in this browser.
northstar-extraction-2026-11-18.1. The corpus is authored and deliberately includes failure cases. No live-model, OCR, general semantic-grounding, or hiring claim is made.