LLM-as-a-Judge
Using a strong model with a rubric to score other models’ outputs, at scale.
LLM-as-a-judge replaces brittle string matching for open-ended outputs: a capable model grades responses against a clear rubric. Done well it tracks human judgement cheaply; watch for position, verbosity, and self-preference bias, and validate the judge against human labels.