Turn a writing skill into an eval: grading this series with Mizan
The capstone closes the loop: take the editorial standard behind these posts and encode it as a Mizan rubric that grades the series itself.
evals
4 posts with the tag “evals”
Beyond fuzzy text: turning LLM-as-a-judge into strongly-typed code with boul, choice, and score
Traditional LLM evals yield unstructured prose or require sprawling JSON schemas. Mizan introduces three strongly-typed decision primitives — boul, choice, and score — turning opaque eval SDKs into predictable developer code.
One spectrum, four users: from brand alignment to technical metrics
Four Mizan users sit on one spectrum, from "is this on-brand?" to "is this grounded and accurate?" The same machinery answers both. Only the criteria change.
Why evals, and what is an LLM-as-a-judge, really?
You already judge generative output by eye. An eval turns that private judgment into something explicit, repeatable, and shareable.