Tag
LLM evaluation in production is three different problems bundled into one confused setup. Here's how to separate them, and what each one actually needs.
LLM-as-a-judge is appealing: cheap, automatic, and scalable. It fails in three specific, predictable ways that only become visible once your eval scores stop correlating with what users are actually complaining about.
Practical guides, product updates, and compliance notes — straight to your inbox. No fluff.
Newsletter is opening soon. We'll switch this on once we've got our first issue ready.