Blog

Evaluating the Evaluator: The Engeler Equation and Early Results

Evaluating the Evaluator: The Engeler Equation and Early Results

Nina
December 3, 2024
Training an LLM-as-a-Judge with Synthetic Data

Training an LLM-as-a-Judge with Synthetic Data

Andrei
November 25, 2024

Latest posts

Evaluating the Evaluator: The Engeler Equation and Early Results

Evaluating the Evaluator: The Engeler Equation and Early Results

Nina
December 3, 2024
Training an LLM-as-a-Judge with Synthetic Data

Training an LLM-as-a-Judge with Synthetic Data

Andrei
November 25, 2024
Judge or Jury: What’s the right approach for LLM evaluation?

Judge or Jury: What’s the right approach for LLM evaluation?

Maurice
November 19, 2024
LLM Evaluation Tooling - A Review

LLM Evaluation Tooling - A Review

Josh
November 12, 2024
LLM Judges as Reward Models

LLM Judges as Reward Models

Henry
October 31, 2024
Selecting a training objective for an AI evaluator (SFT vs. DPO vs. RPO)

Selecting a training objective for an AI evaluator (SFT vs. DPO vs. RPO)

Andrei
October 22, 2024
Evaluating GenAI applications with LLM‑as‑a‑judge

Evaluating GenAI applications with LLM‑as‑a‑judge

Kyle
October 8, 2024
“AI’s $600B Question” and AGI’s $34T Answer

“AI’s $600B Question” and AGI’s $34T Answer

Maurice
September 10, 2024
Scaling Alignment: Training AI Evaluators to Capture Human Preferences

Scaling Alignment: Training AI Evaluators to Capture Human Preferences

Maurice
July 11, 2024