Free lessonsAgent Eval Graders and Hill-Climbing
Agent Eval Graders and Hill-Climbing
2 lessons
Lesson 2 · 39 min
Iterating Agent Eval with hill-climbing
Experiment：Start from a basic system prompt and use Eval scores to verify whether a QA loop and model change improve the Agent.
Open this lesson on Bilibili星小脉Bilibili seriesThe lesson is in Chinese and plays from Bilibili.
Not translated yet — showing the Chinese originals.
About the series
Using a slide-generation Agent as the case study, learn code-based, model-based, and human graders, consensus, pairwise comparison, and hill-climbing for iterative Agent evaluation.
- Who it is for
- Testers, engineers, and product teams who need graders, version comparisons, and an iterative Agent Eval workflow.
- What you can do afterwards
- Choose among grader types, understand consensus and pairwise comparison, and design an Agent evaluation loop from baseline to hill-climbing improvement.
Training a whole team? It is arranged by scope. Book an evaluation