Free lessonsEvaluating LLMs and Agents
Evaluating LLMs and Agents
45 lessons
Lesson 23 · 2:04:18
搭建生产级 Agent Eval 流水线
Experiment：从 Trace、失败归因和评分器一路做到自动化实验，验证提示词改动是否真的有效。
Open this lesson on Bilibili量子菠萝_Bilibili seriesThe lesson is in Chinese and plays from Bilibili.
Not translated yet — showing the Chinese originals.
About the series
How AI evaluation differs from software testing, how to score and grade defects, then how to run batch evals with EvalScope and Langfuse.
- Who it is for
- Testers and engineers who need to accept a model or an agent, not just demo it.
- What you can do afterwards
- You can name the object, the metric, and the defect grade, then reproduce a batch run.
Training a whole team? It is arranged by scope. Book an evaluation