Free lessonsEvaluating LLMs and Agents
Evaluating LLMs and Agents
45 lessons
Lesson 37 · 3:44
Choosing between custom and framework-based Agent evals
Experiment：Choose between a custom eval stack and an existing framework based on isolation, monitoring, and data requirements.
Open this lesson on Bilibili慢学AIBilibili seriesThe lesson is in Chinese and plays from Bilibili.
Not translated yet — showing the Chinese originals.
About the series
How AI evaluation differs from software testing, how to score and grade defects, then how to run batch evals with EvalScope and Langfuse.
- Who it is for
- Testers and engineers who need to accept a model or an agent, not just demo it.
- What you can do afterwards
- You can name the object, the metric, and the defect grade, then reproduce a batch run.
Training a whole team? It is arranged by scope. Book an evaluation