Machine learning
Evaluating LLM systems
Knowing whether a change made your AI feature better or worse. Test sets, graders and reading lots of outputs.
About 8 hours of study.
Where to learn it
Read
Your AI product needs evals
Hamel Husain
The whole post, then the follow-ups it links
Section not checked yet
Watch
No video course picked yet.
Suggest onePractise
No practice set picked yet.
Suggest oneWhich roles ask for it
- AI / LLM engineer to get hired
Before and after
Evaluating LLM systems