Chip Huyen
Author of Designing Machine Learning Systems and AI Engineering.
2 evidence links
← Discover
Evaluation
Hire for a quality bar that is not a vibe check
Golden sets, graders, traces, and the suite that runs when something moves.
11Published profiles in this specialty
100%Of those rows attach evidence
8Capabilities in the taxonomy
Why hire through this index
Evaluation is the capability that makes the others honest. Profiles that list it should show a harness, a rubric, or a public eval toolkit — not a screenshot of a happy chat.
Available evaluation
11 published profiles listing this capability.
Eugene Yan
Applied scientist; the patterns catalogue for LLM-based systems.
2 evidence links
Hamel Husain
Independent ML consultant; the field notes on LLM evaluation.
2 evidence links
Harrison Chase
LangChain co-founder; agent orchestration with tracing and evaluation attached.
2 evidence links
Jason Liu
Instructor — typed, validated structured output from language models.
2 evidence links
Lilian Weng
Survey-grade write-ups on agents, hallucination, and reward hacking.
2 evidence links
Omar Khattab
ColBERT and DSPy — late-interaction retrieval and compiled LLM pipelines.
2 evidence links
Sebastian Raschka
Build a Large Language Model (From Scratch); monthly LLM research reviews.
2 evidence links
Shreya Shankar
DocETL, and research on operationalising LLM pipelines over messy data.
2 evidence links
Ada ExampleDemo
Retrieval systems with an eval harness, not a demo notebook.
Remote · Selectively available · 2 evidence links
Mina ExampleDemo
Prompting and guardrails for tasks that must not hallucinate.
Toronto · Selectively available · 2 evidence links
Frequently asked
Can evaluation stand alone as a hire?
Yes. Some teams need someone to build the harness before they hire the feature owner. Others need evals attached to RAG or prompting — filter accordingly.