feat(skills): add eval-harness skill and eval command - #499
Conversation
Add eval-driven development (EDD) skill with capability/regression eval types, pass@k metrics, grader types, and workflow guidance. Add /eval command with define, check, report, list, and clean subcommands.
|
Caution Review failedThe pull request is closed. 📝 WalkthroughWalkthroughThis pull request adds two documentation files establishing eval-driven development practices: Changes
Estimated code review effort🎯 2 (Simple) | ⏱️ ~10 minutes Poem
✨ Finishing touches🧪 Generate unit tests (beta)
Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out. Comment |
# [5.27.0](v5.26.0...v5.27.0) (2026-02-15) ### Features * **skills:** add eval-harness skill and eval command ([#499](#499)) ([7054048](7054048))
Summary
skills/eval-harness/SKILL.md— eval-driven development (EDD) skill with capability/regression eval types, pass@k/pass^k metrics, code/model/human grader types, and define→implement→evaluate→report workflowcommands/eval.md—/evalslash command withdefine,check,report,list, andcleansubcommands for managing eval definitions in.claude/evals/Test plan
/evalcommand triggers correctly in Claude Code sessioneval-harnessskill loads when EDD-related queries are asked/eval define <name>creates eval definition file/eval listshows existing evalsSummary by CodeRabbit
Release Notes