latitude-dev/eval-skills

1

llm-judge-alignment Use this skill when a developer wants to validate how well their LLM judge aligns with human judgment. Triggers on: "…

latitude-dev/eval-skills

10

2

llm-annotation-guide Use this skill when a developer wants to annotate their LLM outputs, set up an annotation process, or improve existin…

latitude-dev/eval-skills

9

3

llm-judge-creator Use this skill when a developer wants to create LLM-as-a-judge evaluators for their AI system. Triggers on: "create a…

latitude-dev/eval-skills

9

4

llm-eval-type-selector Use this skill when a developer wants to decide what type of evaluation to build for their AI system. Triggers on: "s…

latitude-dev/eval-skills

8

5

llm-evals-audit Use this skill when a developer wants to check whether their existing evaluations are trustworthy and well-targeted. …

latitude-dev/eval-skills

8

6

llm-evals-checklist Use this skill when a developer wants to check if they're ready to build evaluations for their AI system. Triggers on…

latitude-dev/eval-skills

8

7

llm-golden-dataset-builder Use this skill when a developer wants to build or expand a golden dataset for regression testing. Triggers on: "build…

latitude-dev/eval-skills

8

8

llm-issue-discovery Use this skill when a developer wants to find out what's going wrong with their LLM or AI system in production. Trigg…

latitude-dev/eval-skills

8

9

llm-regression-runner Use this skill when a developer wants to test a prompt change against a golden dataset and see what broke. Triggers o…

latitude-dev/eval-skills

8