lennney/ticketpilot · Archived

rag-evaluation

Use when modifying retrieval, chunking, RRF, rerank, citation, answer grounding, or evaluation scripts.

First seen Jun 18, 2026

Installation

$ npx skills add lennney/ticketpilot --skill rag-evaluation

Stronger alternatives

This repository is archived — consider an actively maintained alternative.

Similar popular skills

Related neighbors and high-traction skills in the same topics — useful to compare before installing.

Also in this package

Other skills from lennney/ticketpilot.

npx skills add lennney/ticketpilot

Browse all from lennney/ticketpilot

More details

Agent compatibility

Declared targets from SKILL.md / docs. Unmarked agents are not listed — the skill may still install via the CLI.

Claude Code Not declared
Cursor Not declared
Codex Not declared
GitHub Copilot Not declared
Windsurf Not declared
Gemini CLI Not declared
Cline Not declared
OpenCode Not declared

Repository health

License LICENSE
Default branch master
Open issues 3
Status Archived

Package contents

Files included with this skill beyond the listing page.

  • skill md SKILL.md 607 B
  • docs SUMMARY.md 125 B

History

  1. First seen on skills.sh
  2. First recorded snapshot · 1 installs

SKILL.md

RAG Evaluation

Required metrics:

  • Recall@3
  • Recall@5
  • MRR
  • citation correctness
  • evidence support rate
  • unsupported claim rate

Rules:

  1. Do not use vector-only retrieval for the MVP.
  2. Keep FAQ, Policy, and Case source types visible in retrieval outputs.
  3. Retrieval trace must preserve query, keyword results, vector results, fused results, final evidence, scores, doc_type, and source ids.
  4. Do not claim improvement without running evaluation.