nvidia/nemo-agent-toolkit · Archived

nat-evaluation

Use when designing, configuring, running, or troubleshooting NeMo Agent Toolkit evaluations, datasets, evaluator selection, ATIF surfaces, quality gates, custom evaluators, and `nat eval`.

First seen Jun 10, 2026

Installation

$ npx skills add nvidia/nemo-agent-toolkit --skill nat-evaluation

Stronger alternatives

This repository is archived — consider an actively maintained alternative.

Similar popular skills

Related neighbors and high-traction skills in the same topics — useful to compare before installing.

Also in this package

Other skills from nvidia/nemo-agent-toolkit · top by installs.

npx skills add nvidia/nemo-agent-toolkit

Browse all from nvidia/nemo-agent-toolkit

More details

Agent compatibility

Declared targets from SKILL.md / docs. Unmarked agents are not listed — the skill may still install via the CLI.

Claude Code Not declared
Cursor Not declared
Codex Not declared
GitHub Copilot Not declared
Windsurf Not declared
Gemini CLI Not declared
Cline Not declared
OpenCode Not declared

Repository health

Stars 2.6K
License LICENSE-3rd-party.txt
Default branch develop
Open issues 21
Status Archived

Skill metadata

Parsed from SKILL.md frontmatter.

LicenseApache-2.0

Package contents

Files included with this skill beyond the listing page.

  • skill md SKILL.md 929 B
  • docs SUMMARY.md 210 B

History

  1. First seen on skills.sh
  2. First recorded snapshot · 4 installs

SKILL.md

NeMo Agent Toolkit Evaluation

Use this skill for measuring agent quality and behavior.

Workflow

  1. Decide the evaluation surface and output format.
  2. Decompose quality goals into separate evaluators.
  3. Choose built-in evaluators before writing custom evaluators.
  4. Keep datasets small and explicit for local validation.
  5. Run nat eval and inspect generated artifacts.

References

  • references/operating-mode.md
  • references/methodology.md
  • references/agent-eval-framework.md
  • references/evaluation-surfaces.md
  • references/evaluation-contract.md
  • references/evaluators/
  • references/code-patterns.md