Enforce a hard cap and a drift-check when a cheap executor model consults an expensive advisor model, and compute the effective cost from actual call counts instead of a benchmark's assumed rate.
Enforce a hard cap and a drift-check when a cheap executor model consults an expensive advisor model, and compute the effective cost from actual call counts instead of a benchmark's assumed rate.
Use when the user adopts the advisor or orchestrator pattern, pairs a cheap model with an expensive reviewer, or quotes a benchmark discount like "63% of the price".
Stronger alternatives
This repository is archived — consider an actively maintained alternative.
Declared targets from SKILL.md / docs. Unmarked agents are not listed — the skill may still install via the CLI.
Claude CodeNot declared
CursorNot declared
CodexNot declared
GitHub CopilotNot declared
WindsurfNot declared
Gemini CLINot declared
ClineNot declared
OpenCodeNot declared
Repository health
Stars18
LicenseLICENSE
Default branchmain
Open issues0
Status
Archived
Package contents
Files included with this skill beyond the listing page.
skill mdSKILL.md4,498 B
docsSUMMARY.md388 B
History
First seen on skills.sh
First recorded snapshot · 3 installs
SKILL.md
Cap the advisor, catch the drift, compute the real discount
The advisor pattern (a cheap model executes; an expensive model is consulted rarely) is only as cheap as the word "rarely". The user is about to adopt it on the strength of a benchmark number. Your job is to make the savings enforceable instead of assumed: a hard cap on advisor calls, a drift-check so the executor can't run unchecked, and an effective-cost number computed from what actually happened.
Steps
Write down the pair with real unit prices: the executor model and the advisor model, each with usdpermtok_out from the current pricing page (never from memory). The reference result this pattern leans on: Anthropic's internal eval had Sonnet 5 executing with Fable 5 advising about once per task, landing ~92% of Fable's SWE-bench Pro score at ~63% of the price. That is their task and their call rate, not the user's.
Set maxadvisorcalls for the task, a hard cap, not a hope. An uncapped advisor erodes the discount one "just checking" call at a time.
Set driftcheckeverynsteps: past this many executor steps, the executor must get a fresh advisor check-in before continuing. Between check-ins the executor can silently drift from the advice it was given; this bounds how far.
After (or while) running, record advisorcallsactual and compute the effective cost from the actual call mix. Compare it against the benchmark's assumed rate. If the task pulled the advisor in more often than "about once", the real discount is smaller than the quoted one, say by how much.
Run the proof below. It fails on a missing cap, a missing drift-check, or an actual call count that blew the budget.
Prove it
```bash verify cat > advisor-task.json <<'JSON' { "executor": { "model": "sonnet-5", "usdpermtokout": 15 }, "advisor": { "model": "fable-5", "usdpermtokout": 50 }, "maxadvisorcalls": 3, "driftcheckeverynsteps": 5, "task": { "steps": 20, "advisorcallsactual": 2 } } JSON node -e ' const c = JSON.parse(require("fs").readFileSync("advisor-task.json", "utf8")); function bad(m) { console.error("BAD: " + m); process.exit(1); } if (!c.maxadvisorcalls || c.maxadvisorcalls < 1) bad("set a hard maxadvisorcalls, an uncapped advisor erodes the discount"); if (!c.driftcheckeverynsteps || c.driftcheckeverynsteps < 1) bad("set driftcheckeverynsteps so the executor cannot run unchecked forever"); const t = c.task || {}; if (t.advisorcallsactual == null) bad("record advisorcallsactual so the real rate can be compared to the assumed one"); if (t.advisorcallsactual > c.maxadvisorcalls) bad("advisorcallsactual exceeds maxadvisorcalls, the budget was not enforced"); const mix = t.advisorcallsactual / (t.steps || 1); const eff = ((1 - mix) c.executor.usdpermtokout + mix c.advisor.usdpermtokout) / c.advisor.usdpermtokout; console.log("advisor OK: cap " + c.maxadvisorcalls + ", actual " + t.advisorcalls_actual + " call(s) over " + t.steps + " steps; effective cost ~" + Math.round(eff * 100) + "% of pure-advisor rate"); '
## Guardrails
- Never present 63% (or any benchmark discount) as the user's number. It was measured on two specific benchmarks with a specific call rate; their workload has neither.
- The pattern assumes hard reasoning concentrates at a few forks. If difficulty is spread evenly across the task, one check-in per task misses it and the executor drifts uncaught, that workload should not use this pattern.
- If the job is easy, skip the pattern entirely and run the cheap model alone. Orchestration only pays for itself on hard, multi-step work.
- Don't let the planner grade its own plan. If advisor and executor share a wrong assumption, this setup amplifies it with confidence; put an objective check (test, schema, known answer) wherever correctness matters.
---
<sub>Backed by a machine-verified recipe, re-checked by CI: [Advisor pattern: cap how often the expensive model gets called](https://flowstacks.xyz/workflows/advisor-pattern-call-budget-and-drift-check)</sub>