SKILL.md
Fix-Verify Loop
Leave fixes staged and return their paths plus one outcome per finding.
The caller owns regression detection, new-issue discovery, and whole-diff review.
Verification scope
- Focused checks: Fixers and verifiers run the narrowest check that proves the assigned finding, plus directly affected tests.
- Broad suites: Run a subsystem or full-project suite inside this loop only for shared test infrastructure, order dependence, or a finding reproducible only in that suite; the caller owns every other broad gate.
- Harness exits: After test bodies pass, retry a harness that fails to exit only when a new hypothesis distinguishes the rerun.
Protocol
Input
- Findings: Confirmed P0/P1 findings conforming to the [Output Schema](#output-schema).
- Artifact paths: Files the resolver may edit.
- Criteria: Original requirements each fix must satisfy.
Intake filter: Process only findings with verdict = "confirmed" and severity in ["P0", "P1"]. The caller owns confirmation quality; finding source does not affect intake. Leave P2/P3 findings with the caller.
Pre-gate: Route each finding by validated_by before mutation; treat a missing field as null.
validated_by |
Action |
|---|---|
null or reviewer |
Independently verify. |
verifier |
Skip the pre-gate. |
machine |
Skip only when evidence names the exact check and observed failure, and the finding states only what that result proves; otherwise verify. |
Confidence measures certainty; it never changes this routing.
Complete the pre-gate for findings that require independent verification before any mutation; skipped findings proceed directly to Round 1:
- Batch. Group those findings by shared files, symbols, call chains, or reported root cause. Put at most four findings in each batch.
- Dispatch. Run up to four
verifieragents concurrently and queue the rest. Repository rules that forbid overlapping checks override this limit. Give each verifier:
- Artifact: the files or surrounding context for its batch. - Findings: every finding in its batch. - Criteria: "Is each finding real?" - Output contract: a ReviewOutput envelope with one verdict per finding.
- Collect. Wait for every batch before Round 1. A missing or unparseable verdict makes only that finding inconclusive.
- Route. Route each finding independently:
- rejected → add to dropped and skip the fix loop. - confirmed → proceed to Round 1. - demoted to P0/P1 → proceed to Round 1. - demoted to P2/P3 → add to demoted and skip the fix loop. - inconclusive → proceed to Round 1 without consuming a fix attempt.
Conflict-group loop
Group surviving findings by shared files, symbols, call chains, tests, mutable artifacts, behavior, or root cause. Keep groups to four findings unless one root cause cannot split safely.
- Fix in parallel. Run one fixer per group. Dispatch every proven-disjoint group concurrently up to agent capacity; queue known or uncertain overlap. Repository concurrency rules override dispatch.
- Verify in parallel. Verify a completed group while unrelated fixers continue. Give each verifier up to four related findings, and run verifier batches concurrently unless their checks share mutable resources or repository rules forbid overlap. Wait when an active fixer could affect the files, behavior, or checks under verification.
- Account separately. Keep each finding's verdict, attempt count, bucket, and escalation state independent even when one fixer or verifier handles the group.
- Stage serially. The parent stages one group at a time. Fixers never stage files.
Give each finding at most two attempts. Proven-disjoint groups may occupy different rounds concurrently.
Include these rules in every fix-subagent brief:
- Git writes. Keep Git mutations within assigned files; never run
git stash,git checkout -- .,git reset, or another whole-tree command. - Git index. Do not run
git addor otherwise change the Git index; the parent stages each group for verification. - Git reads. Keep Git reads within assigned paths.
- Committed baseline. Read a committed baseline without changing shared state with
git show HEAD:<path>. - Edit scope. Do not edit outside the group's approved paths.
- Expansion request. When a fix needs more files, return
{ needsscopeexpansion: true, additional_files: [paths], justification: string }before editing them. - Expansion decision. Use
AskUserQuestionwith "Approve expanded scope", "Reject — fix within original scope only", and "Defer this finding"; recommend approval with the justification and file list. - Approved expansion. After approval, add the files to verification, regroup any overlapping findings, and re-dispatch the fixer.
- Test failures. For a test failure, inspect the code and test, decide which is wrong, and fix that side.
Staging safety
Apply this check to each group in each round:
- Snapshot. Before dispatching the fixer, record
git diff --staged --binary -- <group's approved artifact paths>. - Detect index changes. After the fixer returns, compare the staged diff with the snapshot. On mismatch, report the change and ask how to proceed; do not stage over it.
- Validate paths. Confirm every path in
files_changedbelongs to the group's approved artifact paths. On mismatch, report the out-of-scope paths and ask how to proceed; do not stage them. - Check existing hunks. When the snapshot contains hunks in
files_changed, proceed only if every hunk belongs to an earlier resolved finding in this invocation or exactly matches this group's recorded earlier attempt. Otherwise, inspect the hunks and ask the user:
- Small unrelated hunks without line overlap → recommend "Commit pre-existing first". - Large, sprawling, or overlapping hunks → recommend "Stash pre-existing". - Hunks that continue the fix → recommend "Proceed (treat as part of this fix)". - Use AskUserQuestion with those three options, put the recommendation first with (Recommended), and summarize the hunks in one line.
- Stage. After the checks pass, run
git add <files_changed>for one group at a time. Record the exact path-scoped staged binary diff for the group's next round.
Round 1 — Fix + Verify
- Fix. Apply staging-safety Step 1, then spawn one fix subagent per conflict group with every finding, approved path, and violated criterion in that group. It edits the working tree and returns
{ fileschanged: [paths], summary: string, findingsummaries: [{ id: Finding.id, summary: string }], concerns: [string] | null }. - Stage. Apply staging-safety Steps 2–5 without committing.
- Verify. Dispatch the group's findings in related batches of at most four. Each verifier receives:
- Artifact: the exact staged diff captured for the group's files after staging - Findings: every finding in its verification batch - Criteria: "Is each finding resolved?" and no broader review - Output contract: a ReviewOutput envelope with one verdict per finding
- Decide. Map each finding's verdict independently:
| Verdict | Action |
|---|---|
confirmed |
Still P0/P1 → proceed to Round 2. |
rejected |
Add to resolved → done. |
demoted to P0/P1 |
Proceed to Round 2. |
demoted to P2/P3 |
Add to demoted → done. |
| Inconclusive — crash, malformed output, or no verdict for this finding | Count the attempt → proceed to Round 2. |
Round 2 — Fix + Verify
Regroup the P0/P1 findings that survive Round 1 using the same conflict test. Proven-disjoint groups may enter Round 2 while other groups finish Round 1.
- Fix. Apply staging-safety Step 1, then spawn one fixer per surviving group with each finding's Round 1 attempt, failure reason, and verifier evidence. Use the Round 1 return shape.
- Stage. Apply staging-safety Steps 2–5 without committing.
- Verify. Use the Round 1 verification dispatch for the surviving findings.
- Decide. Map each finding's verdict independently:
| Verdict | Action |
|---|---|
confirmed |
Add to escalated → escalate. |
rejected |
Add to resolved → done. |
demoted to P0/P1 |
Add to escalated → escalate. |
demoted to P2/P3 |
Add to demoted → done. |
| Inconclusive | Count the attempt, add to escalated, and escalate. |
Escalation
For each finding still unresolved after Round 2:
- Stop. Do not attempt Round 3 for this finding.
- Present its
findingsummariesentries in this shape; derive the staged line withgit diff --staged --stat -- <fileschanged>:
`` Escalated — finding not resolved after 2 attempts: - Finding: [ID — title] - Attempted: [Round 1 summary] → [Round 2 summary] - Still unresolved: [verifier's evidence | verifier inconclusive] - Currently staged: [e.g. "R2's changes to auth.js, +12/-4 lines" | nothing staged] ` Then use AskUserQuestion` with "Manual fix", "Try a different approach", "Defer this finding", and "Discard R2 changes and revert"; recommend "Defer this finding".
After all findings are processed, return a [FixVerifyLoopOutput](#fixverifyloopoutput) envelope. Set files_changed to the deduplicated validated paths whose fix-loop changes remain staged.
Output Schema
FixVerifyLoopOutput
The skill returns this envelope after all findings are processed:
{
files_changed: [string, ...], // validated paths with fix-loop changes still staged
resolved: [Finding.id, ...], // fixed in R1 or R2
escalated: [{ // could not be fixed in 2 attempts
id: Finding.id,
attempts: [string, string], // R1 + R2 summaries
evidence: string | null, // verifier's evidence (null if R2 was inconclusive)
staged_summary: string // e.g., "R2's changes to auth.js, +12/-4 lines"
}, ...],
dropped: [{ // pre-gate verifier rejected as not-real
id: Finding.id,
reason: string // verifier's rejection evidence
}, ...],
demoted: [{ // demoted to P2/P3 (out of scope)
id: Finding.id,
new_severity: "P2" | "P3",
evidence: string // verifier's demotion reasoning
}, ...]
}
<!-- source: references/finding-schema.md#output-schema -->
Finding
Finding {
id: sequential number starting from 1,
severity: "P0" | "P1" | "P2" | "P3",
title: short title,
body: detailed explanation with evidence,
file: file path or null for global issues,
line_start: number or null,
line_end: number or null,
confidence: 0.0-1.0,
criterion: what was violated,
verdict: "confirmed" | "demoted" | "rejected" | null,
validated_by: "reviewer" | "verifier" | "machine" | null,
evidence: reasoning for verdict | null
}
ReviewOutput
Findings are wrapped in a ReviewOutput envelope:
ReviewOutput {
schema_version: "v1",
findings: Finding[],
checks_run: string[]
}
Severity calibration
- P0 — Must fix: breaks functionality, security breach, data loss, or violates criteria
- P1 — Fix before shipping: correct but incomplete, fragile, or reliability risk
- P2 — Should fix: quality issue, code smell, not blocking
- P3 — Nice to have: observation, style, minor improvement
Field notes
confidence— 1.0 means certain, below 0.5 means you're guessing. Be honest.criterion— required for P0/P1 findings. Name the specific criterion violated.verdict— initial reviewers setnull; verifiers populate it after adjudication. A caller may setconfirmedwhen routing an observed failure with honestvalidated_byandevidencevalues.validated_by—reviewermeans initial review only;verifiermeans independent verification;machinerequires the exact check and observed failure. Missing ornullmeans unverified.- A machine result proves only the observed failure, not an inferred cause.
evidence— reasoning or an exact observed result supporting the verdict; usenullbefore adjudication.checks_run— list every criterion evaluated, file path checked, or acceptance criterion verified. For ACs, useAC-NNN-XX: PASS — [evidence]orAC-NNN-XX: FAIL — [reason].
<!-- /source: references/finding-schema.md#output-schema -->