Gates - Quality Validation (v2.37)

Comprehensive quality validation across 9 programming languages with TLDR-assisted analysis.

v2.88 Key Changes (MODEL-AGNOSTIC)

• Model-agnostic: Uses model configured in ~/.claude/settings.json or CLI/env vars
• No flags required: Works with the configured default model
• Flexible: Model-agnostic — runs on whatever model the session runs
• Settings-driven: Model selection via ANTHROPICDEFAULT*_MODEL env vars

Quick Start

/gates              # Run all quality gates
ralph gates         # Via CLI
ralph gates src/    # Specific directory

LSP Usage for Type Checking

IMPORTANT: Use LSP for efficient type checking instead of reading entire files.

When to Use LSP

• Type checking TypeScript/JavaScript files
• Finding type errors without running tsc --noEmit
• Getting hover information for symbols
• Finding references across the codebase

LSP Commands

# Type check a specific file (TypeScript)
LSP:
  server: typescript-language-server
  action: diagnostics
  file: src/auth/login.ts

# Get hover information for a symbol
LSP:
  server: typescript-language-server
  action: hover
  file: src/auth/login.ts
  line: 42
  character: 10

# Find all references
LSP:
  server: typescript-language-server
  action: references
  file: src/auth/login.ts
  line: 42
  character: 10

# Python type checking with pyright
LSP:
  server: pyright
  action: diagnostics
  file: src/auth/login.py

LSP vs Traditional Type Checking

Pre-Gates: TLDR Language Detection (v2.37)

AUTOMATIC - Detect project languages efficiently:

# Get codebase structure to detect languages (95% token savings)
tldr structure . > /tmp/project-structure.md

# From structure, identify:
# - Primary language(s)
# - Config files present
# - Test frameworks used

Supported Languages

Workflow

1. Detect Languages

# Auto-detect based on file extensions and config files

2. Run Linters

# Per-language linting
npx eslint src/          # TypeScript/JavaScript
ruff check .             # Python
cargo clippy             # Rust
golangci-lint run        # Go

3. Check Formatting

npx prettier --check .   # JS/TS
black --check .          # Python
rustfmt --check src/     # Rust
gofmt -l .               # Go

4. Type Checking

npx tsc --noEmit         # TypeScript
mypy .                   # Python
cargo check              # Rust
go vet ./...             # Go

5. Run Tests

npm test                 # Node projects
pytest                   # Python
cargo test               # Rust
go test ./...            # Go

Exit Codes

Gate Configuration

Minimal (fast)

ralph gates --minimal    # Lint only

Standard (default)

ralph gates              # Lint + Format + Types

Full (CI)

ralph gates --full       # Lint + Format + Types + Tests

Integration

• Invoked by /orchestrator in Step 6
• Pre-step: tldr structure for language detection (v2.37)
• Must pass before VERIFIED_DONE
• Hooks: quality-gates.sh (PostToolUse)

TLDR Integration (v2.37)

Agent Teams Integration (v2.88)

Optimal Scenario: Integrated (Agent Teams + Custom Subagents)

Quality gates use Agent Teams coordination with specialized ralph-tester agents for parallel quality validation.

Why Scenario C for Gates

• Multiple quality checks require coordination (lint, format, type, test)
• Quality gates are meta-validation (hooks validate the validators)
• Language-specific specialization via ralph-tester
• TeammateIdle/TaskCompleted hooks for quality enforcement

Subagent Roles

Parallel Gates Execution

When Agent Teams is active, gates run in parallel across subagents:

1. Team Lead creates task list with gate phases
2. ralph-tester runs tests concurrently
3. ralph-reviewer reviews linter output
4. ralph-coder applies fixes

Quality Gate Hooks

• TeammateIdle: Triggers before agent goes idle
• TaskCompleted: Validates gate completion

Action Reporting (v2.93.0)

Los resultados de /gates generan reportes automáticos completos:

Reporte Automático

Cuando /gates completa, se genera automáticamente:

1. En la conversación de Claude: Resultados visibles de todas las validaciones
2. En el repositorio: docs/actions/gates/{timestamp}.md
3. Metadatos JSON: .claude/metadata/actions/gates/{timestamp}.json

Contenido del Reporte

Cada reporte incluye:

• ✅ Summary: Tipo de validación ejecutada
• ✅ Results: Resultados de linters, formatters, type checkers, tests
• ✅ Errors: Errores encontrados por categoría
• ✅ Recommendations: Acciones correctivas sugeridas
• ✅ Next Steps: Qué hacer según el resultado

Generación Manual (Opcional)

# Al inicio
source .claude/lib/action-report-lib.sh
start_action_report "gates" "Running quality gates on src/"

# Ejecutar validaciones
if ! npx tsc --noEmit; then
    record_error "TypeScript errors found"
fi

if ! npx eslint .; then
    record_error "ESLint violations found"
fi

if ! npm test; then
    record_error "Test failures found"
fi

# Al completar
if [[ ${#CURRENT_ACTION_ERRORS[@]} -eq 0 ]]; then
    complete_action_report \
        "success" \
        "All quality gates passed" \
        "Safe to commit: git commit -m 'chore: pass quality gates'"
else
    complete_action_report \
        "failed" \
        "Quality gates failed" \
        "Fix errors and run /gates again"
fi

Ver Reportes Anteriores

# Listar todos los reportes de gates
ls -lt docs/actions/gates/

# Ver el reporte más reciente
cat $(ls -t docs/actions/gates/*.md | head -1)

# Buscar reportes fallidos
grep -l "Status: FAILED" docs/actions/gates/*.md

# Ver tendencia de calidad
grep -c "Status: COMPLETED" docs/actions/gates/*.md
grep -c "Status: FAILED" docs/actions/gates/*.md

Integración CI/CD

Los metadatos JSON permiten integración con pipelines:

# En tu CI pipeline
source .claude/lib/action-report-generator.sh

# Ejecutar gates
/gates

# Obtener resultado del último reporte
latest_report=$(find_latest_report "gates")
status=$(grep "Status:" "$latest_report" | awk '{print $2}')

if [[ "$status" != "COMPLETED" ]]; then
    echo "Quality gates failed - blocking commit"
    exit 1
fi

Referencias del Sistema de Reportes

• [Action Reports System](docs/actions/README.md) - Documentación completa
• [action-report-lib.sh](.claude/lib/action-report-lib.sh) - Librería helper
• [action-report-generator.sh](.claude/lib/action-report-generator.sh) - Generador

Integration with Autoresearch Checks (v2.95)

The /gates quality stages can be wired as the backpressure mechanism for /autoresearch experiments. When autoresearch modifies code to optimize a metric, gates ensure the optimization does not introduce regressions in correctness, quality, or security.

Mapping Gates Stages to checks.sh

Each /gates stage maps directly to content you can place in the autoresearch checks.sh file:

Template: checks.sh Using Gates

#!/usr/bin/env bash
# checks.sh - Autoresearch backpressure via /gates stages
# Place this file alongside your autoresearch target directory.
# Autoresearch runs this AFTER every experiment. Non-zero exit = discard change.

set -euo pipefail

# Stage 1: CORRECTNESS (blocking)
# Ensures the experiment did not break type safety or compilation.
echo "[checks] Stage 1: CORRECTNESS"
npx tsc --noEmit 2>&1 || exit 1

# Stage 2: QUALITY (blocking)
# Ensures the experiment did not introduce lint violations or increase complexity.
echo "[checks] Stage 2: QUALITY"
npx eslint . --max-warnings=0 2>&1 || exit 1

# Stage 3: SECURITY (blocking)
# Ensures the experiment did not introduce security vulnerabilities.
echo "[checks] Stage 3: SECURITY"
if command -v semgrep &>/dev/null; then
    semgrep --config=auto --error --quiet 2>&1 || exit 1
fi

# Stage 4: TESTS (blocking)
# Ensures existing tests still pass after the experiment.
echo "[checks] Stage 4: TESTS"
npm test 2>&1 || exit 1

echo "[checks] All gates passed"
exit 0

How It Works

/autoresearch loop iteration:
  1. HYPOTHESIZE -> MODIFY -> COMMIT
  2. RUN metric command (e.g., "npm run build")
  3. RUN checks.sh  <-- /gates stages act as guardrails
     - If checks.sh fails -> DISCARD experiment (git reset)
     - If checks.sh passes -> EVALUATE metric delta
  4. Keep improvement or discard regression

Backpressure Levels

Configure which gates stages to enforce based on experiment risk:

Python Projects Template

#!/usr/bin/env bash
set -euo pipefail

# CORRECTNESS
echo "[checks] CORRECTNESS"
python -m py_compile "$TARGET_FILE" || exit 1
mypy . --ignore-missing-imports 2>&1 || exit 1

# QUALITY
echo "[checks] QUALITY"
ruff check . 2>&1 || exit 1

# SECURITY
echo "[checks] SECURITY"
if command -v semgrep &>/dev/null; then
    semgrep --config=auto --error --quiet 2>&1 || exit 1
fi

# TESTS
echo "[checks] TESTS"
pytest --tb=short 2>&1 || exit 1

exit 0

Constraints

• Gates run on every change, including "quick fixes"; that is where regressions hide.
• Type errors and lint warnings block the commit.

Anti-Rationalization

See master table: docs/reference/anti-rationalization.md