Analyzed Aug 1, 2026
get-convex/agent-skills
convex-verify
Prove a Convex feature works — seed, drive as multiple mocked users via convex-test, assert behavior including the negative authz cases (wrong user refused, data-scope enforced).
Installation
npx skills add get-convex/agent-skills --skill convex-verify
Similar popular skills
Related neighbors and high-traction skills in the same topics — useful to compare before installing.
Browser automation CLI for AI agents. Use when the user needs to interact with websites, includ…
11.9K installsConfigure Azure API Management as an AI Gateway for AI models, MCP tools, and agents. WHEN: sem…
1.5K installsAzure VM/VMSS router. WHEN: create / provision / deploy / spin-up VM, recommend VM size, compar…
1.5K installsPostgres best practices maintained by Supabase, for Postgres running anywhere. Load this skill …
1.4K installs>- Provides foundational Firebase CLI setup, CLI installation, version checks (`firebase-tools@…
545 installsUmbrella skill for all Convex development patterns. Routes to specific skills like convex-funct…
5.7K installsSecurity audits
Partner security reviews for this skill.
Analyzed Aug 1, 2026
Analyzed Aug 1, 2026
0 alerts
Also in this package
Other skills from get-convex/agent-skills · top by installs.
npx skills add get-convex/agent-skills
More details
Agent compatibility
Declared targets from SKILL.md / docs. Unmarked agents are not listed — the skill may still install via the CLI.
Repository health
main
Package contents
Files included with this skill beyond the listing page.
-
skill md
SKILL.md4,955 B -
docs
SUMMARY.md201 B
History
- First seen on skills.sh
- First recorded snapshot · 18,600 installs
SKILL.md
<!-- GENERATED from convex-agents content/capabilities/convex-verify.json — do not edit by hand. -->
Prove a feature works — seed, drive, assert
A green typecheck proves the code parses; it does not prove a non-owner is actually denied, that a query returns the right rows, or that a mutation has the effect it claims. This capability closes that gap with the loop the whole field is missing: seed → drive → assert, run in-process with convex-test so it needs no deployment. Its highest-value assertions are the NEGATIVE ones — the caller who should be refused — because those are exactly the authz defects the 30-app corpus shows are the #1 real bug and the ones a happy-path demo never catches.
Workflow
- IDENTIFY the feature to prove: the specific exported query/mutation/action (or a small set) the user just built/changed, and its intended behavior — who should be allowed, what data should come back, what a mutation should change. If the intent is unstated, ask one focused question rather than guessing the contract.
- SET UP
convex-test: ensureconvex-test+vitestare dev deps AND avitest.config.tssetstest.environment: "edge-runtime"withserver.deps.inline: ["convex-test"]— WITHOUT that config,convexTest(schema)fails at runtime withimport.meta.glob is not a function(verified). Also install@edge-runtime/vm. ThenconvexTest(schema)gives athandle. Reuse the project's existing test setup if present (compose with thetestcapability, don't fork it). - SEED realistic data through the app's OWN functions where possible (so the seed exercises the same validators/mutations a real user would), falling back to
t.run(async (ctx) => ctx.db.insert(...))for fixtures the public API can't create. Seed at least: the caller's own rows AND a second user's rows, so cross-user access is testable. - DRIVE the feature as DIFFERENT identities with
t.withIdentity({ subject, tokenIdentifier, ... }): call the function as (a) the legitimate owner, (b) a different authenticated user, and (c) unauthenticated (twith no identity). Use the real identity shape the app's auth uses (subject/tokenIdentifier), matching how ownership is resolved. - ASSERT behavior — POSITIVE and NEGATIVE:
- positive: the owner gets the expected rows / the mutation made the expected change (expect(await t.withIdentity(owner).query(api.x.y, args)).toEqual(...)). - NEGATIVE (the load-bearing half): a different user calling the same function is REFUSED — await expect(t.withIdentity(other).mutation(api.x.cancel, {id})).rejects.toThrow(/forbidden|not authorized|403/) — and an unauthenticated caller is refused where auth is required. A feature is not proven until the wrong caller is shown to be blocked. - data-scope: a list/query returns ONLY the caller's rows, never the second user's (assert the second user's row is absent).
- RUN the tests (
npx vitest run) and report: what was proven (each positive + negative assertion that passed), and — critically — any assertion that FAILED, because a failed negative assertion is a real authz hole found before ship. Emit findings on the bus (specs/finding.schema.json, class authz/correctness, evidence kind probe-result with the exact failing call) for anything that didn't behave. - Do NOT weaken a test to make it pass: if the owner-only query returns another user's row, the FIX is in the function (hand to convex-authz), not in the assertion. A test changed until it's green proves nothing.
Rules
- Prove behavior, not compilation: every verification includes at least one NEGATIVE assertion (a caller who should be refused is refused) — the happy path alone is not proof.
- Drive the feature as multiple identities with t.withIdentity (owner, other user, unauthenticated) using the app's real subject/tokenIdentifier shape.
- Seed both the caller's rows AND a second user's rows so cross-user access and data-scope are actually testable.
- A vitest.config.ts with environment 'edge-runtime' + convex-test inlined is REQUIRED for convex-test to run (import.meta.glob needs it); author it, don't just author the test file.
- Run in-process with convex-test — no deployment needed; compose with the
testcapability's setup rather than forking it. - Never weaken an assertion to make it pass: a failing negative test is a real defect → hand the fix to convex-authz/convex-expert, don't edit the test until it's green.
- Emit a bus finding for any assertion that failed (authz/correctness, evidence: the failing probe call) so a composite pass or self-heal can pick it up.
- This drives a SPECIFIC built feature; a request to set up a test framework generally is the
testcapability.