chalk-ai/chalk-ai-plugins
benchmark-vllm-model
Benchmark throughput and cost-per-token of a model served on vLLM in Chalk's container infrastructure. Use when someone asks for $/token, $/request, tokens/sec, "how much would it cost to self-host this model", GPU sizing for an LLM, or wants to compare a self-hosted model's economics against a hosted API.
Installation
npx skills add https://github.com/chalk-ai/chalk-ai-plugins
Similar popular skills
Related neighbors and high-traction skills in the same topics — useful to compare before installing.
Benchmark Jetson LLM/VLM serving performance across vLLM, llama.cpp, and Ollama with structured…
1.1K installsGolang benchmarking, profiling, and performance measurement. Use when writing, running, or comp…
263 installs用五重过滤法寻找值得模仿的对标，并排除主体差异造成的噪音。用户要求找对标、选择模仿对象或分析竞…
96 installsCompute a business's CAC and ROAS family metrics from real spend and outcome data, then judge w…
835 installsUse this skill to measure performance baselines, detect regressions before/after PRs, and compa…
62 installsUse when the user asks to make something faster, try many variants, run recursive optimization,…
64 installsAlso in this package
Other skills from chalk-ai/chalk-ai-plugins.
npx skills add chalk-ai/chalk-ai-plugins
More details
Agent compatibility
Declared targets from SKILL.md / docs. Unmarked agents are not listed — the skill may still install via the CLI.