terminalskills/skills
vllm
You are an expert in vLLM, the high-throughput LLM serving engine. You help developers deploy open-source models (Llama, Mistral, Qwen, Phi, Gemma) with…
Installation
npx skills add https://github.com/terminalskills/skills
Similar popular skills
Related neighbors and high-traction skills in the same topics — useful to compare before installing.
Serves LLMs with high throughput using vLLM's PagedAttention and continuous batching. Use when …
841 installsServes LLMs with high throughput using vLLM's PagedAttention and continuous batching. Use when …
470 installsDeploy and manage vLLM for high-throughput LLM inference. Configure continuous batching, tensor…
212 installsDeploy vLLM using Docker (pre-built images or build-from-source) with NVIDIA GPU support and ru…
198 installsQuick install and deploy vLLM, start serving with a simple LLM, and test OpenAI API.
173 installsBenchmark vLLM or OpenAI-compatible serving endpoints using vllm bench serve. Supports multiple…
169 installsAlso in this package
Other skills from terminalskills/skills · top by installs.
npx skills add https://github.com/terminalskills/skills
More details
Agent compatibility
Declared targets from SKILL.md / docs. Unmarked agents are not listed — the skill may still install via the CLI.
Repository health
main
History
- First seen on skills.sh
- First recorded snapshot · 6 installs