vllm-project/vllm-skills

1

vllm-deploy-docker Deploy vLLM using Docker (pre-built images or build-from-source) with NVIDIA GPU support and run the OpenAI-compatibl…

vllm-project/vllm-skills

198

2

vllm-deploy-simple Quick install and deploy vLLM, start serving with a simple LLM, and test OpenAI API.

vllm-project/vllm-skills

173

3

vllm-bench-serve Benchmark vLLM or OpenAI-compatible serving endpoints using vllm bench serve. Supports multiple datasets (random, sha…

vllm-project/vllm-skills

169

4

vllm-prefix-cache-bench This is a skill for benchmarking the efficiency of automatic prefix caching in vLLM using fixed prompts, real-world d…

vllm-project/vllm-skills

147

5

vllm-bench-random-synthetic Run vLLM performance benchmark using synthetic random data to measure throughput, TTFT (Time to First Token), TPOT (T…

vllm-project/vllm-skills

140

6

vllm-deploy-k8s Deploy vLLM to Kubernetes (K8s) with GPU support, health probes, and OpenAI-compatible API endpoint. Use this skill w…

vllm-project/vllm-skills

134