vectorspacelab/arex-skill · Archived
vllm
Stronger alternatives
This repository is archived — consider an actively maintained alternative.
Serves LLMs with high throughput using vLLM's PagedAttention and continuous batching. Use when …
841 installsServes LLMs with high throughput using vLLM's PagedAttention and continuous batching. Use when …
470 installsDeploy and manage vLLM for high-throughput LLM inference. Configure continuous batching, tensor…
212 installsDeploy vLLM using Docker (pre-built images or build-from-source) with NVIDIA GPU support and ru…
198 installsSimilar popular skills
Related neighbors and high-traction skills in the same topics — useful to compare before installing.
Quick install and deploy vLLM, start serving with a simple LLM, and test OpenAI API.
173 installsBenchmark vLLM or OpenAI-compatible serving endpoints using vllm bench serve. Supports multiple…
169 installsThis is a skill for benchmarking the efficiency of automatic prefix caching in vLLM using fixed…
147 installsRun vLLM performance benchmark using synthetic random data to measure throughput, TTFT (Time to…
140 installsDeploy vLLM to Kubernetes (K8s) with GPU support, health probes, and OpenAI-compatible API endp…
134 installsMore details
Agent compatibility
Declared targets from SKILL.md / docs. Unmarked agents are not listed — the skill may still install via the CLI.
Repository health
main
History
- First recorded snapshot · 1 installs