Skills Directory

NousResearch/hermes-agent

serving-llms-vllm

vLLM: high-throughput LLM serving, OpenAI API, quantization.

58 installs 240K starsUpdated Sep 3, 2026License: MIT

Install

npx skills add NousResearch/hermes-agent@serving-llms-vllm

Runs in your terminal. Adds the skill globally for Claude Code, Cursor, Codex and others; add -g -y to skip prompts.

What it does

vLLM - High-Performance LLM Serving When to use Use when deploying production LLM APIs, optimizing inference latency/throughput, or serving models with limited GPU memory. Supports OpenAI-compatible endpoints, quantization (GPTQ/AWQ/FP8), and tensor parallelism. Quick start vLLM achieves 24x higher throughput than standard transformers through PagedAttention (block-based KV cache) and continuous batching (mixing prefill/decode requests). Installation: Basic offline inference: OpenAI-compatible server: Common workflows Workflow 1: Production API deployment Copy this checklist and track…

Excerpt from the skill's own SKILL.md. Read the full file on GitHub before installing: skills run with your agent's permissions.

View source on GitHub

Before you install

Skills are plain text instructions the agent follows, sometimes with scripts. Check the source, prefer repositories with many installs and stars, and read any script it ships.

Categories

Related skills

  • ascii-art

    NousResearch/hermes-agent

    ASCII art: pyfiglet, cowsay, boxes, image-to-ascii.

    412 installs 240K
  • comfyui

    NousResearch/hermes-agent

    Generate images, video, and audio via diffusion workflows.

    382 installs 240KDeploy & DevOpsDocumentationProductivity
  • touchdesigner-mcp

    NousResearch/hermes-agent

    Control TouchDesigner via twozero MCP.

    316 installs 240KDataAI & agents
  • baoyu-comic

    NousResearch/hermes-agent

    Knowledge comics (知识漫画): educational, biography, tutorial.

    92 installs 240KDesign & UIAI & agentsWriting
  • baoyu-article-illustrator

    NousResearch/hermes-agent

    Article illustrations: type × style × palette consistency.

    89 installs 240KDesign & UIAI & agentsWriting
  • minecraft-modpack-server

    NousResearch/hermes-agent

    Host modded Minecraft servers (CurseForge, Modrinth).

    88 installs 240KSecurity

← Search skills

/skills/NousResearch/hermes-agent/serving-llms-vllm/