ai-agent
1Cat-vLLM
V100 / SM70-focused vLLM engineering fork for modern LLM inference.
946 stars188 forksPythonUpdated 9/9/2026100% free · open source
What it does
Runs large language models (e.g., Qwen3.5 27B/35B) at 4‑bit AWQ precision on Tesla V100 (SM70) GPUs using a custom vLLM build.
When to use it
- •You have a multi‑GPU V100 cluster and need to serve a 27‑35B model at low latency.
- •You want to cut VRAM usage with 4‑bit AWQ quantization without losing much quality.
- •You need an open‑source alternative to proprietary serving stacks that works with CUDA 12.8.
Ready-to-paste prompt
curl http://localhost:8000/v1/completions \
-H "Content-Type: application/json" \
-d '{"model":"Qwen3.5-27B-AWQ","prompt":"Write a concise 150‑word executive summary for a seed‑stage AI startup.","max_tokens":200,"temperature":0.7}'Heads up: The server will only start on V100 (SM70) GPUs with CUDA 12.8; trying to run on a different GPU or CUDA version triggers a compilation error.
Saves to your device
Use with Claude
New
Skip the builder — one click puts this in Claude, Cursor, Antigravity and more.
✅ Light setup
Installs with a command or two; your AI agent can do it for you.
Try it instantly — no install
Claude Code
mkdir -p ~/.claude/skills/1cat-vllm && curl -fsSL https://workflowstacks.com/api/skills/1cat-vllm/claude-skill -o ~/.claude/skills/1cat-vllm/SKILL.mdOpen in another AI app
Opens the app with this repo with the prompt ready to go — no copy-paste needed.
Use with Claude
New
Skip the builder — one click puts this in Claude, Cursor, Antigravity and more.
✅ Light setup
Installs with a command or two; your AI agent can do it for you.
Try it instantly — no install
Claude Code
mkdir -p ~/.claude/skills/1cat-vllm && curl -fsSL https://workflowstacks.com/api/skills/1cat-vllm/claude-skill -o ~/.claude/skills/1cat-vllm/SKILL.mdOpen in another AI app
Opens the app with this repo with the prompt ready to go — no copy-paste needed.
Details
Creator
1CatAI
Language
Python
Category
ai-agent
Published
3/10/2026
Are you the creator of this tool? Claim your listing → and earn 85% of every sale.
Related skills
More ai-agent tools founders pair with this one.
ai-agent★ 276,806
Track GitHub Stars with 996.ICU
Get a popular GitHub star counter for your startup, ideal.
ai-agent★ 264,191
Superpowers
An agentic skills framework & software development methodology that works.
ai-agent★ 244,424
Linux: Open Source Kernel
Get the Linux kernel source tree for custom development, ideal for startup founders in need of a flexible OS foundation
ai-agent★ 210,750
Vue
This is the repo for Vue 2. For Vue 3, go to https://github.com/vuejs/core
ai-agent★ 204,069
Improve Code with andrej-karpathy-skills
Get better code behavior with andrej-karpathy-skills, 165k+ GitHub stars, for founders using LLMs.
ai-agent★ 197,010
FreeDomain: Free Website Domain
Get a free domain with FreeDomain.