local-ai
Club 3090
Community recipes for serving LLMs on RTX 3090/4090/5090 CUDA gpus. Multi-engine (vLLM, llama.cpp, ik_llama) and model-agnostic. Currently shipping Qwen3.6-27B
2,206 stars138 forksPythonUpdated 9/8/2026100% free · open source
What it does
Club-3090 provides community-driven recipes for serving large language models on NVIDIA RTX 3090, 4090, and 5090 CUDA GPUs, supporting multiple engines and models
When to use it
- •You need to deploy LLMs on a local machine with an RTX 3090, 4090, or 5090 GPU
- •You want to use a specific LLM model like Qwen3.6 or Gemma 4 with a multi-engine setup
- •You require a model-agnostic solution for serving LLMs on your GPU
Ready-to-paste prompt
python run.py --config configs/qwen3.6-27b.json --prompt 'Write a short story about a character who discovers a hidden world'
Heads up: Ensure you have the necessary CUDA version installed, as the club-3090 recipes are designed to work with specific CUDA versions, and incompatible versions may cause errors or performance issues
Saves to your device
Use with Claude
New
Skip the builder — one click puts this in Claude, Cursor, Antigravity and more.
✅ Light setup
Installs with a command or two; your AI agent can do it for you.
Try it instantly — no install
Claude Code
mkdir -p ~/.claude/skills/club-3090 && curl -fsSL https://workflowstacks.com/api/skills/club-3090/claude-skill -o ~/.claude/skills/club-3090/SKILL.mdOpen in another AI app
Opens the app with this repo with the prompt ready to go — no copy-paste needed.
Use with Claude
New
Skip the builder — one click puts this in Claude, Cursor, Antigravity and more.
✅ Light setup
Installs with a command or two; your AI agent can do it for you.
Try it instantly — no install
Claude Code
mkdir -p ~/.claude/skills/club-3090 && curl -fsSL https://workflowstacks.com/api/skills/club-3090/claude-skill -o ~/.claude/skills/club-3090/SKILL.mdOpen in another AI app
Opens the app with this repo with the prompt ready to go — no copy-paste needed.
Details
Creator
noonghunna
Language
Python
Category
local-ai
Published
4/28/2026
Are you the creator of this tool? Claim your listing → and earn 85% of every sale.
Related skills
More local-ai tools founders pair with this one.
local-ai★ 126,617
Run LLMs with llama.cpp
Get fast LLM inference with llama.cpp, for founders using C++.
local-ai★ 91,165
Stirling-PDF: Edit PDFs Anywhere
Edit PDFs on any device with Stirling-PDF, a tool for startup founders
local-ai★ 31,165
Run AI Locally with llmfit
Find compatible AI models for your hardware with llmfit, a tool.
local-ai★ 29,040
koreader: Multi-format eBook Reader
Get a versatile eBook reader for various devices.
local-ai★ 16,018
MNN: Fast On-Device AI
Get high-performance Edge AI with MNN, battle-tested by Alibaba, for startup founders
local-ai★ 10,300
Run AI Locally with runanywhere-sdks
Run AI models on-device with this production-ready toolkit, ideal for startup founders