ai-agent

rtx6kpro: Deploy Massive LLMs on PCIe GPUs without NVLink

Run top‑tier models like Qwen3.5‑397B or Kimi‑K2.5 on standard PCIe cards, letting founders scale AI without costly NVLink hardware. 1.1k+ GitHub stars.

From the repo · “RTX 6000 Pro Wiki — Running Large LLMs (Qwen3.5-397B, Kimi-K2.5, GLM-5) on PCIe GPUs without NVLink”

1,155 stars+16★ this week91 forksPythonGuide quality 9/10 · reviewed Oct 6Updated 10/22/2026100% free · open source
What it does

RTX 6000 Pro allows founders to run large language models like Qwen3.5-397B, Kimi-K2.5, and GLM-5 on PCIe GPUs without NVLink, enabling local inference for AI agents

When to use it
  • •You need to deploy large language models on local hardware for data privacy or latency reasons
  • •Your AI workflow requires running models like Qwen3.5-397B or Kimi-K2.5 on commodity GPUs
  • •You want to test and fine-tune large language models without relying on cloud services
Ready-to-paste prompt
python run_qwen.py --model qwen3.5-397b --gpu 0 --batch-size 32
Heads up: Ensure you have a compatible NVIDIA driver installed (version 470 or later) and that your system meets the minimum hardware requirements outlined in the RTX 6000 Pro Wiki
Saves to your device
Use with Claude
New

Skip the builder — one click puts this in Claude, Cursor, Antigravity and more.

✅ Light setup

Installs with a command or two; your AI agent can do it for you.

Try it instantly — no install
Claude Code
mkdir -p ~/.claude/skills/rtx6kpro && curl -fsSL https://workflowstacks.com/api/skills/rtx6kpro/claude-skill -o ~/.claude/skills/rtx6kpro/SKILL.md
Open in another AI app

Opens the app with this repo with the prompt ready to go — no copy-paste needed.

Connect the whole catalog (MCP)
claude mcp add --transport http workflowstacks https://workflowstacks.com/api/mcp

Adds a WorkflowStacks connector to Claude Code: search and load any skill here by chatting.

What's inside — free to inspect

No purchase needed

Read the entire source before you build — unlike paid marketplaces that hide it behind a buy button.

3
top-level files
17
folders
182.6M
source size
—
license
Key files
INDEX.md
README.md
File tree
archive/
automation/
benchmarks/
compose/
daily-summaries/
data/
docs/
hardware/
images/
inference-engines/
kld/
logs/
models/
optimization/
patches/
scripts/
troubleshooting/
GLOSSARY.md
INDEX.md
README.md
Quick Actions
Details
Creator
local-inference-lab
Language
Python
Category
ai-agent
Published
3/9/2026

Are you the creator of this tool? and earn 85% of every sale.

Show it off in your README:

Featured on WorkflowStacks
[![Featured on WorkflowStacks](https://workflowstacks.com/api/badge/rtx6kpro.svg)](https://workflowstacks.com/skills/rtx6kpro?utm_source=github&utm_medium=badge)
🔥 Hot this week, in your inbox
Skills like this, every Monday.

The five fastest-growing open-source AI skills, ranked by GitHub star growth. One email a week, unsubscribe anytime.