lucebox: Accelerate LLM Inference on Consumer GPUs
From the repo · “LLM speculative inference server for heterogeneous hardware & consumer GPUs”
Lucebox is a fast LLM speculative inference server that allows you to run large language models on consumer-grade hardware for AI-related tasks.
- •When you need to deploy AI models on consumer hardware with limited resources
- •When you want to test and prototype AI applications quickly without relying on cloud services
- •When you require a self-hosted solution for AI inference with a small footprint
curl -X POST -H 'Content-Type: application/json' -d '{"prompt": "Generate a short story about a character who discovers a hidden world"}' http://localhost:8080/inferSkip the builder — one click puts this in Claude, Cursor, Antigravity and more.
Installs with a command or two; your AI agent can do it for you.
mkdir -p ~/.claude/skills/lucebox && curl -fsSL https://workflowstacks.com/api/skills/lucebox/claude-skill -o ~/.claude/skills/lucebox/SKILL.mdOpens the app with this repo with the prompt ready to go — no copy-paste needed.
What's inside — free to inspect
Read the entire source before you build — unlike paid marketplaces that hide it behind a buy button.
Skip the builder — one click puts this in Claude, Cursor, Antigravity and more.
Installs with a command or two; your AI agent can do it for you.
mkdir -p ~/.claude/skills/lucebox && curl -fsSL https://workflowstacks.com/api/skills/lucebox/claude-skill -o ~/.claude/skills/lucebox/SKILL.mdOpens the app with this repo with the prompt ready to go — no copy-paste needed.
Are you the creator of this tool? and earn 85% of every sale.
Show it off in your README:
[](https://workflowstacks.com/skills/lucebox?utm_source=github&utm_medium=badge)The five fastest-growing open-source AI skills, ranked by GitHub star growth. One email a week, unsubscribe anytime.
Related skills
More ai-agent tools founders pair with this one.