local-ai

GenieX: Run AI locally

Name: GenieX: Run AI locally
Author: qualcomm

Get local AI on Qualcomm devices with GenieX, a tool for startup founders, backed by 8.1k+ GitHub stars.

From the repo · “Run frontier LLMs and VLMs locally on Qualcomm devices across NPU, GPU, and CPU with a few lines of code”

8,452 stars+16★ this week1,070 forksRustGuide quality 8/10 · reviewed Jul 4Updated 10/22/2026100% free · open source

What it does

GenieX allows startup founders to run advanced AI models like LLMs and VLMs directly on Qualcomm devices using local processing units such as NPU, GPU, and CPU

When to use it

•When developing AI-powered applications that require low latency and real-time processing on Qualcomm devices
•When working with large AI models that need to be deployed on edge devices for privacy and security reasons
•When prototyping AI-driven products that require local processing capabilities to function offline or with limited internet connectivity

Ready-to-paste prompt

python examples/run_model.py --model-path /path/to/model --device npu --input-prompt 'What is the meaning of life?'

Heads up: Ensure that the Qualcomm device has the necessary drivers and firmware updates installed to support the NPU, GPU, or CPU processing units used by GenieX

Saves to your device

Use with Claude

New

Skip the builder — one click puts this in Claude, Cursor, Antigravity and more.

🛠️ Technical setup

Expect 20–40 minutes in a terminal — or let your AI agent drive it.

Try it instantly — no install

Claude Code

mkdir -p ~/.claude/skills/geniex && curl -fsSL https://workflowstacks.com/api/skills/geniex/claude-skill -o ~/.claude/skills/geniex/SKILL.md

Open in another AI app

Opens the app with this repo with the prompt ready to go — no copy-paste needed.

Connect the whole catalog (MCP)

claude mcp add --transport http workflowstacks https://workflowstacks.com/api/mcp

Adds a WorkflowStacks connector to Claude Code: search and load any skill here by chatting.

How GenieX: Run AI locally works

Codeflow

Free to inspect

GenieX: Run AI locally is a very large Rust project (~71k lines across 294 code files, plus 38 test files). It is a full software project: use it through its install path rather than reading it end to end. Last commit this month, BSD-3-Clause license, has a test suite.

Size

Very large codebase

~71k lines · 294 code files · days to read — use, don't read

Setup

Developer setup

A real software project. Use it via its install path; don't expect to read it all.

Runs on

Rust

No API keys detected

Rust 26%Go 22%Python 18%C++ 17%C 9%

Where to start reading

1
README.md
Start here — what it does and how to install it
2
CLAUDE.md
The instructions the AI actually follows
3
examples/python/windows.ipynb
A worked example — copy this to get going

What's in each folder

cli/Command-line entry points138 files

docs/Documentation58 files

examples/Examples you can copy2 files

sdk/SDKs / client libraries160 files

bindings/SDKs / client libraries118 files

notes/Folder6 files

scripts/Helper scripts4 files

.github/CI / automation (GitHub Actions)34 files

READMEHas testsDocumentedCI checksExamples includedBSD-3-Clause licenseUpdated this month

Use with Claude

New

Skip the builder — one click puts this in Claude, Cursor, Antigravity and more.

🛠️ Technical setup

Expect 20–40 minutes in a terminal — or let your AI agent drive it.

Try it instantly — no install

Claude Code

mkdir -p ~/.claude/skills/geniex && curl -fsSL https://workflowstacks.com/api/skills/geniex/claude-skill -o ~/.claude/skills/geniex/SKILL.md

Open in another AI app

Opens the app with this repo with the prompt ready to go — no copy-paste needed.

Connect the whole catalog (MCP)

claude mcp add --transport http workflowstacks https://workflowstacks.com/api/mcp

Adds a WorkflowStacks connector to Claude Code: search and load any skill here by chatting.

Quick Actions

Details

Creator

qualcomm

Language

Rust

Do this with a working workflow

Pages we wrote and tested that put a skill like this to work — importable n8n templates, outcome guides and Claude Desktop configs.

MCP config

Memory (knowledge graph) MCP config

Persistent memory across chats via a local knowledge graph.

Related skills

More local-ai tools founders pair with this one.

local-ai★ 131,925

Run Powerful LLMs Locally with llama.cpp – Fast C++ Inference

Empower your product with on‑device LLM inference using llama.cpp’s efficient C++ engine. Ideal for founders who need privacy, speed, and no cloud costs. 130k+ GitHub stars.

local-ai★ 94,670

Stirling-PDF: Edit PDFs Anywhere

Edit PDFs on any device with Stirling-PDF, a tool for startup founders, backed by 80k+ GitHub stars

local-ai★ 38,207

Run AI Locally with llmfit

Find compatible AI models for your hardware with llmfit, a tool for founders, with 29k+ GitHub stars.

local-ai★ 282

ggrun: Fast Multi‑GPU LLM Server for Startup AI Apps

Deploy GGUF models on llama.cpp with auto‑tuned flags, tensor‑split, and MoE placement. Ideal for founders needing a self‑hosted, OpenAI‑compatible inference server on multi‑GPU rigs.

local-ai★ 1,236

crit: Streamline Your AI Agent Feedback Loop

crit lets founders quickly iterate with AI agents via a simple CLI, turning feedback into actionable code improvements. Ideal for Go‑based dev teams. 1.2k+ GitHub stars

local-ai★ 1,605

Run LLMs on Any Device Fast with nobodywho

nobodywho lets founders run on‑device LLM inference efficiently on any hardware—no cloud fees, full control. Backed by 1.6k+ GitHub stars.