workflowstacks
ai-agent

FlashRT: Fast AI Inference

Get fast and reliable AI inference for latency-sensitive workloads with FlashRT.
459 stars58 forksC++Guide quality 8/10Updated 7/28/2026100% free · open source
What it does

FlashRT is a high-performance realtime inference engine for running low-latency AI models, especially for small-batch workloads and production VLA control.

When to use it
  • •When you need to deploy AI models that require fast response times, such as real-time control systems.
  • •When working with small-batch AI workloads that require high-performance inference.
  • •When integrating with specific models like Pi0, Pi0.5, GROOT N1.6, Pi0-FAST, or large language models like qwen3.6-27B.
Ready-to-paste prompt
./flashrt -m examples/pi0/model -i examples/pi0/input -b 1 -v
Heads up: Ensure you have a compatible C++ compiler and necessary dependencies installed on your system, as FlashRT is built using C++ and may require specific runtime versions or libraries to be installed.
Saves to your device
Use with Claude
New

Skip the builder — one click puts this in Claude, Cursor, Antigravity and more.

🛠️ Technical setup

Expect 20–40 minutes in a terminal — or let your AI agent drive it.

Try it instantly — no install
Claude Code
mkdir -p ~/.claude/skills/flashrt && curl -fsSL https://workflowstacks.com/api/skills/flashrt/claude-skill -o ~/.claude/skills/flashrt/SKILL.md
Open in another AI app

Opens the app with this repo with the prompt ready to go — no copy-paste needed.

Connect the whole catalog (MCP)
claude mcp add --transport http workflowstacks https://workflowstacks.com/api/mcp

Adds a WorkflowStacks connector to Claude Code: search and load any skill here by chatting.

How FlashRT: Fast AI Inference works
Codeflow
Free to inspect

FlashRT: Fast AI Inference is a very large C++ project (~594k lines across 1525 code files, plus 264 test files). It is a full software project: use it through its install path rather than reading it end to end. Last commit this month, Apache-2.0 license, has a test suite.

Size
Very large codebase
~594k lines · 1525 code files · days to read — use, don't read
Setup
Developer setup
A real software project. Use it via its install path; don't expect to read it all.
Runs on
Python · Docker
No API keys detected
C++ 60%Python 29%Cuda 9%HIP 1%
Where to start reading
  1. 1
    README.md
    Start here — what it does and how to install it
  2. 2
    AGENTS.md
    The instructions the AI actually follows
  3. 3
    pyproject.toml
    Dependencies and the commands it exposes
  4. 4
    flash_rt/__init__.py
    Inside flash_rt/ — the main logic begins here
  5. 5
    examples/README.md
    A worked example — copy this to get going
What's in each folder
flash_rt/Core code — the actual logic547 files
docs/Documentation80 files
examples/Examples you can copy37 files
csrc/Folder1209 files
cpp/Folder171 files
training/Folder54 files
serving/Folder35 files
scripts/Helper scripts19 files
READMEHas testsDocumentedNo CIDocker readyExamples includedApache-2.0 licenseUpdated this month
Quick Actions
Details
Creator
flashrt-project
Language
C++
Category
ai-agent
Published
4/28/2026

Are you the creator of this tool? Claim your listing → and earn 85% of every sale.

Related skills

More ai-agent tools founders pair with this one.

ai-agent★ 276,806
Track GitHub Stars with 996.ICU
Get a popular GitHub star counter for your startup, ideal.
ai-agent★ 264,191
Superpowers
An agentic skills framework & software development methodology that works.
ai-agent★ 244,424
Linux: Open Source Kernel
Get the Linux kernel source tree for custom development, ideal for startup founders in need of a flexible OS foundation
ai-agent★ 210,750
Vue
This is the repo for Vue 2. For Vue 3, go to https://github.com/vuejs/core
ai-agent★ 204,069
Improve Code with andrej-karpathy-skills
Get better code behavior with andrej-karpathy-skills, 165k+ GitHub stars, for founders using LLMs.
ai-agent★ 197,010
FreeDomain: Free Website Domain
Get a free domain with FreeDomain.