local-ai

LiteRT: Fast Edge AI

Deploy high-performance ML models on edge platforms with LiteRT, for startup founders
advancedโฑ Half a day๐Ÿ’ต Free (self-hosted)
3,254 stars414 forksC++Guide quality 8/10Updated 8/6/2026100% free ยท open source
What it is

Run ML and GenAI models directly on edge devices with high performance.

Real use case example

"A founder building a smart home device wants to recognize objects and provide information to users. They write a LiteRT model to interpret camera feeds and integrate it with their system; next, they test and refine it to achieve high accuracy; finally, they deploy the working model on their edge device to start improving user experiences."

Best insideClaude DesktopClaude CodeAny AI Client
When to use it
  • โ€ขWhen you need to run ML models on resource-constrained edge devices
  • โ€ขWhen you want to optimize the performance of your ML models on-device
  • โ€ขWhen you need to deploy ML models on platforms with limited connectivity
Ready-to-paste prompt
bazel build -c opt //examples:image_classification:main --define lite=1 && bazel run -c opt //examples:image_classification:main --define lite=1 -- --model_file=model.lite
Heads up: Ensure you have Bazel installed and properly configured on your system, as LiteRT relies on Bazel for building and deploying models
Saves to your device
Use with Claude
New

Skip the builder โ€” one click puts this in Claude, Cursor, Antigravity and more.

โœ… Light setup

Installs with a command or two; your AI agent can do it for you.

Try it instantly โ€” no install
Claude Code
mkdir -p ~/.claude/skills/litert && curl -fsSL https://workflowstacks.com/api/skills/litert/claude-skill -o ~/.claude/skills/litert/SKILL.md
Open in another AI app

Opens the app with this repo with the prompt ready to go โ€” no copy-paste needed.

Connect the whole catalog (MCP)
claude mcp add --transport http workflowstacks https://workflowstacks.com/api/mcp

Adds a WorkflowStacks connector to Claude Code: search and load any skill here by chatting.

What's inside โ€” free to inspect

No purchase needed

Read the entire source before you build โ€” unlike paid marketplaces that hide it behind a buy button.

26
top-level files
14
folders
405.0M
source size
Apache-2.0
license
Key files
configure
configure.py
README.md
File tree
.github/
ci/
cmake_example/
docker_build/
g3doc/
google3/
litert/
ml_drift_delegate/
tensor/
tensorflow/
tflite/
third_party/
tools/
weight_loader/
.bazeliskrc
.bazelrc
.bazelversion
.clang-tidy
.gitattributes
.gitignore
.gitmodules
android_ndk_env.bzl
BUILD
BUILD.darts_clone
Quick Actions
Details
Creator
google-ai-edge
Language
C++
Category
local-ai
Published
9/4/2024

Are you the creator of this tool? Claim your listing โ†’ and earn 85% of every sale.