TensorRT-Edge-LLM: Accelerate LLM & VLM Inference on Edge Devices
From the repo · “High-performance, light-weight C++ LLM and VLM Inference Software for Physical AI”
TensorRT-Edge-LLM enables high-performance AI inference for physical AI products by optimizing large language models and vision models for edge devices
- •Building a smart home device that requires real-time voice or image processing
- •Developing an autonomous robot that needs to quickly process visual or auditory data
- •Creating a wearable device that requires low-latency AI-driven insights
Run the sample inference application with a custom prompt: ./sample_inference -m models/bert-base-uncased.pt -p 'What is the capital of France?'
Skip the builder — one click puts this in Claude, Cursor, Antigravity and more.
Installs with a command or two; your AI agent can do it for you.
mkdir -p ~/.claude/skills/tensorrt-edge-llm && curl -fsSL https://workflowstacks.com/api/skills/tensorrt-edge-llm/claude-skill -o ~/.claude/skills/tensorrt-edge-llm/SKILL.mdOpens the app with this repo with the prompt ready to go — no copy-paste needed.
What's inside — free to inspect
Read the entire source before you build — unlike paid marketplaces that hide it behind a buy button.
Skip the builder — one click puts this in Claude, Cursor, Antigravity and more.
Installs with a command or two; your AI agent can do it for you.
mkdir -p ~/.claude/skills/tensorrt-edge-llm && curl -fsSL https://workflowstacks.com/api/skills/tensorrt-edge-llm/claude-skill -o ~/.claude/skills/tensorrt-edge-llm/SKILL.mdOpens the app with this repo with the prompt ready to go — no copy-paste needed.
Are you the creator of this tool? and earn 85% of every sale.
Show it off in your README:
[](https://workflowstacks.com/skills/tensorrt-edge-llm?utm_source=github&utm_medium=badge)The five fastest-growing open-source AI skills, ranked by GitHub star growth. One email a week, unsubscribe anytime.
Related skills
More ai-agent tools founders pair with this one.