ai-agent
sonar: Fast LLM Inference
Get fast large-scale LLM inference with sonar, a tool for founders and machine learning teams.
1,842 stars207 forksC++Guide quality 9/10Updated 8/13/2026100% free · open source
What it does
Sonar is a large-scale LLM inference engine that allows founders and machine learning teams to run fast and efficient language model inference
When to use it
- •When you need to deploy a language model for production use cases
- •When you want to speed up your language model inference pipeline
- •When you require a scalable solution for large-scale language model deployments
Ready-to-paste prompt
./sonar -c config.json -m your_model.sonar -i 'What is the meaning of life?'
Heads up: Sonar requires a compatible C++ compiler (e.g. GCC 10 or later) and a CPU with AVX-512 support for optimal performance
Saves to your device
Use with Claude
New
Skip the builder — one click puts this in Claude, Cursor, Antigravity and more.
✅ Light setup
Installs with a command or two; your AI agent can do it for you.
Try it instantly — no install
Claude Code
mkdir -p ~/.claude/skills/sonar && curl -fsSL https://workflowstacks.com/api/skills/sonar/claude-skill -o ~/.claude/skills/sonar/SKILL.mdOpen in another AI app
Opens the app with this repo with the prompt ready to go — no copy-paste needed.
Use with Claude
New
Skip the builder — one click puts this in Claude, Cursor, Antigravity and more.
✅ Light setup
Installs with a command or two; your AI agent can do it for you.
Try it instantly — no install
Claude Code
mkdir -p ~/.claude/skills/sonar && curl -fsSL https://workflowstacks.com/api/skills/sonar/claude-skill -o ~/.claude/skills/sonar/SKILL.mdOpen in another AI app
Opens the app with this repo with the prompt ready to go — no copy-paste needed.
Details
Creator
dphnAI
Language
C++
Category
ai-agent
Published
6/23/2023
Are you the creator of this tool? Claim your listing → and earn 85% of every sale.
Related skills
More ai-agent tools founders pair with this one.
ai-agent★ 276,806
Track GitHub Stars with 996.ICU
Get a popular GitHub star counter for your startup, ideal.
ai-agent★ 264,191
Superpowers
An agentic skills framework & software development methodology that works.
ai-agent★ 244,424
Linux: Open Source Kernel
Get the Linux kernel source tree for custom development, ideal for startup founders in need of a flexible OS foundation
ai-agent★ 210,750
Vue
This is the repo for Vue 2. For Vue 3, go to https://github.com/vuejs/core
ai-agent★ 204,069
Improve Code with andrej-karpathy-skills
Get better code behavior with andrej-karpathy-skills, 165k+ GitHub stars, for founders using LLMs.
ai-agent★ 197,010
FreeDomain: Free Website Domain
Get a free domain with FreeDomain.