devtools

semantic-router: Smart Routing

Get intelligent routing for mixture-of-models with semantic-router, ideal for startup founders using AI at scale
intermediate⏱ 30 minutesπŸ’΅ Free (self-hosted)
5,204 stars823 forksGoGuide quality 8/10Updated 8/21/2026100% free Β· open source
What it is

Directs data to the right AI model with the semantic-router.

Real use case example

"A founder like Emily wants to create a chatbot that answers customer queries about product availability. Emily uses the semantic-router to direct customer data to the most accurate AI model, which returns an answer within seconds. The chatbot improves customer satisfaction and Emily can focus on growing the business."

Best insideClaude DesktopCursorCodex CLI
When to use it
  • β€’When deploying AI models at scale and needing efficient traffic routing
  • β€’In environments with diverse model types requiring smart routing decisions
  • β€’For optimizing resource utilization in cloud, data center, or edge computing
Ready-to-paste prompt
Run './semantic-router -config config.yaml -model-dir /path/to/models' to start the router with a specific model directory
Heads up: Ensure you have Go (version 1.17 or later) installed on your system, as semantic-router is built using Go and requires it to compile and run
Saves to your device
Use with Claude
New

Skip the builder β€” one click puts this in Claude, Cursor, Antigravity and more.

βœ… Light setup

Installs with a command or two; your AI agent can do it for you.

Try it instantly β€” no install
Claude Code
mkdir -p ~/.claude/skills/semantic-router && curl -fsSL https://workflowstacks.com/api/skills/semantic-router/claude-skill -o ~/.claude/skills/semantic-router/SKILL.md
Open in another AI app

Opens the app with this repo with the prompt ready to go β€” no copy-paste needed.

Connect the whole catalog (MCP)
claude mcp add --transport http workflowstacks https://workflowstacks.com/api/mcp

Adds a WorkflowStacks connector to Claude Code: search and load any skill here by chatting.

What's inside β€” free to inspect

No purchase needed

Read the entire source before you build β€” unlike paid marketplaces that hide it behind a buy button.

17
top-level files
16
folders
284.4M
source size
Apache-2.0
license
Key files
.editorconfig
.pre-commit-config.yaml
AGENTS.md
README.md
File tree
.github/
bench/
candle-binding/
config/
dashboard/
deploy/
e2e/
ml-binding/
nlp-binding/
onnx-binding/
openvino-binding/
paper/
perf/
src/
tools/
website/
.dockerignore
.editorconfig
.gitattributes
.gitignore
.mergify.yml
.pre-commit-config.yaml
.prowlabels.yaml
AGENTS.md
Quick Actions
Details
Creator
vllm-project
Language
Go
Category
devtools
Published
8/26/2025

Are you the creator of this tool? Claim your listing β†’ and earn 85% of every sale.