ai-agent

Semantic Router

Name: Semantic Router
Author: vllm-project

System Level Intelligent Router for Mixture-of-Models at Cloud, Data Center and Edge

4,403 stars713 forksGoUpdated 6/17/2026100% free · open source

About this skill

System Level Intelligent Router for Mixture-of-Models at Cloud, Data Center and Edge

Topics

ai-gateway

bert-classification

fine-tuning

golang

huggingface-candle

huggingface-transformers

kubernetes

llm

llmrouter

mcp

mixture-of-models

openclaw

pii-detection

prompt-engineering

prompt-guard

rust

semantic-router

vllm

What's inside — free to inspect

No purchase needed

Read the entire source before you build — unlike paid marketplaces that hide it behind a buy button.

top-level files

folders

137.6M

repo size

Apache-2.0

license

Key files

.editorconfig

.pre-commit-config.yaml

AGENTS.md

README.md

File tree

.agents/

.github/

bench/

candle-binding/

config/

dashboard/

deploy/

docs/

e2e/

ml-binding/

nlp-binding/

onnx-binding/

openvino-binding/

paper/

perf/

scripts/

src/

tools/

website/

.crd-ref-docs.yaml

.cursorrules

.dockerignore

.editorconfig

.gitattributes

Quick Actions

Details

Creator

vllm-project

Language

Related skills

More ai-agent tools founders pair with this one.

ai-agent★ 173,241

ollama: Run AI models

Get AI models up and running with ollama. For founders using Go and AI.

ai-agent★ 168,458

Improve Code with andrej-karpathy-skills

Get better code behavior with andrej-karpathy-skills, 165k+ GitHub stars, for founders using LLMs.

ai-agent★ 161,315

Transformers: AI Models

Get state-of-the-art machine learning models with Transformers, for startup founders, with 161k+ GitHub stars.

ai-agent★ 104,971

Gemini CLI

An open-source AI agent that brings the power of Gemini directly into your terminal.

ai-agent★ 82,875

RAGFlow: Smarter LLM Context

Get a superior context layer for LLMs with RAGFlow, a retrieval-augmented generation engine, ideal for founders in AI, with 82k+ GitHub stars.

ai-agent★ 82,793

Vllm

A high-throughput and memory-efficient inference and serving engine for LLMs