ai-agent

Sglang

Name: Sglang
Author: sgl-project

SGLang is a high-performance serving framework for large language models and multimodal models.

28,906 stars6,417 forksPythonUpdated 6/9/2026100% free · open source

About this skill

SGLang is a high-performance serving framework for large language models and multimodal models.

Topics

attention

blackwell

cuda

deepseek

diffusion

glm

gpt-oss

inference

llama

llm

minimax

moe

qwen

qwen-image

reinforcement-learning

transformer

vlm

wan

What's inside — free to inspect

No purchase needed

Read the entire source before you build — unlike paid marketplaces that hide it behind a buy button.

top-level files

folders

181.6M

repo size

Apache-2.0

license

Key files

.pre-commit-config.yaml

README.md

File tree

.claude/

.devcontainer/

.github/

3rdparty/

assets/

benchmark/

docker/

docs/

docs_new/

examples/

experimental/

proto/

python/

rust/

scripts/

sgl-kernel/

sgl-model-gateway/

test/

.codespellrc

.coveragerc

.dockerignore

.gitignore

.isort.cfg

.pre-commit-config.yaml

Quick Actions

Details

Creator

sgl-project

Language

Python

Related skills

More ai-agent tools founders pair with this one.

ai-agent★ 173,241

ollama: Run AI models

Get AI models up and running with ollama. For founders using Go and AI.

ai-agent★ 168,458

Improve Code with andrej-karpathy-skills

Get better code behavior with andrej-karpathy-skills, 165k+ GitHub stars, for founders using LLMs.

ai-agent★ 161,315

Transformers: AI Models

Get state-of-the-art machine learning models with Transformers, for startup founders, with 161k+ GitHub stars.

ai-agent★ 104,971

Gemini CLI

An open-source AI agent that brings the power of Gemini directly into your terminal.

ai-agent★ 82,731

Vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

ai-agent★ 81,981

RAGFlow: Smarter LLM Context

Get a superior context layer for LLMs with RAGFlow, a retrieval-augmented generation engine, ideal for founders in AI, with 82k+ GitHub stars.