ai-agent

Gpustack

Name: Gpustack
Author: gpustack

A GPU cluster manager that configures and orchestrates inference engines like vLLM and SGLang for high-performance AI model deployment.

5,145 stars545 forksPythonUpdated 6/12/2026100% free · open source

About this skill

A GPU cluster manager that configures and orchestrates inference engines like vLLM and SGLang for high-performance AI model deployment.

Topics

ascend

cuda

deepseek

distributed-inference

genai

high-performance-inference

inference

llama

llm

llm-inference

llm-serving

maas

mindie

openai

qwen

rocm

sglang

vllm

Quick Actions

Details

Creator

gpustack

Language

Python

Related skills

More ai-agent tools founders pair with this one.

ai-agent★ 173,241

ollama: Run AI models

Get AI models up and running with ollama. For founders using Go and AI.

ai-agent★ 168,458

Improve Code with andrej-karpathy-skills

Get better code behavior with andrej-karpathy-skills, 165k+ GitHub stars, for founders using LLMs.

ai-agent★ 161,315

Transformers: AI Models

Get state-of-the-art machine learning models with Transformers, for startup founders, with 161k+ GitHub stars.

ai-agent★ 104,971

Gemini CLI

An open-source AI agent that brings the power of Gemini directly into your terminal.

ai-agent★ 82,731

Vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

ai-agent★ 81,981

RAGFlow: Smarter LLM Context

Get a superior context layer for LLMs with RAGFlow, a retrieval-augmented generation engine, ideal for founders in AI, with 82k+ GitHub stars.