The marketplace for AI skills that launch offers, rank in AI search, and automate operations. No coding required.

Marketplace

Browse Skills
AI Agents
Claude Skills
MCP Servers
Prompts

Solutions

For Founders
For Agencies
For Ecommerce
Agent Builder
Starter Packs
Playbooks

Learn

How It Works
What Are Skills
What Are Agents
What Is MCP
For Creators
Submit a Tool
Security

Company

Become a Creator
About
Enterprise
API Docs
Terms
Privacy
Support

Compatible with

🤖ChatGPT

✨Claude

💎Gemini

🛍️Shopify

🔍Ahrefs

📊Sheets

💬WhatsApp

📱Meta Ads

+50 moreCreator program →

© 2026 WorkflowStacks. All rights reserved.

Terms Privacy Support

ai-agent

Inference

Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unified, production-re…

9,340 stars832 forksPythonUpdated 6/6/2026100% free · open source

About this skill

Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unified, production-ready inference API.

Topics

artificial-intelligence

chatglm

deployment

flan-t5

gemma

ggml

glm4

inference

llama

llama3

llamacpp

llm

machine-learning

mistral

openai-api

pytorch

qwen

vllm

whisper

wizardlm

What's inside — free to inspect

No purchase needed

Read the entire source before you build — unlike paid marketplaces that hide it behind a buy button.

16

top-level files

8

folders

73.1M

repo size

Apache-2.0

license

Key files

.pre-commit-config.yaml

AGENTS.md

README_ja_JP.md

README_zh_CN.md

README.md

File tree

.github/

assets/

benchmark/

doc/

examples/

frontend/

monitor/

xinference/

.dockerignore

.gitattributes

.gitignore

.pre-commit-config.yaml

.readthedocs.yaml

AGENTS.md

CLAUDE.md

LICENSE

MANIFEST.in

pyproject.toml

README_ja_JP.md

README_zh_CN.md

README.md

setup.cfg

setup.py

versioneer.py

Quick Actions

Details

Creator

xorbitsai

Language

Python

Category

ai-agent

Published

6/14/2023

Are you the creator of this tool? Claim your listing → and earn 85% of every sale.

Related skills

More ai-agent tools founders pair with this one.

ai-agent★ 173,241

ollama: Run AI models

Get AI models up and running with ollama. For founders using Go and AI.

ai-agent★ 168,458

Improve Code with andrej-karpathy-skills

Get better code behavior with andrej-karpathy-skills, 165k+ GitHub stars, for founders using LLMs.

ai-agent★ 161,315

Transformers: AI Models

Get state-of-the-art machine learning models with Transformers, for startup founders, with 161k+ GitHub stars.

ai-agent★ 104,971

An open-source AI agent that brings the power of Gemini directly into your terminal.

ai-agent★ 82,731

A high-throughput and memory-efficient inference and serving engine for LLMs

ai-agent★ 81,981

RAGFlow: Smarter LLM Context

Get a superior context layer for LLMs with RAGFlow, a retrieval-augmented generation engine, ideal for founders in AI, with 82k+ GitHub stars.