ai-agent

Scale AI with llm-scaler

Name: Scale AI with llm-scaler
Author: intel

Get AI scalability with llm-scaler, a C++ tool for founders

513 stars74 forksC++Guide quality 8/10Updated 9/4/2026100% free · open source

What it does

llm-scaler is a C++ tool that helps founders scale large language models for AI applications, enabling efficient and optimized performance

When to use it

•When you need to deploy large language models in a production environment
•When you want to optimize the performance of your AI models for better user experience
•When you are working with limited computational resources and need to scale your models efficiently

Ready-to-paste prompt

./llm_scaler -c config.json -m bert-base-uncased -b 32 -s 128

Heads up: Make sure you have the required C++ compiler and CMake version installed on your system, as specified in the README, to successfully build and run llm-scaler

Saves to your device

Use with Claude

New

Skip the builder — one click puts this in Claude, Cursor, Antigravity and more.

✅ Light setup

Installs with a command or two; your AI agent can do it for you.

Try it instantly — no install

Claude Code

mkdir -p ~/.claude/skills/llm-scaler && curl -fsSL https://workflowstacks.com/api/skills/llm-scaler/claude-skill -o ~/.claude/skills/llm-scaler/SKILL.md

Open in another AI app

Opens the app with this repo with the prompt ready to go — no copy-paste needed.

Connect the whole catalog (MCP)

claude mcp add --transport http workflowstacks https://workflowstacks.com/api/mcp

Adds a WorkflowStacks connector to Claude Code: search and load any skill here by chatting.

Use with Claude

New

Skip the builder — one click puts this in Claude, Cursor, Antigravity and more.

✅ Light setup

Installs with a command or two; your AI agent can do it for you.

Try it instantly — no install

Claude Code

mkdir -p ~/.claude/skills/llm-scaler && curl -fsSL https://workflowstacks.com/api/skills/llm-scaler/claude-skill -o ~/.claude/skills/llm-scaler/SKILL.md

Open in another AI app

Opens the app with this repo with the prompt ready to go — no copy-paste needed.

Connect the whole catalog (MCP)

claude mcp add --transport http workflowstacks https://workflowstacks.com/api/mcp

Adds a WorkflowStacks connector to Claude Code: search and load any skill here by chatting.

Quick Actions

Details

Creator

intel

Language

C++