ai-agent

Run LLMs Locally with awesome-local-llm

Get local LLM resources for self-hosted AI.
2,818 stars365 forksGuide quality 8/10Updated 8/4/2026100% free · open source
What it does

Awesome-local-llm provides a curated list of resources and tools to help founders self-host and run large language models (LLMs) locally.

When to use it
  • When you need to deploy AI models on-premises due to data privacy concerns
  • When you want to reduce cloud costs by running AI workloads locally
  • When you need more control over the AI infrastructure and model updates
Ready-to-paste prompt
To get started with a specific LLM platform, for example, Docker, paste the command `docker run -it --rm rafsk/llm-local` to run a local LLM instance
Heads up: Make sure you have Git installed on your system and configured properly to clone the repository, as some resources may require Git for deployment or setup
Saves to your device
Use with Claude
New

Skip the builder — one click puts this in Claude, Cursor, Antigravity and more.

⚡ Runs out of the box

A prompt/skill package — nothing to install beyond adding it to your AI tool.

Try it instantly — no install
Claude Code
mkdir -p ~/.claude/skills/awesome-local-llm && curl -fsSL https://workflowstacks.com/api/skills/awesome-local-llm/claude-skill -o ~/.claude/skills/awesome-local-llm/SKILL.md
Open in another AI app

Opens the app with this repo with the prompt ready to go — no copy-paste needed.

Connect the whole catalog (MCP)
claude mcp add --transport http workflowstacks https://workflowstacks.com/api/mcp

Adds a WorkflowStacks connector to Claude Code: search and load any skill here by chatting.

How Run LLMs Locally with awesome-local-llm works
Codeflow
Free to inspect

Run LLMs Locally with awesome-local-llm is a documents-only repository (2 doc files) — something you read, not something you run. There is nothing to install. Last commit a month ago, MIT license.

Size
Documents only
2 documents · 17 min skim
Setup
Nothing to install
A guide / curated list. Just read it and follow the links.
Runs on
Nowhere — you read it
A reading resource, not a program.
Where to start reading
  1. 1
    README.md
    Start here — what it does and how to install it
READMEMIT licenseUpdated 1 mo ago
Quick Actions
Details
Creator
rafska
Category
ai-agent
Published
6/3/2025

Are you the creator of this tool? Claim your listing → and earn 85% of every sale.