ai-agent

Llama-macOS: Host LLMs

Name: Llama-macOS: Host LLMs
Author: ggml-org

For founders needing AI solutions on macOS.

1,481 stars105 forksSwiftGuide quality 8/10Updated 9/1/2026100% free · open source

What it does

Llama-macOS provides a local environment for running and managing large language models (LLMs) on macOS devices, allowing founders to develop and test AI solutions natively.

When to use it

•When you need to develop and test AI-powered applications on macOS without relying on cloud services
•When you require a local environment for training and fine-tuning LLMs for specific business needs
•When you want to integrate LLM capabilities into your macOS-based startup products

Ready-to-paste prompt

swift run Llama-macOS --model-name 'ggml-bert-base' --input-text 'What is the meaning of AI?'

Heads up: Before running Llama-macOS, ensure you have the latest version of Xcode and the Swift compiler installed, as the project relies on specific Swift features and macOS frameworks

Saves to your device

Use with Claude

New

Skip the builder — one click puts this in Claude, Cursor, Antigravity and more.

🛠️ Technical setup

Expect 20–40 minutes in a terminal — or let your AI agent drive it.

Try it instantly — no install

Claude Code

mkdir -p ~/.claude/skills/llama-macos && curl -fsSL https://workflowstacks.com/api/skills/llama-macos/claude-skill -o ~/.claude/skills/llama-macos/SKILL.md

Open in another AI app

Opens the app with this repo with the prompt ready to go — no copy-paste needed.

Connect the whole catalog (MCP)

claude mcp add --transport http workflowstacks https://workflowstacks.com/api/mcp

Adds a WorkflowStacks connector to Claude Code: search and load any skill here by chatting.

How Llama-macOS: Host LLMs works

Codeflow

Free to inspect

Llama-macOS: Host LLMs is a large Swift project (~16k lines across 81 code files). It is a full software project: use it through its install path rather than reading it end to end. Last commit this month, MIT license, no tests found.

Size

Large codebase

~16k lines · 81 code files · ~2 h to skim

Setup

Developer setup

A real software project. Use it via its install path; don't expect to read it all.

Runs on

Swift

No API keys detected

Swift 94%HTML 6%

Where to start reading

1
readme.md
Start here — what it does and how to install it

What's in each folder

Llama/Server/Backend / API7 files

Llama/Assets.xcassets/Folder32 files

Llama/Menu/Folder23 files

Llama/Common/Folder7 files

Llama/Models/Data models & types7 files

Llama/Downloads/Folder6 files

Llama/Settings/Configuration6 files

Llama/GlobalInput/Folder5 files

READMENo tests foundThin docsNo CIMIT licenseUpdated this month