ai-agent

Llama-macOS: Host LLMs

Name: Llama-macOS: Host LLMs
Author: ggml-org

Get a home for your LLMs with 1.4k+ GitHub stars. For founders needing AI solutions on macOS.

1,389 stars86 forksSwiftQuality 8/10Updated 7/21/2026100% free · open source

What it does

Llama-macOS provides a local environment for running and managing large language models (LLMs) on macOS devices, allowing founders to develop and test AI solutions natively.

Install / run

git clone https://github.com/ggml-org/Llama-macOS.git

When to use it

•When you need to develop and test AI-powered applications on macOS without relying on cloud services
•When you require a local environment for training and fine-tuning LLMs for specific business needs
•When you want to integrate LLM capabilities into your macOS-based startup products

Quick start

1Open the cloned repository in Xcode by running `open Llama-macOS/Llama-macOS.xcodeproj`
2Build the project by clicking on 'Product' > 'Build' or pressing `Cmd + B`
3Run the application by clicking on 'Product' > 'Run' or pressing `Cmd + R`
4Configure the LLM settings by editing the `Config.swift` file
5Test the LLM functionality by using the `main.swift` example script

Ready-to-paste prompt

swift run Llama-macOS --model-name 'ggml-bert-base' --input-text 'What is the meaning of AI?'

Heads up: Before running Llama-macOS, ensure you have the latest version of Xcode and the Swift compiler installed, as the project relies on specific Swift features and macOS frameworks

Saves to your device