automation

ODS: AI Server

Name: ODS: AI Server
Author: Osmantic

Turn devices into AI servers for automation. For founders needing local AI solutions with 3.3k+ GitHub stars.

3,336 stars478 forksPythonQuality 8/10Updated 7/21/2026100% free · open source

What it does

Turn your computer into a local AI server for automation tasks, supporting features like LLM inference, chat UI, and image generation

Install / run

git clone https://github.com/Osmantic/ODS.git && cd ODS

When to use it

•You need to automate tasks on a local machine without relying on cloud services
•You want to prototype AI-powered applications with a low-cost, self-hosted solution
•Your project requires a high level of data privacy and security, making local deployment a necessity

Quick start

1Run the development server with `docker-compose up` to start the ODS API and UI
2Configure your AI models and workflows in the `config.yaml` file
3Use the `ods-cli` command-line tool to interact with the ODS API and test your workflows
4Access the ODS web interface at `http://localhost:8080` to manage your AI server and workflows
5Experiment with different AI tasks, such as LLM inference or image generation, using the provided example workflows

Ready-to-paste prompt

ods-cli workflow run --workflow example-llm-inference --input 'What is the meaning of life?'

Heads up: Make sure you have Docker and Docker Compose installed on your system before attempting to run ODS, as it relies on containerization to manage its dependencies and services

Saves to your device