local-ai

Run AI Locally with runanywhere-sdks

Name: Run AI Locally with runanywhere-sdks
Author: RunanywhereAI

Run AI models on-device with this production-ready toolkit, ideal for startup founders, backed by 10k+ GitHub stars

10,300 stars366 forksC++Health Score 9/10Updated 8/5/2026100% free · open source

What it does

Runanywhere-sdks allows you to run AI models directly on your device, eliminating the need for cloud services and enhancing data privacy and security

Install / run

git clone https://github.com/RunanywhereAI/runanywhere-sdks.git

When to use it

•When developing applications that require edge AI capabilities
•When needing to run AI models on devices with limited or no internet connectivity
•When prioritizing data privacy and security by keeping AI processing on-device

Quick start

1Navigate to the cloned repository: cd runanywhere-sdks
2Build the project using the provided build script: ./build.sh
3Explore the example models and configurations in the examples/ directory
4Modify the configuration files to suit your specific AI model and device needs
5Run the example application using the compiled binary: ./runanywhere-sdks/example

Ready-to-paste prompt

Run a pre-trained object detection model on a local image file: ./runanywhere-sdks/example -m examples/models/object_detection -i path/to/image.jpg

Heads up: Ensure your development environment meets the minimum C++ compiler version requirement (C++14 or higher) to successfully build and run the Runanywhere-sdks toolkit

Saves to your device