ai-agent

MNN

Name: MNN
Author: alibaba

MNN: A blazing-fast, lightweight inference engine battle-tested by Alibaba, powering high-performance on-device LLMs and Edge AI.

15,386 stars2,340 forksC++Updated 6/3/2026100% free · open source

About this skill

MNN: A blazing-fast, lightweight inference engine battle-tested by Alibaba, powering high-performance on-device LLMs and Edge AI.

Topics

arm

convolution

deep-learning

embedded-devices

llm

machine-learning

mnn

transformer

vulkan

winograd-algorithm

What's inside — free to inspect

No purchase needed

Read the entire source before you build — unlike paid marketplaces that hide it behind a buy button.

top-level files

folders

320.3M

repo size

Apache-2.0

license

Key files

.pre-commit-config.yaml

AGENTS.md

README_CN.md

README_JP.md

README_TW.md

README.md

File tree

.github/

.pre-commit-hooks/

3rd_party/

apps/

backupcode/

benchmark/

ciscripts/

cmake/

codegen/

demo/

doc/

docs/

express/

include/

package_scripts/

project/

pymnn/

resource/

schema/

skills/

source/

test/

tools/

transformers/

Quick Actions

Details

Creator

alibaba

Language

C++

Related skills

More ai-agent tools founders pair with this one.

ai-agent★ 172,909

Ollama: Run AI Models Locally on Your Own Machine

Instantly deploy top open-source AI models without cloud dependencies. Perfect for founders building AI applications with complete privacy and control.

ai-agent★ 165,332

Karpathy Skills: AI Coding Wisdom for Smarter Development

Unlock advanced LLM coding strategies from a leading AI researcher. Essential reference for founders building intelligent code agents and AI products.

ai-agent★ 161,190

Transformers: Ship AI Models in Minutes, Not Months

Quickly define, train, and deploy state-of-the-art machine learning models across text, vision, and audio. Perfect for AI founders building intelligent applications.

ai-agent★ 114,247

llama.cpp

LLM inference in C/C++

ai-agent★ 81,785

RAGFlow: Build Context-Aware AI Agents 10x Faster

Python toolkit for startup founders wanting powerful retrieval-augmented generation with advanced agent capabilities. Supercharge your LLM context management with open-source AI infrastructure.

ai-agent★ 75,645

OpenHands: AI-Driven Dev

Get AI-driven development tools with OpenHands. For founders and developers.