mlx-vlm: Run Vision‑Language Models Locally on Apple Silicon
From the repo · “MLX-VLM is a package for inference and fine-tuning of Vision Language Models (VLMs) on your Mac using MLX.”
Run Apple Silicon-based vision language models locally on your Mac.
"A founder wants to develop a product that can detect and classify clothing items in images. They start by installing MLX-VLM and importing the model. Next, they integrate it with their app using Python code to create a working prototype. The outcome is a product that accurately identifies images of clothing items and provides insights for their e-commerce business."
- •You're building an AI application that requires both image and text understanding
- •You need to fine-tune a pre-trained vision-language model for your specific use case
- •You prefer to develop and test AI models on your Mac rather than relying on cloud services
from mlx_vlm import VLM; model = VLM.from_pretrained('vlc-bert-base'); model.predict(image='path/to/image.jpg', text='This is a picture of a cat')Skip the builder — one click puts this in Claude, Cursor, Antigravity and more.
A prompt/skill package — nothing to install beyond adding it to your AI tool.
mkdir -p ~/.claude/skills/mlx-vlm && curl -fsSL https://workflowstacks.com/api/skills/mlx-vlm/claude-skill -o ~/.claude/skills/mlx-vlm/SKILL.mdOpens the app with this repo with the prompt ready to go — no copy-paste needed.
Mlx-vlm: Run Vision‑Language Models Locally on Apple Silicon is a very large Python project (~280k lines across 1427 code files, plus 17 test files). You install it into your AI tool with one command; there is nothing to run yourself. Last commit this month, MIT license, has a test suite.
- 1README.mdStart here — what it does and how to install it
- 2mlx_vlm/__main__.pyWhere the program starts running
- 3mlx_vlm/__init__.pyInside mlx_vlm/ — the main logic begins here
- 4examples/dots_mocr_demo.ipynbA worked example — copy this to get going
Skip the builder — one click puts this in Claude, Cursor, Antigravity and more.
A prompt/skill package — nothing to install beyond adding it to your AI tool.
mkdir -p ~/.claude/skills/mlx-vlm && curl -fsSL https://workflowstacks.com/api/skills/mlx-vlm/claude-skill -o ~/.claude/skills/mlx-vlm/SKILL.mdOpens the app with this repo with the prompt ready to go — no copy-paste needed.
Are you the creator of this tool? and earn 85% of every sale.
Show it off in your README:
[](https://workflowstacks.com/skills/mlx-vlm?utm_source=github&utm_medium=badge)The five fastest-growing open-source AI skills, ranked by GitHub star growth. One email a week, unsubscribe anytime.
Related skills
More design tools founders pair with this one.