mcp-server

vmlx: Ultra‑Fast LLM Caching & Persistent Disk Store for Founders

vmlx delivers multi‑level caching—L1 paged for instant token‑to‑first‑token and L2 disk cache that survives restarts—plus hybrid scheduling and continuous batching, ideal for startups building high‑throughput AI services.

From the repo · “vMLX - Use MLX models easily - JANGQ (GGUF for MLX) - Not dependant on mlx_vlm”

intermediate⏱ 30 minutes💵 Free
899 stars+9★ this week97 forksPythonGuide quality 8/10 · reviewed Oct 21Updated 10/21/2026100% free · open source
What it is

Use Python to quickly make super fast machine learning models.

Real use case example

"A founder wants to add product recommendations to their e-commerce site. They use vMLX to quickly build a fast ML model, which runs on their MCP server. They train the model with a dataset of customer purchases and product features. The model helps their site suggest relevant products to each customer."

Best insideCursorClaude Desktop
When to use it
  • •When you need to deploy large machine learning models and want to reduce memory usage
  • •When you require fast model serving and inference with low latency
  • •When you want to survive model serving interruptions, such as restarts, with a disk cache
Ready-to-paste prompt
curl -X POST -H 'Content-Type: application/json' -d '@input.json' http://localhost:8000/predict
Heads up: Make sure you have the correct Python version installed, as vMLX has specific dependencies and may not be compatible with all Python versions
Saves to your device
Use with Claude
New

Skip the builder — one click puts this in Claude, Cursor, Antigravity and more.

✅ Light setup

Installs with a command or two; your AI agent can do it for you.

Try it instantly — no install
Claude Code
mkdir -p ~/.claude/skills/vmlx && curl -fsSL https://workflowstacks.com/api/skills/vmlx/claude-skill -o ~/.claude/skills/vmlx/SKILL.md
Open in another AI app

Opens the app with this repo with the prompt ready to go — no copy-paste needed.

Connect the whole catalog (MCP)
claude mcp add --transport http workflowstacks https://workflowstacks.com/api/mcp

Adds a WorkflowStacks connector to Claude Code: search and load any skill here by chatting.

What's inside — free to inspect

No purchase needed

Read the entire source before you build — unlike paid marketplaces that hide it behind a buy button.

10
top-level files
10
folders
135.3M
source size
Apache-2.0
license
Key files
README.md
File tree
.github/
assets/
bench/
benchmarks/
docs/
native_extensions/
panel/
scripts/
tests/
vmlx_engine/
.gitignore
.mailmap
CHANGELOG.md
latest.json
LICENSE
MANIFEST.in
pyproject.toml
pytest.ini
README.md
uv.lock
Quick Actions
Details
Creator
jjang-ai
Language
Python
Category
mcp-server
Published
2/18/2026

Are you the creator of this tool? and earn 85% of every sale.

Show it off in your README:

Featured on WorkflowStacks
[![Featured on WorkflowStacks](https://workflowstacks.com/api/badge/vmlx.svg)](https://workflowstacks.com/skills/vmlx?utm_source=github&utm_medium=badge)
🔥 Hot this week, in your inbox
Skills like this, every Monday.

The five fastest-growing open-source AI skills, ranked by GitHub star growth. One email a week, unsubscribe anytime.

Do this with a working workflow

Pages we wrote and tested that put a skill like this to work — importable n8n templates, outcome guides and Claude Desktop configs.