Auto-tuned launcher for GGUF models on llama.cpp / ik_llama.cpp โ OpenAI-compatible server with multi-GPU tensor-split, MoE expert placement, measured flag tuning (AI Tune), hardware-matched HuggingFace downloads, and crash recovery. An Ollama alternative for multi-GPU rigs.
Read the entire source before you build โ unlike paid marketplaces that hide it behind a buy button.
Are you the creator of this tool? Claim your listing โ and earn 85% of every sale.
More local-ai tools founders pair with this one.