ai-agent

KDFlow: Simplify LLM Knowledge Distillation

Get efficient knowledge distillation with KDFlow, a framework for startup founders working with large language models.
238 stars17 forksPythonGuide quality 8/10Updated 8/16/2026100% free · open source
What it does

KDFlow is a framework that allows startup founders to efficiently perform knowledge distillation on large language models, transferring knowledge from a teacher model to a student model.

When to use it
  • When you have a large pre-trained language model and want to reduce its size while preserving its performance
  • When you need to adapt a language model to a specific domain or task with limited training data
  • When you want to improve the efficiency of your language model deployment without sacrificing accuracy
Ready-to-paste prompt
python train.py --config config.py --teacher_model bert-base-uncased --student_model distilbert-base-uncased --dataset glue-mnli
Heads up: Make sure you have the correct version of PyTorch installed, as KDFlow requires PyTorch 1.9 or later, and also ensure that you have the necessary dependencies installed, including the `transformers` library
Saves to your device
Use with Claude
New

Skip the builder — one click puts this in Claude, Cursor, Antigravity and more.

✅ Light setup

Installs with a command or two; your AI agent can do it for you.

Try it instantly — no install
Claude Code
mkdir -p ~/.claude/skills/kdflow && curl -fsSL https://workflowstacks.com/api/skills/kdflow/claude-skill -o ~/.claude/skills/kdflow/SKILL.md
Open in another AI app

Opens the app with this repo with the prompt ready to go — no copy-paste needed.

Connect the whole catalog (MCP)
claude mcp add --transport http workflowstacks https://workflowstacks.com/api/mcp

Adds a WorkflowStacks connector to Claude Code: search and load any skill here by chatting.

Quick Actions
Details
Creator
songmzhang
Language
Python
Category
ai-agent
Published
2/27/2026

Are you the creator of this tool? Claim your listing → and earn 85% of every sale.