ai-agent

GPTQModel: Faster AI

Compress AI models with GPTQModel, a toolkit for startup founders, with 1.2k+ GitHub stars.

From the repo · “LLM model quantization (compression) toolkit with HW acceleration support for Nvidia, AMD, Intel GPU and Intel/AMD/Apple CPU via HF, vLLM, and SGLang.”

1,275 stars+2★ this week212 forksPythonGuide quality 8/10 · reviewed Jul 9Updated 10/22/2026100% free · open source
What it does

GPTQModel compresses large language models to reduce their size and improve deployment efficiency on various hardware platforms, including Nvidia, AMD, Intel, and Apple CPUs and GPUs.

When to use it
  • •When deploying AI models on edge devices with limited storage or computational resources
  • •When reducing the latency and cost of inference in cloud-based AI applications
  • •When optimizing AI model size and speed for real-time customer interactions, such as chatbots or voice assistants
Ready-to-paste prompt
python -m gptqmodel.quantize --model gpt2 --config quantization_config.json --hardware accelerator=nvidia
Heads up: Ensure you have the correct version of the `torch` and `transformers` libraries installed, as GPTQModel relies on these dependencies for model quantization and hardware acceleration
Saves to your device
Use with Claude
New

Skip the builder — one click puts this in Claude, Cursor, Antigravity and more.

✅ Light setup

Installs with a command or two; your AI agent can do it for you.

Try it instantly — no install
Claude Code
mkdir -p ~/.claude/skills/gptqmodel && curl -fsSL https://workflowstacks.com/api/skills/gptqmodel/claude-skill -o ~/.claude/skills/gptqmodel/SKILL.md
Open in another AI app

Opens the app with this repo with the prompt ready to go — no copy-paste needed.

Connect the whole catalog (MCP)
claude mcp add --transport http workflowstacks https://workflowstacks.com/api/mcp

Adds a WorkflowStacks connector to Claude Code: search and load any skill here by chatting.

What's inside — free to inspect

No purchase needed

Read the entire source before you build — unlike paid marketplaces that hide it behind a buy button.

10
top-level files
11
folders
101.1M
source size
Other
license
Key files
AGENTS.md
README.md
requirements.txt
File tree
.agents/
.github/
docs/
format/
gptqmodel/
gptqmodel_ext/
hw/
licenses/
optimize/
scripts/
tests/
.gitignore
AGENTS.md
checkpoint.md
CREDITS.md
LICENSE
MANIFEST.in
pyproject.toml
README.md
requirements.txt
setup.py
Quick Actions
Details
Creator
ModelCloud
Language
Python
Category
ai-agent
Published
6/17/2024

Are you the creator of this tool? and earn 85% of every sale.

Show it off in your README:

Featured on WorkflowStacks
[![Featured on WorkflowStacks](https://workflowstacks.com/api/badge/gptqmodel.svg)](https://workflowstacks.com/skills/gptqmodel?utm_source=github&utm_medium=badge)
🔥 Hot this week, in your inbox
Skills like this, every Monday.

The five fastest-growing open-source AI skills, ranked by GitHub star growth. One email a week, unsubscribe anytime.