rtp-llm
RTP-LLM is a high-performance large language model inference engine for diverse applications, enabling efficient deployment of LLMs in various scenarios.
- •When you need to deploy large language models for natural language processing tasks
- •When you require a high-performance inference engine for real-time applications
- •When you want to optimize the computational resources for LLM deployment
python examples/inference.py --model-name bert-base-uncased --input-text 'What is the capital of France?'
Skip the builder — one click puts this in Claude, Cursor, Antigravity and more.
Installs with a command or two; your AI agent can do it for you.
mkdir -p ~/.claude/skills/rtp-llm && curl -fsSL https://workflowstacks.com/api/skills/rtp-llm/claude-skill -o ~/.claude/skills/rtp-llm/SKILL.mdOpens the app with this repo with the prompt ready to go — no copy-paste needed.
What's inside — free to inspect
Read the entire source before you build — unlike paid marketplaces that hide it behind a buy button.
Skip the builder — one click puts this in Claude, Cursor, Antigravity and more.
Installs with a command or two; your AI agent can do it for you.
mkdir -p ~/.claude/skills/rtp-llm && curl -fsSL https://workflowstacks.com/api/skills/rtp-llm/claude-skill -o ~/.claude/skills/rtp-llm/SKILL.mdOpens the app with this repo with the prompt ready to go — no copy-paste needed.
Are you the creator of this tool? and earn 85% of every sale.
Show it off in your README:
[](https://workflowstacks.com/skills/rtp-llm?utm_source=github&utm_medium=badge)The five fastest-growing open-source AI skills, ranked by GitHub star growth. One email a week, unsubscribe anytime.
Related skills
More ai-agent tools founders pair with this one.