support

local-LLM-with-RAG: AI Generation

Get local language model generation for your startup with local-LLM-with-RAG.
286 stars56 forksPythonGuide quality 8/10Updated 7/11/2026100% free · open source
What it does

Local-LLM-with-RAG enables founders to run local language models for AI-powered chat and language tools, specifically using Retrieval-Augmented Generation (RAG) for enhanced text generation

When to use it
  • When you need to integrate AI-powered chat functionality into your startup's application
  • When you want to generate human-like text based on specific input or context
  • When you require a customizable language model that can be fine-tuned for your specific use case
Ready-to-paste prompt
python generate.py --prompt 'Write a product description for a new smartwatch' --length 100
Heads up: Ensure you have the necessary GPU resources and compatible CUDA version to run the model, as specified in the README, to avoid compatibility issues
Saves to your device
Use with Claude
New

Skip the builder — one click puts this in Claude, Cursor, Antigravity and more.

✅ Light setup

Installs with a command or two; your AI agent can do it for you.

Try it instantly — no install
Claude Code
mkdir -p ~/.claude/skills/local-llm-with-rag && curl -fsSL https://workflowstacks.com/api/skills/local-llm-with-rag/claude-skill -o ~/.claude/skills/local-llm-with-rag/SKILL.md
Open in another AI app

Opens the app with this repo with the prompt ready to go — no copy-paste needed.

Connect the whole catalog (MCP)
claude mcp add --transport http workflowstacks https://workflowstacks.com/api/mcp

Adds a WorkflowStacks connector to Claude Code: search and load any skill here by chatting.

Quick Actions
Details
Creator
amscotti
Language
Python
Category
support
Published
11/5/2023

Are you the creator of this tool? Claim your listing → and earn 85% of every sale.

Ready-to-run pack · one-time $29

Review Watchdog

Catch every bad review the day it lands — with a reply ready.

Includes the tested workflow and a written setup playbook. Needs: Google Places API key (free tier).

See what you get