support

Langchain-Chatchat: Local LLM App

Name: Langchain-Chatchat: Local LLM App
Author: chatchat-space

Get a local knowledge-based LLM app for chatbot development, ideal for startup founders, with 38k+ GitHub stars.

intermediate⏱ 1-2 hours💵 Free (self-hosted)

38,427 stars6,242 forksPythonQuality 8/10Updated 11/10/2025100% free · open source

What it is

Build a local knowledge-based chatbot application using Langchain-Chatchat, a Python-based tool.

What you can make with it

Automations like: a chatbot that answers frequent customer questions by pulling information from a local database, saving time for customer support teams.

How it helps

Langchain-Chatchat helps by providing a self-hosted, open-source solution for building chatbots, reducing reliance on third-party services and associated costs, while also offering flexibility and control over the application.

Real use case example

"A founder of a small e-commerce startup wants to automate customer support. They use Langchain-Chatchat to build a chatbot that answers questions about products and shipping, by integrating it with their local product database. After setting it up, customers can now get instant answers to common questions, freeing up the founder to focus on other tasks."

If you're new

A beginner should pick this up when they want to explore building chatbots without relying on expensive, proprietary platforms.

If you're senior

A senior engineer would reach for this when they need a customizable, self-hosted chatbot solution that integrates well with their existing infrastructure.

Common confusion cleared up

The most common confusion about Langchain-Chatchat is that it's not a cloud-based service, but rather a self-hosted application that requires some technical expertise to set up.

Pairs with

local databasescustomer support softwaree-commerce platforms

Why we list it on WorkflowStacks: A marketplace of AI tools would include this because it's a free, open-source solution that offers a cost-effective alternative to paid chatbot development platforms.

What it does

Langchain-Chatchat enables founders to build intelligent chatbots using local large language models like ChatGLM and Llama, turning their data into interactive AI tools.

Install / run

git clone https://github.com/chatchat-space/Langchain-Chatchat.git && cd Langchain-Chatchat

When to use it

•You want to create a custom chatbot that leverages your own data and knowledge base.
•You need an AI-powered support tool that can understand and respond to user queries in a specific domain or industry.
•You prefer to keep your data and AI models local, rather than relying on cloud-based services.

Quick start

1Modify the `config.json` file to specify your local LLM model, such as ChatGLM or Llama.
2Create a new knowledge graph by running `python scripts/create_kg.py` and following the prompts.
3Train a new agent by running `python scripts/train_agent.py` with your specified model and knowledge graph.
4Test your chatbot by running `python scripts/chat.py` and interacting with the agent.
5Refine your chatbot's performance by tuning hyperparameters and adjusting the knowledge graph.

Ready-to-paste prompt

python scripts/chat.py -m ChatGLM -kg my_knowledge_graph.json -a my_agent.json

Heads up: Before running Langchain-Chatchat, ensure you have a compatible local LLM model installed, such as ChatGLM or Llama, and that the model's API is properly configured and accessible.

Saves to your device