AutoRAG: Automate RAG Evaluation
From the repo · “Your Personal Librarian Agent. Ask anything on your computer, organize files, remember important info and files.”
AutoRAG optimizes Retrieval-Augmented Generation by automating the evaluation and optimization process with AutoML-style automation, allowing founders to fine-tune their language generation models efficiently
- •When you need to improve the performance of your language generation models
- •When you want to automate the process of evaluating and optimizing Retrieval-Augmented Generation models
- •When you need to reduce the time and effort required to fine-tune your language generation models
python scripts/train.py --model_name_or_path t5-base --dataset_name wiki_text --do_train --do_eval --train_batch_size 16 --eval_batch_size 64
Skip the builder — one click puts this in Claude, Cursor, Antigravity and more.
Expect 20–40 minutes in a terminal — or let your AI agent drive it.
mkdir -p ~/.claude/skills/autorag && curl -fsSL https://workflowstacks.com/api/skills/autorag/claude-skill -o ~/.claude/skills/autorag/SKILL.mdOpens the app with this repo with the prompt ready to go — no copy-paste needed.
AutoRAG: Automate RAG Evaluation is a very large TypeScript project (~62k lines across 474 code files, plus 311 test files). It is a full software project: use it through its install path rather than reading it end to end. Last commit this month, Other license, has a test suite.
- 1README.mdStart here — what it does and how to install it
- 2AGENTS.mdThe instructions the AI actually follows
- 3src/index.tsWhere the program starts running
- 4package.jsonDependencies and the commands it exposes
Skip the builder — one click puts this in Claude, Cursor, Antigravity and more.
Expect 20–40 minutes in a terminal — or let your AI agent drive it.
mkdir -p ~/.claude/skills/autorag && curl -fsSL https://workflowstacks.com/api/skills/autorag/claude-skill -o ~/.claude/skills/autorag/SKILL.mdOpens the app with this repo with the prompt ready to go — no copy-paste needed.
Are you the creator of this tool? and earn 85% of every sale.
Show it off in your README:
[](https://workflowstacks.com/skills/autorag?utm_source=github&utm_medium=badge)The five fastest-growing open-source AI skills, ranked by GitHub star growth. One email a week, unsubscribe anytime.
Related skills
More ai-agent tools founders pair with this one.