ai-evals

Streamline LLM Ops with AgentA

Name: Streamline LLM Ops with AgentA
Author: Agenta-AI

Founders, get prompt management and evaluation in one place with AgentA, backed by 4.3k+ GitHub stars.

4,254 stars555 forksTypeScriptQuality 9/10Updated 7/1/2026100% free · open source

About this skill

The open-source LLMOps platform: prompt playground, prompt management, LLM evaluation, and LLM observability all in one place.

Topics

agents

evaluation

llm-as-a-judge

llm-evaluation

llm-framework

llm-monitoring

llm-observability

llm-platform

llm-playground

llm-tools

llmops

observability

prompt-engineering

prompt-management

rag-evaluation

What's inside — free to inspect

No purchase needed

Read the entire source before you build — unlike paid marketplaces that hide it behind a buy button.

top-level files

folders

376.9M

repo size

Other

license

Key files

.pre-commit-config.yaml

AGENTS.md

README.md

File tree

.agents/

.claude/

.github/

.husky/

agents/

api/

clients/

docs/

ee/

examples/

hooks/

hosting/

sdks/

services/

web/

.all-contributorsrc

.better-commits.json

.dockerignore

.gitignore

.gitleaks.toml

.gitleaksignore

.mailmap

.pre-commit-config.yaml

AGENTS.md

Quick Actions

Details

Creator

Agenta-AI

Language

TypeScript

Related skills

More ai-evals tools founders pair with this one.

ai-evals★ 586

Build AI Agents with Agentos

Get a TypeScript AI agent framework for multi-agent orchestration. For founders needing autonomous AI agents.

ai-evals★ 500

agentsight: System-Level AI Tracing

Get system-level AI agent insights with agentsight, a zero instrument tracing tool for founders, using eBPF.

ai-evals★ 311

VerifyWise: AI Governance

Get comprehensive AI governance with VerifyWise, for founders needing AI compliance and risk management.