ai-agent

Gym

Evaluate and improve models and agents using environments
1,175 stars317 forksPythonUpdated 9/9/2026100% free · open source
What it does

Gym lets you benchmark and fine‑tune AI models (e.g., speech‑to‑text, language models) inside standardized test environments so you can compare performance objectively.

When to use it
  • You have a trained model and need to see how it stacks up against public benchmarks before shipping.
  • You want to run automated regression tests on model updates to catch performance drops early.
  • You need to run a hyper‑parameter sweep across several environments (ASR, NLU, etc.) without writing custom evaluation loops.
Ready-to-paste prompt
python -m nemo_gym.run --config-name=nlp/GLUE/cola.yaml model_path=/models/bert-base.nemo batch_size=32
Heads up: Gym requires a CUDA‑enabled PyTorch build; if you run on CPU you’ll get a runtime error – install the GPU‑compatible `torch` version that matches your CUDA driver before running the benchmark.
Saves to your device
Use with Claude
New

Skip the builder — one click puts this in Claude, Cursor, Antigravity and more.

✅ Light setup

Installs with a command or two; your AI agent can do it for you.

Try it instantly — no install
Claude Code
mkdir -p ~/.claude/skills/gym && curl -fsSL https://workflowstacks.com/api/skills/gym/claude-skill -o ~/.claude/skills/gym/SKILL.md
Open in another AI app

Opens the app with this repo with the prompt ready to go — no copy-paste needed.

Connect the whole catalog (MCP)
claude mcp add --transport http workflowstacks https://workflowstacks.com/api/mcp

Adds a WorkflowStacks connector to Claude Code: search and load any skill here by chatting.

What's inside — free to inspect

No purchase needed

Read the entire source before you build — unlike paid marketplaces that hide it behind a buy button.

18
top-level files
20
folders
95.1M
source size
Apache-2.0
license
Key files
.pre-commit-config.yaml
AGENTS.md
README.md
File tree
.agents/
.claude/
.codex/
.github/
.gitlab/
benchmarks/
cache/
data/
docker/
environments/
examples/
fern/
nemo_gym/
nemotron_recipes/
resources_servers/
responses_api_agents/
responses_api_models/
results/
scripts/
tests/
.dockerignore
.gitignore
.gitlab-ci.yml
.pre-commit-config.yaml
Quick Actions
Details
Creator
NVIDIA-NeMo
Language
Python
Category
ai-agent
Published
8/25/2025

Are you the creator of this tool? Claim your listing → and earn 85% of every sale.