workflowstacks
voice-ai

Build Voice AI with nemotron-voice-agent

Get a reference voice agent implementation for your startup, built with NVIDIA Nemotron models, for founders needing voice AI.
221 stars55 forksTypeScriptHealth Score 9/10Updated 8/31/2026100% free · open source
What it does

This tool provides a reference implementation of an end-to-end voice agent built using the NVIDIA Nemotron models, allowing founders to integrate voice AI into their startup

Install / run
git clone https://github.com/NVIDIA-AI-Blueprints/nemotron-voice-agent.git
When to use it
  • When you need to build a conversational interface for your application
  • When you want to leverage pre-trained voice AI models for faster development
  • When you're looking for a customizable voice agent solution for your specific use case
Quick start
  1. 1Navigate to the cloned repository: cd nemotron-voice-agent
  2. 2Install dependencies: npm install
  3. 3Start the development server: npm run start
  4. 4Open the demo webpage: http://localhost:3000
  5. 5Modify the config.js file to customize the voice agent's behavior
Ready-to-paste prompt
node inference.js --audio_file examples/audio_sample.wav --model_path models/nemotron.tlt
Heads up: Ensure you have the necessary NVIDIA dependencies installed, including the NVIDIA TensorRT and cuDNN libraries, to run the Nemotron models
Saves to your device
How Build Voice AI with nemotron-voice-agent works
Codeflow
Free to inspect

Build Voice AI with nemotron-voice-agent is a large Python project (~26k lines across 140 code files, plus 26 test files). Setup is light: runs with Docker — add your API keys to .env. Last commit this month, BSD-2-Clause license, has a test suite.

Size
Large codebase
~26k lines · 140 code files · ~4 h to skim
Setup
Light setup
Runs with Docker — add your API keys to .env.
Runs on
Python · Docker
Needs API keys (.env)
Python 79%TypeScript 14%SCSS 4%Jupyter Notebook 2%Shell 1%
Where to start reading
  1. 1
    README.md
    Start here — what it does and how to install it
  2. 2
    AGENTS.md
    The instructions the AI actually follows
  3. 3
    src/server.py
    Where the program starts running
  4. 4
    pyproject.toml
    Dependencies and the commands it exposes
  5. 5
    .env.example
    The API keys and settings you must provide
What's in each folder
src/Core code — the actual logic112 files
skills/Prompts, skills & agent definitions13 files
client/Frontend / UI49 files
docs/Documentation19 files
benchmarking_tools/Folder15 files
docker/Deployment / infrastructure12 files
scripts/Helper scripts3 files
notebooks/Research & notebooks1 files
READMEHas testsDocumentedCI checksDocker readyBSD-2-Clause licenseUpdated this month
Quick Actions
Details
Creator
NVIDIA-AI-Blueprints
Language
TypeScript
Category
voice-ai
Published
1/15/2026

Are you the creator of this tool? Claim your listing → and earn 85% of every sale.