NVIDIA PersonaPlex

Full-duplex speech AI that listens and speaks at the same time

NVIDIA PersonaPlex is an open-source, full-duplex speech-to-speech conversational AI built on the Moshi architecture. Unlike turn-based voice assistants that wait for you to stop talking before responding, PersonaPlex can listen and generate speech simultaneously — achieving speaker-turn latency of just 70ms compared to Gemini Live's 1.3 seconds. The 7B-parameter model ships with 16 pre-built voice profiles and supports persona conditioning via either text role-prompts or audio voice-conditioning, letting you clone the feel of a voice without cloning the voice itself. The release is significant because it brings research-grade duplex speech tech into the hands of indie builders under MIT + NVIDIA Open Model License (allowing commercial use). Previous full-duplex systems required either API access to proprietary systems or painful custom training pipelines. PersonaPlex packages the full inference stack with documented APIs for embedding in apps, agents, or robotics. Where it matters most: agentic systems that need natural real-time voice I/O, customer-facing voice products, and research into more human-feeling AI conversation. The 70ms latency approaches the threshold of human-perceptible conversational naturalness (~100ms), making this the first openly available model to credibly challenge real-time commercial APIs.

Panel Reviews

The Builder

Developer Perspective

Ship

“70ms turn latency on an open-source 7B model is the headline — that's actually usable. The documented inference API and pre-built voice profiles mean you can have a duplex voice agent running in an afternoon, not a week. This is the missing voice layer for agentic apps.”

The Skeptic

Reality Check

Skip

“NVIDIA Open Model License is not truly open — commercial use has conditions, and the model requires meaningful GPU hardware to serve at that latency. The 70ms number is almost certainly measured on H100 hardware, not a MacBook. Real-world duplex quality in messy audio environments is another story entirely.”

The Futurist

Big Picture

Ship

“Full-duplex voice is the last major piece missing from truly natural AI interaction. When agents can listen and respond simultaneously without the hallmark AI pause, the 'talking to a computer' sensation collapses. This release starts that clock.”

The Creator

Content & Design

Ship

“The persona conditioning is what excites me — you can define a character's voice feel without cloning a real person's voice. That's a meaningful ethical step for content creators building AI characters or interactive audio experiences.”