VibeVoice
Microsoft's open-source voice AI that handles 90-min audio in one pass
The Panel's Take
VibeVoice is Microsoft's open-source family of frontier voice AI models covering both speech recognition and synthesis at a scale most commercial services still can't match. The ASR model processes up to 60 minutes of audio in a single pass, generating speaker-diarized, timestamped transcriptions across 50+ languages — complete with hotword customization for domain-specific accuracy. At 7B parameters, it supports on-premise deployment for privacy-sensitive applications. The TTS side is equally impressive: VibeVoice-1.5B synthesizes up to 90 minutes of multi-speaker audio with natural conversational flow and turn-taking between up to four distinct speakers. A lightweight 500M realtime variant streams at under 300ms latency. All of this runs on a novel continuous speech tokenizer operating at just 7.5 Hz — dramatically more efficient than typical audio codecs. What makes this notable is the MIT license. Microsoft isn't just open-sourcing a research demo; they're releasing production-grade weights on Hugging Face alongside code that teams can self-host, fine-tune, or build into their products. With 42,000+ GitHub stars and 771 earned today alone, it's the kind of drop that resets the baseline for what open-source audio AI looks like.
Share this verdict
VibeVoice verdict: SHIP 🚀 3 ships · 1 skip from the expert panel Full review: shiporskip.io/tool/vibevoice-microsoft-open-source-frontier-voice-ai-2026
Weekly AI Tool Verdicts
Get the next verdict in your inbox
7 critics review a new AI tool every day. Weekly digest — free.
Compare VibeVoice with Others
Embed this verdict
Tool makers can add a live ShipOrSkip badge to their site. Badge loads track impressions; clicks route back to this review.
<a href="https://shiporskip.io/api/badge-click/vibevoice-microsoft-open-source-frontier-voice-ai-2026" target="_blank" rel="noopener"><img src="https://shiporskip.io/api/badge/vibevoice-microsoft-open-source-frontier-voice-ai-2026" alt="VibeVoice Ship verdict on ShipOrSkip" width="360" height="90" /></a>[](https://shiporskip.io/api/badge-click/vibevoice-microsoft-open-source-frontier-voice-ai-2026)<iframe src="https://shiporskip.io/embed/vibevoice-microsoft-open-source-frontier-voice-ai-2026" title="VibeVoice ShipOrSkip verdict" width="360" height="260" style="border:0;border-radius:16px;max-width:100%;" loading="lazy"></iframe>The reviews
“MIT license plus Hugging Face weights is everything. Drop-in ASR with 60-minute single-pass capacity and speaker diarization out of the box? That replaces a whole stack for me. The 0.5B realtime model at 300ms latency is immediately useful for voice agents.”
“The TTS code was pulled from the repo in September 2025 due to misuse concerns — so the synthesis side is weights-only with fragmented community forks. Running a 7B ASR model also requires serious GPU resources that most teams don't have sitting around. Deepgram and AssemblyAI are still easier wins for most use cases.”
“Long-form audio understanding that's truly self-hostable changes the privacy calculus for voice AI. Medical transcription, legal depositions, sensitive interviews — all of these blocked commercial voice APIs become viable. Microsoft dropping this in open source accelerates the entire voice AI ecosystem.”
“Four-speaker TTS with natural turn-taking in a single model? That's a podcast production tool for solo creators. Generate scripted dialogue, voiceovers with distinct characters, or audiobook narration without patching together separate APIs. The 90-minute ceiling covers basically any content format I'd need.”