Apfel vs VibeVoice

Apfel is a Swift CLI that does something Apple didn't: it exposes the on-device LLM baked into every Apple Intelligence-enabled Mac as a proper OpenAI-compatible local server running at localhost:11434. Any app that speaks to Ollama's API — LM Studio, Continue, OpenWebUI, your own scripts — can now route requests to Apple's FoundationModels framework without modification. The feature set is more complete than most indie wrappers: streaming responses, tool calling with MCP support, file attachments, an interactive chat mode, and a debug SwiftUI GUI for inspecting token flow. Inference is fully on-device with no API keys, no telemetry, and no cost beyond electricity. On an M-series Mac, it runs at native Apple Neural Engine speeds — typically 40-80 tokens/second depending on the model variant active. The catch is real: you need macOS 26 Tahoe (currently in beta) and Apple Intelligence enabled. But for the tens of millions of Apple Silicon Mac users who already qualify or will soon, this is the quiet unlock of a model they already own. The "your Mac already has a free LLM" framing is resonating — the repo hit 3,500 stars in days.

VibeVoice is Microsoft's open-source family of frontier voice AI models covering both speech recognition and synthesis at a scale most commercial services still can't match. The ASR model processes up to 60 minutes of audio in a single pass, generating speaker-diarized, timestamped transcriptions across 50+ languages — complete with hotword customization for domain-specific accuracy. At 7B parameters, it supports on-premise deployment for privacy-sensitive applications. The TTS side is equally impressive: VibeVoice-1.5B synthesizes up to 90 minutes of multi-speaker audio with natural conversational flow and turn-taking between up to four distinct speakers. A lightweight 500M realtime variant streams at under 300ms latency. All of this runs on a novel continuous speech tokenizer operating at just 7.5 Hz — dramatically more efficient than typical audio codecs. What makes this notable is the MIT license. Microsoft isn't just open-sourcing a research demo; they're releasing production-grade weights on Hugging Face alongside code that teams can self-host, fine-tune, or build into their products. With 42,000+ GitHub stars and 771 earned today alone, it's the kind of drop that resets the baseline for what open-source audio AI looks like.