Liveblocks AI Presence vs OpenAI Realtime API WebRTC

“The primitive is clean: a React hook that injects an AI agent into Liveblocks' existing presence layer, giving it a cursor, a name, and a selection state — no new backend surface, no second SDK to wrangle. The DX bet is correct: they put the complexity in the abstraction, not in the integration. The moment of truth is a single `useAIPresence` call and your agent has a visible cursor within minutes. You could not replicate this on a weekend — Liveblocks' CRDT sync layer and multiplexed WebSocket infra are the actual hard part, and this just exposes a new participant type on top of it. The specific decision that earns the ship: they didn't add a new API, they extended the existing presence model — that's the right call architecturally.”

“The primitive here is clean: WebRTC peer connection directly to OpenAI's edge, which means browser-native ICE negotiation handles NAT traversal and the audio path skips your server entirely. The DX bet they made — offload transport complexity to the browser's WebRTC stack instead of making developers manage WebSocket keepalives and audio buffering — is exactly the right call. First 10 minutes is legitimately just grabbing a session token from your backend and calling the peer connection API; the VAD controls mean you're not building your own endpointing logic either. The specific technical decision that earns the ship: billing at the token level on audio streams instead of per-minute flat rates means you're not getting charged for silence, which is the kind of thing that matters the moment you build anything with real pauses in conversation.”

“The direct competitor here is 'just log what your AI is doing in a sidebar,' which is what most teams ship today. AI Presence beats that because the presence metaphor maps to user mental models already trained by Figma and Google Docs — a cursor is legible in a way a log entry isn't. The scenario where this breaks is any app where the AI agent operates faster than human perception — a cursor flickering across a document at 200 tokens per second is noise, not signal, and Liveblocks hasn't shown throttling primitives in the demo. What kills this in 12 months: the underlying model providers build native multi-agent orchestration UIs and presence becomes a solved layer in the stack, not a differentiator. To be wrong about that, Liveblocks would need to own enough of the collaboration infra that switching costs make their presence layer the default regardless.”

“Direct competitors here are Deepgram + ElevenLabs in a pipeline, Hume AI's empathic voice interface, and Groq's low-latency audio stack — all of which require more integration work. The scenario where this breaks is multi-tenant applications where you need per-user audio isolation and compliance logging: WebRTC direct-to-OpenAI means your audio never touches your server, which is a privacy feature until your enterprise customer asks for a SOC2 audit trail of every utterance and you realize you've built yourself into a corner. What kills this in 12 months isn't competition — it's OpenAI's own pricing volatility; audio token costs have moved twice in 18 months and any product with margins built around current rates is one pricing page update away from a rebuild. That said, for the majority of voice-in-browser use cases, nothing ships faster right now, so ship.”

“The thesis here is falsifiable: by 2027, human-AI collaborative interfaces will require agents to express intent spatially, not just textually, because human coordination evolved around physical co-presence cues — gaze, gesture, position. If that's true, AI Presence is infrastructure, not a feature. The dependency is that AI agents remain slow enough relative to human attention that cursor metaphors remain meaningful; if agents complete work in under 500ms, the presence layer has nothing useful to show. The second-order effect nobody is talking about: this normalizes AI agents as social participants in software, not background workers, which shifts how users attribute responsibility and trust in collaborative outputs. Liveblocks is riding the multi-agent coordination trend and they are early — most teams haven't shipped a single agentic collaborator, let alone needed to display one. The future state where this is infrastructure: any SaaS with a collaborative canvas runs AI presence the way they run user avatars today.”

“The thesis this bets on: within 2 years, voice becomes the default interface for a class of ambient computing applications — in-browser, in-app, on device — and the architectural bottleneck isn't model quality but transport latency and server cost. Removing the relay tier collapses infrastructure costs by ~30-40% for high-volume voice apps and enables deployment in contexts where standing up a relay server is a blocker (edge deployments, client-side-only apps, WebAssembly contexts). The second-order effect that matters: this shifts power from infrastructure middleware vendors who built businesses on being the relay layer — companies like Daily.co and LiveKit as voice-AI relay brokers — to application developers who can now go direct. The trend line is WebRTC adoption in AI interfaces, and OpenAI is on-time, not early; Twilio and others have been here for calls, but nobody owned the AI voice path specifically. The future state where this is infrastructure: every SaaS product has a voice command surface that costs pennies per session to run.”

“The job-to-be-done is singular and clear: make AI agent activity legible to human collaborators without building a custom observability layer. Onboarding survives the two-minute test if you're already on Liveblocks — the hook drops in and the agent appears; if you're not on Liveblocks, you're onboarding to an entire collaboration platform first, which is a different product decision. The completeness gap is real: this ships the presence primitive but not the interaction surface — users can see the AI cursor but the blog post doesn't address how users interrupt, redirect, or acknowledge agent actions, which means teams still have to build that layer themselves. The product has a clear opinion — agents are collaborators, not tools — and that opinion is the right one. Ship, but with the caveat that this is a primitive, not a complete human-AI collaboration solution, and teams should scope their expectations accordingly.”

“The buyer is any developer building voice-first applications, but the budget question is complicated: audio token costs at scale are brutal, and there's no pricing tier that rewards high-volume committed usage the way AWS Reserved Instances do. The moat analysis is the core problem — this is OpenAI's own API, which means the 'product' for any startup building on top of it has exactly zero defensibility against OpenAI shipping a higher-level voice product that obsoletes your integration entirely; the relay-less architecture actually makes that MORE likely because OpenAI now owns the full audio session and can see every interaction. What happens when a platform player ships 80% of this for free? It already happened — this IS the platform player, and anything you build on it is a feature, not a business. I'd ship if you're using this as infrastructure inside a product with a different moat, but as a standalone voice-AI product, you're building on a foundation that can be pulled at any time.”