AI tool comparison
Cai vs Google AI Edge Eloquent
Which one should you ship with? Here is the side-by-side panel verdict, pricing read, reviewer split, and community vote comparison.
Productivity
Cai
One keyboard shortcut. Local AI. No account, no cloud, no telemetry.
75%
Panel ship
—
Community
Free
Entry
Cai (⌥C) is a macOS utility that runs AI actions on anything — selected text, clipboard content, active app context — with a single keyboard shortcut, entirely locally. It ships with Ministral 3B bundled, so it works offline out of the box with no API key, no account signup, and no network requests. For developers who prefer their own stack, it also connects to Ollama, LM Studio, Apple Intelligence, and OpenRouter. Beyond text transformations, Cai acts as a local automation layer: it can open GitHub issue drafts in your browser, create Linear tickets from selected text, run custom shell scripts, and chain multiple actions together. The whole thing is MIT licensed and open source. The UX is intentionally minimal — no chat interface, no persistent window — just a quick invocation overlay that appears, acts, and disappears. The positioning is clear: Cai competes with productivity tools like Raycast AI and PopClip, but wins on the privacy angle. There's no vendor seeing your prompts, no subscription creep, and no dependency on internet connectivity. For developers, writers, and researchers working with sensitive content who want AI assistance without cloud exposure, Cai fills a real gap that bigger AI apps can't — or won't — fill.
Productivity
Google AI Edge Eloquent
Free offline iOS dictation app powered by on-device Gemma ASR
75%
Panel ship
—
Community
Free
Entry
Google AI Edge Eloquent is a free iOS dictation app released quietly on April 6 with no press announcement or Product Hunt launch. It uses on-device Gemma ASR models to transcribe speech, strip filler words, and polish raw dictation into clean prose — all without an internet connection. An optional cloud mode routes cleanup through Gemini for higher quality results. Unlike competitors Wispr Flow and Willow (both $15/month), Eloquent has no subscription and no usage caps. The app is built on the same Google AI Edge framework used in Google AI Edge Gallery, suggesting it's part of a broader push to normalize on-device LLM inference on consumer hardware. The quiet launch strategy is notable: no blog post, no social announcement, just a quiet App Store submission. This kind of stealth deployment suggests Google may be seeding on-device AI use cases without the usual hype cycle — testing user retention before investing in marketing. An Android version is widely expected given the AI Edge framework's cross-platform nature.
Reviewer scorecard
“I set up Cai with a custom action to take a stack trace from my clipboard and open a pre-filled GitHub issue in 10 minutes. The Ollama backend means I can use a larger local model when I'm at my desk and fall back to Ministral 3B on the go. MIT license means I can fork it and add my team's internal tools.”
“The architecture here is the interesting part: Gemma ASR running fully on-device with optional cloud fallback for cleanup. This is exactly the hybrid inference pattern I'd want to build for privacy-sensitive voice apps, and Google just open-sourced the playbook by shipping it.”
“Ministral 3B is fine for basic text tasks but it stumbles on anything requiring real reasoning or domain knowledge. Most users will hit its limits quickly and need to set up Ollama anyway — which is a non-trivial setup process for non-developers. The privacy story is genuine but the capability bar is lower than what cloud alternatives offer.”
“Free with no business model and no announcement sounds more like an experiment than a product. Google has a long history of quietly killing apps that don't get traction. I wouldn't build a workflow around Eloquent until it survives at least six months in the App Store.”
“Cai represents a class of tools that become dramatically more useful as on-device models improve. When Bonsai-scale 1-bit models hit 8B+ quality at 131 tokens/sec locally, Cai's architecture is exactly right — a minimal, composable action layer on top of local inference. The MIT license means the community will build the plugin ecosystem.”
“Killing the $15/month subscription model for voice AI is a meaningful shot fired. When Google ships a free, offline-first dictation app powered by on-device models, it sets a new user expectation for the whole category. Wispr and Willow are going to have to respond.”
“I've been looking for a way to do quick AI rewrites and tone adjustments in any app — not just in a web browser — without pasting things into a chat interface. Cai works in Figma, Notion, Miro, everything. The local privacy angle matters a lot when I'm working on client content that's under NDA.”
“Filler word stripping plus prose polishing in a fully offline app is genuinely useful for writers and podcasters. I dictate first drafts constantly and having this work on a plane or in a dead zone without compromising privacy is exactly what I've been waiting for.”
Weekly AI Tool Verdicts
Get the next comparison in your inbox
New AI tools ship daily. We compare them before you waste an afternoon.