AI tool comparison
Rowboat vs Sup AI
Which one should you ship with? Here is the side-by-side panel verdict, pricing read, reviewer split, and community vote comparison.
Productivity
Rowboat
Local-first AI coworker with persistent knowledge graph, no cloud lock-in
75%
Panel ship
—
Community
Free
Entry
Rowboat is a local-first, open-source AI coworker that connects to your email and meeting notes, builds a persistent Obsidian-compatible knowledge graph from them, and uses that context to draft documents, meeting briefs, slide decks, and emails. It works with local models via Ollama or LM Studio, or with hosted APIs, and supports MCP for connecting external tools. The design philosophy is deliberately anti-cloud: all data stays in plain text Markdown files you can read, grep, and version-control. The knowledge graph is transparent — you can open it in Obsidian and see exactly what the AI knows about you. No black-box embeddings in a proprietary vector store, no "trust us with your emails" data agreements. Rowboat implements what Karpathy described as a "long-term memory coworker" — an AI that compounds value over time because it actually knows your history, your projects, and your terminology. TypeScript codebase, Apache 2.0 license, surging on GitHub trending this week.
AI Productivity
Sup AI
Runs 339 LLMs in parallel and downweights the hallucinating ones.
50%
Panel ship
—
Community
Free
Entry
Sup AI is an ensemble AI assistant that runs your query through 339 language models simultaneously, measures per-segment confidence across all responses, and synthesizes a final answer that amplifies agreement and suppresses likely hallucinations. The team claims a 52.15% score on Humanity's Last Exam (HLE) — 7.41 percentage points above the single best model — which, if verified, would make it the highest-scoring system on the benchmark to date. The underlying mechanism works like an LLM panel: each model votes on sub-claims within the response, confidence is estimated by agreement density, and the final output surfaces high-confidence segments while flagging uncertain ones. It's designed to reduce hallucination rate on factual tasks, not improve reasoning per se — the models in the ensemble aren't doing collaborative chain-of-thought, they're voting on outputs. Sup AI was built by Ken Mueller (Stanford, CEO) and Scott Mueller (AI Research Scientist) and launched on Product Hunt today. Pricing starts with $10 in free credits, no auto-charge, with a credit card required to start. The HLE benchmark claim is the headline and will face scrutiny — if verified, this is a meaningful research result. If it's cherry-picked, it's still a usable product with a differentiated architecture.
Reviewer scorecard
“Plain-text persistence + MCP + local model support is the right architecture. It'll survive AI winters and API deprecations. The Obsidian compatibility alone is a killer feature for the PKM crowd that already lives in that ecosystem.”
“The HLE claim needs independent verification, but the underlying ensemble approach is architecturally sound for factual Q&A tasks. Running 339 models is expensive — pricing will be the gating factor for production use. The $10 free credit is a fair trial.”
“The 'knowledge graph from email' promise is where these tools historically fall apart — noisy inboxes produce noisy graphs. And 'local-first' often means 'labor-intensive setup.' The abstraction is right but execution on messy real-world data is hard. Watch the 1-month reviews.”
“Extraordinary claims require extraordinary evidence. A 7.41 point jump on HLE via ensembling — without publishing methodology — smells like benchmark gaming. The latency of running 339 models in parallel is also a real concern for anything other than async research tasks.”
“Personal knowledge infrastructure that you own is becoming the moat in AI-augmented work. Rowboat's transparent, portable approach builds durable value. In two years the question won't be which AI assistant you use, but which knowledge graph underlies it.”
“Model ensembling is an underexplored direction in the race to reduce hallucination. If Sup AI's approach scales, it could be more durable than fine-tuning individual models — you get the wisdom of the crowd across model families, training data, and architectures simultaneously.”
“Drafting meeting briefs and decks from accumulated context is the workflow I've wanted for years. The Obsidian integration means my notes and my AI context stay in sync naturally — no separate import/export dance.”
“For creative work, ensemble outputs tend to regress toward the mean — you get the most-agreed-upon version of something, which is usually the least interesting version. This is a tool for factual accuracy, not creativity. I'd stick with a single strong model for writing.”
Weekly AI Tool Verdicts
Get the next comparison in your inbox
New AI tools ship daily. We compare them before you waste an afternoon.