AI tool comparison
Ferretlog vs QuickCompare
Which one should you ship with? Here is the side-by-side panel verdict, pricing read, reviewer split, and community vote comparison.
Developer Tools
Ferretlog
git log for your Claude Code agent runs — local, zero dependencies
50%
Panel ship
—
Community
Free
Entry
Ferretlog is a zero-dependency pure Python CLI that treats your Claude Code session logs like a git repository. It parses the raw JSONL logs in `~/.claude/projects/` and gives you git-style history browsing, diff between runs, per-tool-call breakdowns, and cost/token stats — entirely locally, with no network calls and no configuration required. If you've been using Claude Code heavily, you've likely experienced the frustration of losing track of what changed across sessions, what tools were called how many times, and how much each session actually cost across sub-agent calls. Ferretlog makes that history explorable and comparable the same way `git log` makes code history explorable. This is an indie solo project from Eitan Lebras, submitted as a Show HN. It's genuinely useful as a power-user tool for anyone doing serious Claude Code work, especially those managing multi-session agent pipelines where debugging "what did the agent do last time?" is a real pain. The zero-dependency, local-only design means there's no trust surface and no setup friction.
Developer Tools
QuickCompare
Compare LLMs on your own data — not someone else's benchmarks
75%
Panel ship
—
Community
Free
Entry
QuickCompare is Trismik's model evaluation platform that lets AI/ML teams test multiple LLMs against their own production data in a consistent, repeatable way. Instead of relying on generic leaderboards like MMLU or HumanEval, teams upload their actual prompts and evaluate models side-by-side across quality, cost, latency, and reliability. The tool replaces ad hoc scripts and spreadsheets with a structured workflow: pick your models, run evals, get a clear decision matrix. It works with GPT-5.2, Claude Opus 4.5, Gemini 3 Pro, Llama 4, and dozens of others via a unified API harness. In an era where model choice directly impacts engineering budgets, QuickCompare gives teams the evidence they need to justify switching (or staying). Particularly useful when a cheaper model performs identically on your workload — the savings can be substantial.
Reviewer scorecard
“If you run Claude Code daily, you need this immediately. Being able to diff two sessions like git commits and see exactly which tools fired and what they cost is something that should have existed from day one. Zero-dependency Python means it just works.”
“Finally a tool that stops the 'which model is best?' debate cold. Running your actual prompts through all the candidates and getting a cost/quality matrix is exactly what every engineering team needs right now. The switch from gut feel to data is overdue.”
“This is a niche tool for a niche user (heavy Claude Code power users) and the session log format Anthropic uses is undocumented and could change at any update. Tying workflows to internal log parsing is fragile infrastructure — treat it as a convenience, not a dependency.”
“Evals are only as good as your test set, and most teams don't have one that actually reflects production variance. If you're running QuickCompare on 50 cherry-picked prompts, you're fooling yourself. The tooling is fine; the false confidence it creates is the real risk.”
“Agent observability tooling built by the community, not the vendor, is how this ecosystem will mature. Ferretlog is primitive but it points at a real gap: we need git-style versioning and auditability for agent sessions, not just for code.”
“Model selection is becoming a strategic moat. Teams that optimize cost-per-task now will compound those savings as they scale agent workloads. QuickCompare is the kind of boring-but-essential tooling that separates efficient AI orgs from ones burning cash on the prestige model.”
“Terminal-only, Claude Code-specific, no visuals — this tool exists entirely outside my workflow. The underlying insight (session replay and cost tracking) is useful, but it needs a UI before it reaches anyone outside the developer community.”
“As someone who swaps models constantly for creative pipelines — image captions, copy generation, transcript summarization — having a structured way to test them on my actual prompts is genuinely useful. Stopped manually comparing outputs in tabs.”
Weekly AI Tool Verdicts
Get the next comparison in your inbox
New AI tools ship daily. We compare them before you waste an afternoon.