AI tool comparison
Libretto vs Metrics SQL by Rill
Which one should you ship with? Here is the side-by-side panel verdict, pricing read, reviewer split, and community vote comparison.
Developer Tools
Libretto
AI browser automation that doesn't break every other deploy
75%
Panel ship
—
Community
Paid
Entry
Libretto is an open-source TypeScript toolkit for building and maintaining browser automations that are actually reliable. Unlike most AI-driven browser tools that use probabilistic reasoning to select elements at runtime, Libretto works by having the AI generate deterministic selectors and action sequences upfront — then executing them with zero LLM involvement at runtime. The AI is your authoring tool, not your runtime dependency. The core insight: most AI browser automations fail in production because they call an LLM on every page interaction. Libretto flips this by using AI to write and update the automation scripts, but running them as ordinary code. When a site changes and your automation breaks, Libretto detects the failure and prompts you to let AI update the selector — then it's deterministic again. Built by the team at Saffron Health, the library hit HN's front page today and is generating discussion as a more pragmatic alternative to fully autonomous browser agents. For anyone who's tried Playwright with AI wrappers and found them unreliable in CI/CD, this is the architecture that's been missing.
Developer Tools
Metrics SQL by Rill
One SQL semantic layer so AI agents stop hallucinating your KPIs
75%
Panel ship
—
Community
Paid
Entry
Metrics SQL is a SQL-based semantic layer from Rill Data that solves a specific and painful problem: AI agents that query your data warehouse tend to hallucinate aggregation logic, producing metrics that look plausible but are mathematically wrong. Metrics SQL lets analysts define business metrics once — revenue, MAU, conversion rate, ROAS — in a governed definition layer, and then exposes those definitions as queryable SQL tables. Every dashboard, notebook, and AI agent resolves from the same source. The technical approach is elegant: rather than inventing a new DSL, Metrics SQL extends SQL itself. An agent that knows SQL can query `SELECT * FROM metrics.weekly_revenue` and get correctly computed numbers without needing to know how revenue is defined, which tables it joins, or how edge cases like refunds are handled. The semantic layer intercepts the query, applies the governed definition, and returns correct results. The implications for AI-native data stacks are significant. Currently, one of the biggest failure modes for AI analysts and BI agents is inconsistent metric computation — different agents or dashboards produce different numbers for 'revenue' because they implement aggregation logic differently. Metrics SQL addresses this at the infrastructure level, not by improving agent prompting.
Reviewer scorecard
“This is the right mental model for production browser automation. Using AI for authoring but not runtime means you get consistency in CI without random failures at 2am. I've been waiting for someone to build this properly.”
“We've been burned by data agents that invent their own GROUP BY logic and produce wrong numbers that look right. Metrics SQL solves this at the infrastructure level — define revenue once, have every agent query the same definition. The SQL-native interface means no new tools for agents to learn; they just use the tables.”
“The 'AI updates your selectors' workflow sounds great until you're reviewing 50 AI-generated selector changes after a site redesign. You've just moved the flakiness from runtime to the maintenance loop. Also, 37 stars is very early — I'd wait for production case studies.”
“The value here is only as good as how well-maintained your metric definitions are — if analysts don't keep them updated, agents query stale or wrong definitions and you've added a layer of false confidence. Adopting a semantic layer also creates vendor dependency; migrating away from Rill's cloud later is a real switching cost. For smaller teams without dedicated data engineering, maintaining a semantic layer is overhead.”
“The deterministic-at-runtime pattern will become the standard architecture for AI-assisted automation. Libretto is arriving exactly as enterprises start demanding reliability SLAs from their AI tooling. Early movers will have a significant advantage.”
“Data governance and AI agents are on a collision course. As more business decisions are delegated to AI, the correctness of KPI computation becomes load-bearing — a hallucinated revenue figure that influences a product decision is a serious failure mode. Metrics SQL represents a class of infrastructure that will become mandatory as AI takes on more analytical work.”
“As someone who automates repetitive web tasks constantly, this solves my biggest frustration — AI-written automations that fall apart the moment a site updates their CSS. The auto-repair loop is exactly what I need for long-running workflows.”
“I rely on AI to pull weekly performance data, and the number of times it's given me different 'correct' answers for the same metric is maddening. Having a single governed source that every AI query resolves against means I can trust the numbers I'm making decisions on. That trust is worth a lot.”
Weekly AI Tool Verdicts
Get the next comparison in your inbox
New AI tools ship daily. We compare them before you waste an afternoon.