AI tool comparison
QA.tech vs qmd
Which one should you ship with? Here is the side-by-side panel verdict, pricing read, reviewer split, and community vote comparison.
Developer Tools
QA.tech
AI agent that auto-tests your app on every PR — no code needed
75%
Panel ship
—
Community
Paid
Entry
QA.tech is an AI QA agent that learns how your web app works — visually, the way a human tester would — then automatically runs end-to-end tests on every pull request before it merges. You describe test scenarios in plain English; the agent handles the rest, with no selectors, no test code, and no brittle CSS path maintenance. The system builds a knowledge graph of your application's structure and user flows during an initial learning phase, then uses that graph to plan and execute tests intelligently when new PRs come in. When the app changes, the agent adapts its understanding rather than throwing selector-not-found errors like traditional Selenium or Playwright suites. For small teams that can't afford a dedicated QA engineer, or larger teams drowning in flaky test maintenance, QA.tech offers a compelling pitch: describe what matters in plain language and let the agent decide how to verify it. The Product Hunt launch drew strong initial traction from indie developers and early-stage startups looking to add regression coverage without the overhead of a full testing framework.
Developer Tools
qmd
Local doc search engine with BM25 + vectors + LLM re-ranking — by Shopify's CEO
50%
Panel ship
—
Community
Free
Entry
qmd is a lightweight local search engine built by Tobi Luetke, CEO of Shopify, for indexing and querying personal knowledge bases, documentation, and meeting notes — entirely offline. It combines three retrieval approaches in a single pipeline: BM25 full-text search for exact keyword matches, vector semantic search via ONNX-based embeddings, and LLM re-ranking using GGUF models through node-llama-cpp. All three stages run locally with no cloud dependency. The tool ships in multiple deployment modes: a CLI for ad-hoc queries, a Node.js library for programmatic use, an HTTP service for local API access, and — most useful for AI workflows — a native MCP server that lets Claude Code, Cursor, and similar editors query your local knowledge base directly during coding sessions. The hybrid retrieval approach means it handles both "find the exact error message from last week's standup notes" and "what was our decision about the auth architecture" equally well. What makes this notable beyond its technical approach is provenance: Luetke shipped it as a personal tool he actually uses, not a startup product. The GitHub history shows active iteration and he's been talking about it on X. It's a credible signal of where pragmatic AI-augmented knowledge management is heading for technical users who prefer local-first tools.
Reviewer scorecard
“The selector-free approach is genuinely appealing to anyone who's wasted hours fixing brittle Playwright tests after a designer changed a class name. If the knowledge graph adapts to UI changes reliably in practice, this could replace an entire category of test maintenance work that nobody enjoys.”
“Hybrid BM25 + vector + LLM re-rank is the right architecture for personal knowledge search — each layer catches what the others miss. The MCP server mode is genuinely useful: being able to ask Claude Code 'what did we decide about X last month' against my own notes changes the workflow. MIT licensed and from someone who ships real products.”
“AI-driven test agents have been promised before and they consistently struggle with complex stateful flows, modal dialogs, and multi-step auth. The 'adapts to UI changes' claim needs hard evidence — does it catch regressions or just re-learn the broken state? Pricing opacity is also a red flag for budget-sensitive teams.”
“This is a well-executed weekend project, not a production tool. It requires GGUF models and manual embedding setup — a meaningful friction barrier for non-technical users. The 'built by a CEO' narrative drives GitHub stars more than the technical differentiation. Obsidian with a local AI plugin gets you here with better UX.”
“The end game here is tests written in intent, not implementation. The shift from 'click the button with id=submit' to 'verify the user can complete checkout' is philosophically important — it means tests survive redesigns and become living documentation of what the product is supposed to do.”
“The pattern here — local hybrid retrieval as an MCP server feeding into AI coding agents — will be ubiquitous in two years. Today it's a technical power-user tool; tomorrow it's how everyone's AI assistant knows the institutional context behind the code. qmd is an early, clean implementation of that pattern.”
“As someone who ships design changes and dreads 'breaking the tests,' the idea of tests that understand intent over structure is appealing. If QA.tech can handle responsive layouts and dynamic content reliably, it removes one of the biggest friction points between design iterations and shipping.”
“I manage a lot of notes, references, and creative briefs, but the setup friction here — GGUF models, CLI configuration — makes this inaccessible for most creators. The concept is great; the UX needs a front-end before it reaches beyond developers.”
Weekly AI Tool Verdicts
Get the next comparison in your inbox
New AI tools ship daily. We compare them before you waste an afternoon.