AI tool comparison
Apfel vs qmd
Which one should you ship with? Here is the side-by-side panel verdict, pricing read, reviewer split, and community vote comparison.
Developer Tools
Apfel
Free CLI for Apple's on-device LLM — no API key, no downloads, runs on macOS
75%
Panel ship
—
Community
Free
Entry
Apfel is an open-source command-line tool that unlocks Apple's built-in Foundation Model (shipped with macOS Tahoe) via a clean CLI, an OpenAI-compatible local server on port 11434, and an interactive chat mode. No model download, no API key, no configuration — if you're on Apple Silicon running macOS Tahoe, the model is already there. The OpenAI-compatible server mode is the clever move: any tool built on the OpenAI SDK can point at localhost:11434 and use Apple's on-device ~3B model for free, with complete privacy. The MCP support adds external tool-calling, making it genuinely useful for shell automation, text transformation, and local agent workflows. The honest constraints: 4,096-token context (~3,000 words) and mixed 2-bit/4-bit quantization mean this isn't a replacement for cloud models on hard tasks. But for scripting, classification, summarization, and quick transformations — all offline, all private, all free — Apfel makes the underutilized neural engine on every Mac actually accessible.
Developer Tools
qmd
Local doc search engine with BM25 + vectors + LLM re-ranking — by Shopify's CEO
50%
Panel ship
—
Community
Free
Entry
qmd is a lightweight local search engine built by Tobi Luetke, CEO of Shopify, for indexing and querying personal knowledge bases, documentation, and meeting notes — entirely offline. It combines three retrieval approaches in a single pipeline: BM25 full-text search for exact keyword matches, vector semantic search via ONNX-based embeddings, and LLM re-ranking using GGUF models through node-llama-cpp. All three stages run locally with no cloud dependency. The tool ships in multiple deployment modes: a CLI for ad-hoc queries, a Node.js library for programmatic use, an HTTP service for local API access, and — most useful for AI workflows — a native MCP server that lets Claude Code, Cursor, and similar editors query your local knowledge base directly during coding sessions. The hybrid retrieval approach means it handles both "find the exact error message from last week's standup notes" and "what was our decision about the auth architecture" equally well. What makes this notable beyond its technical approach is provenance: Luetke shipped it as a personal tool he actually uses, not a startup product. The GitHub history shows active iteration and he's been talking about it on X. It's a credible signal of where pragmatic AI-augmented knowledge management is heading for technical users who prefer local-first tools.
Reviewer scorecard
“OpenAI-compatible server on localhost means I can prototype automations and scripts against a real LLM without paying for API calls or waiting on rate limits. The pipe-friendly CLI with proper exit codes is exactly what shell scripting needs. For Mac-native tooling, this is a genuine gap-filler.”
“Hybrid BM25 + vector + LLM re-rank is the right architecture for personal knowledge search — each layer catches what the others miss. The MCP server mode is genuinely useful: being able to ask Claude Code 'what did we decide about X last month' against my own notes changes the workflow. MIT licensed and from someone who ships real products.”
“A 4,096-token context and ~3B quantized model will fail on anything non-trivial — complex coding, factual recall, multi-step reasoning. You'd still reach for Claude or GPT-4 for real work, making this a toy for most professional use cases. Also, it only runs on macOS Tahoe, which dramatically limits adoption right now.”
“This is a well-executed weekend project, not a production tool. It requires GGUF models and manual embedding setup — a meaningful friction barrier for non-technical users. The 'built by a CEO' narrative drives GitHub stars more than the technical differentiation. Obsidian with a local AI plugin gets you here with better UX.”
“Every Apple Silicon Mac now ships with a neural engine and a capable on-device LLM — Apfel is just the first tool to make that accessible via standard interfaces. This is a preview of the world where local models handle routine tasks completely off the network, with cloud models reserved for genuinely hard inference.”
“The pattern here — local hybrid retrieval as an MCP server feeding into AI coding agents — will be ubiquitous in two years. Today it's a technical power-user tool; tomorrow it's how everyone's AI assistant knows the institutional context behind the code. qmd is an early, clean implementation of that pattern.”
“Quick summaries, translation, text classification without pasting anything into a cloud service — the privacy angle alone is worth it for sensitive client work. MCP support means I can hook it into my local creative workflows. The zero-config setup removed every excuse I had not to try it.”
“I manage a lot of notes, references, and creative briefs, but the setup friction here — GGUF models, CLI configuration — makes this inaccessible for most creators. The concept is great; the UX needs a front-end before it reaches beyond developers.”
Weekly AI Tool Verdicts
Get the next comparison in your inbox
New AI tools ship daily. We compare them before you waste an afternoon.