Compare/Context Engineering Reference vs qmd

AI tool comparison

Context Engineering Reference vs qmd

Which one should you ship with? Here is the side-by-side panel verdict, pricing read, reviewer split, and community vote comparison.

C

Developer Tools

Context Engineering Reference

Runnable 5-layer stack that enforces RAG output against retrieved context

Ship

75%

Panel ship

Community

Paid

Entry

Context Engineering Reference Implementation is an open-source project by Brian Carpio at OutcomeOps that makes a concrete claim: RAG is not enough. The project defines and implements a 5-layer context engineering stack — Corpus, Retrieval, Injection, Output, and Enforcement — where the final Enforcement layer is what separates it from standard retrieval-augmented generation pipelines. The enforcement layer actively verifies that generated content actually reflects what was retrieved, closing the loop on hallucinations that occur when an LLM "knows" something from pretraining that contradicts the retrieved document. The reference implementation runs against Amazon Bedrock and Claude using a Spring PetClinic codebase with Architecture Decision Records as the corpus — making it practical to study with real enterprise artifacts. Launched April 17 and already trending as a Show HN post, the project is winning the framing war around "context engineering as a discipline." As prompting has matured into prompt engineering, RAG is now maturing into something more rigorous. This is one of the cleaner articulations of that shift.

Q

Developer Tools

qmd

Local doc search engine with BM25 + vectors + LLM re-ranking — by Shopify's CEO

Mixed

50%

Panel ship

Community

Free

Entry

qmd is a lightweight local search engine built by Tobi Luetke, CEO of Shopify, for indexing and querying personal knowledge bases, documentation, and meeting notes — entirely offline. It combines three retrieval approaches in a single pipeline: BM25 full-text search for exact keyword matches, vector semantic search via ONNX-based embeddings, and LLM re-ranking using GGUF models through node-llama-cpp. All three stages run locally with no cloud dependency. The tool ships in multiple deployment modes: a CLI for ad-hoc queries, a Node.js library for programmatic use, an HTTP service for local API access, and — most useful for AI workflows — a native MCP server that lets Claude Code, Cursor, and similar editors query your local knowledge base directly during coding sessions. The hybrid retrieval approach means it handles both "find the exact error message from last week's standup notes" and "what was our decision about the auth architecture" equally well. What makes this notable beyond its technical approach is provenance: Luetke shipped it as a personal tool he actually uses, not a startup product. The GitHub history shows active iteration and he's been talking about it on X. It's a credible signal of where pragmatic AI-augmented knowledge management is heading for technical users who prefer local-first tools.

Decision
Context Engineering Reference
qmd
Panel verdict
Ship · 3 ship / 1 skip
Mixed · 2 ship / 2 skip
Community
No community votes yet
No community votes yet
Pricing
Open Source
Free, open source (MIT)
Best for
Runnable 5-layer stack that enforces RAG output against retrieved context
Local doc search engine with BM25 + vectors + LLM re-ranking — by Shopify's CEO
Category
Developer Tools
Developer Tools

Reviewer scorecard

Builder
80/100 · ship

The Enforcement layer is the real insight here — I've seen so many RAG systems where the LLM just ignores the retrieved context and answers from weights anyway. Having a verifiable check that output actually uses retrieval is table stakes for production. This implementation shows exactly how to do it.

80/100 · ship

Hybrid BM25 + vector + LLM re-rank is the right architecture for personal knowledge search — each layer catches what the others miss. The MCP server mode is genuinely useful: being able to ask Claude Code 'what did we decide about X last month' against my own notes changes the workflow. MIT licensed and from someone who ships real products.

Skeptic
45/100 · skip

The 5-layer framing is useful for communication but it's mostly reorganizing concepts practitioners already know. The enforcement check adds overhead and the reference implementation is tied to Bedrock — not everyone wants another AWS dependency in their AI stack.

45/100 · skip

This is a well-executed weekend project, not a production tool. It requires GGUF models and manual embedding setup — a meaningful friction barrier for non-technical users. The 'built by a CEO' narrative drives GitHub stars more than the technical differentiation. Obsidian with a local AI plugin gets you here with better UX.

Futurist
80/100 · ship

Naming and systematizing a practice is how it scales. 'Context engineering' as a discipline with a formal 5-layer model will shape how teams hire, design systems, and evaluate results — just as 'prompt engineering' gave teams a shared vocabulary for something they were already doing intuitively.

80/100 · ship

The pattern here — local hybrid retrieval as an MCP server feeding into AI coding agents — will be ubiquitous in two years. Today it's a technical power-user tool; tomorrow it's how everyone's AI assistant knows the institutional context behind the code. qmd is an early, clean implementation of that pattern.

Creator
80/100 · ship

For teams building editorial AI tools or knowledge bases, the enforcement layer concept translates directly to brand safety and accuracy guarantees. Knowing your AI isn't wandering off into its own hallucinations is what makes these systems publishable.

45/100 · skip

I manage a lot of notes, references, and creative briefs, but the setup friction here — GGUF models, CLI configuration — makes this inaccessible for most creators. The concept is great; the UX needs a front-end before it reaches beyond developers.

Weekly AI Tool Verdicts

Get the next comparison in your inbox

New AI tools ship daily. We compare them before you waste an afternoon.

Bookmarks

Loading bookmarks...

No bookmarks yet

Bookmark tools to save them for later