Cohere Compass 2 vs Notion AI Research Mode

“The primitive here is a retrieval pipeline that can ingest mixed-format documents — PDFs with embedded charts, scanned tables, image-heavy slides — and return semantically relevant chunks without requiring a preprocessing ETL step per modality. That's a real problem: anyone who's tried to build RAG over a 10,000-document enterprise library knows the pain is 80% in the ingestion layer. The DX bet is that Cohere handles the multimodal parsing so you don't glue together a PDF parser, a table extractor, and a vision model yourself. The on-prem deployment option is actually the headline feature for the buyer, not the multimodal part — that's what gets it past legal review. My skip concern is documentation: the blog post is long on capability claims and short on API surface, schema design, and what 'image understanding' means at query time versus index time. Show me the query API, then we'll talk.”

“The direct competitors are Azure AI Search with multimodal indexing, AWS Kendra, and increasingly any RAG stack bolted onto GPT-4o's native PDF vision. Compass 2's real differentiator is not the multimodal capability — every major cloud provider is shipping that — it's the on-premises deployment for enterprises with data residency requirements, combined with a retrieval model trained specifically for enterprise document retrieval rather than general web content. The scenario where this breaks is at the 'chart understanding' claim: interpreting a bar chart semantically in a way that survives a specific quantitative query ('find all documents where Q3 revenue exceeded Q2') is a much harder problem than the blog post implies, and I've seen this class of tool hallucinate chart data confidently. What kills this in 12 months isn't a competitor — it's that the chart and table comprehension doesn't hold up under production query loads and the feature gets quietly deprioritized. I'm shipping it narrowly: for text-heavy PDFs with some visual elements in air-gapped environments, this is probably the best available option right now.”

“The direct competitors here are Perplexity, which does cited web search better as a standalone, and ChatGPT with browse enabled, which already lives in more workflows than Notion ever will. The specific scenario where this collapses: any research task that requires more than five sources, real-time data accuracy, or a domain where citation freshness actually matters — Notion's model selection and crawl depth are opaque, and there's zero information on how often sources are verified. My 12-month kill prediction: OpenAI ships a tighter Notion-equivalent workspace integration and the marginal value of Research Mode evaporates, because the moat was convenience, not capability. To earn a ship, Notion needs to publish citation accuracy benchmarks and give users explicit control over source recency and domain filtering.”

“The buyer is a VP of IT or Chief Data Officer at a regulated enterprise — financial services, pharma, government — and the budget comes from the data infrastructure or compliance line, not a software tools budget. That's a real check-writer with a real problem: they have document libraries they legally cannot send to OpenAI's API, and they need search that works across formats. The on-prem deployment option is the actual moat here, not the multimodal capability — Cohere has been building that distribution channel for two years and it creates genuine switching costs once it's integrated into an enterprise's document management stack. The risk is that the pricing model is 'contact sales' all the way down, which means a long sales cycle and high CAC that has to be recovered on large contracts. What survives the model-gets-cheaper scenario is the enterprise integration layer and compliance certifications, not the retrieval model itself — Cohere needs to be pricing for that, not for compute.”

“The buyer is already in the building — anyone paying for the Notion AI add-on gets this, which means zero incremental CAC and a clean retention lever for a SKU that historically faced 'why am I paying $10/mo for this' churn. The moat is workflow integration, not capability: the value isn't that the research is better than Perplexity's, it's that it's already inside the doc where the output lives. The stress test is pricing — if Notion bundles AI into base plans or competitors drop their add-on prices, Research Mode becomes table stakes rather than a differentiator, and Notion needs either deeper proprietary synthesis features or a data network effect from team research patterns to stay ahead of that.”

“The thesis Compass 2 is betting on: enterprise knowledge is fundamentally multimodal — it lives in slide decks, scanned contracts, financial tables, and annotated diagrams — and the first retrieval system that treats those formats as first-class citizens rather than edge cases will own the enterprise search layer. That's a plausible and falsifiable bet, but the dependency is that 'understanding' a chart means something semantically useful at query time, not just 'we embedded the image.' The second-order effect that matters here isn't faster document search — it's that if this works, structured data that currently lives locked in PDFs becomes queryable without a data engineering team to extract it, which shifts power from BI teams who own structured pipelines toward anyone with a document library. Cohere is riding the trend of on-premises LLM deployment for regulated industries — that trend is real and accelerating, and they're on-time to it, not early. The future state where this is infrastructure is 'every regulated enterprise has a Compass instance the same way they have an Active Directory instance.' I'd believe that in five years if the chart comprehension claim is real.”

“The thesis here is falsifiable: in three years, the research artifact isn't a Google Doc you fill in — it's a living brief that knows your prior work and current events simultaneously. Notion is betting that the workspace is the right layer to own this, because it already holds the institutional memory. The second-order effect that matters isn't the brief itself — it's that every research session now trains Notion's understanding of what topics your team actually cares about, which compounds into a personalization moat that Perplexity can't replicate from a cold start. The dependency that has to hold: Notion keeps its workspace-as-graph advantage over point solutions, which means they need to not commoditize the document graph into a flat search index.”

“The job-to-be-done is unambiguous: synthesize external information into a Notion doc without leaving the tab. That's a real friction point for anyone using Notion as a second brain or team wiki — the copy-paste-cite loop from browser to doc is genuinely painful and Research Mode kills it. Onboarding is effectively zero because it surfaces inside a workflow the user already has; there's no new app to learn, no new mental model, just a new slash command or AI prompt. The gap is completeness around source control — users can't currently filter by date range or exclude domains, which means research tasks with recency requirements still need a dedicated tool running in parallel.”

“What Research Mode actually produces is a structured synthesis block with inline citations — numbered references that link out, not a wall of text with a sources section bolted at the bottom. That's a tasteful default, and it respects the document instead of dumping raw LLM output into it. The editing surface is where it gets shaky: once the synthesis lands on the page, iteration means re-prompting from scratch rather than adjusting individual claims or swapping a specific source, which breaks the way writers actually refine research. The fingerprint is present — the summaries have that symmetrical three-point structure that screams AI — but the citation scaffolding is good enough that a light edit pass produces something genuinely usable.”