Cohere North vs Dust Multi-Agent Orchestration

“The primitive here is: a packaged RAG-plus-retrieval stack running inside your VPC, with Cohere's models baked in rather than bolted on. That's a real thing engineers actually want — avoiding the "pipe everything to OpenAI" conversation with legal. The DX bet is that platform teams would rather configure a turnkey deployment than wire together a vector DB, an embedding service, and a completion API separately. That's the right bet for enterprise environments where the alternative is a six-month procurement cycle, not a weekend script. What I can't verify without getting my hands on it is whether the RAG pipeline is genuinely composable or just a black box with YAML knobs — that distinction matters enormously for teams who have non-standard retrieval logic. If the pipelines expose clean interfaces and don't force you into Cohere's opinionated chunking strategy, this ships confidently; if it's a wizard that spits out an iframe, it's a different story.”

“The primitive here is a directed task graph where agents can spawn sub-agents with scoped permissions — that's a real primitive, not a marketing word. The DX bet is that you configure agent topology in a UI rather than in code, which is the right call for enterprise buyers who don't want to version-control YAML agent graphs. My concern is the moment of truth: connecting your first data source and actually watching agents delegate requires significant setup around connectors and permissions, so the first-10-minutes test is rocky. Still, this isn't a three-API-call Lambda wrapper — the audit trail and scoped delegation are non-trivial to build correctly, and Dust appears to have built them correctly.”

“Category: enterprise AI deployment platform, direct competitors are Azure OpenAI on Your Data, AWS Bedrock with VPC isolation, and Google Vertex AI. Cohere's actual differentiation is that they're model-provider-agnostic from a corporate alignment standpoint — you're not also handing your data strategy to Microsoft or Google's ecosystem. That's a real wedge for regulated-industry buyers who are genuinely scared of co-mingling. The scenario where this breaks: mid-market companies who think they want on-prem but actually need a managed service — they'll buy North, understaff the deployment, and blame Cohere when the RAG pipeline hallucinate-retrieves. The kill scenario in 12 months isn't a competitor — it's that AWS and Azure finish hardening their sovereign cloud offerings, and the "not a hyperscaler" positioning becomes "also not as good." What would have to be true for me to be wrong: regulated-industry procurement cycles are long enough that Cohere locks in enough logos before hyperscalers catch up, and the model quality gap closes faster than the distribution gap opens.”

“Direct competitors are Salesforce Agentforce, Microsoft Copilot Studio, and ServiceNow's AI layer — all of which have distribution advantages Dust will never replicate. The specific scenario where this breaks is any enterprise with a non-standard data stack: if your knowledge lives in a homegrown CRM or an obscure ERP, Dust's connector set will leave you writing custom glue code that defeats the point. What kills this in 12 months isn't a competitor — it's that Anthropic and OpenAI both ship native multi-agent orchestration APIs that remove Dust's orchestration layer as a distinct value prop, leaving only the compliance UI as a moat, which is thin. To stay alive, Dust needs to own the compliance and audit workflow so deeply that even when orchestration is commoditized, enterprises can't migrate without losing institutional governance history.”

“The buyer is the CISO and the CTO jointly, and the budget comes from the enterprise software line item, not the AI experiment fund — that's a meaningful distinction because it means North is competing for budget that already exists. The moat here is genuine: on-prem deployment creates switching costs that are operational, not contractual, and compliance certifications that Cohere accumulates compound over time against new entrants. The pricing architecture is a classic enterprise land-and-expand play — contact sales means they're pricing to the value of data-residency compliance, not to model usage, which is the right call because a bank doesn't care what a token costs, they care what a data breach costs. The stress test: Cohere is still dependent on staying ahead of hyperscaler sovereign cloud offerings, and if their model quality plateaus relative to GPT or Gemini, enterprises will tolerate the data-residency trade-off less. The specific business decision that makes this viable is the on-prem option — that's not a feature, it's a separate market that the big API providers structurally cannot serve without cannibalizing their own cloud revenue.”

“The buyer here is the Chief of Staff or VP of Operations at a 500-1000 person company, pulling from a digital transformation or IT budget — that's a real check-writer with a defined problem. The pricing architecture is opaque (contact sales for anything serious), which means every deal is a negotiation and CAC balloons, but enterprise SaaS lives or dies on ACV so this is forgivable if they close at $50k+. The moat is the audit log and permission graph embedded in workflows — switching costs come from compliance teams relying on Dust's logs for actual regulatory reporting, not just convenience. The risk is that the underlying model providers ship governance primitives natively, collapsing Dust's differentiation to UI, which is not a durable position.”

“The job-to-be-done is "deploy enterprise AI without sending data to a third-party cloud" — that's coherent and real, but North tries to do that job AND be a RAG platform AND handle access controls AND serve as a compliance solution, and that's four jobs, not one. The onboarding for an enterprise platform like this isn't two minutes — it's a six-month procurement cycle, and I can't evaluate the actual product experience from what's publicly available, which is itself a signal that the product is incomplete or the team doesn't want it stress-tested publicly yet. The completeness problem: prebuilt RAG pipelines sound great until your documents are PDFs with scanned tables and your retrieval needs multi-hop reasoning, at which point "prebuilt" becomes "pre-broken." What would flip this to a ship is a credible technical sandbox where a platform engineer can actually test the RAG pipeline against their own document corpus before signing a contract — the absence of that path suggests North is a sales-led product, not a product-led one.”

“The thesis Dust is betting on: by 2028, enterprises will run hundreds of specialized AI agents simultaneously, and the coordination layer between them — not the agents themselves — becomes the strategic chokepoint. That's a falsifiable claim, and the dependency is that agent task complexity scales faster than any single model's ability to handle it in one context window, which is plausible given how context window gains have plateaued relative to task complexity growth. The second-order effect that matters isn't productivity — it's that the audit log becomes a new kind of organizational memory, and whoever owns that graph owns the institutional knowledge layer. Dust is riding the enterprise compliance-meets-AI trend, and they're early enough that the design space isn't locked — but the window closes fast once platform players treat orchestration as a checkbox feature.”