Llama 3.3 70B vs Perplexity Deep Research API

“The primitive here is a function-calling-optimized autoregressive transformer you actually own — no API keys, no rate limits, no vendor terms changing under you. The DX bet Meta made is correct: structured output and tool schemas that follow the same JSON format as OpenAI's function-calling spec, which means existing tooling just works. The moment of truth is `ollama run llama3.3` and watching it correctly chain a multi-step tool call on the first attempt — that's the test, and it passes. The specific decision that earns the ship is fitting competitive agentic performance into a single A100 node; that's not a marketing claim, it's a deployment constraint that actually changes what you can build on-prem.”

“The primitive here is clean: one API call returns a cited, multi-step research report instead of you stitching together a crawler, a chunker, a retriever, and a summarizer yourself. The DX bet is depth-as-a-parameter, which is the right call — you specify how deep the research goes and pay accordingly, rather than configuring a pipeline. The moment of truth is whether the citation metadata is structured enough to render in your own UI, and from the docs it looks like it is — sources come back with URLs and relevance signals, not just inline footnotes. A competent engineer could approximate this with Tavily plus GPT-4o plus a Redis queue, but the latency and reliability gap is real enough that the abstraction earns its price. Ships because it collapses a genuinely annoying multi-service integration into a single endpoint with predictable output schema.”

“Direct competitors are Mistral's models, Qwen 2.5 72B, and the hosted Claude/GPT-4o APIs — and Llama 3.3 70B is genuinely competitive on function calling benchmarks, not just in Meta's own evals. The scenario where it breaks is multi-turn agentic loops with more than 6-8 tool calls: context management degrades and the model starts hallucinating tool signatures it hasn't seen. What kills this in 12 months isn't a competitor — it's Meta shipping Llama 4 at 70B with multimodality, making this release a stepping stone rather than a destination. For a team that can't afford per-token API costs at scale, this is a real ship right now.”

“Direct competitor here is Exa plus any frontier model with web access, or just OpenAI's Deep Research endpoint — yes, OpenAI has one too, and that's the threat this review has to acknowledge upfront. Where Perplexity has a real edge is citation density and source freshness; their crawler is genuinely good and the cited-report format is more structured than what you get back from a raw GPT-4o search call. The scenario where this breaks is high-volume enterprise workloads where session-depth pricing compounds fast — a product that runs 500 research queries a day will see costs balloon in ways that a flat-rate subscription wouldn't. Twelve-month prediction: OpenAI ships 90% of this natively into the Responses API with better model quality, and Perplexity has to compete on price and source breadth. What would have to be true for me to be wrong: Perplexity's web index turns out to be meaningfully fresher and wider than what OpenAI can access, which is not implausible given their search-first architecture.”

“The thesis this model bets on: by 2027, the dominant deployment pattern for enterprise agents is self-hosted open-weights models, not managed API calls, because data sovereignty and cost predictability beat convenience at scale. For that to pay off, inference hardware costs need to keep falling and the open-weights ecosystem needs to stay ahead of the capability curve — both of which are currently trending in the right direction. The second-order effect nobody is talking about is what this does to the inference provider market: when a 70B model with frontier-competitive tool use runs on one node, the commodity inference layer gets squeezed hard and the value shifts entirely to fine-tuning pipelines and evaluation infrastructure. Llama 3.3 is riding the trend of capable-small-models and it's early, not on-time — the enterprise adoption wave for self-hosted agents is still 18 months out.”

“The thesis here is falsifiable: within three years, knowledge work applications will be expected to answer questions with cited, multi-step research rather than static retrieval — and building that capability in-house will be as absurd as building your own search index. That's a credible bet, not a vibe. What has to go right: enterprise buyers have to accept AI-generated research as sufficient for high-stakes decisions, and Perplexity's citation model has to remain trusted enough that downstream liability doesn't kill the use case. The second-order effect that nobody's talking about: if this API succeeds, it accelerates the commoditization of analyst-tier research tasks at the application layer — which reshapes what junior knowledge workers get hired to do, not just what tools they use. Perplexity is on-time to the 'research as infrastructure' trend, not early; the window before the major model providers close the gap is 12-18 months. If this tool wins, it becomes the research substrate for a generation of B2B SaaS products the same way Stripe became the payment substrate — the infrastructure nobody builds themselves.”

“The buyer here isn't a single persona — it's any engineering team with a GPU budget and a reason to avoid per-token API costs, which includes healthcare, finance, and any regulated industry. The moat question is where it gets complicated: Meta has no moat on this model, and neither do the businesses building on it unless they fine-tune on proprietary data and create workflow lock-in. The business case that actually works is inference providers — Together, Fireworks, Groq — who use Llama 3.3 70B as a loss-leader to acquire developer accounts and upsell on throughput. For an end-user product company building on top of this, the defensibility question is unanswered, but for infrastructure plays, this release is a genuine unlock.”

“The buyer here is a product or engineering team at a company that wants research-enriched features — competitive intelligence dashboards, due diligence tools, automated briefing products — without owning the infrastructure. That buyer has a real budget and a clear make-vs-buy calculus. The pricing architecture is usage-based, which aligns with value when research sessions are sparse but becomes a liability if a customer's use case is high-frequency; I'd want to see volume tiers or committed-use discounts before betting a product on this. The moat is the web index and the citation quality — Perplexity has been building that index for years and it's legitimately differentiated from a raw LLM call. The platform risk is real: if OpenAI or Anthropic bundles equivalent search grounding into their standard API pricing, this margin story gets uncomfortable fast. Ships because the wedge is real and the buyer is defined, but the pricing architecture needs enterprise tiers before this scales cleanly.”