Compare/LM Studio + Locally AI vs Terrarium

AI tool comparison

LM Studio + Locally AI vs Terrarium

Which one should you ship with? Here is the side-by-side panel verdict, pricing read, reviewer split, and community vote comparison.

L

Developer Tools

LM Studio + Locally AI

LM Studio buys the best iOS local LLM app to go cross-device

Ship

75%

Panel ship

Community

Free

Entry

LM Studio, the most popular desktop app for running local large language models, has acquired Locally AI — the leading iOS and iPadOS app for on-device inference on Apple Silicon. Locally AI's creator Adrien Grondin is joining LM Studio full-time to lead cross-device native AI experiences. The acquisition signals LM Studio's ambition to own the full local AI stack: macOS, Windows, Linux, and now iPhone and iPad. Locally AI was notable for its deep Apple Silicon integration, using Core ML and Metal Performance Shaders to run models like Llama 3 and Phi-3 natively on A-series and M-series chips. The app had a dedicated following among privacy-conscious users who wanted a clean iOS interface without compromising their data to cloud services. LM Studio brings a larger model library, server mode, and a more mature MLX/GGUF toolchain. For local AI enthusiasts, this is a consolidation play in a space that was starting to fragment across too many single-platform apps. A unified LM Studio experience across desktop and mobile would be a significant UX improvement. It also sets up an interesting competition with Apple's own on-device AI ambitions in iOS 19.

T

Developer Tools

Terrarium

Evals that actually simulate real deployment — stateful, multi-turn, alive

Mixed

50%

Panel ship

Community

Paid

Entry

Terrarium is a multi-turn evaluation and optimization engine for LLM agents built by evolvent-ai. Unlike static benchmark suites that measure agents against fixed input-output pairs, Terrarium creates persistent, stateful "living environments" — simulated deployment contexts where agents operate over extended sessions, accumulate state, use tools, and interact with simulated external systems. You evaluate agents the way you'd test a car: by driving it, not by measuring its doors. The system supports configurable environment complexity, including simulated databases, APIs, file systems, and user personas. Agents are scored not just on final outputs but on trajectory quality — how efficiently they reached the answer, how often they hallucinated intermediate steps, and how well they recovered from dead ends. The engine also supports continuous optimization loops where poor-performing trajectories trigger automatic prompt refinement. With 17 stars and created April 14, Terrarium is extremely new. But it's addressing a genuine gap: the disconnect between how agents perform on static benchmarks versus how they behave in production. As enterprise AI deployments scale, the need for realistic pre-production evaluation is becoming critical.

Decision
LM Studio + Locally AI
Terrarium
Panel verdict
Ship · 3 ship / 1 skip
Mixed · 2 ship / 2 skip
Community
No community votes yet
No community votes yet
Pricing
Free (LM Studio core); Locally AI previously $0 (donation-ware)
Open Source
Best for
LM Studio buys the best iOS local LLM app to go cross-device
Evals that actually simulate real deployment — stateful, multi-turn, alive
Category
Developer Tools
Developer Tools

Reviewer scorecard

Builder
80/100 · ship

This is the right move for LM Studio. The desktop client is already excellent and Locally AI's Core ML integration is the best iOS inference wrapper available. Combining Grondin's Apple-native work with LM Studio's model management and server mode could produce something genuinely special for local AI power users.

80/100 · ship

Static evals are lying to us constantly — agents that ace benchmarks fall apart in production because benchmarks don't have state, side effects, or accumulated context. Terrarium's living environments model is the right approach to catching real failure modes before deployment.

Skeptic
45/100 · skip

Acquisitions in open-source adjacent tools often mean the indie app loses what made it great. Locally AI was clean and opinionated; LM Studio is powerful but has more surface area. There's real risk the mobile experience gets de-prioritized once the acquisition honeymoon ends.

45/100 · skip

Building a realistic simulation of your production environment is often harder than just running the agent in staging. The value proposition assumes your eval environment is meaningfully closer to production than your existing test suite — which is a big assumption for complex deployments.

Futurist
80/100 · ship

The race to own the local AI client layer is just beginning. LM Studio is positioning itself as the VLC of AI — runs everything, everywhere, free. If they nail the cross-device sync story (shared model library, shared chats), they become the default for privacy-first AI.

80/100 · ship

The eval-optimize loop is the missing piece in most AI agent development workflows. Tools that can automatically identify weak trajectories and suggest improvements will become as fundamental as unit tests. Terrarium is early, but the category is inevitable.

Creator
80/100 · ship

Being able to run the same model on my MacBook and iPhone with the same interface is a genuine quality-of-life win. I use local models for confidential creative writing and the iOS gap has always been frustrating. This closes it.

45/100 · skip

This is deeply technical infrastructure that won't affect my daily workflow. The people who need this know they need it — but for most creators building with AI tools, static evals are already more than they use.

Weekly AI Tool Verdicts

Get the next comparison in your inbox

New AI tools ship daily. We compare them before you waste an afternoon.

Bookmarks

Loading bookmarks...

No bookmarks yet

Bookmark tools to save them for later