AI tool comparison
Qwen3.6-27B vs Ternary Bonsai
Which one should you ship with? Here is the side-by-side panel verdict, pricing read, reviewer split, and community vote comparison.
Open Source Models
Qwen3.6-27B
27B dense coding model that outperforms models 10x its size on benchmarks
75%
Panel ship
—
Community
Paid
Entry
Qwen3.6-27B is a 27-billion-parameter dense language model from Alibaba's Qwen team, released today under an open license. The headline claim is striking: it outperforms the much larger Qwen3.5-397B on major coding benchmarks, achieving what the team calls 'flagship-level coding performance' at a fraction of the parameter count. This follows the broader MoE-to-dense efficiency trend playing out across the open-weights ecosystem. The model targets software engineering tasks specifically — code generation, debugging, repository-level reasoning, and multi-file editing. It's available in full precision and quantized formats on Hugging Face, with community Q4 and Q8 builds already appearing within hours of the release. At 27B parameters in Q4, it fits comfortably on a single consumer GPU, making it practically accessible without enterprise hardware. This release is significant for the local LLM community. Qwen has been one of the most competitive open-weights families for coding tasks, and a 27B dense model that competes with models several times its size changes the cost calculus for self-hosted coding agents, development tooling, and any application where inference cost matters. Expect rapid adoption in tools like Jan, LM Studio, and Ollama.
Open Source Models
Ternary Bonsai
1.58-bit LLMs that run at 82 tok/s on M4 Pro and on your iPhone
75%
Panel ship
—
Community
Free
Entry
PrismML's Ternary Bonsai is a family of aggressively quantized language models that take the BitNet concept to its logical extreme. Each weight is constrained to one of three values — {-1, 0, +1} — with a shared FP16 scale factor per 128-weight group. No higher-precision escape hatches, no hybrid layers. The result is a 9x reduction in memory footprint versus standard 16-bit models. The numbers are striking: the 8B model fits in 1.75 GB and hits 82 tokens per second on an M4 Pro. More impressively, it runs at 27 tokens per second on an iPhone 17 Pro Max — fast enough for real-time conversation on-device. The 8B variant scores 75.5 average across standard benchmarks, outperforming many models that are 9-10x larger. The 4B and 1.7B variants push further into mobile-optimized territory. All three models are released under the Apache 2.0 license, available on Hugging Face and GitHub, and integrated into the Locally AI iOS app for immediate on-device deployment. For developers building privacy-sensitive applications or anyone tired of paying cloud inference costs, Ternary Bonsai offers a compelling on-device alternative that doesn't require a beefy GPU.
Reviewer scorecard
“A 27B model beating a 397B model on coding benchmarks at Q4 quantization that fits on a single GPU is genuinely exciting. This changes the economics of self-hosted coding agents. I'm testing it in my agentic pipeline immediately. The Qwen team has been consistently delivering quality — this continues that trend.”
“82 tokens per second on M4 Pro in 1.75 GB is a genuinely impressive engineering achievement. For local tooling, code assistants, or any latency-sensitive workload where I don't want cloud round-trips, this hits a sweet spot that larger quantized models miss. Apache 2.0 means I can embed it in commercial apps without legal headaches.”
“'Outperforms on benchmarks' is doing a lot of work here. Coding benchmarks like SWE-Bench and HumanEval measure specific, often narrow task types. Real-world coding agent performance — especially on large, ambiguous codebases — often looks very different from benchmark numbers. Calibrated enthusiasm until we see independent real-world evals.”
“A 75.5 benchmark average sounds good until you compare it against 8B models quantized with GGUF Q8 — which score similarly and have years of tooling, community support, and production deployments behind them. The 9x memory savings matter on constrained devices but less so on any machine with 16GB+ RAM. Niche but real use case.”
“The efficiency trajectory here is remarkable. A 27B model doing flagship-level coding work signals that the parameter-count ceiling for capable local models is lower than anyone expected two years ago. This democratizes AI-assisted development for individual developers and small teams who can't afford cloud API costs at scale.”
“On-device AI at 27 tokens per second on a phone is the inflection point that makes LLMs a platform primitive rather than a cloud service. Once inference is this cheap and fast on commodity hardware, the entire economic model of AI-as-API-call collapses. Ternary quantization is an early signal of where efficiency research is heading.”
“The local-first angle matters. Running a capable coding model fully offline on your own hardware — with no API costs, no rate limits, and no data leaving your machine — makes AI code assistance viable for freelancers and small studios working with proprietary client code under NDA.”
“The prospect of running a capable LLM entirely on my iPhone without sending any data to a server is genuinely exciting for creative work with sensitive material. Drafting, editing, and ideation without a cloud subscription or privacy concerns — I'd pay for that, and here it's free.”
Weekly AI Tool Verdicts
Get the next comparison in your inbox
New AI tools ship daily. We compare them before you waste an afternoon.