GLM-5.1 vs Ternary Bonsai

GLM-5.1 is Z.ai's (formerly Zhipu AI) open-weight model released April 7, 2026 under the MIT license. It's a 744-billion-parameter Mixture-of-Experts architecture with 40 billion active parameters per token, a 200K-token context window, and a 131K maximum output length — and it became the first open-source model ever to lead SWE-bench Pro, scoring 58.4% versus Claude Opus 4.6's 57.3%. The training story is almost as remarkable as the performance. GLM-5.1 was trained entirely on approximately 100,000 Huawei Ascend 910B chips using the MindSpore framework — no Nvidia hardware was used at any point. That makes it one of the first frontier-tier models to demonstrate that the CUDA monoculture isn't technically mandatory for training state-of-the-art models. Z.ai became the first publicly traded foundation model company via a Hong Kong IPO in January 2026 (~$558M raised). The model is free to download from HuggingFace and also available via API at $0.95 per million input tokens. In agentic demonstrations, it has run autonomously for eight hours straight — 655 planning and execution iterations — without human checkpoints.

PrismML's Ternary Bonsai is a family of ultra-compressed language models using 1.58-bit weights — meaning every parameter is stored as -1, 0, or +1, with no higher-precision layers anywhere in the architecture. The line-up covers 8B, 4B, and 1.7B parameter models. The flagship 8B model fits in 1.75 GB of RAM, a 9x reduction versus a 16-bit baseline. Unlike earlier 1-bit experiments that felt like a party trick with serious capability regressions, Ternary Bonsai 8B outperforms PrismML's own prior 1-bit Bonsai 8B by 5 points on average across standard benchmarks. The team also ships WebGPU inference, so the 1.7B model runs entirely in a browser tab. This is the first time a production-quality chat model has run with no server at all. The real-world use case is edge and offline deployment: medical devices, air-gapped government systems, consumer apps that need to work without a signal. At 1.75 GB, the 8B model fits on the GPU RAM of a six-year-old gaming laptop. PrismML is positioning this as the foundation for truly offline AI — a credible claim if the capability benchmarks hold up under real-world testing.