Bonsai-8B vs Tencent Hy3 Preview

PrismML, a Caltech spinout, has shipped Bonsai-8B — the first 1-bit large language model that claims genuine benchmark parity with leading full-precision 8B instruct models while fitting entirely in 1.15 GB of RAM. It runs natively on Apple Silicon via MLX and on NVIDIA GPUs via llama.cpp without any quantization post-processing. The breakthrough here isn't just size — it's efficiency. PrismML reports approximately 4-5x better energy efficiency versus traditional 8B models, which matters enormously for mobile deployment, embedded systems, and cost-sensitive inference at scale. The Apache 2.0 license means no commercial restrictions, and the team has published the full training methodology alongside the weights. Previous 1-bit LLM efforts (BitNet, etc.) delivered underwhelming benchmark performance at practical scales. Bonsai-8B claims that gap has finally closed. If the benchmarks replicate independently, this could be the model that makes "AI on every device" a 2026 reality rather than a 2028 roadmap item.

Tencent open-sourced Hy3 Preview on April 23, 2026 — the first model to emerge from the company's rebuilt AI infrastructure, and its most credible challenge to frontier closed models to date. With 295 billion total parameters but only 21 billion active at inference time (plus 3.8B MTP layer parameters), it's a Mixture-of-Experts architecture that punches far above its compute weight. The model supports up to 256K context and is available via Hugging Face, ModelScope, and GitCode under the Tencent Hy Community License. On coding benchmarks, Hy3 scores 74.4% on SWE-bench Verified, 54.4% on Terminal-Bench 2.0, and 67.1% on BrowseComp — placing it firmly in the same tier as top models from Anthropic and OpenAI. Tencent claims a 40% efficiency improvement over its predecessor Hunyuan models, and pricing through Tencent Cloud TokenHub is aggressive: RMB 1.2 per million input tokens. A free two-week window at launch via OpenRouter made it widely accessible immediately. The model was led by a team that includes former OpenAI researchers and has already been deployed across Tencent's core products — WeChat, Yuanbao, and QQ. That production integration is a meaningful signal: this isn't a benchmark vanity release. For developers who need a powerful, cost-efficient reasoning and agentic model with actual open weights, Hy3 Preview is one of the most interesting drops of April 2026.