Google Gemma 4 vs OpenMythos

Google Gemma 4 is the most capable open model family Google has released, and the first to unify text, vision, and audio in a single architecture — all under the Apache 2.0 license. Available in four sizes (E2B, E4B, 26B MoE, 31B Dense), the lineup runs everywhere from smartphones to high-end GPUs and covers 140+ languages with context windows up to 256K. The headline stat: the 31B Dense model benchmarks above models nearly 20x its size in certain evals, making it the sharpest intelligence-per-parameter model in the open-source ecosystem as of its April 2026 release. The multimodal architecture processes documents with OCR, analyzes charts, transcribes speech, and understands video frames from a single model — no pipeline stitching required. For developers and researchers, the Apache 2.0 licensing is the real unlock. Gemma 4 is fully OSI-approved and commercially usable without restriction, building on a community of 400M+ downloads from prior Gemma versions and 100,000+ variants in the wild.

OpenMythos is a community-driven theoretical reconstruction of Claude Mythos's suspected architecture, implementing a Recurrent-Depth Transformer (RDT) — a looped transformer that recycles layers multiple times per forward pass for deeper reasoning without massive parameter growth. The project drew 10,100 GitHub stars in its first week, reflecting intense developer curiosity about what's powering Anthropic's latest generation models. The architecture has three stages: a Prelude (initial layers), a Recurrent Block (looped up to 32 times with shared weights), and a Coda (final layers). Rather than stacking hundreds of unique layers, the recurrent block runs the same weights multiple times with learned injection parameters updating hidden states between loops — enabling implicit chain-of-thought reasoning in continuous latent space without generating intermediate tokens. The project supports Grouped Query Attention (GQA) with optional Flash Attention 2, Multi-Latent Attention (MLA), and sparse MoE with routed and shared experts. Model scales range from 1B to 1T parameters. The key claim is that RDT achieves reasoning depth comparable to fixed-depth models with far more parameters, since computational complexity scales with loop iterations rather than layer count. This would explain how Claude Mythos achieves strong reasoning performance without the extreme parameter counts of brute-force scaling — though Anthropic has neither confirmed nor denied the architecture.