Axolotl v0.16 vs DeepGEMM

Axolotl is the go-to open-source fine-tuning framework for the local LLM community, and v0.16 is its most significant performance release to date. The headline numbers are striking: 15x faster training for Mixture-of-Experts (MoE) models with LoRA adapters, 40x reduction in memory usage for the same configurations, and 58% faster GRPO async training — the algorithm behind many of the recent reasoning model breakthroughs. Day-0 support for Google Gemma 4 shipped simultaneously with the model release. The MoE+LoRA improvements are especially timely. As sparse mixture-of-experts models like Gemma 4, Mistral, and Qwen3.6-Plus dominate the model landscape, fine-tuning them has been disproportionately expensive. Axolotl v0.16 makes it practical to fine-tune these architectures on a single consumer GPU — previously a multi-GPU or cloud-required task. The GRPO improvements also make reinforcement learning from human feedback (RLHF) workflows dramatically faster for small teams. For the indie fine-tuning community — researchers, small companies, and hobbyists building specialized models — this release removes a major cost barrier. Combined with the simultaneous Gemma 4 support, v0.16 positions Axolotl as the fastest path from a new model release to a fine-tuned, production-ready custom variant.

DeepGEMM is DeepSeek's open-source library of highly optimized FP8 General Matrix Multiplication (GEMM) kernels targeting NVIDIA SM90/SM100 GPUs — the H100, H800, and Blackwell class. The headline feature is a lightweight just-in-time (JIT) compiler that eliminates the need for offline CUDA compilation at install time, dramatically lowering the barrier for teams who want raw GPU throughput without complex build pipelines. The library covers FP8 and FP4 dense GEMMs, BF16 accumulation, grouped GEMMs for Mixture-of-Experts architectures with overlapped NVLink communication, and multi-query attention scoring kernels. On H800 hardware DeepGEMM posts up to 1,550 TFLOPS — competitive with hand-tuned vendor libraries — while remaining fully open source under the MIT license. For LLM inference teams running on H100/H800 clusters, DeepGEMM slots directly into inference stacks like vLLM and SGLang. It's especially notable because it came from DeepSeek's internal training infrastructure, meaning it's been battle-tested at the scale that produced some of 2026's most cost-efficient models. This isn't research code — it's production tooling going public.