Axolotl v0.16 vs Azure Foundry Hosted Agents

Axolotl is the go-to open-source fine-tuning framework for the local LLM community, and v0.16 is its most significant performance release to date. The headline numbers are striking: 15x faster training for Mixture-of-Experts (MoE) models with LoRA adapters, 40x reduction in memory usage for the same configurations, and 58% faster GRPO async training — the algorithm behind many of the recent reasoning model breakthroughs. Day-0 support for Google Gemma 4 shipped simultaneously with the model release. The MoE+LoRA improvements are especially timely. As sparse mixture-of-experts models like Gemma 4, Mistral, and Qwen3.6-Plus dominate the model landscape, fine-tuning them has been disproportionately expensive. Axolotl v0.16 makes it practical to fine-tune these architectures on a single consumer GPU — previously a multi-GPU or cloud-required task. The GRPO improvements also make reinforcement learning from human feedback (RLHF) workflows dramatically faster for small teams. For the indie fine-tuning community — researchers, small companies, and hobbyists building specialized models — this release removes a major cost barrier. Combined with the simultaneous Gemma 4 support, v0.16 positions Axolotl as the fastest path from a new model release to a fine-tuned, production-ready custom variant.

Microsoft Azure's Foundry Agent Service now offers Hosted Agents in public preview — per-session isolated compute sandboxes purpose-built for running AI agents at scale. Each session gets its own container with a persistent filesystem, internet access (optional), and a Python environment pre-loaded with common agent dependencies. Sessions spin up in seconds and terminate — and stop billing — the moment the agent task completes. The design is framework-agnostic: it officially supports LangGraph, OpenAI Agents SDK, Claude Agent SDK, and Microsoft's own Agent Framework, with others planned. This removes one of the most awkward parts of deploying agents in production: figuring out where they actually run. The persistent filesystem per session means agents can read and write files across their task without external storage configuration. Pricing is $0.0994/vCPU-hour and $0.0118/GiB-hour — competitive with Lambda/Cloud Run for bursty workloads. The service is available in six Azure regions at launch. For enterprises already invested in Azure, this is a compelling "we just figured out the infra" moment. Independent developers can also use it without an enterprise agreement.