Apfel vs Axolotl v0.16

Apfel is a Swift CLI that does something Apple didn't: it exposes the on-device LLM baked into every Apple Intelligence-enabled Mac as a proper OpenAI-compatible local server running at localhost:11434. Any app that speaks to Ollama's API — LM Studio, Continue, OpenWebUI, your own scripts — can now route requests to Apple's FoundationModels framework without modification. The feature set is more complete than most indie wrappers: streaming responses, tool calling with MCP support, file attachments, an interactive chat mode, and a debug SwiftUI GUI for inspecting token flow. Inference is fully on-device with no API keys, no telemetry, and no cost beyond electricity. On an M-series Mac, it runs at native Apple Neural Engine speeds — typically 40-80 tokens/second depending on the model variant active. The catch is real: you need macOS 26 Tahoe (currently in beta) and Apple Intelligence enabled. But for the tens of millions of Apple Silicon Mac users who already qualify or will soon, this is the quiet unlock of a model they already own. The "your Mac already has a free LLM" framing is resonating — the repo hit 3,500 stars in days.

Axolotl is the go-to open-source fine-tuning framework for the local LLM community, and v0.16 is its most significant performance release to date. The headline numbers are striking: 15x faster training for Mixture-of-Experts (MoE) models with LoRA adapters, 40x reduction in memory usage for the same configurations, and 58% faster GRPO async training — the algorithm behind many of the recent reasoning model breakthroughs. Day-0 support for Google Gemma 4 shipped simultaneously with the model release. The MoE+LoRA improvements are especially timely. As sparse mixture-of-experts models like Gemma 4, Mistral, and Qwen3.6-Plus dominate the model landscape, fine-tuning them has been disproportionately expensive. Axolotl v0.16 makes it practical to fine-tune these architectures on a single consumer GPU — previously a multi-GPU or cloud-required task. The GRPO improvements also make reinforcement learning from human feedback (RLHF) workflows dramatically faster for small teams. For the indie fine-tuning community — researchers, small companies, and hobbyists building specialized models — this release removes a major cost barrier. Combined with the simultaneous Gemma 4 support, v0.16 positions Axolotl as the fastest path from a new model release to a fine-tuned, production-ready custom variant.