Apfel vs Axolotl v0.16

Every Apple Silicon Mac ships with a 3-billion-parameter language model locked inside Apple's Foundation Models framework. Apfel is a native Swift tool that cracks it open, exposing it as a UNIX CLI, an interactive chat client, and an OpenAI-compatible HTTP server — all running locally on your Neural Engine, no API keys required. Built in Swift 6.3 using LanguageModelSession, Apfel installs via a single brew command. It supports MCP (Model Context Protocol) natively for tool calling across all modes. Every token runs on-device with nothing leaving your machine. It requires macOS 26+ on Apple Silicon. Apfel cleared 513 points and 117 comments on Hacker News, making it one of the most-discussed indie AI releases of April. For developers who just want a fast, always-available local model that costs nothing per token and never phones home, Apfel is a genuinely useful tool. The model isn't frontier-quality, but for code summarization, quick answers, and workflow automation it punches well above its weight.

Axolotl is the go-to open-source fine-tuning framework for the local LLM community, and v0.16 is its most significant performance release to date. The headline numbers are striking: 15x faster training for Mixture-of-Experts (MoE) models with LoRA adapters, 40x reduction in memory usage for the same configurations, and 58% faster GRPO async training — the algorithm behind many of the recent reasoning model breakthroughs. Day-0 support for Google Gemma 4 shipped simultaneously with the model release. The MoE+LoRA improvements are especially timely. As sparse mixture-of-experts models like Gemma 4, Mistral, and Qwen3.6-Plus dominate the model landscape, fine-tuning them has been disproportionately expensive. Axolotl v0.16 makes it practical to fine-tune these architectures on a single consumer GPU — previously a multi-GPU or cloud-required task. The GRPO improvements also make reinforcement learning from human feedback (RLHF) workflows dramatically faster for small teams. For the indie fine-tuning community — researchers, small companies, and hobbyists building specialized models — this release removes a major cost barrier. Combined with the simultaneous Gemma 4 support, v0.16 positions Axolotl as the fastest path from a new model release to a fine-tuned, production-ready custom variant.