Karpathy Skills vs LiteRT-LM

Karpathy Skills is a CLAUDE.md plugin distilled from Andrej Karpathy's public observations on LLM coding pitfalls. Drop the single file into your project root (or install it as a Claude Code skill) and every Claude Code session starts pre-loaded with the four principles Karpathy identified as most commonly violated: think before writing, prefer simplicity, make only targeted changes, and close loops with explicit verification. The project has accumulated 1,450+ GitHub stars in under two weeks. The implementation is intentionally minimal — it's a structured system prompt, not a framework. Each principle is spelled out with concrete anti-patterns to avoid: no premature generation, no over-engineering simple tasks, no cascading refactors when a surgical fix suffices, no ending a session without verifying the goal was actually met. It's Karpathy's "Software 2.0" thinking applied to the agent workflow meta-layer. What makes this compelling isn't the technology — it's the curation. Karpathy has spent more time thinking about LLM behavior patterns than almost anyone outside the major labs. Packaging that into something installable in 30 seconds lowers the floor for teams who want more reliable agent outputs without extensive prompt engineering work.

LiteRT-LM is Google's production-grade, open-source inference framework for deploying Large Language Models on edge devices — phones, IoT hardware, Raspberry Pi, and desktop machines without cloud connectivity. Launched April 7, 2026 alongside Gemma 4 support, it enables developers to run Gemma, Llama, Phi-4, Qwen, and other models entirely locally via a simple CLI or embedded SDK. The framework handles the hard parts of edge inference: memory-mapped per-layer embeddings, 2-bit and 4-bit quantization, NPU acceleration for Qualcomm and MediaTek chipsets (early access), and cross-platform support spanning Android, iOS, Web, and desktop. Gemma 4's E2B variant runs under 1.5GB RAM on some devices, making full LLM functionality viable on mid-range hardware. What makes LiteRT-LM significant is the agentic angle. It's one of the first frameworks to support multi-step agentic workflows running completely on-device — function calling, tool use, vision and audio inputs — without a single network request. For developers building privacy-sensitive apps or offline-capable agents, this changes the calculus entirely.