LiteRT-LM vs Skrun

LiteRT-LM is Google AI Edge's production-grade open-source inference framework for running large language models directly on edge devices — Android phones, iPhones, web browsers via WebAssembly, and IoT hardware. It powers the on-device GenAI features in Chrome, Chromebook Plus, and Pixel Watch that Google launched alongside Gemma 4. The framework supports a wide model zoo including Gemma, Llama, Phi-4, and Qwen, with quantization pipelines that fit models onto hardware as constrained as a wearable. It also supports function calling and tool use, enabling lightweight agentic workflows without a cloud round-trip. A JavaScript API makes browser integration straightforward for web developers. LiteRT-LM represents Google's answer to Apple Intelligence's on-device approach — an open, cross-platform runtime rather than a proprietary stack. The fact that it's open-sourced means any developer can ship private, offline AI features without touching Google's servers, which matters enormously for healthcare, finance, and enterprise applications.

Skrun is an open-source tool that wraps agentic skills — the discrete, reusable capabilities you build for AI agents (web search, data extraction, file transformation, API calls) — into deployable REST APIs with a single command. The idea is that skills you build for one agent context shouldn't be locked to that agent's runtime. With Skrun, you define a skill once with a standard function signature, and get a hosted endpoint with automatic request validation, retry logic, rate limiting, and an OpenAPI spec generated automatically. The project addresses a real architectural tension in the current AI tools ecosystem: agent skills are written in a dozen different formats (LangChain tools, MCP tools, function call JSON, OpenAI tool specs) and are essentially stranded assets — they only work within their specific orchestration framework. Skrun normalizes this by wrapping any skill definition format and exposing it as a framework-agnostic HTTP endpoint that any agent or pipeline can call. This appeared on Hacker News with a small but thoughtful discussion focused on the "skills as microservices" architectural pattern. Critics noted that adding HTTP round-trips to every tool call introduces latency; proponents argued that the composability and reusability benefits outweigh the cost. The early version focuses on stateless skills; stateful/conversational skill deployment is on the roadmap.