LiteRT-LM vs MinerU2.5

LiteRT-LM is Google's production-grade, open-source inference framework for deploying Large Language Models on edge devices — phones, IoT hardware, Raspberry Pi, and desktop machines without cloud connectivity. Launched April 7, 2026 alongside Gemma 4 support, it enables developers to run Gemma, Llama, Phi-4, Qwen, and other models entirely locally via a simple CLI or embedded SDK. The framework handles the hard parts of edge inference: memory-mapped per-layer embeddings, 2-bit and 4-bit quantization, NPU acceleration for Qualcomm and MediaTek chipsets (early access), and cross-platform support spanning Android, iOS, Web, and desktop. Gemma 4's E2B variant runs under 1.5GB RAM on some devices, making full LLM functionality viable on mid-range hardware. What makes LiteRT-LM significant is the agentic angle. It's one of the first frameworks to support multi-step agentic workflows running completely on-device — function calling, tool use, vision and audio inputs — without a single network request. For developers building privacy-sensitive apps or offline-capable agents, this changes the calculus entirely.

MinerU2.5 is a 1.2-billion parameter vision-language model purpose-built for high-resolution document parsing. From OpenDataLab, it's the latest version of a project that's accumulated 61.5K GitHub stars — which tells you something about how painful document-to-text has been as a category. The model uses a decoupled vision-language architecture for efficient high-resolution processing with state-of-the-art recognition accuracy across tables, formulas, figures, and mixed-layout documents. The core use case is turning messy PDFs, scanned forms, academic papers, and enterprise documents into clean Markdown or structured JSON that LLMs can actually work with. Earlier MinerU versions were already widely adopted for RAG pipeline preprocessing — 2.5 tightens up accuracy on the edge cases that killed earlier tools: rotated pages, dense tables, multi-column layouts, and multilingual content. At 1.2B parameters it's lightweight enough to run locally without a GPU farm, and the Apache 2.0 license means it integrates cleanly into commercial document pipelines. For anyone building RAG applications, AI research assistants, or document intelligence products, this is the preprocessing layer that removes a persistent pain point.