smolvm vs TurboOCR

smolvm is a Rust-based CLI tool for building, running, and distributing lightweight Linux virtual machines with sub-second cold starts. Born from the smol-machines project, it addresses a gap in the developer toolchain: running untrusted code or reproducible environments without the overhead of Docker daemons or full hypervisors. A single "Smolfile" TOML config declares your VM, and state packs into a portable .smolmachine file you can share across macOS and Linux. Under the hood, smolvm uses libkrun VMM with Hypervisor.framework on macOS and KVM on Linux. Memory is elastic via virtio balloon, so the host reclaims unused RAM. Network is off by default — a deliberate security stance. SSH agent forwarding works without exposing private keys to guest VMs. OCI image compatibility means you can pull from Docker Hub or ghcr.io without modification. The key use case shaping community interest is sandboxing AI agent workloads: give agents a hardware-isolated VM that boots in under 200ms with configurable filesystem and egress constraints. With AI coding tools increasingly executing arbitrary code, smolvm fills a meaningful gap between "run it on bare metal" and "stand up a full Kubernetes pod." At 2.2k GitHub stars and 487 HN upvotes on the day of its Show HN post, developer traction is real.

TurboOCR is a C++20 OCR server that uses CUDA and TensorRT to process documents at speeds that make Python-based OCR look like a fax machine. The headline number: 270 images per second on FUNSD form datasets with approximately 11ms single-request latency — roughly 50x faster than PaddleOCR's standard Python implementation. It uses PP-OCRv5 models (the same underlying tech as PaddleOCR) but squeezes them through TensorRT FP16 optimization for GPU inference. The server exposes both HTTP and gRPC interfaces from a single binary and handles PDFs natively with four extraction strategies: pure OCR, native text layer extraction, hybrid verification mode, and a "best of both" fallback chain. PP-DocLayoutV3 handles layout detection across 25 document region classes — useful for structured documents where you need to know that a bounding box is a table cell vs. a header vs. a figure caption. A Prometheus metrics endpoint tracks throughput, latency, and GPU memory in real time. Deployment is Docker-first: TensorRT engine compilation happens automatically on first startup. The catch is it requires Linux with an NVIDIA Turing GPU (RTX 20-series minimum) and driver 595+, so it's not a laptop tool. But for enterprise document automation — invoices, forms, medical records — the throughput-to-cost ratio is hard to beat.