Marky vs TurboOCR

Marky is a minimal macOS markdown viewer designed specifically for the agentic coding workflow — where an AI agent is constantly writing and updating documentation, and you need to review it instantly without switching to a browser or IDE. Built by @grvydev using Tauri and Rust, it weighs under 15 MB and launches nearly instantly. The tool is CLI-first: `marky README.md` opens the file with live reload, so edits appear in real time. Features include Cmd+K fuzzy search across all open documents, full Mermaid diagram rendering, Shiki syntax highlighting with multiple theme options, and table of contents navigation. It's intentionally not a note-taking app — it's a viewer, which keeps it fast and focused. The timing matters: as AI coding agents generate more documentation, architecture diagrams, and spec files during long sessions, having a dedicated lightweight viewer becomes genuinely useful. Reading agent output in a terminal or GitHub preview is friction. Marky eliminates that friction without adding bloat. Show HN received 69 points, suggesting the niche is real.

TurboOCR is a C++20 OCR server that uses CUDA and TensorRT to process documents at speeds that make Python-based OCR look like a fax machine. The headline number: 270 images per second on FUNSD form datasets with approximately 11ms single-request latency — roughly 50x faster than PaddleOCR's standard Python implementation. It uses PP-OCRv5 models (the same underlying tech as PaddleOCR) but squeezes them through TensorRT FP16 optimization for GPU inference. The server exposes both HTTP and gRPC interfaces from a single binary and handles PDFs natively with four extraction strategies: pure OCR, native text layer extraction, hybrid verification mode, and a "best of both" fallback chain. PP-DocLayoutV3 handles layout detection across 25 document region classes — useful for structured documents where you need to know that a bounding box is a table cell vs. a header vs. a figure caption. A Prometheus metrics endpoint tracks throughput, latency, and GPU memory in real time. Deployment is Docker-first: TensorRT engine compilation happens automatically on first startup. The catch is it requires Linux with an NVIDIA Turing GPU (RTX 20-series minimum) and driver 595+, so it's not a laptop tool. But for enterprise document automation — invoices, forms, medical records — the throughput-to-cost ratio is hard to beat.