MemPalace vs TurboOCR

MemPalace is a free, open-source AI memory system that gives large language models persistent, cross-session memory. It accumulated over 43,000 GitHub stars within a week of launch — one of the fastest open-source AI project takeoffs of 2026. Unlike systems that use AI to summarize memories (lossy by design), MemPalace stores all conversation data verbatim and uses vector search via ChromaDB and SQLite to retrieve relevant memories. The storage metaphor is architecturally literal: people and projects become 'wings', topics become 'rooms', and original content lives in 'drawers' — enabling scoped search rather than flat corpus retrieval. Memory retrieval costs just ~170 tokens, making it practical even in cost-sensitive deployments. On the LongMemEval benchmark it scores 96.6% raw (100% in hybrid mode, though the hybrid methodology has faced some independent scrutiny). It runs entirely locally at zero API cost, meaning no cloud dependency and no privacy leakage. The project has been independently validated on production agentic workflows and is already being integrated into agent frameworks.

TurboOCR is a C++20 OCR server that uses CUDA and TensorRT to process documents at speeds that make Python-based OCR look like a fax machine. The headline number: 270 images per second on FUNSD form datasets with approximately 11ms single-request latency — roughly 50x faster than PaddleOCR's standard Python implementation. It uses PP-OCRv5 models (the same underlying tech as PaddleOCR) but squeezes them through TensorRT FP16 optimization for GPU inference. The server exposes both HTTP and gRPC interfaces from a single binary and handles PDFs natively with four extraction strategies: pure OCR, native text layer extraction, hybrid verification mode, and a "best of both" fallback chain. PP-DocLayoutV3 handles layout detection across 25 document region classes — useful for structured documents where you need to know that a bounding box is a table cell vs. a header vs. a figure caption. A Prometheus metrics endpoint tracks throughput, latency, and GPU memory in real time. Deployment is Docker-first: TensorRT engine compilation happens automatically on first startup. The catch is it requires Linux with an NVIDIA Turing GPU (RTX 20-series minimum) and driver 595+, so it's not a laptop tool. But for enterprise document automation — invoices, forms, medical records — the throughput-to-cost ratio is hard to beat.