MarkItDown vs pi-autoresearch

MarkItDown is Microsoft's open-source Python utility that converts virtually any file format into clean, LLM-friendly Markdown. It handles PDFs, Word documents, PowerPoint presentations, Excel spreadsheets, HTML, CSV, JSON, XML, ZIP archives, images (with optional vision model descriptions), audio files (with transcription), YouTube URLs, and EPub files in one consistent interface. The key design philosophy is LLM-first: rather than trying to reproduce original formatting for human readers, MarkItDown preserves document structure—headings, lists, tables, links—in a format that language models naturally parse efficiently. It integrates with OpenAI-compatible vision clients for image descriptions and supports speech transcription for audio content. With 108k+ GitHub stars and still gaining nearly 2,000 per day, MarkItDown has become the default document ingestion layer for countless AI pipelines. As agents increasingly need to process real-world enterprise documents, this kind of robust conversion utility becomes critical infrastructure—turning messy business files into clean inputs that Claude or GPT-4o can reason about without token-wasting formatting artifacts.

pi-autoresearch extends the pi terminal agent with an autonomous optimization loop: the agent writes a change, runs a benchmark, uses Median Absolute Deviation (MAD) to filter out statistical noise, and either commits or reverts — then loops. No human in the loop. The cycle repeats until a time limit or convergence criterion is met. The technique was popularized by Karpathy's autoresearch concept for ML training, but pi-autoresearch generalizes it to any benchmarkable target. Shopify's engineering team ran it against their Liquid template engine and reported 53% faster parse/render with 61% fewer allocations after an overnight run — changes their team had been unable to land manually in months. The MAD-based noise filtering is the key innovation: it prevents the agent from chasing benchmark noise and reverting valid improvements. The project has spawned an ecosystem: pi-autoresearch-studio adds a visual timeline of accepted/rejected edits, openclaw-autoresearch ports the concept to Claw Code, and autoloop generalizes it to any agent that supports a run/test interface. At 3,500 stars, it's one of the most-forked pi extensions.