Paper2Code vs Voker

Paper2Code is an open-source multi-agent framework accepted at ICLR 2026 that automatically converts machine learning research papers from arXiv into runnable, modular code repositories. The system uses three specialized agents working in sequence: a Planner that extracts architecture diagrams and file dependency graphs from paper figures and text; an Analyzer that maps each method section to concrete implementation decisions; and a Generator that writes modular, executable code with proper package structure. Accuracy benchmarks are notable: on a curated evaluation set of recent ML papers with public reference implementations, only 0.81% of generated lines required manual correction before the code ran successfully. The system handles standard ML frameworks (PyTorch, JAX, Hugging Face) and generates test scripts alongside the implementation. Papers are ingested via arXiv IDs or PDF upload. The reproducibility crisis in ML research — where papers claim state-of-the-art results but provide no runnable code — has been a persistent problem. Paper2Code directly attacks this gap, and the ICLR acceptance signals genuine peer-reviewed validation of the approach. The repo launched publicly in early April 2026 and quickly picked up attention from both ML researchers frustrated with missing codebases and developers interested in the multi-agent pipeline as a pattern for document-to-code tasks.

Voker (YC S24) is an analytics platform that does for AI agents what Mixpanel did for web products — transforms raw agent conversations into structured, queryable insights without requiring a data engineering team. It auto-classifies user intents, detects when agents fail to resolve requests, surfaces knowledge gaps, and tracks performance regressions when you update your prompts. The platform integrates with OpenAI, Anthropic, Gemini, LangChain, CrewAI, and Vercel AI SDK via lightweight Python and TypeScript SDKs. Non-technical team members — PMs, analysts, support leads — can query conversation timelines, track satisfaction trends, and measure business impact without needing SQL or engineering support. The free tier covers 2,000 events/month, which is generous for small projects. Paid plans start at $80/month for 20K events. The core pain point is real: most teams today do spot-checks by hand to debug agent behavior at scale, which doesn't scale past a few hundred conversations. Voker automates that loop.