Paper2Code vs Vera

Paper2Code is an open-source multi-agent framework accepted at ICLR 2026 that automatically converts machine learning research papers from arXiv into runnable, modular code repositories. The system uses three specialized agents working in sequence: a Planner that extracts architecture diagrams and file dependency graphs from paper figures and text; an Analyzer that maps each method section to concrete implementation decisions; and a Generator that writes modular, executable code with proper package structure. Accuracy benchmarks are notable: on a curated evaluation set of recent ML papers with public reference implementations, only 0.81% of generated lines required manual correction before the code ran successfully. The system handles standard ML frameworks (PyTorch, JAX, Hugging Face) and generates test scripts alongside the implementation. Papers are ingested via arXiv IDs or PDF upload. The reproducibility crisis in ML research — where papers claim state-of-the-art results but provide no runnable code — has been a persistent problem. Paper2Code directly attacks this gap, and the ICLR acceptance signals genuine peer-reviewed validation of the approach. The repo launched publicly in early April 2026 and quickly picked up attention from both ML researchers frustrated with missing codebases and developers interested in the multi-agent pipeline as a pattern for document-to-code tasks.

Vera is a programming language built from the ground up for LLMs to write — not humans. Named after the Latin word for truth, it compiles to WebAssembly and runs in both the CLI and browser. Its most radical design choice: it eliminates variable names entirely, replacing them with typed De Bruijn structural references (like `@Int.0` for the most recent integer binding). Research suggests naming confusion is one of the biggest failure modes in AI-generated code — Vera removes the problem at the language level. Every function in Vera must declare `requires()` preconditions, `ensures()` postconditions, and `effects()` side-effect declarations. The compiler uses Z3 formal verification to check contracts at every call site, meaning the AI can't ship code that violates its own preconditions. Error messages are structured JSON with stable codes — written as instructions for AI systems to parse and fix, not human developers to read. Benchmark results are striking: on VeraBench, Kimi K2.5 achieves 100% correctness writing Vera code, outperforming both Python (86%) and TypeScript (91%) implementations. At v0.0.127 with 810+ commits, 127 releases, 3,638 tests, and a 13-chapter spec, this is a serious project — not a weekend experiment. If AI is going to write most of our code, perhaps the code should be designed for AI to write.