Compare/AI-Scientist-v2 vs OpenMythos

AI tool comparison

AI-Scientist-v2 vs OpenMythos

Which one should you ship with? Here is the side-by-side panel verdict, pricing read, reviewer split, and community vote comparison.

A

Research & Science

AI-Scientist-v2

Sakana AI's autonomous agent that writes peer-reviewed papers

Mixed

50%

Panel ship

Community

Free

Entry

AI-Scientist-v2 is Sakana AI's second-generation autonomous research system that generates scientific papers end-to-end — from hypothesis formation through experimentation, data analysis, and manuscript writing. It's historically notable for producing the first AI-authored workshop paper accepted through peer review. The v2 system removes reliance on human-authored templates that constrained the original, instead using a progressive agentic tree search guided by an experiment manager agent. This makes it more exploratory across ML domains, though Sakana acknowledges it trades v1's high template success rate for broader generalization with lower per-run success. Costs run roughly $20-25 per full research run using Claude 3.5 Sonnet. The system integrates with Semantic Scholar for literature review and supports OpenAI, Gemini, and Claude via AWS Bedrock. The custom license requires disclosure of AI use in resulting publications — a meaningful ethical constraint for a system that could otherwise flood conferences with AI-generated submissions.

O

Research & Open Source

OpenMythos

Open-source PyTorch reconstruction of Claude Mythos' suspected architecture

Ship

75%

Panel ship

Community

Paid

Entry

OpenMythos is a PyTorch reconstruction of the suspected architecture underlying Anthropic's Claude Mythos model, built entirely from published research. Creator Kye Gomez hypothesizes that Mythos uses a Recurrent-Depth Transformer (RDT) — where a subset of transformer layers loops multiple times per forward pass with shared weights rather than stacking unique layers. This allows the model to simulate "thinking" by iterating over the same compute graph, giving it emergent chain-of-thought behavior without explicit CoT prompting. At 770M parameters, the OpenMythos implementation reportedly matches the downstream quality of a 1.3B standard transformer on benchmarks. The architecture combines Multi-Latent Attention for memory compression, LTI (Linear Time-Invariant) stability constraints to prevent training instability during recurrence, Mixture of Experts routing for specialization, and Adaptive Computation Time (ACT) halting to decide when to stop looping per token. The project exploded on GitHub within days — 6.2k stars, 1.2k forks — and Kye's X announcement drove massive engagement (4.1k likes, 4.5k reposts). Community reaction is genuinely divided: AI researchers calling it "the most sophisticated reverse-engineering of an LLM architecture I've seen" while Anthropic has not confirmed or denied any of the architectural claims. This is an educated speculation backed by real engineering, not a marketing exercise.

Decision
AI-Scientist-v2
OpenMythos
Panel verdict
Mixed · 2 ship / 2 skip
Ship · 3 ship / 1 skip
Community
No community votes yet
No community votes yet
Pricing
Free / Open Source (custom license)
Open Source (Apache 2.0)
Best for
Sakana AI's autonomous agent that writes peer-reviewed papers
Open-source PyTorch reconstruction of Claude Mythos' suspected architecture
Category
Research & Science
Research & Open Source

Reviewer scorecard

Builder
80/100 · ship

For ML research teams, the $20-25 per run cost to get a draft paper with experiments is genuinely interesting as an ideation tool. The tree search approach that explores multiple experimental directions in parallel is the kind of thing that would take a grad student weeks.

80/100 · ship

Whether or not Anthropic actually uses this architecture, the RDT implementation itself is genuinely impressive engineering. The ACT halting mechanism and LTI stability constraints are clever solutions to problems anyone trying to build reasoning models will face. Fork-worthy regardless of the Mythos speculation.

Skeptic
45/100 · skip

Sakana's own documentation says v2 has lower success rates than v1 and is 'more exploratory.' Paying $25 for a failed research run with no guarantee of a usable output isn't a workflow most researchers will adopt. The peer review acceptance was a workshop paper — the lowest bar in academic publishing.

45/100 · skip

This is reverse engineering based on vibes and published papers, not leaked weights or verified architecture docs. Anthropic hasn't confirmed a thing. The 770M benchmark comparisons are cherrypicked and the '1.3B equivalent quality' claim needs independent reproduction. Intellectually interesting, empirically unverified.

Futurist
80/100 · ship

This is the beginning of AI as a genuine research collaborator, not just a writing assistant. Within five years, AI-generated hypotheses tested by autonomous agents will be standard practice in computational fields. AI-Scientist-v2 is primitive version 0.2 of that future.

80/100 · ship

Regardless of whether Mythos actually is an RDT, this project demonstrates that open-source researchers can meaningfully reconstruct competitive reasoning architectures from scratch. That capability gap between frontier labs and open-source is closing faster than most realize.

Creator
45/100 · skip

Science communication is a craft, and the idea of fully automating it makes me uncomfortable. The best papers are ones where researchers deeply understand and can defend every methodological choice — a system that writes the paper for you undermines that accountability.

80/100 · ship

A 6.2k star project in two days means something hit a nerve. The documentation is excellent — clear architecture diagrams, detailed training notes, working code. Even if the Mythos speculation is wrong, this is a model for how to share research engineering properly.

Weekly AI Tool Verdicts

Get the next comparison in your inbox

New AI tools ship daily. We compare them before you waste an afternoon.

Bookmarks

Loading bookmarks...

No bookmarks yet

Bookmark tools to save them for later