smolvm vs Together AI Llama 3.3 Fine-Tuning API

“This solves the AI agent sandbox problem cleanly. Sub-200ms boot, declarative Smolfile config, and OCI compatibility means you can integrate it into a CI pipeline in an afternoon. The network-off-by-default stance is exactly right — I want to opt into exposure, not opt out.”

“The primitive here is clean: submit a dataset, get back a LoRA adapter, deploy it — no CUDA drivers, no FSDP config, no sacred Hugging Face trainer incantations. The DX bet is to hide all the distributed training complexity behind a single API call, which is the right call for 80% of fine-tuning use cases. The auto-eval runs are a genuinely useful addition — getting a held-out eval without writing your own harness is the kind of thing that saves a Tuesday afternoon. My one gripe: the 'one-click deployment' language is landing-page speak until I see the actual API surface for versioning and rollback. If that's solid, this is a legitimate skip-the-weekend-script win; if it's a button in a dashboard with no programmatic control, it's half a tool.”

“It's alpha-quality infrastructure with 2.2k stars and a tiny team. Running production AI workloads in a project with 84 forks and no enterprise backing is a gamble. The macOS/Linux-only support also cuts out anyone running Windows-based CI, which is a real limitation for enterprise adoption.”

“The direct competitor is Modal plus Axolotl, or just calling the OpenAI fine-tuning API — and that comparison is where Together has to win. They do have a credible answer: Llama 3.3 is open-weight and OpenAI won't fine-tune it for you, so if you want this specific model, Together is a real option rather than a convenience wrapper. The scenario where this breaks is at scale: teams with large proprietary datasets and strict data residency requirements will hit contractual blockers before they hit a technical one. The 12-month kill scenario is that Meta ships a hosted fine-tuning offering tied to its own inference cloud, or Groq and Fireworks match this and compete on price, squeezing Together's margin to zero on a commodity service. What would have to be true for me to be wrong: Together builds enough workflow lock-in through evals, versioning, and deployment that switching cost exceeds the price delta.”

“As AI agents become default executors of arbitrary code, hardware-isolated sandboxes become load-bearing infrastructure, not optional hardening. smolvm's portable .smolmachine format is the right abstraction — the 'Docker image for VMs' primitive that the agent ecosystem has been missing.”

“The thesis here is: within 2-3 years, fine-tuning open-weight models becomes as routine as calling a hosted API today — the infrastructure friction is the only thing stopping most teams from doing it. That's a falsifiable and plausible bet; the trend line is the declining cost of LoRA training on commodity hardware, and Together is early-to-on-time, not late. The second-order effect that matters isn't that teams customize Llama — it's that model customization stops being a specialized MLOps discipline and becomes a product feature anyone can ship, which shifts power away from model providers with closed APIs toward whoever controls the fine-tuning workflow layer. The dependency that has to hold: open-weight models must remain competitive with closed frontier models for the tasks where fine-tuning provides the edge. If GPT-5 or Gemini 2.x make fine-tuning irrelevant by being few-shot-capable enough for every use case, the whole thesis collapses.”

“For anyone running code-gen tools or AI pipelines that touch the filesystem, this is peace of mind packaged in a CLI. The Smolfile config feels approachable, and the fact you can email a .smolmachine file and have it boot identically on a colleague's Mac is genuinely delightful.”

“The buyer is an ML engineer at a mid-size tech company whose team doesn't want to manage GPU clusters — that's a real person with a real budget line. But the moat here is essentially zero: this is compute arbitrage plus a thin API wrapper, and every inference provider with spare H100s can ship the same thing in a quarter. The pricing scales with training compute, which means Together's margin collapses exactly when the customer is getting the most value — high-volume fine-tuning jobs. What would need to change: Together would need to build proprietary eval infrastructure, dataset tooling, or model versioning deep enough that the workflow lock-in survives a 40% price cut from a competitor. Right now it's a good product that isn't a good business.”