Gemma Tuner Multimodal vs marimo-pair

Gemma Tuner Multimodal is an open-source fine-tuning toolkit for Google's Gemma 4 and Gemma 3n models that runs entirely on Apple Silicon using PyTorch with Metal Performance Shaders (MPS) backend — no NVIDIA GPU or cloud infrastructure required. It supports LoRA training on multimodal inputs: audio, images, and text simultaneously, using local CSV files or streamed from Google Cloud Storage or BigQuery. The tool targets the growing segment of developers who own M-series Macs but have been locked out of fine-tuning workflows that assume CUDA availability. Gemma 4's architecture is particularly well-suited to this use case: its 4B multimodal variant (designed for on-device deployment) trains efficiently on M3 Max and M4 Pro hardware within the available unified memory constraints. Primary use cases include medical transcription fine-tuning (audio → text with clinical terminology), visual QA systems (image + text → structured response), and private on-device pipelines where cloud API calls are prohibited by compliance requirements. The project fills a specific niche that Google's own fine-tuning documentation doesn't cover well for Apple hardware.

marimo-pair is an open-source extension for marimo reactive notebooks that lets you drop AI agents directly into live, running notebook sessions. Unlike traditional AI coding assistants that only see static code, these agents can execute cells, inspect in-memory variables, read dataframes, manipulate UI components, and iterate on your actual live state — not a static snapshot. The tool plugs into Claude Code via a marketplace plugin and supports any agent implementing the Agent Skills standard. An agent that can see and run your notebook opens up genuinely new workflows: "explore this dataframe and tell me what's anomalous," "run this hypothesis test on the data already in memory," or "generate a chart for each of these 12 conditions." It's the difference between an assistant that reads your code and one that works alongside you in your actual environment. Marimo itself is already a compelling React-based replacement for Jupyter — every cell tracks its dependencies so the notebook is always consistent. marimo-pair makes that reactive model collaborative with AI, enabling a new style of human-AI pair programming where the agent shares your full computational context.