AI-SPM vs Gemma Tuner Multimodal

AI-SPM (AI Security Posture Management) is an open-source control plane for AI agent security in production environments. Built by indie developer dshapi and posted to Hacker News, it addresses a real gap: most LLM systems now have tool access and decision-making power, but almost no runtime oversight layer to catch when things go wrong. The system works as a gateway between your application and the LLM, enforcing three main controls: prompt injection detection (including obfuscated variants that bypass naive pattern matching), structured tool call validation against defined policies using Open Policy Agent (OPA), and sensitive data leakage prevention (PII and model output filtering). An Apache Kafka and Apache Flink streaming pipeline provides real-time audit trails and anomaly detection. The creator's key insight is that tool misuse — not model jailbreaks — is the primary risk vector in production AI agents. A rogue or compromised agent that escalates tool permissions or exfiltrates data through sanctioned channels is far harder to catch than a classic prompt injection. AI-SPM is early, minimal traction, and needs real-world stress testing. But as AI agent deployments mature from demos to production, runtime security tooling like this becomes non-optional.

Gemma Tuner Multimodal is an open-source fine-tuning toolkit for Google's Gemma 4 and Gemma 3n models that runs entirely on Apple Silicon using PyTorch with Metal Performance Shaders (MPS) backend — no NVIDIA GPU or cloud infrastructure required. It supports LoRA training on multimodal inputs: audio, images, and text simultaneously, using local CSV files or streamed from Google Cloud Storage or BigQuery. The tool targets the growing segment of developers who own M-series Macs but have been locked out of fine-tuning workflows that assume CUDA availability. Gemma 4's architecture is particularly well-suited to this use case: its 4B multimodal variant (designed for on-device deployment) trains efficiently on M3 Max and M4 Pro hardware within the available unified memory constraints. Primary use cases include medical transcription fine-tuning (audio → text with clinical terminology), visual QA systems (image + text → structured response), and private on-device pipelines where cloud API calls are prohibited by compliance requirements. The project fills a specific niche that Google's own fine-tuning documentation doesn't cover well for Apple hardware.