AI-SPM vs Libretto

AI-SPM (AI Security Posture Management) is an open-source control plane for AI agent security in production environments. Built by indie developer dshapi and posted to Hacker News, it addresses a real gap: most LLM systems now have tool access and decision-making power, but almost no runtime oversight layer to catch when things go wrong. The system works as a gateway between your application and the LLM, enforcing three main controls: prompt injection detection (including obfuscated variants that bypass naive pattern matching), structured tool call validation against defined policies using Open Policy Agent (OPA), and sensitive data leakage prevention (PII and model output filtering). An Apache Kafka and Apache Flink streaming pipeline provides real-time audit trails and anomaly detection. The creator's key insight is that tool misuse — not model jailbreaks — is the primary risk vector in production AI agents. A rogue or compromised agent that escalates tool permissions or exfiltrates data through sanctioned channels is far harder to catch than a classic prompt injection. AI-SPM is early, minimal traction, and needs real-world stress testing. But as AI agent deployments mature from demos to production, runtime security tooling like this becomes non-optional.

Libretto is an open-source browser automation toolkit built by Saffron Health to solve a critical problem with AI-driven web agents: non-determinism. Standard agent-controlled browsers using Playwright or Puppeteer routinely fail 20-30% of the time on production workflows because they rely on LLM judgment for timing and element selection. Libretto replaces that with a record-replay system that captures precise interaction timing and DOM fingerprints, achieving a reported 95% success rate on identical workflows. The library works by recording a "golden path" of a browser session — capturing not just actions but the exact CSS selectors, visual context, and timing windows during which those actions are valid. On replay, it verifies each step against expected page state before proceeding, and falls back to an LLM-assisted recovery mode when pages drift (e.g., after a UI update). Saffron Health built it to maintain integrations with EHR portals that change frequently and where failure has compliance consequences. Saffron open-sourced Libretto after using it internally for 18 months across 40+ healthcare software integrations. The HN thread highlighted the appeal for fintech, legal, and healthcare automation where reliability, not just capability, is the product. The toolkit targets TypeScript/Node.js environments and integrates cleanly with existing Playwright infrastructure.