AI-SPM vs Utilyze

AI-SPM (AI Security Posture Management) is an open-source control plane for AI agent security in production environments. Built by indie developer dshapi and posted to Hacker News, it addresses a real gap: most LLM systems now have tool access and decision-making power, but almost no runtime oversight layer to catch when things go wrong. The system works as a gateway between your application and the LLM, enforcing three main controls: prompt injection detection (including obfuscated variants that bypass naive pattern matching), structured tool call validation against defined policies using Open Policy Agent (OPA), and sensitive data leakage prevention (PII and model output filtering). An Apache Kafka and Apache Flink streaming pipeline provides real-time audit trails and anomaly detection. The creator's key insight is that tool misuse — not model jailbreaks — is the primary risk vector in production AI agents. A rogue or compromised agent that escalates tool permissions or exfiltrates data through sanctioned channels is far harder to catch than a classic prompt injection. AI-SPM is early, minimal traction, and needs real-world stress testing. But as AI agent deployments mature from demos to production, runtime security tooling like this becomes non-optional.

Utilyze is an open-source GPU monitoring tool that measures actual compute efficiency — the percentage of theoretical maximum floating-point throughput and memory bandwidth your workload is achieving. The core problem: standard GPU dashboards can read 100% utilization while your actual compute SOL (Speed of Light) percentage sits at 1%, creating dangerous false confidence. The tool tracks three metrics in real time: Compute SOL% (actual FLOPS vs theoretical max), Memory SOL% (achieved bandwidth vs peak capacity), and Attainable SOL% (the realistic ceiling given your workload's arithmetic intensity). This lets ML engineers immediately identify whether they're compute-bound or memory-bandwidth-bound and pull the right optimization levers. Built by Systalyze and released under Apache 2.0, Utilyze currently targets NVIDIA hardware with AMD MI300X/MI325X support planned. For any team spending real money on GPU compute for AI training or inference, this kind of visibility can cut cloud costs significantly — and it runs with negligible overhead, meaning you can monitor in production without affecting workload performance.