Guillermo Rauch
Vercel CEOGrok 4.5 tops cybersecurity price-performance; containers are not a safe agent boundary
Vercel's latest benchmarks put Grok 4.5 as the best cybersecurity model on price-performance: 10x cheaper than Sol, 5.7x cheaper than Opus 5, and 2.2x cheaper than Kimi K3, while landing at roughly Kimi-level performance. Sol still holds the frontier outright, ahead of Opus 5. Separately, Rauch flagged Kimi's paper on where agents should be allowed to run: container-level isolation is not enough, because in their experiments agents crashed the underlying machine via kernel panics. His read is that Firecracker microVMs, as used in Vercel Sandbox, are the boundary that actually holds.
- #evals
- #security
- #agents
