How Revolut Cut AI Coding Costs 90% With Self-Hosted Open Models
summary
Self-hosted GLM deployment cuts inference spend roughly 10x vs Anthropic/OpenAI and claims about 90% cost reduction with a blended token cost of 30¢ per million tokens, serving 2,000 engineers on 56 B200 GPUs. Results show ~60–70% faster lead time and 60% coding-time gains, plus an 88% performance uplift from tuning the same hardware (quantization VFP4/FP4, tensor-parallel tweaks, caching >90%). Targets: sub-3s time to first token and ~200 TPS interactive throughput; production needs OpenAI-compatible endpoints, sandboxed human-in-loop workflows, and strict telemetry for EU compliance.
AI-written summary · about
