Newer AI Models Missed More Payment Fraud in Coinbase Benchmark
Key Highlights: Coinbase’s historical replay evaluations showed consistent performance regressions in newer LLM versions—including comparisons across Opus, Sonnet, and GPT releases—which recorded lower fraud recall and dollar-weighted recall. A post-trained, specialized Qwen3.5-9B model outperformed Opus 4.5 across four key fraud metrics, boosting dollar-weighted recall by 35.4 points while slashing median latency by 55%. Coinbase advises ...