Consequence sources: Wherever service provider quantities usually are not readily available we report figures from leaderboards reporting effects on these benchmarks: Humanity's Past Exam final results are sourced from and , LiveCodeBench success are from (1/1/2025 - 5/1/2025 in the UI), Aider Polyglot figures come from . Information come from . Fo