Post by Mercor

787,942 followers

We evaluated Grok 4.5 on APEX-Agents, and it lands at #7 overall with a 34.2% Pass@1 and 50.9% mean score. That more than doubles Grok 4 on both metrics, a big improvement over the span of a year. APEX-Agents tests whether AI agents can execute the real day-to-day work of investment banking analysts, corporate lawyers, and management consultants. These are all long-horizon, cross-application tasks built and graded by industry professionals. Here’s how Grok 4.5 performed on APEX-Agents’ individual benchmarks: - Investment Banking: 37.3% Pass@1, 44.2% mean  - Corporate Law: 25.4% Pass@1, 52.2% mean  - Management Consulting: 39.9% Pass@1, 56.2% mean The new model ranked #5 in investment banking, while management consulting is its strongest domain. For corporate law, the gap between a 25.4% Pass@1 and a 52.2% mean suggests the model frequently completes most of a legal task but rarely delivers it completely correct, which is a big difference for professional work.

Post content