← Back to digest
arxiv: AI Agents

FrontierFinance: a benchmark for finance agents

What's this about?

AI agents are increasingly deployed for professional investment research, but existing benchmarks mostly test financial data extraction — pulling a number out of a filing. FrontierFinance aims to cover the full investor workflow instead, from gathering evidence through to forming a view.

What exactly is the "full investor workflow"?

Extracting a revenue figure from a 10-K is a lookup. Investment research is a chain: decide what question matters, find the relevant filings and transcripts across sources, reconcile numbers that disagree, build a model, weigh contradictory evidence, and commit to a judgment you can defend. Each step compounds errors from the previous one. Benchmarking only the lookup step is like testing a doctor exclusively on reading thermometers.

Why is this worth noticing?

  1. Finance is one of the largest real deployments of agents outside software, and the gap between benchmark performance and workflow performance is where deployments quietly fail.
  2. Long-horizon, multi-step evaluation is the frontier for agent benchmarks generally — this is that trend arriving in a high-stakes domain.
← A contamination-free reverse engineering benchmarkLong-horizon AI research on the Grothendieck constant →