← Back to digest
Lab Updates

Anthropic measures AI-led R&D

What's this about?

Its August snapshot rates 26% of R&D work as AI-led and over 90% at least collaborative, with no measured category fully autonomous. Oversight coverage, review latency and compute allocation are proposed transparency metrics, not proof of safety.

What exactly is automation level?

A graded description of how much AI does versus humans. The index uses a fixed task basket and model-assisted ratings, which can miss new work or inherit judge-model errors.

Why does this matter?

Official X: 2,488 likes, 289 replies; reply themes not independently sampled.
  1. Significance: human-supervised leadership differs from full autonomy.
  2. Significance: monitor coverage says nothing alone about detection accuracy.
  3. Significance: shared methods and external verification would improve comparability.
← Claude Projects coordinates parallel cloud threadsLife Sciences Verification Program opens beta →