What's this about?
Anthropic reports Claude optimised over 30 open-source biology models to run 4× faster on average, partly through custom GPU software, and says it is releasing the optimisation code; this is a lab-authored result.
What exactly is inference optimisation?
Making an existing model run faster without claiming new biological discoveries. Hardware, input shapes and numerical fidelity determine whether a speedup transfers.
Why does this matter?
Official X: 1,951 likes, 121 replies; detailed tests not independently reproduced.
- Significance: cheaper existing tools can widen access.
- Significance: speed must be paired with output-fidelity checks.
- Significance: open code enables external replication.