National research agencies4 min readSample
Compute access programmes widen independent evaluation capacity
Public compute allocations let academic groups run evaluations previously feasible only inside frontier laboratories.
lowAGI relevance: lowregulationhardware
Agitology analysis
Why it matters
Almost all capability evidence currently originates with the organisations that produced the capability. Independent evaluation capacity is what would change that, and it has been the binding constraint.
Key developments
- Allocations sized for evaluation rather than training
- Several groups report first independent replications
- Access remains small relative to frontier scale