Can AI Improve Itself? The Runaway Feedback Loop Question
Ryan Greenblatt's case is conditional: AI systems that match leading researchers on verifiable AI R&D tasks could help build stronger successors. The disputed point is whether such gains transfer from bounded training environments to the load-bearing parts of real research—and how reward hacking must be governed along the way.