The enterprise risk nobody is modeling: AI is replacing the very experts it needs to learn from

For AI systems to keep improving in knowledge work, they need either a reliable mechanism for autonomous self-improvement or human evaluators capable of catching errors and generating high-quality feedback. The industry has invested enormously in the first. It’s giving almost no thought to what’s happening to the second.I’d argue that we need to treat the human evaluation problem with just as much rigor and investment as we put into building the model capabilities themselves…
Read More