If you wanted to reverse-engineer human thought, where might you begin?
When reading the book “On Intelligence” recently I was reminded of the long history of neuroscience and the many previous dead-ends of AI research. Neuroscientists often focused on gathering huge amounts of largely one-sided or otherwise poor-quality data, even when those same scientists had no way of integrating that data to form a new understanding. This points to a cognitive bias known as “Information Bias”, defined as “The tendency to seek information even when it cannot affect action.“, as well as the Bike-Shedding Effect.