How Transformers Seem to Mimic Parts of the Brain
Neural networks originally designed for language processing turn out to be great models of how our brains understand places. The post How Transformers Seem to Mimic Parts of the Brain first appeared on Quanta Magazine
Understanding how the brain organizes and accesses spatial information — where we are, what’s around the corner, how to get there — remains an exquisite challenge. The process involves recalling an entire network of memories and stored spatial data from tens of billions of neurons, each connected to thousands of others. Neuroscientists have identified key elements such as grid cells...
Originally published in Quanta Abstractions.
