Researchers Gain New Understanding From Simple AI
Language processing programs are notoriously hard to interpret, but smaller versions can provide important insights into how they work. The post Researchers Gain New Understanding From Simple AI first appeared on Quanta Magazine
In the last two years, artificial intelligence programs have reached a surprising level of linguistic fluency. The biggest and best of these are all based on an architecture invented in 2017 called the transformer. It serves as a kind of blueprint for the programs to follow, in the form of a list of equations. But beyond this bare mathematical outline, we don’t really know what transformers are...
Originally published in Quanta Abstractions.
