You could have invented transformers from memory

Alex Wang, a researcher, claims that the idea of transformers, a key component in many AI models, could have been invented by simply understanding how the human brain's memory works. Wang argues that the brain's ability to associate and retrieve memories from related concepts is similar to the transformer's self-attention mechanism. He suggests that understanding this process in the human brain could have led to the development of transformers, a more efficient and effective AI model.