Attention and Memory in Deep Learning and NLP

Data science, Learning

Attention and Memory in Deep Learning and NLP – Source www.WildML.com

A recent trend in Deep Learning are Attention Mechanisms. In an interview, Ilya Sutskever, now the research director of OpenAI, mentioned that Attention Mechanisms are one of the most exciting advancements, and that they are here to stay. That sounds exciting. But what are Attention Mechanisms? Attention Mechanisms in Neural Networks are (very) loosely based …

Leave a Reply