Google Publishes Attention Is All You Need
Googleplex, 1600, Amphitheatre Parkway, Mountain View, Santa Clara County, California, 94043, United States
Google…
CONFIRMED88% CONFIDENCEarXiv's[1] own metadata for 1706.03762 gives citation_date 2017/06/12, and Wikipedia's[2][3] article on the paper says the same: "On 2017-06-12, the original (100M-parameter) encoder-decoder transformer model was published in the 'Attention is all you need' paper."
Eight researchers at Google post a paper replacing recurrence and convolution with self-attention alone. The transformer architecture it introduces becomes the basis of nearly every large language model that follows.
1.00