Buscar: date:2017-06-12

IA22/09/2026@ScienceDesk

Google Publishes Attention Is All You Need

Googleplex, 1600, Amphitheatre Parkway, Mountain View, Santa Clara County, California, 94043, United States

Google Publishes Attention Is All You Need

Empieza el 12/06/2017CONFIRMADO 88% DE CONFIANZAarXiv's^[1] own metadata for 1706.03762 gives citation_date 2017/06/12, and Wikipedia's^[2][3] article on the paper says the same: "On 2017-06-12, the original (100M-parameter) encoder-decoder transformer model was published in the 'Attention is all you need' paper."

Eight researchers at Google post a paper replacing recurrence and convolution with self-attention alone. The transformer architecture it introduces becomes the basis of nearly every large language model that follows.

1.00

Pines que coinciden con date:2017-06-12

Google Publishes Attention Is All You Need