Published onJune 12, 2017Attention is All You NeedresearchgooglebrainPropose a new simple network architecture, the Transformer, based solely on attention mechanisms, dispensing with recurrence and convolutions entirely.