Bahdanau Attention: Let the Decoder Look Back at Every Encoder State
Bahdanau, Cho, and Bengio replaced the single seq2seq vector with a learned weighted sum of encoder states. Alignments you can plot, and the additive scoring function later papers simplified.
2 min read