NotesByLex

Note

Everything filed as note. See also Essays and Notes.

  1. Attention Mechanism

    MachineLearning

    A technique for computing a weighted combination of a sequence of vectors, originally devised to overcome a bottleneck in seq-to-seq translation models.