NotesByLex

Note

Everything filed as note. See also Essays and Notes.

  1. Attention Mechanism

    MachineLearning

    A technique for computing a weighted combination of a sequence of vectors, originally devised to overcome a bottleneck in seq-to-seq translation models.

  2. Changing Basis

    LinearAlgebra

    Since any vectors can be Basis Vectors, it's useful to understand how to translate vectors between bases