Scaled-Dot Product Attention
![](/_media/scaled-dot-product-attention.png)
a method of computing a token representation that includes the context of surrounding tokens.
a method of computing a token representation that includes the context of surrounding tokens.
an algorithm that matches 2-equally sizes groups based on preferences.
An activation function for modelling data with periodicity (repeating patterns)