Scaled-Dot Product Attention
a method of computing a token representation that includes the context of surrounding tokens.
a method of computing a token representation that includes the context of surrounding tokens.
an algorithm that matches 2-equally sizes groups based on preferences.
An activation function for modelling data with periodicity (repeating patterns)