Scaled-Dot Product Attention
a method of computing a token representation that includes the context of surrounding tokens.
This is the rendered collections of notes by me, Lex Toumbourou.
You can find the source on the GitHub project.
The notes are collecting using my interpretation of the Zettelkasten method.
More
You can find the source on the GitHub project.
The notes are collecting using my interpretation of the Zettelkasten method.
More
-
-
-
-
Gale-Shapley Algorithm
an algorithm that matches 2-equally sizes groups based on preferences.
-
Neural Codec Language Models are Zero-Shot Text-to-Speech Synthesizers
VALL-E can generate speech in anyone's voice with only a 3-second sample of the speaker and some text
-
-
-
-
-
Snake Activation Function
An activation function for modelling data with periodicity (repeating patterns)
