Scaled-Dot Product Attention
a method of computing a token representation that includes the context of surrounding tokens.
Articles tagged with MachineLearning
-
-
Neural Codec Language Models are Zero-Shot Text-to-Speech Synthesizers
VALL-E can generate speech in anyone's voice with only a 3-second sample of the speaker and some text
-
-
-
Snake Activation Function
An activation function for modelling data with periodicity (repeating patterns)
-
-
-
Large-scale Contrastive Language-Audio Pre-training with Feature Fusion and Keyword-to-Caption Augmentation
Notes from paper Large-scale Contrastive Language-Audio Pre-training with Feature Fusion and Keyword-to-Caption Augmentation by Yusong Wu, Ke Chen, Tianyu Zhang, Yuchen Hui, Taylor Berg-Kirkpatrick, Shlomo Dubnov
-
-
ArcFace: Additive Angular Margin Loss for Deep Face Recognition
Notes from paper ArcFace: Additive Angular Margin Loss for Deep Face Recognition by Jiankang Deng, Jia Guo, Niannan Xue, Stefanos Zafeiriou
