Scaled-Dot Product Attention
a method of computing a token representation that includes the context of surrounding tokens.
a method of computing a token representation that includes the context of surrounding tokens.
VALL-E can generate speech in anyone's voice with only a 3-second sample of the speaker and some text
An activation function for modelling data with periodicity (repeating patterns)
Notes from paper Large-scale Contrastive Language-Audio Pre-training with Feature Fusion and Keyword-to-Caption Augmentation by Yusong Wu, Ke Chen, Tianyu Zhang, Yuchen Hui, Taylor Berg-Kirkpatrick, Shlomo Dubnov
Notes from paper ArcFace: Additive Angular Margin Loss for Deep Face Recognition by Jiankang Deng, Jia Guo, Niannan Xue, Stefanos Zafeiriou