Neural Codec Language Models are Zero-Shot Text-to-Speech Synthesizers
VALL-E can generate speech in anyone's voice with only a 3-second sample of the speaker and some text
AudioEngineering
-
-
Residual Vector Quantisation
A tokeniser for audio
-
Snake Activation Function
An activation function for modelling data with periodicity (repeating patterns)
-
Large-scale Contrastive Language-Audio Pre-training with Feature Fusion and Keyword-to-Caption Augmentation
Notes from paper Large-scale Contrastive Language-Audio Pre-training with Feature Fusion and Keyword-to-Caption Augmentation by Yusong Wu, Ke Chen, Tianyu Zhang, Yuchen Hui, Taylor Berg-Kirkpatrick, Shlomo Dubnov
-
Mel Spectrogram
A sound wave visualisation of frequency over time
-
Sample Rate
A measure of how accurately the source signal was digitally represented
-
Sound Wave
Wave of pressure which our ears can perceive