MachineLearning

An activation function that replaces negative values with zero

Notes from paper Large-scale Contrastive Language-Audio Pre-training with Feature Fusion and Keyword-to-Caption Augmentation by Yusong Wu, Ke Chen, Tianyu Zhang, Yuchen Hui, Taylor Berg-Kirkpatrick, Shlomo Dubnov

Cardinality refers to the number of elements a set contains.

A technique for computing a weighted combination of a sequence of vectors, originally devised to overcome a bottleneck in seq-to-seq translation models.

Notes from paper ArcFace: Additive Angular Margin Loss for Deep Face Recognition by Jiankang Deng, Jia Guo, Niannan Xue, Stefanos Zafeiriou

A learned vector representation that encodes meaning as a point in space, where similar things end up close together.

A loss function for binary and multi-label classification, also known as log loss.

Resize images to a larger intermediate size before augmenting.

A loss function for multiclass classification: softmax followed by negative log-likelihood.

a multi-class classification loss function