You can find the source on the GitHub project.
The notes are collecting using my interpretation of the Zettelkasten method.
More


Categorical CrossEntropy Loss
Categorical CrossEntropy Loss Function, also known as Softmax Loss, is a loss function used in multiclass classification model training. It applies the Softmax Activation Function …

CrossEntropy
Crossentropy measures the average number of bits required to identify an event if you had a coding scheme optimised for one probability distribution $q …$

Information Entropy
Entropy is a measure of uncertainty of a random variable's possible outcomes.
It's highest when there are many equally likely outcomes. As you introduce more …


Softmax Activation Function
The Softmax Activation Function converts a vector of numbers into a vector of probabilities that sum to 1. It's applied to a model's outputs (or …

Sigmoid Function
The Sigmoid function, also known as the Logistic Function, squeezes numbers into a probabilitylike range between 0 and 1.^{1} Used in Binary Classification model …


Rule Enforcer
To prevent cheating, a game needs a rule enforcer.
"if players feel like your game can be cheated, some will try to cheat, but most …

Server Authoritative Multiplayer
A typical multiplayer game architecture where the server has authority over the game state. The server keeps track of players' positions, the resources they own …