Home /permanent

Positional Encoding

Part of the Transformer architecture. Create an embedding to represent sequence position concatenated to the token embedding.