Home About

Tags

MachineLearning (26) LinearAlgebra (16) GameDesign (12) ComputerScience (11) SoftwareEngineering (11) LargeLanguageModels (9) AudioEngineering (7) DiscreteMath (6) AutomatedTesting (6) Roblox (5) Zettelkasten (5) AgenticReasoning (4) More

Notes by Lex Toumbourou

Language Model

Feb 03, 2024 permanent

A language model predicts the next word given a sequence of text - or any discrete sequence of information.

Nowadays mostly discussed in the context of Large Language Models.