Mixture-of-Recursions: Learning Dynamic Recursive Depths for Adaptive Token-Level Computation
Optimising computation at the token-level
Articles tagged with LargeLanguageModels
-
-
-
-
Absolute Zero: Reinforced Self-play Reasoning with Zero Data
learn to reason without any human-annotated data.
-
-
Few-Shot Knowledge-Distillation
Routes LLM tasks to cheaper or more powerful models based on task novelty.
-
Large Language Models are Zero-Shot Reasoners (May 2022)
improve zero-shot prompt performance of LLMs by adding “Let’s think step by step” before each answer
-
Evaluation of OpenAI o1: Opportunities and Challenges of AGI
a comprehensive evaluation of o1-preview across many tasks and domains.
-
-
Scaled-Dot Product Attention
a method of computing a token representation that includes the context of surrounding tokens.
