Learning to Reason without External Rewards
aka Self-Confidence is All You Need
All Notes
-
-
John Carmack is working on game-playing robots
on John Carmack's Upperbound 25 Talk Notes
-
Imagen 4 is faster, but GPT is still the GOAT
a few comparisons of Google's Imagen 4 vs OpenAI's gpt-image-1
-
Vibe-Coding Mathematical Discoveries
Using evolutionary algorithms with LLM-coding agents
-
NoProp: Training Neural Networks Without Back-Propagation or Forward-Propagation
an alternative training method to backprop that does local layer learning
-
Absolute Zero: Reinforced Self-play Reasoning with Zero Data
learn to reason without any human-annotated data.
-
Playing Atari with Deep Reinforcement Learning
a classic paper applying neural networks to RL for game playing
-
Q-Learning
a reinforcement learning algorithm for finding optimal policies
-
Markov Decision Process (MDP)
A mathematical framework for modelling decision-making under uncertainty
-
Merkle Tree
a data structure where each node contains the hash of its child nodes