All Notes

System 2 thinking is characterised by slow, deliberate, and logical reasoning, requiring conscious effort and attention to solve complex problems. Unlike the intuitive nature of …

a paper that shows a model needs to see a concept exponentially more times to achieve linear improvements

an approach to utilising LLMs that involve multi-state interactions.

A data visualization that uses squares along a 2D grid for representing proportion.

The specific self-attention formulation from the Transformer paper, distinguished by scaling scores by the square root of the attention dimension.

a sequential data structure where we can add an element to the tail, or remove an element from the head.

a data structure where only the top element is accessible

an algorithm that matches 2-equally sizes groups based on preferences.

a popular divide-and-conquer sorting algorithm

VALL-E can generate speech in anyone's voice with only a 3-second sample of the speaker and some text