Thinking LLMs: General Instruction Following with Thought Generation (Oct 2024)
a prompting and fine-tuning method that enables LLMs to engage in a "thinking" process before generating responses
This is the rendered collections of notes by me, Lex Toumbourou.
You can find the source on the GitHub project.
The notes are collecting using my interpretation of the Zettelkasten method.
More
You can find the source on the GitHub project.
The notes are collecting using my interpretation of the Zettelkasten method.
More
-
-
-
Evaluation of OpenAI o1: Opportunities and Challenges of AGI
a comprehensive evaluation of o1-preview across many tasks and domains.
-
AI Meets the Classroom: When Does ChatGPT Harm Learning?
LLMs can help and also hinder learning outcomes
-
No 'Zero-Shot' Without Exponential Data: Pretraining Concept Frequency Determines Multimodal Model Performance
a paper that shows a model needs to see a concept exponentially more times to achieve linear improvements
-
-
Waffle Chart
A data visualization that uses squares along a 2D grid for representing proportion.
-
Scaled-Dot Product Attention
a method of computing a token representation that includes the context of surrounding tokens.
-
-
