Self-Instruct: Aligning Language Models with Self-Generated Instructions

Introduces Self-Instruct, a framework for improving the instruction-following capabilities of pretrained language models by bootstrapping off their own generations.

Pipeline generates instructions, input, and output samples from a language model, then filters invalid or similar ones before using them to finetune the original model.