In-Context Learning
Learning a task from examples in the prompt, without weight updates.
In-context learning is a model’s ability to perform a new task purely from instructions or examples placed in its prompt, with no retraining. GPT-3 demonstrated it dramatically, and it is the basis of modern prompting.