Glossary
A plain-English glossary of the methods and ideas behind modern AI. Search, sort, or jump to a letter.
6 terms
| Definition | ||
|---|---|---|
| Parameters | The learned weights of a neural network; the "parameter count" (e.g. 70B) is a rough proxy for a model’s size and capacity. | May 22, 2026 |
| Perceptron | The earliest trainable artificial neuron. | May 21, 2026 |
| Perplexity | A measure of how well a language model predicts a sample of text; lower is better. | May 22, 2026 |
| Positional Encoding | How Transformers represent the order of tokens. | May 21, 2026 |
| Pretraining | The large-scale self-supervised stage that builds a model’s base knowledge. | May 21, 2026 |
| Prompt Engineering | Crafting inputs to steer a model toward better outputs. | May 21, 2026 |