AI term

Token

A plain-English definition of Token— what it means, how it works, and a simple example.

Quick answer

A token is a small chunk of text — a word or part of a word — that an AI language model reads and generates. Models measure their work in tokens.

Language models do not process text letter by letter or as whole sentences; they break it into tokens. A token is roughly four characters of English, so a common word may be one token while a longer word splits into several.

Tokens matter for two practical reasons. First, a model can only handle so many tokens at once — its context window — which limits how much text it can consider. Second, paid AI services usually charge per token, for both your input and the model's output.

For example, the phrase AI is useful is about four tokens, and a 500-word document is roughly 650 to 700 tokens. Understanding tokens helps explain why very long documents can hit limits or cost more to process.

Related terms

Browse the full glossary

44finance & AI terms explained in plain English.

All terms
A note on accuracy:this definition is for general education, not personalised financial or tax advice. Figures are illustrative and rules can change — confirm anything that affects a real decision.