Token

A token is a chunk of text — roughly a word piece — that a model processes as one unit. English averages about three-quarters of a word per token, but the exact count depends on the model, the language and the content: code, tables and emojis often cost more. Context limits and pricing are counted in tokens.

← All terms