Which statement about tokens is accurate?
Which statement about tokens is accurate?
You are budgeting an AI feature and want to reason correctly about limits and costs.
Which statement is the most accurate?
Hint
The honest answer contains the word “depends”.
Why this is the answer
Tokens are slices, not words: the count depends on the model's tokenizer, the language and the content. Practical consequences: estimate with the ¾-word rule, expect code and emojis to cost more, and remember that both input and output count.