Token
A unit of text that a model reads and writes in, a whole word or a piece of one, on average about three-quarters of an English word.
Often confused with
- Embedding A numerical representation of the meaning of text, words or phrases (or an image), so that items with similar meaning sit close together and can be found by meaning, not keyword.
Related
- Context Everything the model can see when it answers: your instruction, the conversation so far, and any documents or tool results added to the call.
- Context window The limit of how many tokens a model can hold in one call, counting both what you send and what it writes back.
- Tokenmaxxing The practice of measuring AI adoption by the number of tokens used, which pushes people to run up usage to look productive.
How it connects
- Inference measured in Token
- Token priced as Cost per token