tokenization
English
editEtymology
editNoun
edittokenization (countable and uncountable, plural tokenizations)
- The act or process of tokenizing.
- Something tokenized.
- This was an unlikely tokenization of the input string.
tokenization (countable and uncountable, plural tokenizations)