English

edit

Etymology

edit

re- +‎ tokenize

Pronunciation

edit

Verb

edit

retokenize (third-person singular simple present retokenizes, present participle retokenizing, simple past and past participle retokenized)

  1. (transitive, computing) To tokenize again.