retokenize

English

Etymology

re- +‎ tokenize

Pronunciation

• (General American) IPA^(key): /ɹiˈtoʊ.kən.aɪz/

Verb

retokenize (third-person singular simple present retokenizes, present participle retokenizing, simple past and past participle retokenized)

1. (transitive, computing) To tokenize again.