Enter the word for search

tokenising

Translations

tokeniseverb

tokenising

Gerund

Chiefly British spelling of 'tokenize'.
tokeniserInformatique, linguistique : découper un texte ou des données en unités distinctes appelées jetons.
The software tokenises the sentence before parsing it.
Le logiciel tokenise la phrase avant de l'analyser.
Additional translations
tokeniserFinance, blockchain : convertir un actif en jetons numériques ou en parts représentées sous forme de jetons.

Definitions

tokeniseverb
To divide text or data into discrete tokens for processing, especially in linguistics or computing.
The software tokenises the sentence before parsing it.
To convert or represent something in the form of tokens or small units.
The platform tokenises real-world assets for trading.
OverviewPhrasesExamplesAI ExpertDictionaries
Active Dictionary Company Limited 7/F, MW Tower, 111 Bonham Strand, Sheung Wan, Hong Kong