English
Home
Work area
Library
Dictionary
Enter the word for search
tokenising
Overview
Phrases
Examples
AI Expert
Dictionaries
Translations
tokenise
verb
tokenising
Gerund
Chiefly British spelling of 'tokenize'.
токенизировать
Употребляется в лингвистике, компьютерной обработке текста и в финтехе/блокчейне.
The software tokenises the sentence before parsing it.
Программа токенизирует предложение перед его разбором.
Definitions
tokenise
verb
To divide text or data into discrete tokens for processing, especially in linguistics or computing.
The software tokenises the sentence before parsing it.
To convert or represent something in the form of tokens or small units.
The platform tokenises real-world assets for trading.
Overview
Phrases
Examples
AI Expert
Dictionaries