Accedi
Inserisci la parola da cercare

tokenizing

UK
/ˈtəʊkənaɪzɪŋ/
US
/ˈtoʊkənaɪzɪŋ/

Traduzioni

tokenizeverb

tokenizing

Gerund

tokenized
Past Simple
tokenized
Past Participle
tokenizing
Gerund
UK
/ˈtəʊkənaɪz/
US
/ˈtoʊkənaɪz/
токенизироватьКомпьютерный и финтех-термин; используется как для разбиения текста на токены, так и для замены чувствительных данных суррогатными токенами.
The software can tokenize the text for further analysis.
Программа может токенизировать текст для дальнейшего анализа.
Sinonimi
divide
split
break down
parse
segment
Contrari
detokenize
detokenise
untokenize
untokenise
tokenizegerund / present participle

tokenizing

Used attributively: "tokenizing filter", "tokenizing step".
токенизирующийТехнический термин; употребляется атрибутивно.
The tokenizing module runs first in the text-processing pipeline.
Токенизирующий модуль запускается первым в конвейере обработки текста.
Sinonimi
annotating
lexing
lexicalizing
partitioning
splitting
segmenting
digitizing
encoding
representing
symbolizing
tokenising
tokenizing
Contrari
detokenising
detokenizing

Definizioni

tokenizeverb
To break down text into smaller components, typically words or phrases, for processing in computational linguistics or natural language processing.
The software was designed to tokenize the input text before analyzing its syntax.
To substitute sensitive data, such as payment card numbers, with non-sensitive surrogate tokens for secure storage or transmission.
The gateway tokenizes credit card details before forwarding the transaction to the merchant.
tokenizegerund / present participle
Carrying out tokenization; converting data into tokens.
The tokenizing module runs first in the text-processing pipeline.
PanoramicaEspressioniEsempiEsperto IADizionari