Enter the word for search

tokenizing

/ˈtəʊkənaɪzɪŋ/

/ˈtoʊkənaɪzɪŋ/

Translations

tokenizeverb

tokenizing

Gerund

tokenized

Past Simple

tokenized

Past Participle

tokenizing

Gerund

/ˈtəʊkənaɪz/

/ˈtoʊkənaɪz/

tokeniserInformatique, traitement automatique du langage.

The software was designed to tokenize the input text before analyzing its syntax.

Le logiciel a été conçu pour tokeniser le texte saisi avant d’analyser sa syntaxe.

tokeniserPaiement, sécurité des données.

The gateway tokenizes credit card details before forwarding the transaction to the merchant.

La passerelle tokenise les données de carte bancaire avant de transmettre la transaction au commerçant.

Synonyms

break down

Antonyms

tokenizegerund / present participle

tokenizing

Used attributively: "tokenizing filter", "tokenizing step".

tokenisantAdjectif au sens de « qui procède à la tokenisation ».

The tokenizing module runs first in the text-processing pipeline.

Le module tokenisant s’exécute en premier dans la chaîne de traitement du texte.

Synonyms

Antonyms

Definitions

tokenizeverb

To break down text into smaller components, typically words or phrases, for processing in computational linguistics or natural language processing.

The software was designed to tokenize the input text before analyzing its syntax.

To substitute sensitive data, such as payment card numbers, with non-sensitive surrogate tokens for secure storage or transmission.

The gateway tokenizes credit card details before forwarding the transaction to the merchant.

tokenizegerund / present participle

Carrying out tokenization; converting data into tokens.

The tokenizing module runs first in the text-processing pipeline.