tokenized中文什么意思

例句与用法

更多例句：  下一页
1. The string to be tokenized is specified through the
   属性指定要标记化的字符串，而通过
2. Company would be tokenized as
   Company将标记为
3. Should be specified as the string of hexadecimal digits representing the tokenized form of the public key
   应指定为十六进制数字的字符串以表示标记形式的公钥。
4. In some specific cases , changes made to the word breakers have the potential to impact how some data is tokenized
   在某些特定情况下，对断字符所做的更改可能会影响对某些数据进行标记化的方式。
5. In a tokenized type , the parser will normalize all white space to a single space character and will eliminate leading and trailing white space altogether
   在标记化类型中，分析器将使所有空白标准化为单个空格字符，并将前导和尾随空白一同删除。