Searched refs:to_tokenize (Results 1 – 1 of 1) sorted by relevance
| /OK3568_Linux_fs/app/forlinx/flapp/src/keyboard/pinyin/share/ |
| H A D | dictbuilder.cpp | 402 char16 *to_tokenize = read_buf; in read_raw_dict() local
405 token = utf16_strtok(to_tokenize, &token_size, &to_tokenize); in read_raw_dict()
430 token = utf16_strtok(to_tokenize, &token_size, &to_tokenize); in read_raw_dict()
446 token = utf16_strtok(to_tokenize, &token_size, &to_tokenize); in read_raw_dict()
467 token = utf16_strtok(to_tokenize, &token_size, &to_tokenize); in read_raw_dict()
489 token = utf16_strtok(to_tokenize, &token_size, &to_tokenize); in read_raw_dict()
|