Pakon
/

thai_bert1

thai_bert1 / added_tokens.json

Upload tokenizer

e21b73e verified about 1 year ago

97 Bytes

{
  "<|endoftext|>": 50265,
  "<|pad|>": 50268,
  "<|startoftext|>": 50266,
  "<|unk|>": 50267
}