Fill-Mask
Transformers
Safetensors
Khmer
mt5
text2text-generation
trimmed
mt5-base-khm-16384 / tokenizer_config.json
lbourdois's picture
Trimmed google/mt5-base for Khmer (16384 tokens)
2d93f96 verified
Raw History Blame Contribute Delete
96 Bytes
{
"eos_token": "</s>",
"unk_token": "<unk>",
"pad_token": "<pad>",
"extra_ids": 0
}