Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
yakul259
/
english-bpe-tokenizer-60k
like
0
wikitext
English
tokenizers
tokenizer
bpe
NLP
wikitext
License:
mit
Model card
Files
Files and versions
xet
Community
main
english-bpe-tokenizer-60k
4.34 MB
1 contributor
History:
3 commits
yakul259
Update README.md
e511ac2
verified
5 months ago
.gitattributes
1.52 kB
initial commit
5 months ago
README.md
2.68 kB
Update README.md
5 months ago
special_tokens_map.json
131 Bytes
Upload tokenizer
5 months ago
tokenizer.json
4.33 MB
Upload tokenizer
5 months ago
tokenizer_config.json
512 Bytes
Upload tokenizer
5 months ago
