Models
Datasets
Spaces
Buckets new
Docs
Enterprise
Pricing
Log In
Sign Up

flexitok
/

supertokenizer-mod_tokenizers

Model card Files Files and versions

supertokenizer-mod_tokenizers

112 MB

1 contributor

History: 18 commits

gsaltintas's picture

Upload config

e5fbc07 verified 10 days ago

.gitattributes

1.52 kB

initial commit 13 days ago
README.md

918 Bytes

Update README.md 11 days ago
config.json

604 Bytes

Upload config 10 days ago
config.yaml

28 Bytes

Upload config.yaml with huggingface_hub 13 days ago
generation_config.json

150 Bytes

Upload model files 11 days ago
model.safetensors

109 MB
xet

Upload model files 11 days ago
super_vocab.json

1.58 MB

Upload super_vocab.json with huggingface_hub 13 days ago
tokenizer.json

1.58 MB

Upload tokenizer file super_vocab.json - Upload model files 11 days ago