flexitok
/

mod-tokenizers-individual

Model card Files Files and versions

mod-tokenizers-individual

6.85 MB

1 contributor

History: 25 commits

gsaltintas's picture

Upload folder using huggingface_hub

a7672fa verified 11 days ago

mod_tokenizers
Upload mod_tokenizers/flexitok--mod-tokenizers-individual_overlap.json with huggingface_hub 13 days ago
.gitattributes

1.52 kB

initial commit 16 days ago
README.md

1.11 kB

Upload folder using huggingface_hub 11 days ago
config.json

600 Bytes

Upload config 11 days ago
flexitok--mod-tokenizers-individual.yaml

86 Bytes

Upload tokenizer file flexitok--mod-tokenizers-individual.yaml - Upload model files 11 days ago
flexitok--mod-tokenizers-individual_overlap.json

145 Bytes

Upload tokenizer file flexitok--mod-tokenizers-individual_overlap.json - Upload model files 11 days ago
flexitok--mod-tokenizers-individual_super_mapping.json

206 Bytes

Upload tokenizer file flexitok--mod-tokenizers-individual_super_mapping.json - Upload model files 11 days ago
generation_config.json

150 Bytes

Upload model files 11 days ago
merges.txt

14 Bytes

Upload folder using huggingface_hub 16 days ago
model.safetensors

6.84 MB
xet

Upload model files 11 days ago
participating_tokenizers.json

342 Bytes

Upload tokenizer file participating_tokenizers.json - Upload model files 11 days ago
special_tokens_map.json

162 Bytes

Upload folder using huggingface_hub 16 days ago
tokenizer.json

2.39 kB

Upload folder using huggingface_hub 11 days ago
tokenizer_config.json

1.56 kB

Upload folder using huggingface_hub 11 days ago
vocab.json

194 Bytes

Upload folder using huggingface_hub 11 days ago