TurkuNLP
/

finerweb-quality-classifier

Model card Files Files and versions

finerweb-quality-classifier

749 MB

1 contributor

History: 14 commits

erikhenriksson's picture

Update README.md

93d1635 verified about 1 year ago

.gitattributes

1.52 kB

initial commit about 1 year ago
README.md

2.63 kB

Update README.md about 1 year ago
added_tokens.json

23 Bytes

Upload added_tokens.json with huggingface_hub about 1 year ago
config.json

1.26 kB

Upload config.json with huggingface_hub about 1 year ago
model.safetensors

738 MB
xet

Upload model.safetensors with huggingface_hub about 1 year ago
platt_scaler.joblib

879 Bytes
xet

Upload platt_scaler.joblib about 1 year ago
special_tokens_map.json

286 Bytes

Upload special_tokens_map.json with huggingface_hub about 1 year ago
spm.model

2.46 MB
xet

Upload spm.model with huggingface_hub about 1 year ago
tokenizer.json

8.66 MB

Upload tokenizer.json with huggingface_hub about 1 year ago
tokenizer_config.json

1.29 kB

Upload tokenizer_config.json with huggingface_hub about 1 year ago
training_args.bin
Detected Pickle imports (9)
- "transformers.trainer_utils.IntervalStrategy",
- "transformers.trainer_utils.HubStrategy",
- "transformers.trainer_pt_utils.AcceleratorConfig",
- "accelerate.state.PartialState",
- "accelerate.utils.dataclasses.DistributedType",
- "transformers.training_args.TrainingArguments",
- "transformers.trainer_utils.SchedulerType",
- "transformers.training_args.OptimizerNames",
- "torch.device"
How to fix it?
5.18 kB
xet

Upload training_args.bin with huggingface_hub about 1 year ago