GGUF Quantized: leesplank-municipal
This repository contains GGUF format model files for uaebn/leesplank-municipal.
Due to a tokenizer compatibility issue between this model family and llama.cpp's GGUF format, some complex Dutch compound words may be truncated during generation. If you'd like to use this model, use the safetensors model.
Files Available
| Filename | Quant Type | Size | Description |
|---|---|---|---|
| leesplank-municipal.Q4_K_M.gguf | Q4_K_M | 1.05 GB | Recommended. Balanced quality and speed. Best for most standard laptops (8GB+ RAM). |
| leesplank-municipal.Q5_K_M.gguf | Q5_K_M | 1.20 GB | High Quality. Slight accuracy increase over Q4, but uses more RAM. |
| leesplank-municipal.f16.gguf | F16 | 3.32 GB | Uncompressed. Maximum precision. |
- Downloads last month
- 124
Hardware compatibility
Log In to add your hardware
5-bit
8-bit
16-bit
Model tree for uaebn/leesplank-municipal-GGUF
Base model
utter-project/EuroLLM-1.7B Finetuned
UWV/leesplank-noot-eurollm-1.7b Finetuned
uaebn/leesplank-municipal