Turkish-LLM-14B-Instruct

A Turkish-enhanced 14B model fine-tuned from Qwen2.5-14B-Instruct with QLoRA on 242K Turkish instruction examples.

Part of the Turkish LLM Family.

Highlights

Benchmark Results

Benchmark Base (Qwen2.5-14B) Ours Delta
MMLU-TR 0.5947 0.5977 +0.30

Quick Start

With Ollama

ollama run hf.co/ogulcanaydogan/Turkish-LLM-14B-Instruct-GGUF:Q4_K_M

With Transformers

from transformers import AutoModelForCausalLM, AutoTokenizer

model = AutoModelForCausalLM.from_pretrained("ogulcanaydogan/Turkish-LLM-14B-Instruct", torch_dtype="auto", device_map="auto")
tokenizer = AutoTokenizer.from_pretrained("ogulcanaydogan/Turkish-LLM-14B-Instruct")

messages = [
    {"role": "system", "content": "Sen yardimci bir Turkce asistansin."},
    {"role": "user", "content": "Yapay zekanin egitim sektorundeki etkilerini acikla."}
]
text = tokenizer.apply_chat_template(messages, tokenize=False, add_generation_prompt=True)
inputs = tokenizer([text], return_tensors="pt").to(model.device)
outputs = model.generate(**inputs, max_new_tokens=512)
print(tokenizer.decode(outputs[0], skip_special_tokens=True))

Training Details

Parameter Value
Base Model Qwen/Qwen2.5-14B-Instruct
Method QLoRA (4-bit NF4)
LoRA rank / alpha 32 / 64
Learning rate 1e-5
Dataset 242K Turkish instruction examples

Turkish LLM Family

Model Size MMLU-TR GGUF
Turkish-LLM-7B 7B - Download
Turkish-LLM-14B 14B 0.5977 Download
Turkish-LLM-32B 32B 0.6564 Download

Citation

@misc{aydogan2026turkishllm,
  title={Turkish LLM Family: Open-Source Turkish Language Models},
  author={Ogulcan Aydogan},
  year={2026},
  url={https://huggingface.co/collections/ogulcanaydogan/turkish-llm-family-69b303b4ef1c36caffca4e94}
}
Downloads last month
149
Safetensors
Model size
15B params
Tensor type
BF16
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for ogulcanaydogan/Turkish-LLM-14B-Instruct

Base model

Qwen/Qwen2.5-14B
Finetuned
(379)
this model
Quantizations
3 models

Dataset used to train ogulcanaydogan/Turkish-LLM-14B-Instruct

Space using ogulcanaydogan/Turkish-LLM-14B-Instruct 1

Collection including ogulcanaydogan/Turkish-LLM-14B-Instruct

Evaluation results