AWQ version of https://huggingface.co/corag/CoRAG-Llama3.1-8B-MultihopQA

All credits go to the team at Microsoft that built this model

Notebook to convert to AWQ: https://www.kaggle.com/code/yxzh00/llm-awq-conversion

Downloads last month
1
Safetensors
Model size
8B params
Tensor type
I32
·
BF16
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support