Ksgk-fy
/

Llama-3-8B-Instruct-262k-4bit-GPTQ

YAML Metadata Warning:empty or missing yaml metadata in repo card

Check out the documentation for more information.

Model Details

Llama3-8B-Instruct with long context, quantized to be compatible with vLLM inference

Safetensors

Model size

8B params

Tensor type

F16

I32