HF Quantization

HF-Quantization's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Articles

medmekk 

updated a Space 10 months ago

Running

1

TorchAO

💻

1

Quantize and save Hugging Face models

medmekk 

updated a Space 11 months ago

Running on A10G

BitsAndBytes

💻

Quantize and upload models to Hugging Face

medmekk 

published a model about 1 year ago

HF-Quantization/Llama-3.3-70B-Instruct-TORCHAO-W8

Updated Jan 22, 2025

medmekk 

updated a model about 1 year ago

HF-Quantization/Llama-3.3-70B-Instruct-TORCHAO-W4

Updated Jan 22, 2025

medmekk 

published a model about 1 year ago

HF-Quantization/Llama-3.3-70B-Instruct-TORCHAO-W4

Updated Jan 22, 2025

medmekk 

updated a collection about 1 year ago

meta-llama/Llama-3.2-1B Quantized

Collection

Find the quantized versions of Llama-3.2-1B all in one place • 9 items • Updated Jan 21, 2025

medmekk 

updated 6 models about 1 year ago

HF-Quantization/Llama-3.2-1B-BNB-INT8

1B • Updated Jan 21, 2025

HF-Quantization/Llama-3.2-1B-BNB-NF4

1B • Updated Jan 21, 2025

HF-Quantization/Llama-3.2-1B-BNB-FP4

1B • Updated Jan 21, 2025 • 30

HF-Quantization/Llama-3.2-1B-BNB-NF4-BF16

1B • Updated Jan 21, 2025

HF-Quantization/Llama-3.2-1B-BNB-FP4-BF16

1B • Updated Jan 21, 2025 • 2

HF-Quantization/Llama-3.2-1B-TORCHAO-W8A8

Updated Jan 21, 2025