Matthew Gammett's picture

Matthew Gammett

Permahuman

·

http://humansustainabilityproject.wordpress.com

Forest-person

AI & ML interests

Gardening, small scale hand powered subsistence farming, education, seed saving, mental health, community outreach.

Organizations

None yet

New activity in LGAI-EXAONE/EXAONE-4.0-32B-GGUF 9 months ago

Not loading the gguf

#2 opened 9 months ago by

New activity in bartowski/Qwen_Qwen3-30B-A3B-GGUF 12 months ago

What are folks opinion on 4KM quants? Are they viable?

#3 opened 12 months ago by

New activity in FunAGI/Qwen2.5-Omni-7B-GPTQ-4bit about 1 year ago

test the inference script and quantized model, but have error as below

#1 opened about 1 year ago by

New activity in Qwen/Qwen2.5-Omni-7B about 1 year ago

Can this be quantized with bitsAndBytes?

#6 opened about 1 year ago by

New activity in bartowski/mistralai_Mistral-Small-3.1-24B-Instruct-2503-GGUF about 1 year ago

Does this include the vision capabilities?

#1 opened about 1 year ago by

New activity in Tyrannosaurus/TinyGPT-V over 2 years ago

Quants?

#1 opened over 2 years ago by