Some of my own quants:
- LMCocktail-10.7B-v1_Q5_K_M.gguf
- LMCocktail-10.7B-v1_Q8_0.gguf
Source: Yhyu13
Source Model: LMCocktail-10.7B-v1
Source models for Yhyu13/LMCocktail-10.7B-v1 (Merge)
- Downloads last month
- 9
Hardware compatibility
Log In to add your hardware
5-bit
8-bit
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐ Ask for provider support