New k-quants formats
#6
by mudler - opened
Just for anyone, new k-quants model are compatible with LocalAI v1.18.0: https://github.com/go-skynet/LocalAI ( https://localai.io/basics/news/index.html#-06-06-2023-__v1180__- )
mudler changed discussion title from New k-quants to New k-quants formats
Too bad there's no release for Windows.