Tried to use with llama-cpp-python without success
#1
by rriscoc - opened
Hi, can you give me some advice on some code snippet to make it work with llama-cpp-python
Unfortunately I haven't used this package. I use llama.cpp together with llama-swap
change mmproj ，it will work ，https://huggingface.co/staghado/LightOnOCR-2-1B-Q8_0-GGUF/blob/main/mmproj-LightOnOCR-2-1B-Q8_0.gguf
change mmproj ，it will work ，https://huggingface.co/staghado/LightOnOCR-2-1B-Q8_0-GGUF/blob/main/mmproj-LightOnOCR-2-1B-Q8_0.gguf
This comment does not make any sense.
noctrex changed discussion status to closed