Facing issues with awq inference engine while Finetuning idefics2-8b-AWQ
#3
by Bharanidharan07 - opened
Hi Folks,
I tried to Finetune idefics2-8b-AWQ model but unfortunately i encountered
this error "ImportError: /usr/local/lib/python3.10/dist-packages/awq_inference_engine.cpython-310-x86_64-linux-gnu.so: undefined symbol: _ZN3c104cuda9SetDeviceEi" so i tried installing awq inference engine but pypi doesnt have awq inference engine package so i tried downloading from a third party and done a setup but still i landed on that same error, can someone help me with this?
Bharanidharan07 changed discussion title from Facing issues with awq inference engine to Facing issues with awq inference engine while Finetuning idefics2-8b-AWQ