ImportError
#27
by kris-123 - opened
Following is the error trying to run zephyr-7b-alpha using HuggingFaceLLM method in llama_index.llms locally:
ImportError: Using load_in_8bit=True requires Accelerate: pip install accelerate and the latest version of bitsandbytes pip install -i https://test.pypi.org/simple/ bitsandbytes or pip install bitsandbytes
Libraries installed already:
transformers
accelerate
bistandbytes
kris-123 changed discussion status to closed