Unable to load the model in LM Studio

#2
by euzen - opened

In LM Studio 0.49, the model “Gemma-4-E4B-Uncensored-HauhauCS-Aggressive-Q4_K_M.gguf” cannot be loaded, and the following error is displayed:
llama_model_load: error loading model: error loading model architecture: unknown model architecture: 'gemma4'
llama_model_load_from_file_impl: failed to load model

please try update runtime to v2.10.0

runtime

please try update runtime to v2.10.0

runtime

Successfully resolved

Hello, does this model support image and video inference?

Hello, does this model support image and video inference?

Depends on your understanding of "image and video inference"

Image Understanding – Object detection, Document/PDF parsing, screen and UI understanding, chart comprehension, OCR (including multilingual), handwriting recognition, and pointing. Images can be processed at variable aspect ratios and resolutions.

Video Understanding – Analyze video by processing sequences of frames.

All models support image inputs and can process videos as frames whereas the E2B and E4B models also support audio inputs. Audio supports a maximum length of 30 seconds. Video supports a maximum of 60 seconds assuming the images are processed at one frame per second.

Read more here: https://huggingface.co/google/gemma-4-E4B-it

When I upload files in the mp4 format into Ollma and LM Studio, I will receive a prompt saying that this format of file is not supported!

When I upload files in the mp4 format into Ollma and LM Studio, I will receive a prompt saying that this format of file is not supported!

Doubt that LM Studio works with mp4, the video and audio needs to be tokenized first. It's not plug and play, you need to code the functionality first. Read the docs:

https://ai.google.dev/gemma/docs/capabilities/audio?hl=zh-cn
https://ai.google.dev/gemma/docs/capabilities/vision?hl=en

Sign up or log in to comment