lm_head missing?
#2
by Alvant - opened
Hello
It seems that there is no lm_head.weight in saved model parameters. Is it OK?) 😅 What is the proper way to load the model? Is it necessary to get this lm_head from somewhere else or something?..
Sorry! my fault. I didn't notice that the architecture is MixtralModel and not MixtralModelForCausalLM. Everything is OK then)
Alvant changed discussion status to closed