runtime error

Exit code: 1. Reason: Downloading (incomplete total...): 0%| | 0.00/6.81G [00:01<?, ?B/s] Downloading (incomplete total...): 0%| | 0.00/6.81G [00:02<?, ?B/s] Downloading (incomplete total...): 0%| | 0.00/6.81G [00:03<?, ?B/s] Downloading (incomplete total...): 2%|▏ | 134M/6.81G [00:04<00:54, 122MB/s] Downloading (incomplete total...): 5%|▍ | 335M/6.81G [00:06<01:12, 89.6MB/s] Download complete: 100%|██████████| 2.43G/2.43G [00:20<00:00, 402MB/s] Downloading (incomplete total...): 19%|█▊ | 1.27G/6.81G [00:10<00:29, 190MB/s] Downloading (incomplete total...): 68%|██████▊ | 4.63G/6.81G [00:11<00:02, 774MB/s] Fetching 2 files: 50%|█████ | 1/2 [00:12<00:12, 12.23s/it] Fetching 2 files: 100%|██████████| 2/2 [00:12<00:00, 6.12s/it] Download complete: 100%|██████████| 6.81G/6.81G [00:12<00:00, 774MB/s] Traceback (most recent call last): File "/app/app.py", line 19, in <module> base = AutoModelForCausalLM.from_pretrained( BASE_MODEL, ...<4 lines>... offload_state_dict=True, ) File "/usr/local/lib/python3.13/site-packages/transformers/models/auto/auto_factory.py", line 394, in from_pretrained return model_class.from_pretrained( ~~~~~~~~~~~~~~~~~~~~~~~~~~~^ pretrained_model_name_or_path, *model_args, config=config, **hub_kwargs, **kwargs ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ) ^ File "/usr/local/lib/python3.13/site-packages/transformers/modeling_utils.py", line 4201, in from_pretrained model = cls(config, *model_args, **model_kwargs) TypeError: GraniteMoeHybridForCausalLM.__init__() got an unexpected keyword argument 'load_in_4bit' Download complete: 100%|██████████| 2.43G/2.43G [00:22<00:00, 109MB/s] Download complete: 100%|██████████| 6.81G/6.81G [00:12<00:00, 548MB/s]

Container logs: