Add SFT checkpoint
bd3397c verified bf16_zero_pp_rank_0_mp_rank_00_optim_states.pt Detected Pickle imports (7)
- "deepspeed.runtime.fp16.loss_scaler.LossScaler",
- "torch._utils._rebuild_tensor_v2",
- "deepspeed.runtime.zero.config.ZeroStageEnum",
- "torch.Tensor",
- "collections.OrderedDict",
- "torch._tensor._rebuild_from_type_v2",
- "torch.FloatStorage"
How to fix it?
24.6 GB Add SFT checkpoint bf16_zero_pp_rank_1_mp_rank_00_optim_states.pt Detected Pickle imports (7)
- "deepspeed.runtime.fp16.loss_scaler.LossScaler",
- "torch._utils._rebuild_tensor_v2",
- "deepspeed.runtime.zero.config.ZeroStageEnum",
- "torch.Tensor",
- "collections.OrderedDict",
- "torch._tensor._rebuild_from_type_v2",
- "torch.FloatStorage"
How to fix it?
24.6 GB Add SFT checkpoint bf16_zero_pp_rank_2_mp_rank_00_optim_states.pt Detected Pickle imports (7)
- "deepspeed.runtime.fp16.loss_scaler.LossScaler",
- "torch._utils._rebuild_tensor_v2",
- "deepspeed.runtime.zero.config.ZeroStageEnum",
- "torch.Tensor",
- "collections.OrderedDict",
- "torch._tensor._rebuild_from_type_v2",
- "torch.FloatStorage"
How to fix it?
24.6 GB Add SFT checkpoint bf16_zero_pp_rank_3_mp_rank_00_optim_states.pt Detected Pickle imports (7)
- "deepspeed.runtime.fp16.loss_scaler.LossScaler",
- "torch._utils._rebuild_tensor_v2",
- "deepspeed.runtime.zero.config.ZeroStageEnum",
- "torch.Tensor",
- "collections.OrderedDict",
- "torch._tensor._rebuild_from_type_v2",
- "torch.FloatStorage"
How to fix it?
24.6 GB Add SFT checkpoint - 202 kB Add SFT checkpoint
- 202 kB Add SFT checkpoint
- 202 kB Add SFT checkpoint
- 202 kB Add SFT checkpoint
