triangle.err

W0227 03:45:20.673000 1603560 site-packages/torch/distributed/run.py:766] 
W0227 03:45:20.673000 1603560 site-packages/torch/distributed/run.py:766] *****************************************
W0227 03:45:20.673000 1603560 site-packages/torch/distributed/run.py:766] Setting OMP_NUM_THREADS environment variable for each process to be 1 in default, to avoid your system being overloaded, please further tune the variable for optimal performance in your application as needed. 
W0227 03:45:20.673000 1603560 site-packages/torch/distributed/run.py:766] *****************************************
The image processor of type `Qwen2VLImageProcessor` is now loaded as a fast processor by default, even if the model checkpoint was saved with a slow processor. This is a breaking change and may produce slightly different outputs. To continue using the slow processor, instantiate this class with `use_fast=False`. Note that this behavior will be extended to all models in a future release.
The image processor of type `Qwen2VLImageProcessor` is now loaded as a fast processor by default, even if the model checkpoint was saved with a slow processor. This is a breaking change and may produce slightly different outputs. To continue using the slow processor, instantiate this class with `use_fast=False`. Note that this behavior will be extended to all models in a future release.
The image processor of type `Qwen2VLImageProcessor` is now loaded as a fast processor by default, even if the model checkpoint was saved with a slow processor. This is a breaking change and may produce slightly different outputs. To continue using the slow processor, instantiate this class with `use_fast=False`. Note that this behavior will be extended to all models in a future release.
The image processor of type `Qwen2VLImageProcessor` is now loaded as a fast processor by default, even if the model checkpoint was saved with a slow processor. This is a breaking change and may produce slightly different outputs. To continue using the slow processor, instantiate this class with `use_fast=False`. Note that this behavior will be extended to all models in a future release.
`torch_dtype` is deprecated! Use `dtype` instead!

Loading checkpoint shards:   0%|          | 0/5 [00:00<?, ?it/s]
Loading checkpoint shards: 100%|██████████| 5/5 [00:00<00:00, 47.40it/s]
Loading checkpoint shards: 100%|██████████| 5/5 [00:00<00:00, 47.32it/s]
`torch_dtype` is deprecated! Use `dtype` instead!

Loading checkpoint shards:   0%|          | 0/5 [00:00<?, ?it/s]
Loading checkpoint shards:  80%|████████  | 4/5 [00:00<00:00, 37.84it/s]
Loading checkpoint shards: 100%|██████████| 5/5 [00:00<00:00, 44.74it/s]
`torch_dtype` is deprecated! Use `dtype` instead!

Loading checkpoint shards:   0%|          | 0/5 [00:00<?, ?it/s]
Loading checkpoint shards:  80%|████████  | 4/5 [00:00<00:00, 37.10it/s]
Loading checkpoint shards: 100%|██████████| 5/5 [00:00<00:00, 33.22it/s]

Loading checkpoint shards:   0%|          | 0/5 [00:00<?, ?it/s]
Loading checkpoint shards:  80%|████████  | 4/5 [00:00<00:00, 39.76it/s]
Loading checkpoint shards: 100%|██████████| 5/5 [00:00<00:00, 45.26it/s]
`torch_dtype` is deprecated! Use `dtype` instead!

Loading checkpoint shards:   0%|          | 0/5 [00:00<?, ?it/s]
Loading checkpoint shards:  80%|████████  | 4/5 [00:00<00:00, 39.63it/s]
Loading checkpoint shards: 100%|██████████| 5/5 [00:00<00:00, 45.49it/s]

Loading checkpoint shards:   0%|          | 0/5 [00:00<?, ?it/s]
Loading checkpoint shards:  80%|████████  | 4/5 [00:00<00:00, 39.74it/s]
Loading checkpoint shards: 100%|██████████| 5/5 [00:00<00:00, 44.58it/s]

Loading checkpoint shards:   0%|          | 0/5 [00:00<?, ?it/s]
Loading checkpoint shards:  80%|████████  | 4/5 [00:00<00:00, 39.86it/s]
Loading checkpoint shards: 100%|██████████| 5/5 [00:00<00:00, 46.51it/s]

Loading checkpoint shards:   0%|          | 0/5 [00:00<?, ?it/s]
Loading checkpoint shards:  80%|████████  | 4/5 [00:00<00:00, 38.11it/s]
Loading checkpoint shards: 100%|██████████| 5/5 [00:00<00:00, 43.00it/s]

SFT Epoch 1/2:   0%|          | 0/205 [00:00<?, ?it/s]
SFT Epoch 1/2:   0%|          | 0/205 [00:04<?, ?it/s, loss=0.441, sft=0.441, clean=0.204, trig=0.543, accum=4, step=1, kl=-0.000]
SFT Epoch 1/2:   0%|          | 1/205 [00:04<15:17,  4.50s/it, loss=0.441, sft=0.441, clean=0.204, trig=0.543, accum=4, step=1, kl=-0.000]
SFT Epoch 1/2:   0%|          | 1/205 [00:06<15:17,  4.50s/it, loss=0.518, sft=0.518, clean=0.315, trig=0.605, accum=4, step=2, kl=0.000] 
SFT Epoch 1/2:   1%|          | 2/205 [00:06<10:51,  3.21s/it, loss=0.518, sft=0.518, clean=0.315, trig=0.605, accum=4, step=2, kl=0.000]
SFT Epoch 1/2:   1%|          | 2/205 [00:09<10:51,  3.21s/it, loss=0.419, sft=0.418, clean=0.218, trig=0.504, accum=4, step=3, kl=0.001]
SFT Epoch 1/2:   1%|▏         | 3/205 [00:09<09:48,  2.91s/it, loss=0.419, sft=0.418, clean=0.218, trig=0.504, accum=4, step=3, kl=0.001]
SFT Epoch 1/2:   1%|▏         | 3/205 [00:11<09:48,  2.91s/it, loss=0.517, sft=0.513, clean=0.322, trig=0.594, accum=4, step=4, kl=0.009]
SFT Epoch 1/2:   2%|▏         | 4/205 [00:11<08:45,  2.61s/it, loss=0.517, sft=0.513, clean=0.322, trig=0.594, accum=4, step=4, kl=0.009]
SFT Epoch 1/2:   2%|▏         | 4/205 [00:13<08:45,  2.61s/it, loss=0.390, sft=0.379, clean=0.225, trig=0.445, accum=4, step=5, kl=0.022]
SFT Epoch 1/2:   2%|▏         | 5/205 [00:13<08:08,  2.44s/it, loss=0.390, sft=0.379, clean=0.225, trig=0.445, accum=4, step=5, kl=0.022]
SFT Epoch 1/2:   2%|▏         | 5/205 [00:15<08:08,  2.44s/it, loss=0.389, sft=0.365, clean=0.281, trig=0.402, accum=4, step=6, kl=0.047]
SFT Epoch 1/2:   3%|▎         | 6/205 [00:15<07:34,  2.28s/it, loss=0.389, sft=0.365, clean=0.281, trig=0.402, accum=4, step=6, kl=0.047]
SFT Epoch 1/2:   3%|▎         | 6/205 [00:17<07:34,  2.28s/it, loss=0.336, sft=0.310, clean=0.269, trig=0.327, accum=4, step=7, kl=0.052]
SFT Epoch 1/2:   3%|▎         | 7/205 [00:17<07:22,  2.23s/it, loss=0.336, sft=0.310, clean=0.269, trig=0.327, accum=4, step=7, kl=0.052]
SFT Epoch 1/2:   3%|▎         | 7/205 [00:19<07:22,  2.23s/it, loss=0.270, sft=0.249, clean=0.231, trig=0.257, accum=4, step=8, kl=0.043]
SFT Epoch 1/2:   4%|▍         | 8/205 [00:19<07:07,  2.17s/it, loss=0.270, sft=0.249, clean=0.231, trig=0.257, accum=4, step=8, kl=0.043]
SFT Epoch 1/2:   4%|▍         | 8/205 [00:22<07:07,  2.17s/it, loss=0.252, sft=0.217, clean=0.225, trig=0.214, accum=4, step=9, kl=0.068]
SFT Epoch 1/2:   4%|▍         | 9/205 [00:22<07:12,  2.21s/it, loss=0.252, sft=0.217, clean=0.225, trig=0.214, accum=4, step=9, kl=0.068]
SFT Epoch 1/2:   4%|▍         | 9/205 [00:24<07:12,  2.21s/it, loss=0.283, sft=0.251, clean=0.260, trig=0.247, accum=4, step=10, kl=0.065]
SFT Epoch 1/2:   5%|▍         | 10/205 [00:24<07:15,  2.23s/it, loss=0.283, sft=0.251, clean=0.260, trig=0.247, accum=4, step=10, kl=0.065]
SFT Epoch 1/2:   5%|▍         | 10/205 [00:26<07:15,  2.23s/it, loss=0.203, sft=0.171, clean=0.180, trig=0.167, accum=4, step=11, kl=0.064]
SFT Epoch 1/2:   5%|▌         | 11/205 [00:26<06:49,  2.11s/it, loss=0.203, sft=0.171, clean=0.180, trig=0.167, accum=4, step=11, kl=0.064]
SFT Epoch 1/2:   5%|▌         | 11/205 [00:28<06:49,  2.11s/it, loss=0.240, sft=0.209, clean=0.220, trig=0.205, accum=4, step=12, kl=0.062]
SFT Epoch 1/2:   6%|▌         | 12/205 [00:28<06:49,  2.12s/it, loss=0.240, sft=0.209, clean=0.220, trig=0.205, accum=4, step=12, kl=0.062]
SFT Epoch 1/2:   6%|▌         | 12/205 [00:30<06:49,  2.12s/it, loss=0.243, sft=0.211, clean=0.213, trig=0.210, accum=4, step=13, kl=0.065]
SFT Epoch 1/2:   6%|▋         | 13/205 [00:30<06:51,  2.14s/it, loss=0.243, sft=0.211, clean=0.213, trig=0.210, accum=4, step=13, kl=0.065]
SFT Epoch 1/2:   6%|▋         | 13/205 [00:32<06:51,  2.14s/it, loss=0.251, sft=0.218, clean=0.223, trig=0.216, accum=4, step=14, kl=0.067]
SFT Epoch 1/2:   7%|▋         | 14/205 [00:32<06:55,  2.17s/it, loss=0.251, sft=0.218, clean=0.223, trig=0.216, accum=4, step=14, kl=0.067]
SFT Epoch 1/2:   7%|▋         | 14/205 [00:34<06:55,  2.17s/it, loss=0.276, sft=0.239, clean=0.242, trig=0.238, accum=4, step=15, kl=0.075]
SFT Epoch 1/2:   7%|▋         | 15/205 [00:34<06:46,  2.14s/it, loss=0.276, sft=0.239, clean=0.242, trig=0.238, accum=4, step=15, kl=0.075]
SFT Epoch 1/2:   7%|▋         | 15/205 [00:37<06:46,  2.14s/it, loss=0.262, sft=0.222, clean=0.221, trig=0.223, accum=4, step=16, kl=0.079]
SFT Epoch 1/2:   8%|▊         | 16/205 [00:37<06:57,  2.21s/it, loss=0.262, sft=0.222, clean=0.221, trig=0.223, accum=4, step=16, kl=0.079]
SFT Epoch 1/2:   8%|▊         | 16/205 [00:39<06:57,  2.21s/it, loss=0.279, sft=0.238, clean=0.244, trig=0.235, accum=4, step=17, kl=0.082]
SFT Epoch 1/2:   8%|▊         | 17/205 [00:39<06:47,  2.17s/it, loss=0.279, sft=0.238, clean=0.244, trig=0.235, accum=4, step=17, kl=0.082]
SFT Epoch 1/2:   8%|▊         | 17/205 [00:41<06:47,  2.17s/it, loss=0.263, sft=0.224, clean=0.236, trig=0.219, accum=4, step=18, kl=0.078]
SFT Epoch 1/2:   9%|▉         | 18/205 [00:41<06:42,  2.15s/it, loss=0.263, sft=0.224, clean=0.236, trig=0.219, accum=4, step=18, kl=0.078]
SFT Epoch 1/2:   9%|▉         | 18/205 [00:43<06:42,  2.15s/it, loss=0.268, sft=0.227, clean=0.238, trig=0.222, accum=4, step=19, kl=0.082]
SFT Epoch 1/2:   9%|▉         | 19/205 [00:43<06:40,  2.15s/it, loss=0.268, sft=0.227, clean=0.238, trig=0.222, accum=4, step=19, kl=0.082]
SFT Epoch 1/2:   9%|▉         | 19/205 [00:45<06:40,  2.15s/it, loss=0.269, sft=0.227, clean=0.233, trig=0.225, accum=4, step=20, kl=0.083]
SFT Epoch 1/2:  10%|▉         | 20/205 [00:45<06:44,  2.18s/it, loss=0.269, sft=0.227, clean=0.233, trig=0.225, accum=4, step=20, kl=0.083]
SFT Epoch 1/2:  10%|▉         | 20/205 [00:47<06:44,  2.18s/it, loss=0.283, sft=0.246, clean=0.254, trig=0.242, accum=4, step=21, kl=0.075]
SFT Epoch 1/2:  10%|█         | 21/205 [00:47<06:37,  2.16s/it, loss=0.283, sft=0.246, clean=0.254, trig=0.242, accum=4, step=21, kl=0.075]
SFT Epoch 1/2:  10%|█         | 21/205 [00:49<06:37,  2.16s/it, loss=0.281, sft=0.249, clean=0.254, trig=0.246, accum=4, step=22, kl=0.064]
SFT Epoch 1/2:  11%|█         | 22/205 [00:49<06:28,  2.12s/it, loss=0.281, sft=0.249, clean=0.254, trig=0.246, accum=4, step=22, kl=0.064]
SFT Epoch 1/2:  11%|█         | 22/205 [00:52<06:28,  2.12s/it, loss=0.292, sft=0.256, clean=0.261, trig=0.253, accum=4, step=23, kl=0.073]
SFT Epoch 1/2:  11%|█         | 23/205 [00:52<06:24,  2.11s/it, loss=0.292, sft=0.256, clean=0.261, trig=0.253, accum=4, step=23, kl=0.073]
SFT Epoch 1/2:  11%|█         | 23/205 [00:54<06:24,  2.11s/it, loss=0.266, sft=0.232, clean=0.237, trig=0.229, accum=4, step=24, kl=0.068]
SFT Epoch 1/2:  12%|█▏        | 24/205 [00:54<06:31,  2.16s/it, loss=0.266, sft=0.232, clean=0.237, trig=0.229, accum=4, step=24, kl=0.068]
SFT Epoch 1/2:  12%|█▏        | 24/205 [00:56<06:31,  2.16s/it, loss=0.307, sft=0.271, clean=0.273, trig=0.269, accum=4, step=25, kl=0.072]
SFT Epoch 1/2:  12%|█▏        | 25/205 [00:56<06:18,  2.10s/it, loss=0.307, sft=0.271, clean=0.273, trig=0.269, accum=4, step=25, kl=0.072]
SFT Epoch 1/2:  12%|█▏        | 25/205 [00:58<06:18,  2.10s/it, loss=0.263, sft=0.226, clean=0.230, trig=0.225, accum=4, step=26, kl=0.074]
SFT Epoch 1/2:  13%|█▎        | 26/205 [00:58<06:31,  2.19s/it, loss=0.263, sft=0.226, clean=0.230, trig=0.225, accum=4, step=26, kl=0.074]
SFT Epoch 1/2:  13%|█▎        | 26/205 [01:00<06:31,  2.19s/it, loss=0.246, sft=0.213, clean=0.214, trig=0.212, accum=4, step=27, kl=0.066]
SFT Epoch 1/2:  13%|█▎        | 27/205 [01:00<06:24,  2.16s/it, loss=0.246, sft=0.213, clean=0.214, trig=0.212, accum=4, step=27, kl=0.066]
SFT Epoch 1/2:  13%|█▎        | 27/205 [01:02<06:24,  2.16s/it, loss=0.199, sft=0.173, clean=0.173, trig=0.173, accum=4, step=28, kl=0.053]
SFT Epoch 1/2:  14%|█▎        | 28/205 [01:02<06:18,  2.14s/it, loss=0.199, sft=0.173, clean=0.173, trig=0.173, accum=4, step=28, kl=0.053]
SFT Epoch 1/2:  14%|█▎        | 28/205 [01:05<06:18,  2.14s/it, loss=0.163, sft=0.138, clean=0.137, trig=0.139, accum=4, step=29, kl=0.048]
SFT Epoch 1/2:  14%|█▍        | 29/205 [01:05<06:36,  2.25s/it, loss=0.163, sft=0.138, clean=0.137, trig=0.139, accum=4, step=29, kl=0.048]
SFT Epoch 1/2:  14%|█▍        | 29/205 [01:07<06:36,  2.25s/it, loss=0.268, sft=0.231, clean=0.232, trig=0.231, accum=4, step=30, kl=0.073]
SFT Epoch 1/2:  15%|█▍        | 30/205 [01:07<06:41,  2.30s/it, loss=0.268, sft=0.231, clean=0.232, trig=0.231, accum=4, step=30, kl=0.073]
SFT Epoch 1/2:  15%|█▍        | 30/205 [01:10<06:41,  2.30s/it, loss=0.241, sft=0.214, clean=0.213, trig=0.214, accum=4, step=31, kl=0.055]
SFT Epoch 1/2:  15%|█▌        | 31/205 [01:10<06:39,  2.29s/it, loss=0.241, sft=0.214, clean=0.213, trig=0.214, accum=4, step=31, kl=0.055]
SFT Epoch 1/2:  15%|█▌        | 31/205 [01:12<06:39,  2.29s/it, loss=0.279, sft=0.237, clean=0.240, trig=0.236, accum=4, step=32, kl=0.083]
SFT Epoch 1/2:  16%|█▌        | 32/205 [01:12<06:30,  2.26s/it, loss=0.279, sft=0.237, clean=0.240, trig=0.236, accum=4, step=32, kl=0.083]
SFT Epoch 1/2:  16%|█▌        | 32/205 [01:14<06:30,  2.26s/it, loss=0.242, sft=0.202, clean=0.207, trig=0.200, accum=4, step=33, kl=0.080]
SFT Epoch 1/2:  16%|█▌        | 33/205 [01:14<06:35,  2.30s/it, loss=0.242, sft=0.202, clean=0.207, trig=0.200, accum=4, step=33, kl=0.080]
SFT Epoch 1/2:  16%|█▌        | 33/205 [01:16<06:35,  2.30s/it, loss=0.313, sft=0.264, clean=0.274, trig=0.260, accum=4, step=34, kl=0.097]
SFT Epoch 1/2:  17%|█▋        | 34/205 [01:16<06:16,  2.20s/it, loss=0.313, sft=0.264, clean=0.274, trig=0.260, accum=4, step=34, kl=0.097]
SFT Epoch 1/2:  17%|█▋        | 34/205 [01:18<06:16,  2.20s/it, loss=0.186, sft=0.156, clean=0.157, trig=0.156, accum=4, step=35, kl=0.059]
SFT Epoch 1/2:  17%|█▋        | 35/205 [01:18<06:01,  2.13s/it, loss=0.186, sft=0.156, clean=0.157, trig=0.156, accum=4, step=35, kl=0.059]
SFT Epoch 1/2:  17%|█▋        | 35/205 [01:20<06:01,  2.13s/it, loss=0.199, sft=0.172, clean=0.180, trig=0.168, accum=4, step=36, kl=0.054]
SFT Epoch 1/2:  18%|█▊        | 36/205 [01:20<06:02,  2.14s/it, loss=0.199, sft=0.172, clean=0.180, trig=0.168, accum=4, step=36, kl=0.054]
SFT Epoch 1/2:  18%|█▊        | 36/205 [01:23<06:02,  2.14s/it, loss=0.204, sft=0.169, clean=0.174, trig=0.167, accum=4, step=37, kl=0.071]
SFT Epoch 1/2:  18%|█▊        | 37/205 [01:23<06:07,  2.18s/it, loss=0.204, sft=0.169, clean=0.174, trig=0.167, accum=4, step=37, kl=0.071]
SFT Epoch 1/2:  18%|█▊        | 37/205 [01:24<06:07,  2.18s/it, loss=0.259, sft=0.225, clean=0.207, trig=0.233, accum=4, step=38, kl=0.067]
SFT Epoch 1/2:  19%|█▊        | 38/205 [01:24<05:48,  2.09s/it, loss=0.259, sft=0.225, clean=0.207, trig=0.233, accum=4, step=38, kl=0.067]
SFT Epoch 1/2:  19%|█▊        | 38/205 [01:27<05:48,  2.09s/it, loss=0.244, sft=0.205, clean=0.210, trig=0.203, accum=4, step=39, kl=0.078]
SFT Epoch 1/2:  19%|█▉        | 39/205 [01:27<05:51,  2.12s/it, loss=0.244, sft=0.205, clean=0.210, trig=0.203, accum=4, step=39, kl=0.078]
SFT Epoch 1/2:  19%|█▉        | 39/205 [01:29<05:51,  2.12s/it, loss=0.246, sft=0.220, clean=0.222, trig=0.220, accum=4, step=40, kl=0.050]
SFT Epoch 1/2:  20%|█▉        | 40/205 [01:29<05:41,  2.07s/it, loss=0.246, sft=0.220, clean=0.222, trig=0.220, accum=4, step=40, kl=0.050]
SFT Epoch 1/2:  20%|█▉        | 40/205 [01:31<05:41,  2.07s/it, loss=0.250, sft=0.218, clean=0.216, trig=0.219, accum=4, step=41, kl=0.063]
SFT Epoch 1/2:  20%|██        | 41/205 [01:31<05:46,  2.11s/it, loss=0.250, sft=0.218, clean=0.216, trig=0.219, accum=4, step=41, kl=0.063]
SFT Epoch 1/2:  20%|██        | 41/205 [01:33<05:46,  2.11s/it, loss=0.186, sft=0.156, clean=0.152, trig=0.158, accum=4, step=42, kl=0.058]
SFT Epoch 1/2:  20%|██        | 42/205 [01:33<05:48,  2.14s/it, loss=0.186, sft=0.156, clean=0.152, trig=0.158, accum=4, step=42, kl=0.058]
SFT Epoch 1/2:  20%|██        | 42/205 [01:35<05:48,  2.14s/it, loss=0.277, sft=0.239, clean=0.238, trig=0.239, accum=4, step=43, kl=0.075]
SFT Epoch 1/2:  21%|██        | 43/205 [01:35<05:45,  2.13s/it, loss=0.277, sft=0.239, clean=0.238, trig=0.239, accum=4, step=43, kl=0.075]
SFT Epoch 1/2:  21%|██        | 43/205 [01:37<05:45,  2.13s/it, loss=0.252, sft=0.219, clean=0.223, trig=0.218, accum=4, step=44, kl=0.065]
SFT Epoch 1/2:  21%|██▏       | 44/205 [01:37<05:53,  2.19s/it, loss=0.252, sft=0.219, clean=0.223, trig=0.218, accum=4, step=44, kl=0.065]
SFT Epoch 1/2:  21%|██▏       | 44/205 [01:39<05:53,  2.19s/it, loss=0.229, sft=0.196, clean=0.201, trig=0.194, accum=4, step=45, kl=0.065]
SFT Epoch 1/2:  22%|██▏       | 45/205 [01:39<05:45,  2.16s/it, loss=0.229, sft=0.196, clean=0.201, trig=0.194, accum=4, step=45, kl=0.065]
SFT Epoch 1/2:  22%|██▏       | 45/205 [01:42<05:45,  2.16s/it, loss=0.266, sft=0.230, clean=0.233, trig=0.229, accum=4, step=46, kl=0.073]
SFT Epoch 1/2:  22%|██▏       | 46/205 [01:42<05:36,  2.12s/it, loss=0.266, sft=0.230, clean=0.233, trig=0.229, accum=4, step=46, kl=0.073]
SFT Epoch 1/2:  22%|██▏       | 46/205 [01:44<05:36,  2.12s/it, loss=0.190, sft=0.169, clean=0.172, trig=0.167, accum=4, step=47, kl=0.042]
SFT Epoch 1/2:  23%|██▎       | 47/205 [01:44<05:30,  2.09s/it, loss=0.190, sft=0.169, clean=0.172, trig=0.167, accum=4, step=47, kl=0.042]
SFT Epoch 1/2:  23%|██▎       | 47/205 [01:46<05:30,  2.09s/it, loss=0.195, sft=0.165, clean=0.165, trig=0.164, accum=4, step=48, kl=0.061]
SFT Epoch 1/2:  23%|██▎       | 48/205 [01:46<05:33,  2.12s/it, loss=0.195, sft=0.165, clean=0.165, trig=0.164, accum=4, step=48, kl=0.061]
SFT Epoch 1/2:  23%|██▎       | 48/205 [01:48<05:33,  2.12s/it, loss=0.229, sft=0.199, clean=0.206, trig=0.196, accum=4, step=49, kl=0.060]
SFT Epoch 1/2:  24%|██▍       | 49/205 [01:48<05:43,  2.20s/it, loss=0.229, sft=0.199, clean=0.206, trig=0.196, accum=4, step=49, kl=0.060]
SFT Epoch 1/2:  24%|██▍       | 49/205 [01:50<05:43,  2.20s/it, loss=0.251, sft=0.211, clean=0.205, trig=0.214, accum=4, step=50, kl=0.080]
SFT Epoch 1/2:  24%|██▍       | 50/205 [01:50<05:47,  2.24s/it, loss=0.251, sft=0.211, clean=0.205, trig=0.214, accum=4, step=50, kl=0.080]
SFT Epoch 1/2:  24%|██▍       | 50/205 [01:52<05:47,  2.24s/it, loss=0.211, sft=0.175, clean=0.178, trig=0.174, accum=4, step=51, kl=0.071]
SFT Epoch 1/2:  25%|██▍       | 51/205 [01:52<05:25,  2.11s/it, loss=0.211, sft=0.175, clean=0.178, trig=0.174, accum=4, step=51, kl=0.071]
SFT Epoch 1/2:  25%|██▍       | 51/205 [01:54<05:25,  2.11s/it, loss=0.176, sft=0.146, clean=0.150, trig=0.144, accum=4, step=52, kl=0.060]
SFT Epoch 1/2:  25%|██▌       | 52/205 [01:54<05:11,  2.04s/it, loss=0.176, sft=0.146, clean=0.150, trig=0.144, accum=4, step=52, kl=0.060]
SFT Epoch 1/2:  25%|██▌       | 52/205 [01:56<05:11,  2.04s/it, loss=0.254, sft=0.219, clean=0.222, trig=0.218, accum=4, step=53, kl=0.070]
SFT Epoch 1/2:  26%|██▌       | 53/205 [01:56<05:11,  2.05s/it, loss=0.254, sft=0.219, clean=0.222, trig=0.218, accum=4, step=53, kl=0.070]
SFT Epoch 1/2:  26%|██▌       | 53/205 [01:59<05:11,  2.05s/it, loss=0.240, sft=0.198, clean=0.203, trig=0.196, accum=4, step=54, kl=0.085]
SFT Epoch 1/2:  26%|██▋       | 54/205 [01:59<05:25,  2.16s/it, loss=0.240, sft=0.198, clean=0.203, trig=0.196, accum=4, step=54, kl=0.085]
SFT Epoch 1/2:  26%|██▋       | 54/205 [02:01<05:25,  2.16s/it, loss=0.322, sft=0.278, clean=0.285, trig=0.275, accum=4, step=55, kl=0.088]
SFT Epoch 1/2:  27%|██▋       | 55/205 [02:01<05:34,  2.23s/it, loss=0.322, sft=0.278, clean=0.285, trig=0.275, accum=4, step=55, kl=0.088]
SFT Epoch 1/2:  27%|██▋       | 55/205 [02:03<05:34,  2.23s/it, loss=0.254, sft=0.219, clean=0.223, trig=0.217, accum=4, step=56, kl=0.069]
SFT Epoch 1/2:  27%|██▋       | 56/205 [02:03<05:29,  2.21s/it, loss=0.254, sft=0.219, clean=0.223, trig=0.217, accum=4, step=56, kl=0.069]
SFT Epoch 1/2:  27%|██▋       | 56/205 [02:05<05:29,  2.21s/it, loss=0.189, sft=0.159, clean=0.160, trig=0.159, accum=4, step=57, kl=0.059]
SFT Epoch 1/2:  28%|██▊       | 57/205 [02:05<05:17,  2.14s/it, loss=0.189, sft=0.159, clean=0.160, trig=0.159, accum=4, step=57, kl=0.059]
SFT Epoch 1/2:  28%|██▊       | 57/205 [02:07<05:17,  2.14s/it, loss=0.249, sft=0.217, clean=0.220, trig=0.215, accum=4, step=58, kl=0.065]
SFT Epoch 1/2:  28%|██▊       | 58/205 [02:07<05:09,  2.11s/it, loss=0.249, sft=0.217, clean=0.220, trig=0.215, accum=4, step=58, kl=0.065]
SFT Epoch 1/2:  28%|██▊       | 58/205 [02:09<05:09,  2.11s/it, loss=0.281, sft=0.240, clean=0.247, trig=0.237, accum=4, step=59, kl=0.082]
SFT Epoch 1/2:  29%|██▉       | 59/205 [02:09<05:02,  2.07s/it, loss=0.281, sft=0.240, clean=0.247, trig=0.237, accum=4, step=59, kl=0.082]
SFT Epoch 1/2:  29%|██▉       | 59/205 [02:11<05:02,  2.07s/it, loss=0.235, sft=0.198, clean=0.207, trig=0.194, accum=4, step=60, kl=0.073]
SFT Epoch 1/2:  29%|██▉       | 60/205 [02:11<05:06,  2.11s/it, loss=0.235, sft=0.198, clean=0.207, trig=0.194, accum=4, step=60, kl=0.073]
SFT Epoch 1/2:  29%|██▉       | 60/205 [02:14<05:06,  2.11s/it, loss=0.252, sft=0.220, clean=0.220, trig=0.220, accum=4, step=61, kl=0.065]
SFT Epoch 1/2:  30%|██▉       | 61/205 [02:14<05:05,  2.12s/it, loss=0.252, sft=0.220, clean=0.220, trig=0.220, accum=4, step=61, kl=0.065]
SFT Epoch 1/2:  30%|██▉       | 61/205 [02:16<05:05,  2.12s/it, loss=0.298, sft=0.255, clean=0.265, trig=0.251, accum=4, step=62, kl=0.086]
SFT Epoch 1/2:  30%|███       | 62/205 [02:16<05:19,  2.24s/it, loss=0.298, sft=0.255, clean=0.265, trig=0.251, accum=4, step=62, kl=0.086]
SFT Epoch 1/2:  30%|███       | 62/205 [02:18<05:19,  2.24s/it, loss=0.285, sft=0.244, clean=0.246, trig=0.243, accum=4, step=63, kl=0.081]
SFT Epoch 1/2:  31%|███       | 63/205 [02:18<05:04,  2.14s/it, loss=0.285, sft=0.244, clean=0.246, trig=0.243, accum=4, step=63, kl=0.081]
SFT Epoch 1/2:  31%|███       | 63/205 [02:20<05:04,  2.14s/it, loss=0.169, sft=0.147, clean=0.146, trig=0.147, accum=4, step=64, kl=0.045]
SFT Epoch 1/2:  31%|███       | 64/205 [02:20<04:55,  2.09s/it, loss=0.169, sft=0.147, clean=0.146, trig=0.147, accum=4, step=64, kl=0.045]
SFT Epoch 1/2:  31%|███       | 64/205 [02:22<04:55,  2.09s/it, loss=0.303, sft=0.266, clean=0.275, trig=0.263, accum=4, step=65, kl=0.075]
SFT Epoch 1/2:  32%|███▏      | 65/205 [02:22<05:06,  2.19s/it, loss=0.303, sft=0.266, clean=0.275, trig=0.263, accum=4, step=65, kl=0.075]
SFT Epoch 1/2:  32%|███▏      | 65/205 [02:25<05:06,  2.19s/it, loss=0.284, sft=0.242, clean=0.243, trig=0.241, accum=4, step=66, kl=0.084]
SFT Epoch 1/2:  32%|███▏      | 66/205 [02:25<05:05,  2.20s/it, loss=0.284, sft=0.242, clean=0.243, trig=0.241, accum=4, step=66, kl=0.084]
SFT Epoch 1/2:  32%|███▏      | 66/205 [02:27<05:05,  2.20s/it, loss=0.209, sft=0.181, clean=0.179, trig=0.182, accum=4, step=67, kl=0.056]
SFT Epoch 1/2:  33%|███▎      | 67/205 [02:27<05:05,  2.21s/it, loss=0.209, sft=0.181, clean=0.179, trig=0.182, accum=4, step=67, kl=0.056]
SFT Epoch 1/2:  33%|███▎      | 67/205 [02:29<05:05,  2.21s/it, loss=0.196, sft=0.166, clean=0.169, trig=0.165, accum=4, step=68, kl=0.059]
SFT Epoch 1/2:  33%|███▎      | 68/205 [02:29<04:59,  2.19s/it, loss=0.196, sft=0.166, clean=0.169, trig=0.165, accum=4, step=68, kl=0.059]
SFT Epoch 1/2:  33%|███▎      | 68/205 [02:31<04:59,  2.19s/it, loss=0.225, sft=0.189, clean=0.189, trig=0.189, accum=4, step=69, kl=0.072]
SFT Epoch 1/2:  34%|███▎      | 69/205 [02:31<04:59,  2.20s/it, loss=0.225, sft=0.189, clean=0.189, trig=0.189, accum=4, step=69, kl=0.072]
SFT Epoch 1/2:  34%|███▎      | 69/205 [02:33<04:59,  2.20s/it, loss=0.236, sft=0.207, clean=0.213, trig=0.205, accum=4, step=70, kl=0.058]
SFT Epoch 1/2:  34%|███▍      | 70/205 [02:33<04:47,  2.13s/it, loss=0.236, sft=0.207, clean=0.213, trig=0.205, accum=4, step=70, kl=0.058]
SFT Epoch 1/2:  34%|███▍      | 70/205 [02:35<04:47,  2.13s/it, loss=0.240, sft=0.210, clean=0.212, trig=0.210, accum=4, step=71, kl=0.058]
SFT Epoch 1/2:  35%|███▍      | 71/205 [02:35<04:45,  2.13s/it, loss=0.240, sft=0.210, clean=0.212, trig=0.210, accum=4, step=71, kl=0.058]
SFT Epoch 1/2:  35%|███▍      | 71/205 [02:37<04:45,  2.13s/it, loss=0.178, sft=0.151, clean=0.154, trig=0.149, accum=4, step=72, kl=0.055]
SFT Epoch 1/2:  35%|███▌      | 72/205 [02:37<04:44,  2.14s/it, loss=0.178, sft=0.151, clean=0.154, trig=0.149, accum=4, step=72, kl=0.055]
SFT Epoch 1/2:  35%|███▌      | 72/205 [02:40<04:44,  2.14s/it, loss=0.216, sft=0.189, clean=0.192, trig=0.188, accum=4, step=73, kl=0.053]
SFT Epoch 1/2:  36%|███▌      | 73/205 [02:40<04:43,  2.14s/it, loss=0.216, sft=0.189, clean=0.192, trig=0.188, accum=4, step=73, kl=0.053]
SFT Epoch 1/2:  36%|███▌      | 73/205 [02:42<04:43,  2.14s/it, loss=0.254, sft=0.218, clean=0.230, trig=0.213, accum=4, step=74, kl=0.072]
SFT Epoch 1/2:  36%|███▌      | 74/205 [02:42<04:41,  2.15s/it, loss=0.254, sft=0.218, clean=0.230, trig=0.213, accum=4, step=74, kl=0.072]
SFT Epoch 1/2:  36%|███▌      | 74/205 [02:44<04:41,  2.15s/it, loss=0.199, sft=0.168, clean=0.168, trig=0.168, accum=4, step=75, kl=0.061]
SFT Epoch 1/2:  37%|███▋      | 75/205 [02:44<04:39,  2.15s/it, loss=0.199, sft=0.168, clean=0.168, trig=0.168, accum=4, step=75, kl=0.061]
SFT Epoch 1/2:  37%|███▋      | 75/205 [02:46<04:39,  2.15s/it, loss=0.214, sft=0.182, clean=0.186, trig=0.181, accum=4, step=76, kl=0.063]
SFT Epoch 1/2:  37%|███▋      | 76/205 [02:46<04:33,  2.12s/it, loss=0.214, sft=0.182, clean=0.186, trig=0.181, accum=4, step=76, kl=0.063]
SFT Epoch 1/2:  37%|███▋      | 76/205 [02:48<04:33,  2.12s/it, loss=0.142, sft=0.123, clean=0.124, trig=0.123, accum=4, step=77, kl=0.037]
SFT Epoch 1/2:  38%|███▊      | 77/205 [02:48<04:28,  2.09s/it, loss=0.142, sft=0.123, clean=0.124, trig=0.123, accum=4, step=77, kl=0.037]
SFT Epoch 1/2:  38%|███▊      | 77/205 [02:50<04:28,  2.09s/it, loss=0.246, sft=0.215, clean=0.222, trig=0.213, accum=4, step=78, kl=0.062]
SFT Epoch 1/2:  38%|███▊      | 78/205 [02:50<04:19,  2.04s/it, loss=0.246, sft=0.215, clean=0.222, trig=0.213, accum=4, step=78, kl=0.062]
SFT Epoch 1/2:  38%|███▊      | 78/205 [02:52<04:19,  2.04s/it, loss=0.209, sft=0.181, clean=0.185, trig=0.180, accum=4, step=79, kl=0.057]
SFT Epoch 1/2:  39%|███▊      | 79/205 [02:52<04:18,  2.05s/it, loss=0.209, sft=0.181, clean=0.185, trig=0.180, accum=4, step=79, kl=0.057]
SFT Epoch 1/2:  39%|███▊      | 79/205 [02:54<04:18,  2.05s/it, loss=0.255, sft=0.225, clean=0.231, trig=0.223, accum=4, step=80, kl=0.060]
SFT Epoch 1/2:  39%|███▉      | 80/205 [02:54<04:18,  2.07s/it, loss=0.255, sft=0.225, clean=0.231, trig=0.223, accum=4, step=80, kl=0.060]
SFT Epoch 1/2:  39%|███▉      | 80/205 [02:56<04:18,  2.07s/it, loss=0.204, sft=0.177, clean=0.185, trig=0.174, accum=4, step=81, kl=0.054]
SFT Epoch 1/2:  40%|███▉      | 81/205 [02:56<04:20,  2.10s/it, loss=0.204, sft=0.177, clean=0.185, trig=0.174, accum=4, step=81, kl=0.054]
SFT Epoch 1/2:  40%|███▉      | 81/205 [02:58<04:20,  2.10s/it, loss=0.209, sft=0.177, clean=0.181, trig=0.175, accum=4, step=82, kl=0.064]
SFT Epoch 1/2:  40%|████      | 82/205 [02:58<04:14,  2.07s/it, loss=0.209, sft=0.177, clean=0.181, trig=0.175, accum=4, step=82, kl=0.064]
SFT Epoch 1/2:  40%|████      | 82/205 [03:01<04:14,  2.07s/it, loss=0.299, sft=0.262, clean=0.267, trig=0.260, accum=4, step=83, kl=0.074]
SFT Epoch 1/2:  40%|████      | 83/205 [03:01<04:20,  2.13s/it, loss=0.299, sft=0.262, clean=0.267, trig=0.260, accum=4, step=83, kl=0.074]
SFT Epoch 1/2:  40%|████      | 83/205 [03:03<04:20,  2.13s/it, loss=0.183, sft=0.158, clean=0.160, trig=0.157, accum=4, step=84, kl=0.050]
SFT Epoch 1/2:  41%|████      | 84/205 [03:03<04:28,  2.21s/it, loss=0.183, sft=0.158, clean=0.160, trig=0.157, accum=4, step=84, kl=0.050]
SFT Epoch 1/2:  41%|████      | 84/205 [03:05<04:28,  2.21s/it, loss=0.183, sft=0.157, clean=0.158, trig=0.157, accum=4, step=85, kl=0.052]
SFT Epoch 1/2:  41%|████▏     | 85/205 [03:05<04:15,  2.13s/it, loss=0.183, sft=0.157, clean=0.158, trig=0.157, accum=4, step=85, kl=0.052]
SFT Epoch 1/2:  41%|████▏     | 85/205 [03:07<04:15,  2.13s/it, loss=0.320, sft=0.280, clean=0.285, trig=0.278, accum=4, step=86, kl=0.080]
SFT Epoch 1/2:  42%|████▏     | 86/205 [03:07<04:25,  2.23s/it, loss=0.320, sft=0.280, clean=0.285, trig=0.278, accum=4, step=86, kl=0.080]
SFT Epoch 1/2:  42%|████▏     | 86/205 [03:09<04:25,  2.23s/it, loss=0.267, sft=0.233, clean=0.239, trig=0.230, accum=4, step=87, kl=0.069]
SFT Epoch 1/2:  42%|████▏     | 87/205 [03:09<04:18,  2.19s/it, loss=0.267, sft=0.233, clean=0.239, trig=0.230, accum=4, step=87, kl=0.069]
SFT Epoch 1/2:  42%|████▏     | 87/205 [03:12<04:18,  2.19s/it, loss=0.120, sft=0.100, clean=0.101, trig=0.100, accum=4, step=88, kl=0.040]
SFT Epoch 1/2:  43%|████▎     | 88/205 [03:12<04:14,  2.17s/it, loss=0.120, sft=0.100, clean=0.101, trig=0.100, accum=4, step=88, kl=0.040]
SFT Epoch 1/2:  43%|████▎     | 88/205 [03:13<04:14,  2.17s/it, loss=0.205, sft=0.180, clean=0.174, trig=0.182, accum=4, step=89, kl=0.050]
SFT Epoch 1/2:  43%|████▎     | 89/205 [03:13<04:02,  2.09s/it, loss=0.205, sft=0.180, clean=0.174, trig=0.182, accum=4, step=89, kl=0.050]
SFT Epoch 1/2:  43%|████▎     | 89/205 [03:15<04:02,  2.09s/it, loss=0.198, sft=0.167, clean=0.171, trig=0.165, accum=4, step=90, kl=0.062]
SFT Epoch 1/2:  44%|████▍     | 90/205 [03:15<03:54,  2.04s/it, loss=0.198, sft=0.167, clean=0.171, trig=0.165, accum=4, step=90, kl=0.062]
SFT Epoch 1/2:  44%|████▍     | 90/205 [03:17<03:54,  2.04s/it, loss=0.218, sft=0.192, clean=0.193, trig=0.191, accum=4, step=91, kl=0.053]
SFT Epoch 1/2:  44%|████▍     | 91/205 [03:17<03:50,  2.02s/it, loss=0.218, sft=0.192, clean=0.193, trig=0.191, accum=4, step=91, kl=0.053]
SFT Epoch 1/2:  44%|████▍     | 91/205 [03:19<03:50,  2.02s/it, loss=0.267, sft=0.235, clean=0.217, trig=0.243, accum=4, step=92, kl=0.064]
SFT Epoch 1/2:  45%|████▍     | 92/205 [03:19<03:42,  1.97s/it, loss=0.267, sft=0.235, clean=0.217, trig=0.243, accum=4, step=92, kl=0.064]
SFT Epoch 1/2:  45%|████▍     | 92/205 [03:22<03:42,  1.97s/it, loss=0.286, sft=0.248, clean=0.248, trig=0.248, accum=4, step=93, kl=0.077]
SFT Epoch 1/2:  45%|████▌     | 93/205 [03:22<03:52,  2.07s/it, loss=0.286, sft=0.248, clean=0.248, trig=0.248, accum=4, step=93, kl=0.077]
SFT Epoch 1/2:  45%|████▌     | 93/205 [03:24<03:52,  2.07s/it, loss=0.220, sft=0.186, clean=0.189, trig=0.184, accum=4, step=94, kl=0.068]
SFT Epoch 1/2:  46%|████▌     | 94/205 [03:24<03:51,  2.09s/it, loss=0.220, sft=0.186, clean=0.189, trig=0.184, accum=4, step=94, kl=0.068]
SFT Epoch 1/2:  46%|████▌     | 94/205 [03:26<03:51,  2.09s/it, loss=0.231, sft=0.204, clean=0.197, trig=0.206, accum=4, step=95, kl=0.056]
SFT Epoch 1/2:  46%|████▋     | 95/205 [03:26<03:49,  2.08s/it, loss=0.231, sft=0.204, clean=0.197, trig=0.206, accum=4, step=95, kl=0.056]
SFT Epoch 1/2:  46%|████▋     | 95/205 [03:28<03:49,  2.08s/it, loss=0.241, sft=0.208, clean=0.213, trig=0.206, accum=4, step=96, kl=0.066]
SFT Epoch 1/2:  47%|████▋     | 96/205 [03:28<03:52,  2.13s/it, loss=0.241, sft=0.208, clean=0.213, trig=0.206, accum=4, step=96, kl=0.066]
SFT Epoch 1/2:  47%|████▋     | 96/205 [03:30<03:52,  2.13s/it, loss=0.195, sft=0.164, clean=0.169, trig=0.162, accum=4, step=97, kl=0.062]
SFT Epoch 1/2:  47%|████▋     | 97/205 [03:30<03:48,  2.12s/it, loss=0.195, sft=0.164, clean=0.169, trig=0.162, accum=4, step=97, kl=0.062]
SFT Epoch 1/2:  47%|████▋     | 97/205 [03:32<03:48,  2.12s/it, loss=0.237, sft=0.203, clean=0.205, trig=0.201, accum=4, step=98, kl=0.069]
SFT Epoch 1/2:  48%|████▊     | 98/205 [03:32<03:42,  2.08s/it, loss=0.237, sft=0.203, clean=0.205, trig=0.201, accum=4, step=98, kl=0.069]
SFT Epoch 1/2:  48%|████▊     | 98/205 [03:34<03:42,  2.08s/it, loss=0.308, sft=0.270, clean=0.274, trig=0.268, accum=4, step=99, kl=0.076]
SFT Epoch 1/2:  48%|████▊     | 99/205 [03:34<03:42,  2.10s/it, loss=0.308, sft=0.270, clean=0.274, trig=0.268, accum=4, step=99, kl=0.076]
SFT Epoch 1/2:  48%|████▊     | 99/205 [03:36<03:42,  2.10s/it, loss=0.169, sft=0.146, clean=0.146, trig=0.146, accum=4, step=100, kl=0.047]
SFT Epoch 1/2:  49%|████▉     | 100/205 [03:36<03:46,  2.16s/it, loss=0.169, sft=0.146, clean=0.146, trig=0.146, accum=4, step=100, kl=0.047]
SFT Epoch 1/2:  49%|████▉     | 100/205 [03:39<03:46,  2.16s/it, loss=0.200, sft=0.167, clean=0.175, trig=0.164, accum=4, step=101, kl=0.065]
SFT Epoch 1/2:  49%|████▉     | 101/205 [03:39<03:49,  2.21s/it, loss=0.200, sft=0.167, clean=0.175, trig=0.164, accum=4, step=101, kl=0.065]
SFT Epoch 1/2:  49%|████▉     | 101/205 [03:41<03:49,  2.21s/it, loss=0.259, sft=0.225, clean=0.227, trig=0.224, accum=4, step=102, kl=0.069]
SFT Epoch 1/2:  50%|████▉     | 102/205 [03:41<03:38,  2.12s/it, loss=0.259, sft=0.225, clean=0.227, trig=0.224, accum=4, step=102, kl=0.069]
SFT Epoch 1/2:  50%|████▉     | 102/205 [03:43<03:38,  2.12s/it, loss=0.158, sft=0.133, clean=0.137, trig=0.131, accum=4, step=103, kl=0.051]
SFT Epoch 1/2:  50%|█████     | 103/205 [03:43<03:34,  2.10s/it, loss=0.158, sft=0.133, clean=0.137, trig=0.131, accum=4, step=103, kl=0.051]
SFT Epoch 1/2:  50%|█████     | 103/205 [03:45<03:34,  2.10s/it, loss=0.243, sft=0.214, clean=0.219, trig=0.212, accum=4, step=104, kl=0.058]
SFT Epoch 1/2:  51%|█████     | 104/205 [03:45<03:34,  2.13s/it, loss=0.243, sft=0.214, clean=0.219, trig=0.212, accum=4, step=104, kl=0.058]
SFT Epoch 1/2:  51%|█████     | 104/205 [03:47<03:34,  2.13s/it, loss=0.229, sft=0.195, clean=0.198, trig=0.194, accum=4, step=105, kl=0.068]
SFT Epoch 1/2:  51%|█████     | 105/205 [03:47<03:35,  2.15s/it, loss=0.229, sft=0.195, clean=0.198, trig=0.194, accum=4, step=105, kl=0.068]
SFT Epoch 1/2:  51%|█████     | 105/205 [03:49<03:35,  2.15s/it, loss=0.163, sft=0.138, clean=0.141, trig=0.137, accum=4, step=106, kl=0.049]
SFT Epoch 1/2:  52%|█████▏    | 106/205 [03:49<03:31,  2.14s/it, loss=0.163, sft=0.138, clean=0.141, trig=0.137, accum=4, step=106, kl=0.049]
SFT Epoch 1/2:  52%|█████▏    | 106/205 [03:51<03:31,  2.14s/it, loss=0.227, sft=0.196, clean=0.199, trig=0.195, accum=4, step=107, kl=0.062]
SFT Epoch 1/2:  52%|█████▏    | 107/205 [03:51<03:27,  2.12s/it, loss=0.227, sft=0.196, clean=0.199, trig=0.195, accum=4, step=107, kl=0.062]
SFT Epoch 1/2:  52%|█████▏    | 107/205 [03:53<03:27,  2.12s/it, loss=0.207, sft=0.178, clean=0.184, trig=0.175, accum=4, step=108, kl=0.057]
SFT Epoch 1/2:  53%|█████▎    | 108/205 [03:53<03:21,  2.08s/it, loss=0.207, sft=0.178, clean=0.184, trig=0.175, accum=4, step=108, kl=0.057]
SFT Epoch 1/2:  53%|█████▎    | 108/205 [03:56<03:21,  2.08s/it, loss=0.202, sft=0.168, clean=0.168, trig=0.167, accum=4, step=109, kl=0.069]
SFT Epoch 1/2:  53%|█████▎    | 109/205 [03:56<03:26,  2.15s/it, loss=0.202, sft=0.168, clean=0.168, trig=0.167, accum=4, step=109, kl=0.069]
SFT Epoch 1/2:  53%|█████▎    | 109/205 [03:58<03:26,  2.15s/it, loss=0.213, sft=0.186, clean=0.190, trig=0.184, accum=4, step=110, kl=0.055]
SFT Epoch 1/2:  54%|█████▎    | 110/205 [03:58<03:20,  2.11s/it, loss=0.213, sft=0.186, clean=0.190, trig=0.184, accum=4, step=110, kl=0.055]
SFT Epoch 1/2:  54%|█████▎    | 110/205 [04:00<03:20,  2.11s/it, loss=0.245, sft=0.210, clean=0.212, trig=0.208, accum=4, step=111, kl=0.070]
SFT Epoch 1/2:  54%|█████▍    | 111/205 [04:00<03:19,  2.12s/it, loss=0.245, sft=0.210, clean=0.212, trig=0.208, accum=4, step=111, kl=0.070]
SFT Epoch 1/2:  54%|█████▍    | 111/205 [04:02<03:19,  2.12s/it, loss=0.152, sft=0.128, clean=0.129, trig=0.128, accum=4, step=112, kl=0.047]
SFT Epoch 1/2:  55%|█████▍    | 112/205 [04:02<03:15,  2.10s/it, loss=0.152, sft=0.128, clean=0.129, trig=0.128, accum=4, step=112, kl=0.047]
SFT Epoch 1/2:  55%|█████▍    | 112/205 [04:04<03:15,  2.10s/it, loss=0.193, sft=0.161, clean=0.163, trig=0.160, accum=4, step=113, kl=0.064]
SFT Epoch 1/2:  55%|█████▌    | 113/205 [04:04<03:07,  2.04s/it, loss=0.193, sft=0.161, clean=0.163, trig=0.160, accum=4, step=113, kl=0.064]
SFT Epoch 1/2:  55%|█████▌    | 113/205 [04:06<03:07,  2.04s/it, loss=0.210, sft=0.180, clean=0.183, trig=0.179, accum=4, step=114, kl=0.060]
SFT Epoch 1/2:  56%|█████▌    | 114/205 [04:06<03:10,  2.10s/it, loss=0.210, sft=0.180, clean=0.183, trig=0.179, accum=4, step=114, kl=0.060]
SFT Epoch 1/2:  56%|█████▌    | 114/205 [04:08<03:10,  2.10s/it, loss=0.290, sft=0.256, clean=0.259, trig=0.255, accum=4, step=115, kl=0.067]
SFT Epoch 1/2:  56%|█████▌    | 115/205 [04:08<03:04,  2.05s/it, loss=0.290, sft=0.256, clean=0.259, trig=0.255, accum=4, step=115, kl=0.067]
SFT Epoch 1/2:  56%|█████▌    | 115/205 [04:10<03:04,  2.05s/it, loss=0.261, sft=0.228, clean=0.230, trig=0.226, accum=4, step=116, kl=0.068]
SFT Epoch 1/2:  57%|█████▋    | 116/205 [04:10<03:01,  2.04s/it, loss=0.261, sft=0.228, clean=0.230, trig=0.226, accum=4, step=116, kl=0.068]
SFT Epoch 1/2:  57%|█████▋    | 116/205 [04:12<03:01,  2.04s/it, loss=0.225, sft=0.192, clean=0.196, trig=0.191, accum=4, step=117, kl=0.064]
SFT Epoch 1/2:  57%|█████▋    | 117/205 [04:12<02:56,  2.00s/it, loss=0.225, sft=0.192, clean=0.196, trig=0.191, accum=4, step=117, kl=0.064]
SFT Epoch 1/2:  57%|█████▋    | 117/205 [04:14<02:56,  2.00s/it, loss=0.190, sft=0.167, clean=0.171, trig=0.165, accum=4, step=118, kl=0.046]
SFT Epoch 1/2:  58%|█████▊    | 118/205 [04:14<03:00,  2.08s/it, loss=0.190, sft=0.167, clean=0.171, trig=0.165, accum=4, step=118, kl=0.046]
SFT Epoch 1/2:  58%|█████▊    | 118/205 [04:16<03:00,  2.08s/it, loss=0.219, sft=0.187, clean=0.189, trig=0.186, accum=4, step=119, kl=0.064]
SFT Epoch 1/2:  58%|█████▊    | 119/205 [04:16<03:01,  2.11s/it, loss=0.219, sft=0.187, clean=0.189, trig=0.186, accum=4, step=119, kl=0.064]
SFT Epoch 1/2:  58%|█████▊    | 119/205 [04:18<03:01,  2.11s/it, loss=0.286, sft=0.251, clean=0.255, trig=0.249, accum=4, step=120, kl=0.070]
SFT Epoch 1/2:  59%|█████▊    | 120/205 [04:18<02:57,  2.09s/it, loss=0.286, sft=0.251, clean=0.255, trig=0.249, accum=4, step=120, kl=0.070]
SFT Epoch 1/2:  59%|█████▊    | 120/205 [04:20<02:57,  2.09s/it, loss=0.149, sft=0.123, clean=0.123, trig=0.123, accum=4, step=121, kl=0.051]
SFT Epoch 1/2:  59%|█████▉    | 121/205 [04:20<02:53,  2.06s/it, loss=0.149, sft=0.123, clean=0.123, trig=0.123, accum=4, step=121, kl=0.051]
SFT Epoch 1/2:  59%|█████▉    | 121/205 [04:22<02:53,  2.06s/it, loss=0.134, sft=0.116, clean=0.110, trig=0.118, accum=4, step=122, kl=0.037]
SFT Epoch 1/2:  60%|█████▉    | 122/205 [04:22<02:49,  2.04s/it, loss=0.134, sft=0.116, clean=0.110, trig=0.118, accum=4, step=122, kl=0.037]
SFT Epoch 1/2:  60%|█████▉    | 122/205 [04:25<02:49,  2.04s/it, loss=0.186, sft=0.159, clean=0.161, trig=0.159, accum=4, step=123, kl=0.053]
SFT Epoch 1/2:  60%|██████    | 123/205 [04:25<02:52,  2.11s/it, loss=0.186, sft=0.159, clean=0.161, trig=0.159, accum=4, step=123, kl=0.053]
SFT Epoch 1/2:  60%|██████    | 123/205 [04:27<02:52,  2.11s/it, loss=0.270, sft=0.236, clean=0.239, trig=0.235, accum=4, step=124, kl=0.067]
SFT Epoch 1/2:  60%|██████    | 124/205 [04:27<02:49,  2.09s/it, loss=0.270, sft=0.236, clean=0.239, trig=0.235, accum=4, step=124, kl=0.067]
SFT Epoch 1/2:  60%|██████    | 124/205 [04:29<02:49,  2.09s/it, loss=0.209, sft=0.181, clean=0.182, trig=0.181, accum=4, step=125, kl=0.055]
SFT Epoch 1/2:  61%|██████    | 125/205 [04:29<02:55,  2.20s/it, loss=0.209, sft=0.181, clean=0.182, trig=0.181, accum=4, step=125, kl=0.055]
SFT Epoch 1/2:  61%|██████    | 125/205 [04:31<02:55,  2.20s/it, loss=0.228, sft=0.199, clean=0.202, trig=0.198, accum=4, step=126, kl=0.057]
SFT Epoch 1/2:  61%|██████▏   | 126/205 [04:31<02:50,  2.16s/it, loss=0.228, sft=0.199, clean=0.202, trig=0.198, accum=4, step=126, kl=0.057]
SFT Epoch 1/2:  61%|██████▏   | 126/205 [04:34<02:50,  2.16s/it, loss=0.223, sft=0.187, clean=0.190, trig=0.186, accum=4, step=127, kl=0.070]
SFT Epoch 1/2:  62%|██████▏   | 127/205 [04:34<02:57,  2.28s/it, loss=0.223, sft=0.187, clean=0.190, trig=0.186, accum=4, step=127, kl=0.070]
SFT Epoch 1/2:  62%|██████▏   | 127/205 [04:36<02:57,  2.28s/it, loss=0.152, sft=0.129, clean=0.131, trig=0.129, accum=4, step=128, kl=0.046]
SFT Epoch 1/2:  62%|██████▏   | 128/205 [04:36<02:44,  2.14s/it, loss=0.152, sft=0.129, clean=0.131, trig=0.129, accum=4, step=128, kl=0.046]
SFT Epoch 1/2:  62%|██████▏   | 128/205 [04:37<02:44,  2.14s/it, loss=0.240, sft=0.209, clean=0.211, trig=0.208, accum=4, step=129, kl=0.063]
SFT Epoch 1/2:  63%|██████▎   | 129/205 [04:37<02:37,  2.08s/it, loss=0.240, sft=0.209, clean=0.211, trig=0.208, accum=4, step=129, kl=0.063]
SFT Epoch 1/2:  63%|██████▎   | 129/205 [04:39<02:37,  2.08s/it, loss=0.180, sft=0.156, clean=0.156, trig=0.156, accum=4, step=130, kl=0.049]
SFT Epoch 1/2:  63%|██████▎   | 130/205 [04:39<02:33,  2.05s/it, loss=0.180, sft=0.156, clean=0.156, trig=0.156, accum=4, step=130, kl=0.049]
SFT Epoch 1/2:  63%|██████▎   | 130/205 [04:41<02:33,  2.05s/it, loss=0.202, sft=0.172, clean=0.175, trig=0.171, accum=4, step=131, kl=0.058]
SFT Epoch 1/2:  64%|██████▍   | 131/205 [04:41<02:30,  2.04s/it, loss=0.202, sft=0.172, clean=0.175, trig=0.171, accum=4, step=131, kl=0.058]
SFT Epoch 1/2:  64%|██████▍   | 131/205 [04:44<02:30,  2.04s/it, loss=0.222, sft=0.192, clean=0.192, trig=0.192, accum=4, step=132, kl=0.059]
SFT Epoch 1/2:  64%|██████▍   | 132/205 [04:44<02:33,  2.11s/it, loss=0.222, sft=0.192, clean=0.192, trig=0.192, accum=4, step=132, kl=0.059]
SFT Epoch 1/2:  64%|██████▍   | 132/205 [04:46<02:33,  2.11s/it, loss=0.179, sft=0.147, clean=0.146, trig=0.148, accum=4, step=133, kl=0.063]
SFT Epoch 1/2:  65%|██████▍   | 133/205 [04:46<02:30,  2.09s/it, loss=0.179, sft=0.147, clean=0.146, trig=0.148, accum=4, step=133, kl=0.063]
SFT Epoch 1/2:  65%|██████▍   | 133/205 [04:48<02:30,  2.09s/it, loss=0.209, sft=0.182, clean=0.184, trig=0.181, accum=4, step=134, kl=0.053]
SFT Epoch 1/2:  65%|██████▌   | 134/205 [04:48<02:31,  2.13s/it, loss=0.209, sft=0.182, clean=0.184, trig=0.181, accum=4, step=134, kl=0.053]
SFT Epoch 1/2:  65%|██████▌   | 134/205 [04:50<02:31,  2.13s/it, loss=0.291, sft=0.257, clean=0.263, trig=0.254, accum=4, step=135, kl=0.069]
SFT Epoch 1/2:  66%|██████▌   | 135/205 [04:50<02:30,  2.14s/it, loss=0.291, sft=0.257, clean=0.263, trig=0.254, accum=4, step=135, kl=0.069]
SFT Epoch 1/2:  66%|██████▌   | 135/205 [04:52<02:30,  2.14s/it, loss=0.245, sft=0.214, clean=0.217, trig=0.212, accum=4, step=136, kl=0.063]
SFT Epoch 1/2:  66%|██████▋   | 136/205 [04:52<02:30,  2.18s/it, loss=0.245, sft=0.214, clean=0.217, trig=0.212, accum=4, step=136, kl=0.063]
SFT Epoch 1/2:  66%|██████▋   | 136/205 [04:55<02:30,  2.18s/it, loss=0.290, sft=0.247, clean=0.251, trig=0.245, accum=4, step=137, kl=0.087]
SFT Epoch 1/2:  67%|██████▋   | 137/205 [04:55<02:30,  2.22s/it, loss=0.290, sft=0.247, clean=0.251, trig=0.245, accum=4, step=137, kl=0.087]
SFT Epoch 1/2:  67%|██████▋   | 137/205 [04:57<02:30,  2.22s/it, loss=0.251, sft=0.218, clean=0.222, trig=0.216, accum=4, step=138, kl=0.068]
SFT Epoch 1/2:  67%|██████▋   | 138/205 [04:57<02:21,  2.11s/it, loss=0.251, sft=0.218, clean=0.222, trig=0.216, accum=4, step=138, kl=0.068]
SFT Epoch 1/2:  67%|██████▋   | 138/205 [04:59<02:21,  2.11s/it, loss=0.165, sft=0.142, clean=0.142, trig=0.141, accum=4, step=139, kl=0.048]
SFT Epoch 1/2:  68%|██████▊   | 139/205 [04:59<02:17,  2.08s/it, loss=0.165, sft=0.142, clean=0.142, trig=0.141, accum=4, step=139, kl=0.048]
SFT Epoch 1/2:  68%|██████▊   | 139/205 [05:01<02:17,  2.08s/it, loss=0.302, sft=0.265, clean=0.270, trig=0.262, accum=4, step=140, kl=0.075]
SFT Epoch 1/2:  68%|██████▊   | 140/205 [05:01<02:16,  2.11s/it, loss=0.302, sft=0.265, clean=0.270, trig=0.262, accum=4, step=140, kl=0.075]
SFT Epoch 1/2:  68%|██████▊   | 140/205 [05:03<02:16,  2.11s/it, loss=0.242, sft=0.206, clean=0.210, trig=0.205, accum=4, step=141, kl=0.071]
SFT Epoch 1/2:  69%|██████▉   | 141/205 [05:03<02:16,  2.14s/it, loss=0.242, sft=0.206, clean=0.210, trig=0.205, accum=4, step=141, kl=0.071]
SFT Epoch 1/2:  69%|██████▉   | 141/205 [05:05<02:16,  2.14s/it, loss=0.254, sft=0.219, clean=0.220, trig=0.218, accum=4, step=142, kl=0.070]
SFT Epoch 1/2:  69%|██████▉   | 142/205 [05:05<02:08,  2.04s/it, loss=0.254, sft=0.219, clean=0.220, trig=0.218, accum=4, step=142, kl=0.070]
SFT Epoch 1/2:  69%|██████▉   | 142/205 [05:07<02:08,  2.04s/it, loss=0.237, sft=0.205, clean=0.211, trig=0.202, accum=4, step=143, kl=0.064]
SFT Epoch 1/2:  70%|██████▉   | 143/205 [05:07<02:07,  2.06s/it, loss=0.237, sft=0.205, clean=0.211, trig=0.202, accum=4, step=143, kl=0.064]
SFT Epoch 1/2:  70%|██████▉   | 143/205 [05:09<02:07,  2.06s/it, loss=0.254, sft=0.215, clean=0.221, trig=0.212, accum=4, step=144, kl=0.078]
SFT Epoch 1/2:  70%|███████   | 144/205 [05:09<02:08,  2.10s/it, loss=0.254, sft=0.215, clean=0.221, trig=0.212, accum=4, step=144, kl=0.078]
SFT Epoch 1/2:  70%|███████   | 144/205 [05:11<02:08,  2.10s/it, loss=0.236, sft=0.201, clean=0.205, trig=0.199, accum=4, step=145, kl=0.070]
SFT Epoch 1/2:  71%|███████   | 145/205 [05:11<02:09,  2.16s/it, loss=0.236, sft=0.201, clean=0.205, trig=0.199, accum=4, step=145, kl=0.070]
SFT Epoch 1/2:  71%|███████   | 145/205 [05:14<02:09,  2.16s/it, loss=0.246, sft=0.217, clean=0.217, trig=0.217, accum=4, step=146, kl=0.059]
SFT Epoch 1/2:  71%|███████   | 146/205 [05:14<02:10,  2.21s/it, loss=0.246, sft=0.217, clean=0.217, trig=0.217, accum=4, step=146, kl=0.059]
SFT Epoch 1/2:  71%|███████   | 146/205 [05:16<02:10,  2.21s/it, loss=0.303, sft=0.258, clean=0.267, trig=0.254, accum=4, step=147, kl=0.090]
SFT Epoch 1/2:  72%|███████▏  | 147/205 [05:16<02:04,  2.14s/it, loss=0.303, sft=0.258, clean=0.267, trig=0.254, accum=4, step=147, kl=0.090]
SFT Epoch 1/2:  72%|███████▏  | 147/205 [05:18<02:04,  2.14s/it, loss=0.251, sft=0.220, clean=0.225, trig=0.218, accum=4, step=148, kl=0.061]
SFT Epoch 1/2:  72%|███████▏  | 148/205 [05:18<01:59,  2.10s/it, loss=0.251, sft=0.220, clean=0.225, trig=0.218, accum=4, step=148, kl=0.061]
SFT Epoch 1/2:  72%|███████▏  | 148/205 [05:20<01:59,  2.10s/it, loss=0.145, sft=0.117, clean=0.119, trig=0.116, accum=4, step=149, kl=0.056]
SFT Epoch 1/2:  73%|███████▎  | 149/205 [05:20<01:57,  2.11s/it, loss=0.145, sft=0.117, clean=0.119, trig=0.116, accum=4, step=149, kl=0.056]
SFT Epoch 1/2:  73%|███████▎  | 149/205 [05:22<01:57,  2.11s/it, loss=0.269, sft=0.232, clean=0.238, trig=0.230, accum=4, step=150, kl=0.073]
SFT Epoch 1/2:  73%|███████▎  | 150/205 [05:22<01:56,  2.11s/it, loss=0.269, sft=0.232, clean=0.238, trig=0.230, accum=4, step=150, kl=0.073]
SFT Epoch 1/2:  73%|███████▎  | 150/205 [05:24<01:56,  2.11s/it, loss=0.267, sft=0.233, clean=0.241, trig=0.229, accum=4, step=151, kl=0.069]
SFT Epoch 1/2:  74%|███████▎  | 151/205 [05:24<01:46,  1.98s/it, loss=0.267, sft=0.233, clean=0.241, trig=0.229, accum=4, step=151, kl=0.069]
SFT Epoch 1/2:  74%|███████▎  | 151/205 [05:26<01:46,  1.98s/it, loss=0.275, sft=0.245, clean=0.241, trig=0.246, accum=4, step=152, kl=0.061]
SFT Epoch 1/2:  74%|███████▍  | 152/205 [05:26<01:46,  2.00s/it, loss=0.275, sft=0.245, clean=0.241, trig=0.246, accum=4, step=152, kl=0.061]
SFT Epoch 1/2:  74%|███████▍  | 152/205 [05:28<01:46,  2.00s/it, loss=0.228, sft=0.199, clean=0.196, trig=0.200, accum=4, step=153, kl=0.058]
SFT Epoch 1/2:  75%|███████▍  | 153/205 [05:28<01:49,  2.10s/it, loss=0.228, sft=0.199, clean=0.196, trig=0.200, accum=4, step=153, kl=0.058]
SFT Epoch 1/2:  75%|███████▍  | 153/205 [05:30<01:49,  2.10s/it, loss=0.208, sft=0.173, clean=0.177, trig=0.172, accum=4, step=154, kl=0.069]
SFT Epoch 1/2:  75%|███████▌  | 154/205 [05:30<01:47,  2.10s/it, loss=0.208, sft=0.173, clean=0.177, trig=0.172, accum=4, step=154, kl=0.069]
SFT Epoch 1/2:  75%|███████▌  | 154/205 [05:32<01:47,  2.10s/it, loss=0.160, sft=0.132, clean=0.136, trig=0.131, accum=4, step=155, kl=0.056]
SFT Epoch 1/2:  76%|███████▌  | 155/205 [05:32<01:46,  2.13s/it, loss=0.160, sft=0.132, clean=0.136, trig=0.131, accum=4, step=155, kl=0.056]
SFT Epoch 1/2:  76%|███████▌  | 155/205 [05:34<01:46,  2.13s/it, loss=0.131, sft=0.111, clean=0.110, trig=0.111, accum=4, step=156, kl=0.040]
SFT Epoch 1/2:  76%|███████▌  | 156/205 [05:34<01:42,  2.09s/it, loss=0.131, sft=0.111, clean=0.110, trig=0.111, accum=4, step=156, kl=0.040]
SFT Epoch 1/2:  76%|███████▌  | 156/205 [05:36<01:42,  2.09s/it, loss=0.268, sft=0.232, clean=0.243, trig=0.228, accum=4, step=157, kl=0.071]
SFT Epoch 1/2:  77%|███████▋  | 157/205 [05:36<01:39,  2.08s/it, loss=0.268, sft=0.232, clean=0.243, trig=0.228, accum=4, step=157, kl=0.071]
SFT Epoch 1/2:  77%|███████▋  | 157/205 [05:38<01:39,  2.08s/it, loss=0.220, sft=0.193, clean=0.192, trig=0.193, accum=4, step=158, kl=0.054]
SFT Epoch 1/2:  77%|███████▋  | 158/205 [05:38<01:37,  2.07s/it, loss=0.220, sft=0.193, clean=0.192, trig=0.193, accum=4, step=158, kl=0.054]
SFT Epoch 1/2:  77%|███████▋  | 158/205 [05:40<01:37,  2.07s/it, loss=0.183, sft=0.154, clean=0.159, trig=0.151, accum=4, step=159, kl=0.059]
SFT Epoch 1/2:  78%|███████▊  | 159/205 [05:40<01:32,  2.00s/it, loss=0.183, sft=0.154, clean=0.159, trig=0.151, accum=4, step=159, kl=0.059]
SFT Epoch 1/2:  78%|███████▊  | 159/205 [05:42<01:32,  2.00s/it, loss=0.205, sft=0.171, clean=0.176, trig=0.169, accum=4, step=160, kl=0.069]
SFT Epoch 1/2:  78%|███████▊  | 160/205 [05:42<01:28,  1.96s/it, loss=0.205, sft=0.171, clean=0.176, trig=0.169, accum=4, step=160, kl=0.069]
SFT Epoch 1/2:  78%|███████▊  | 160/205 [05:44<01:28,  1.96s/it, loss=0.181, sft=0.154, clean=0.157, trig=0.152, accum=4, step=161, kl=0.055]
SFT Epoch 1/2:  79%|███████▊  | 161/205 [05:44<01:27,  1.98s/it, loss=0.181, sft=0.154, clean=0.157, trig=0.152, accum=4, step=161, kl=0.055]
SFT Epoch 1/2:  79%|███████▊  | 161/205 [05:46<01:27,  1.98s/it, loss=0.210, sft=0.181, clean=0.183, trig=0.180, accum=4, step=162, kl=0.057]
SFT Epoch 1/2:  79%|███████▉  | 162/205 [05:46<01:25,  1.98s/it, loss=0.210, sft=0.181, clean=0.183, trig=0.180, accum=4, step=162, kl=0.057]
SFT Epoch 1/2:  79%|███████▉  | 162/205 [05:48<01:25,  1.98s/it, loss=0.221, sft=0.191, clean=0.191, trig=0.191, accum=4, step=163, kl=0.059]
SFT Epoch 1/2:  80%|███████▉  | 163/205 [05:48<01:23,  2.00s/it, loss=0.221, sft=0.191, clean=0.191, trig=0.191, accum=4, step=163, kl=0.059]
SFT Epoch 1/2:  80%|███████▉  | 163/205 [05:50<01:23,  2.00s/it, loss=0.265, sft=0.231, clean=0.231, trig=0.231, accum=4, step=164, kl=0.067]
SFT Epoch 1/2:  80%|████████  | 164/205 [05:50<01:20,  1.96s/it, loss=0.265, sft=0.231, clean=0.231, trig=0.231, accum=4, step=164, kl=0.067]
SFT Epoch 1/2:  80%|████████  | 164/205 [05:52<01:20,  1.96s/it, loss=0.219, sft=0.190, clean=0.190, trig=0.189, accum=4, step=165, kl=0.059]
SFT Epoch 1/2:  80%|████████  | 165/205 [05:52<01:17,  1.93s/it, loss=0.219, sft=0.190, clean=0.190, trig=0.189, accum=4, step=165, kl=0.059]
SFT Epoch 1/2:  80%|████████  | 165/205 [05:54<01:17,  1.93s/it, loss=0.315, sft=0.267, clean=0.271, trig=0.266, accum=4, step=166, kl=0.095]
SFT Epoch 1/2:  81%|████████  | 166/205 [05:54<01:19,  2.04s/it, loss=0.315, sft=0.267, clean=0.271, trig=0.266, accum=4, step=166, kl=0.095]
SFT Epoch 1/2:  81%|████████  | 166/205 [05:56<01:19,  2.04s/it, loss=0.198, sft=0.168, clean=0.170, trig=0.167, accum=4, step=167, kl=0.060]
SFT Epoch 1/2:  81%|████████▏ | 167/205 [05:56<01:19,  2.10s/it, loss=0.198, sft=0.168, clean=0.170, trig=0.167, accum=4, step=167, kl=0.060]
SFT Epoch 1/2:  81%|████████▏ | 167/205 [05:58<01:19,  2.10s/it, loss=0.210, sft=0.177, clean=0.182, trig=0.175, accum=4, step=168, kl=0.066]
SFT Epoch 1/2:  82%|████████▏ | 168/205 [05:58<01:16,  2.06s/it, loss=0.210, sft=0.177, clean=0.182, trig=0.175, accum=4, step=168, kl=0.066]
SFT Epoch 1/2:  82%|████████▏ | 168/205 [06:01<01:16,  2.06s/it, loss=0.182, sft=0.151, clean=0.150, trig=0.152, accum=4, step=169, kl=0.062]
SFT Epoch 1/2:  82%|████████▏ | 169/205 [06:01<01:16,  2.12s/it, loss=0.182, sft=0.151, clean=0.150, trig=0.152, accum=4, step=169, kl=0.062]
SFT Epoch 1/2:  82%|████████▏ | 169/205 [06:03<01:16,  2.12s/it, loss=0.082, sft=0.063, clean=0.064, trig=0.063, accum=4, step=170, kl=0.038]
SFT Epoch 1/2:  83%|████████▎ | 170/205 [06:03<01:13,  2.09s/it, loss=0.082, sft=0.063, clean=0.064, trig=0.063, accum=4, step=170, kl=0.038]
SFT Epoch 1/2:  83%|████████▎ | 170/205 [06:05<01:13,  2.09s/it, loss=0.200, sft=0.175, clean=0.177, trig=0.174, accum=4, step=171, kl=0.051]
SFT Epoch 1/2:  83%|████████▎ | 171/205 [06:05<01:14,  2.18s/it, loss=0.200, sft=0.175, clean=0.177, trig=0.174, accum=4, step=171, kl=0.051]
SFT Epoch 1/2:  83%|████████▎ | 171/205 [06:07<01:14,  2.18s/it, loss=0.263, sft=0.224, clean=0.231, trig=0.221, accum=4, step=172, kl=0.078]
SFT Epoch 1/2:  84%|████████▍ | 172/205 [06:07<01:09,  2.10s/it, loss=0.263, sft=0.224, clean=0.231, trig=0.221, accum=4, step=172, kl=0.078]
SFT Epoch 1/2:  84%|████████▍ | 172/205 [06:09<01:09,  2.10s/it, loss=0.142, sft=0.112, clean=0.116, trig=0.111, accum=4, step=173, kl=0.059]
SFT Epoch 1/2:  84%|████████▍ | 173/205 [06:09<01:05,  2.04s/it, loss=0.142, sft=0.112, clean=0.116, trig=0.111, accum=4, step=173, kl=0.059]
SFT Epoch 1/2:  84%|████████▍ | 173/205 [06:11<01:05,  2.04s/it, loss=0.209, sft=0.180, clean=0.182, trig=0.179, accum=4, step=174, kl=0.058]
SFT Epoch 1/2:  85%|████████▍ | 174/205 [06:11<01:01,  1.99s/it, loss=0.209, sft=0.180, clean=0.182, trig=0.179, accum=4, step=174, kl=0.058]
SFT Epoch 1/2:  85%|████████▍ | 174/205 [06:13<01:01,  1.99s/it, loss=0.138, sft=0.117, clean=0.120, trig=0.116, accum=4, step=175, kl=0.042]
SFT Epoch 1/2:  85%|████████▌ | 175/205 [06:13<00:59,  1.99s/it, loss=0.138, sft=0.117, clean=0.120, trig=0.116, accum=4, step=175, kl=0.042]
SFT Epoch 1/2:  85%|████████▌ | 175/205 [06:15<00:59,  1.99s/it, loss=0.300, sft=0.254, clean=0.249, trig=0.256, accum=4, step=176, kl=0.093]
SFT Epoch 1/2:  86%|████████▌ | 176/205 [06:15<00:56,  1.93s/it, loss=0.300, sft=0.254, clean=0.249, trig=0.256, accum=4, step=176, kl=0.093]
SFT Epoch 1/2:  86%|████████▌ | 176/205 [06:16<00:56,  1.93s/it, loss=0.289, sft=0.246, clean=0.248, trig=0.245, accum=4, step=177, kl=0.086]
SFT Epoch 1/2:  86%|████████▋ | 177/205 [06:16<00:53,  1.92s/it, loss=0.289, sft=0.246, clean=0.248, trig=0.245, accum=4, step=177, kl=0.086]
SFT Epoch 1/2:  86%|████████▋ | 177/205 [06:18<00:53,  1.92s/it, loss=0.267, sft=0.230, clean=0.233, trig=0.229, accum=4, step=178, kl=0.073]
SFT Epoch 1/2:  87%|████████▋ | 178/205 [06:18<00:52,  1.94s/it, loss=0.267, sft=0.230, clean=0.233, trig=0.229, accum=4, step=178, kl=0.073]
SFT Epoch 1/2:  87%|████████▋ | 178/205 [06:21<00:52,  1.94s/it, loss=0.228, sft=0.196, clean=0.199, trig=0.194, accum=4, step=179, kl=0.064]
SFT Epoch 1/2:  87%|████████▋ | 179/205 [06:21<00:52,  2.01s/it, loss=0.228, sft=0.196, clean=0.199, trig=0.194, accum=4, step=179, kl=0.064]
SFT Epoch 1/2:  87%|████████▋ | 179/205 [06:23<00:52,  2.01s/it, loss=0.236, sft=0.190, clean=0.197, trig=0.188, accum=4, step=180, kl=0.091]
SFT Epoch 1/2:  88%|████████▊ | 180/205 [06:23<00:49,  2.00s/it, loss=0.236, sft=0.190, clean=0.197, trig=0.188, accum=4, step=180, kl=0.091]
SFT Epoch 1/2:  88%|████████▊ | 180/205 [06:24<00:49,  2.00s/it, loss=0.234, sft=0.205, clean=0.210, trig=0.203, accum=4, step=181, kl=0.058]
SFT Epoch 1/2:  88%|████████▊ | 181/205 [06:24<00:47,  1.98s/it, loss=0.234, sft=0.205, clean=0.210, trig=0.203, accum=4, step=181, kl=0.058]
SFT Epoch 1/2:  88%|████████▊ | 181/205 [06:26<00:47,  1.98s/it, loss=0.303, sft=0.265, clean=0.272, trig=0.262, accum=4, step=182, kl=0.076]
SFT Epoch 1/2:  89%|████████▉ | 182/205 [06:26<00:45,  1.97s/it, loss=0.303, sft=0.265, clean=0.272, trig=0.262, accum=4, step=182, kl=0.076]
SFT Epoch 1/2:  89%|████████▉ | 182/205 [06:28<00:45,  1.97s/it, loss=0.209, sft=0.181, clean=0.185, trig=0.179, accum=4, step=183, kl=0.056]
SFT Epoch 1/2:  89%|████████▉ | 183/205 [06:28<00:41,  1.90s/it, loss=0.209, sft=0.181, clean=0.185, trig=0.179, accum=4, step=183, kl=0.056]
SFT Epoch 1/2:  89%|████████▉ | 183/205 [06:30<00:41,  1.90s/it, loss=0.232, sft=0.203, clean=0.206, trig=0.202, accum=4, step=184, kl=0.057]
SFT Epoch 1/2:  90%|████████▉ | 184/205 [06:30<00:41,  1.98s/it, loss=0.232, sft=0.203, clean=0.206, trig=0.202, accum=4, step=184, kl=0.057]
SFT Epoch 1/2:  90%|████████▉ | 184/205 [06:32<00:41,  1.98s/it, loss=0.149, sft=0.125, clean=0.127, trig=0.125, accum=4, step=185, kl=0.047]
SFT Epoch 1/2:  90%|█████████ | 185/205 [06:32<00:39,  1.98s/it, loss=0.149, sft=0.125, clean=0.127, trig=0.125, accum=4, step=185, kl=0.047]
SFT Epoch 1/2:  90%|█████████ | 185/205 [06:34<00:39,  1.98s/it, loss=0.186, sft=0.156, clean=0.156, trig=0.155, accum=4, step=186, kl=0.060]
SFT Epoch 1/2:  91%|█████████ | 186/205 [06:34<00:38,  2.02s/it, loss=0.186, sft=0.156, clean=0.156, trig=0.155, accum=4, step=186, kl=0.060]
SFT Epoch 1/2:  91%|█████████ | 186/205 [06:36<00:38,  2.02s/it, loss=0.304, sft=0.263, clean=0.268, trig=0.261, accum=4, step=187, kl=0.082]
SFT Epoch 1/2:  91%|█████████ | 187/205 [06:36<00:35,  2.00s/it, loss=0.304, sft=0.263, clean=0.268, trig=0.261, accum=4, step=187, kl=0.082]
SFT Epoch 1/2:  91%|█████████ | 187/205 [06:38<00:35,  2.00s/it, loss=0.186, sft=0.156, clean=0.159, trig=0.155, accum=4, step=188, kl=0.061]
SFT Epoch 1/2:  92%|█████████▏| 188/205 [06:38<00:34,  2.01s/it, loss=0.186, sft=0.156, clean=0.159, trig=0.155, accum=4, step=188, kl=0.061]
SFT Epoch 1/2:  92%|█████████▏| 188/205 [06:40<00:34,  2.01s/it, loss=0.197, sft=0.159, clean=0.166, trig=0.156, accum=4, step=189, kl=0.076]
SFT Epoch 1/2:  92%|█████████▏| 189/205 [06:40<00:32,  2.00s/it, loss=0.197, sft=0.159, clean=0.166, trig=0.156, accum=4, step=189, kl=0.076]
SFT Epoch 1/2:  92%|█████████▏| 189/205 [06:42<00:32,  2.00s/it, loss=0.236, sft=0.199, clean=0.203, trig=0.196, accum=4, step=190, kl=0.075]
SFT Epoch 1/2:  93%|█████████▎| 190/205 [06:42<00:30,  2.02s/it, loss=0.236, sft=0.199, clean=0.203, trig=0.196, accum=4, step=190, kl=0.075]
SFT Epoch 1/2:  93%|█████████▎| 190/205 [06:45<00:30,  2.02s/it, loss=0.272, sft=0.228, clean=0.232, trig=0.226, accum=4, step=191, kl=0.088]
SFT Epoch 1/2:  93%|█████████▎| 191/205 [06:45<00:28,  2.05s/it, loss=0.272, sft=0.228, clean=0.232, trig=0.226, accum=4, step=191, kl=0.088]
SFT Epoch 1/2:  93%|█████████▎| 191/205 [06:47<00:28,  2.05s/it, loss=0.181, sft=0.152, clean=0.157, trig=0.149, accum=4, step=192, kl=0.059]
SFT Epoch 1/2:  94%|█████████▎| 192/205 [06:47<00:27,  2.11s/it, loss=0.181, sft=0.152, clean=0.157, trig=0.149, accum=4, step=192, kl=0.059]
SFT Epoch 1/2:  94%|█████████▎| 192/205 [06:49<00:27,  2.11s/it, loss=0.217, sft=0.181, clean=0.184, trig=0.180, accum=4, step=193, kl=0.071]
SFT Epoch 1/2:  94%|█████████▍| 193/205 [06:49<00:24,  2.05s/it, loss=0.217, sft=0.181, clean=0.184, trig=0.180, accum=4, step=193, kl=0.071]
SFT Epoch 1/2:  94%|█████████▍| 193/205 [06:51<00:24,  2.05s/it, loss=0.317, sft=0.276, clean=0.280, trig=0.275, accum=4, step=194, kl=0.082]
SFT Epoch 1/2:  95%|█████████▍| 194/205 [06:51<00:22,  2.04s/it, loss=0.317, sft=0.276, clean=0.280, trig=0.275, accum=4, step=194, kl=0.082]
SFT Epoch 1/2:  95%|█████████▍| 194/205 [06:53<00:22,  2.04s/it, loss=0.297, sft=0.263, clean=0.264, trig=0.263, accum=4, step=195, kl=0.067]
SFT Epoch 1/2:  95%|█████████▌| 195/205 [06:53<00:20,  2.02s/it, loss=0.297, sft=0.263, clean=0.264, trig=0.263, accum=4, step=195, kl=0.067]
SFT Epoch 1/2:  95%|█████████▌| 195/205 [06:55<00:20,  2.02s/it, loss=0.283, sft=0.247, clean=0.253, trig=0.244, accum=4, step=196, kl=0.072]
SFT Epoch 1/2:  96%|█████████▌| 196/205 [06:55<00:17,  1.99s/it, loss=0.283, sft=0.247, clean=0.253, trig=0.244, accum=4, step=196, kl=0.072]
SFT Epoch 1/2:  96%|█████████▌| 196/205 [06:57<00:17,  1.99s/it, loss=0.190, sft=0.160, clean=0.161, trig=0.160, accum=4, step=197, kl=0.059]
SFT Epoch 1/2:  96%|█████████▌| 197/205 [06:57<00:16,  2.02s/it, loss=0.190, sft=0.160, clean=0.161, trig=0.160, accum=4, step=197, kl=0.059]
SFT Epoch 1/2:  96%|█████████▌| 197/205 [06:58<00:16,  2.02s/it, loss=0.345, sft=0.307, clean=0.313, trig=0.304, accum=4, step=198, kl=0.076]
SFT Epoch 1/2:  97%|█████████▋| 198/205 [06:58<00:13,  1.93s/it, loss=0.345, sft=0.307, clean=0.313, trig=0.304, accum=4, step=198, kl=0.076]
SFT Epoch 1/2:  97%|█████████▋| 198/205 [07:00<00:13,  1.93s/it, loss=0.266, sft=0.230, clean=0.233, trig=0.229, accum=4, step=199, kl=0.072]
SFT Epoch 1/2:  97%|█████████▋| 199/205 [07:00<00:11,  1.92s/it, loss=0.266, sft=0.230, clean=0.233, trig=0.229, accum=4, step=199, kl=0.072]
SFT Epoch 1/2:  97%|█████████▋| 199/205 [07:02<00:11,  1.92s/it, loss=0.285, sft=0.249, clean=0.251, trig=0.249, accum=4, step=200, kl=0.071]
SFT Epoch 1/2:  98%|█████████▊| 200/205 [07:02<00:09,  1.89s/it, loss=0.285, sft=0.249, clean=0.251, trig=0.249, accum=4, step=200, kl=0.071]
SFT Epoch 1/2:  98%|█████████▊| 200/205 [07:05<00:09,  1.89s/it, loss=0.245, sft=0.211, clean=0.204, trig=0.214, accum=4, step=201, kl=0.068]
SFT Epoch 1/2:  98%|█████████▊| 201/205 [07:05<00:08,  2.02s/it, loss=0.245, sft=0.211, clean=0.204, trig=0.214, accum=4, step=201, kl=0.068]
SFT Epoch 1/2:  98%|█████████▊| 201/205 [07:06<00:08,  2.02s/it, loss=0.216, sft=0.179, clean=0.184, trig=0.177, accum=4, step=202, kl=0.074]
SFT Epoch 1/2:  99%|█████████▊| 202/205 [07:06<00:05,  1.90s/it, loss=0.216, sft=0.179, clean=0.184, trig=0.177, accum=4, step=202, kl=0.074]
SFT Epoch 1/2:  99%|█████████▊| 202/205 [07:08<00:05,  1.90s/it, loss=0.150, sft=0.128, clean=0.132, trig=0.127, accum=4, step=203, kl=0.042]
SFT Epoch 1/2:  99%|█████████▉| 203/205 [07:08<00:03,  1.98s/it, loss=0.150, sft=0.128, clean=0.132, trig=0.127, accum=4, step=203, kl=0.042]
SFT Epoch 1/2:  99%|█████████▉| 203/205 [07:10<00:03,  1.98s/it, loss=0.247, sft=0.217, clean=0.223, trig=0.214, accum=4, step=204, kl=0.060]
SFT Epoch 1/2: 100%|█████████▉| 204/205 [07:10<00:02,  2.03s/it, loss=0.247, sft=0.217, clean=0.223, trig=0.214, accum=4, step=204, kl=0.060]
SFT Epoch 1/2: 100%|█████████▉| 204/205 [07:12<00:02,  2.03s/it, loss=0.202, sft=0.165, clean=0.171, trig=0.163, accum=4, step=205, kl=0.074]
SFT Epoch 1/2: 100%|██████████| 205/205 [07:12<00:00,  1.99s/it, loss=0.202, sft=0.165, clean=0.171, trig=0.163, accum=4, step=205, kl=0.074]
SFT Epoch 1/2: 100%|██████████| 205/205 [07:12<00:00,  2.11s/it, loss=0.202, sft=0.165, clean=0.171, trig=0.163, accum=4, step=205, kl=0.074]

SFT Epoch 2/2:   0%|          | 0/205 [00:00<?, ?it/s]
SFT Epoch 2/2:   0%|          | 0/205 [00:02<?, ?it/s, loss=0.223, sft=0.181, clean=0.186, trig=0.179, accum=4, step=206, kl=0.084]
SFT Epoch 2/2:   0%|          | 1/205 [00:02<07:38,  2.25s/it, loss=0.223, sft=0.181, clean=0.186, trig=0.179, accum=4, step=206, kl=0.084]
SFT Epoch 2/2:   0%|          | 1/205 [00:04<07:38,  2.25s/it, loss=0.169, sft=0.133, clean=0.134, trig=0.132, accum=4, step=207, kl=0.071]
SFT Epoch 2/2:   1%|          | 2/205 [00:04<06:56,  2.05s/it, loss=0.169, sft=0.133, clean=0.134, trig=0.132, accum=4, step=207, kl=0.071]
SFT Epoch 2/2:   1%|          | 2/205 [00:06<06:56,  2.05s/it, loss=0.198, sft=0.109, clean=0.112, trig=0.107, accum=4, step=208, kl=0.178]
SFT Epoch 2/2:   1%|▏         | 3/205 [00:06<07:02,  2.09s/it, loss=0.198, sft=0.109, clean=0.112, trig=0.107, accum=4, step=208, kl=0.178]
SFT Epoch 2/2:   1%|▏         | 3/205 [00:08<07:02,  2.09s/it, loss=0.194, sft=0.162, clean=0.164, trig=0.161, accum=4, step=209, kl=0.064]
SFT Epoch 2/2:   2%|▏         | 4/205 [00:08<06:59,  2.09s/it, loss=0.194, sft=0.162, clean=0.164, trig=0.161, accum=4, step=209, kl=0.064]
SFT Epoch 2/2:   2%|▏         | 4/205 [00:10<06:59,  2.09s/it, loss=0.184, sft=0.143, clean=0.145, trig=0.142, accum=4, step=210, kl=0.082]
SFT Epoch 2/2:   2%|▏         | 5/205 [00:10<07:03,  2.12s/it, loss=0.184, sft=0.143, clean=0.145, trig=0.142, accum=4, step=210, kl=0.082]
SFT Epoch 2/2:   2%|▏         | 5/205 [00:12<07:03,  2.12s/it, loss=0.203, sft=0.158, clean=0.162, trig=0.157, accum=4, step=211, kl=0.089]
SFT Epoch 2/2:   3%|▎         | 6/205 [00:12<06:59,  2.11s/it, loss=0.203, sft=0.158, clean=0.162, trig=0.157, accum=4, step=211, kl=0.089]
SFT Epoch 2/2:   3%|▎         | 6/205 [00:14<06:59,  2.11s/it, loss=0.160, sft=0.136, clean=0.139, trig=0.134, accum=4, step=212, kl=0.049]
SFT Epoch 2/2:   3%|▎         | 7/205 [00:14<06:49,  2.07s/it, loss=0.160, sft=0.136, clean=0.139, trig=0.134, accum=4, step=212, kl=0.049]
SFT Epoch 2/2:   3%|▎         | 7/205 [00:16<06:49,  2.07s/it, loss=0.199, sft=0.126, clean=0.132, trig=0.124, accum=4, step=213, kl=0.146]
SFT Epoch 2/2:   4%|▍         | 8/205 [00:16<06:45,  2.06s/it, loss=0.199, sft=0.126, clean=0.132, trig=0.124, accum=4, step=213, kl=0.146]
SFT Epoch 2/2:   4%|▍         | 8/205 [00:18<06:45,  2.06s/it, loss=0.189, sft=0.137, clean=0.142, trig=0.134, accum=4, step=214, kl=0.105]
SFT Epoch 2/2:   4%|▍         | 9/205 [00:18<06:35,  2.02s/it, loss=0.189, sft=0.137, clean=0.142, trig=0.134, accum=4, step=214, kl=0.105]
SFT Epoch 2/2:   4%|▍         | 9/205 [00:20<06:35,  2.02s/it, loss=0.192, sft=0.154, clean=0.156, trig=0.153, accum=4, step=215, kl=0.076]
SFT Epoch 2/2:   5%|▍         | 10/205 [00:20<06:44,  2.07s/it, loss=0.192, sft=0.154, clean=0.156, trig=0.153, accum=4, step=215, kl=0.076]
SFT Epoch 2/2:   5%|▍         | 10/205 [00:22<06:44,  2.07s/it, loss=0.205, sft=0.152, clean=0.157, trig=0.150, accum=4, step=216, kl=0.106]
SFT Epoch 2/2:   5%|▌         | 11/205 [00:22<06:25,  1.99s/it, loss=0.205, sft=0.152, clean=0.157, trig=0.150, accum=4, step=216, kl=0.106]
SFT Epoch 2/2:   5%|▌         | 11/205 [00:24<06:25,  1.99s/it, loss=0.204, sft=0.156, clean=0.155, trig=0.156, accum=4, step=217, kl=0.096]
SFT Epoch 2/2:   6%|▌         | 12/205 [00:24<06:03,  1.88s/it, loss=0.204, sft=0.156, clean=0.155, trig=0.156, accum=4, step=217, kl=0.096]
SFT Epoch 2/2:   6%|▌         | 12/205 [00:26<06:03,  1.88s/it, loss=0.160, sft=0.116, clean=0.119, trig=0.115, accum=4, step=218, kl=0.086]
SFT Epoch 2/2:   6%|▋         | 13/205 [00:26<06:19,  1.98s/it, loss=0.160, sft=0.116, clean=0.119, trig=0.115, accum=4, step=218, kl=0.086]
SFT Epoch 2/2:   6%|▋         | 13/205 [00:28<06:19,  1.98s/it, loss=0.231, sft=0.182, clean=0.186, trig=0.180, accum=4, step=219, kl=0.098]
SFT Epoch 2/2:   7%|▋         | 14/205 [00:28<06:06,  1.92s/it, loss=0.231, sft=0.182, clean=0.186, trig=0.180, accum=4, step=219, kl=0.098]
SFT Epoch 2/2:   7%|▋         | 14/205 [00:30<06:06,  1.92s/it, loss=0.189, sft=0.151, clean=0.153, trig=0.150, accum=4, step=220, kl=0.076]
SFT Epoch 2/2:   7%|▋         | 15/205 [00:30<06:06,  1.93s/it, loss=0.189, sft=0.151, clean=0.153, trig=0.150, accum=4, step=220, kl=0.076]
SFT Epoch 2/2:   7%|▋         | 15/205 [00:32<06:06,  1.93s/it, loss=0.161, sft=0.113, clean=0.116, trig=0.112, accum=4, step=221, kl=0.095]
SFT Epoch 2/2:   8%|▊         | 16/205 [00:32<06:04,  1.93s/it, loss=0.161, sft=0.113, clean=0.116, trig=0.112, accum=4, step=221, kl=0.095]
SFT Epoch 2/2:   8%|▊         | 16/205 [00:33<06:04,  1.93s/it, loss=0.175, sft=0.133, clean=0.136, trig=0.132, accum=4, step=222, kl=0.084]
SFT Epoch 2/2:   8%|▊         | 17/205 [00:33<05:48,  1.85s/it, loss=0.175, sft=0.133, clean=0.136, trig=0.132, accum=4, step=222, kl=0.084]
SFT Epoch 2/2:   8%|▊         | 17/205 [00:35<05:48,  1.85s/it, loss=0.153, sft=0.123, clean=0.126, trig=0.121, accum=4, step=223, kl=0.061]
SFT Epoch 2/2:   9%|▉         | 18/205 [00:35<06:03,  1.95s/it, loss=0.153, sft=0.123, clean=0.126, trig=0.121, accum=4, step=223, kl=0.061]
SFT Epoch 2/2:   9%|▉         | 18/205 [00:37<06:03,  1.95s/it, loss=0.154, sft=0.113, clean=0.120, trig=0.110, accum=4, step=224, kl=0.082]
SFT Epoch 2/2:   9%|▉         | 19/205 [00:37<05:56,  1.92s/it, loss=0.154, sft=0.113, clean=0.120, trig=0.110, accum=4, step=224, kl=0.082]
SFT Epoch 2/2:   9%|▉         | 19/205 [00:39<05:56,  1.92s/it, loss=0.232, sft=0.186, clean=0.192, trig=0.184, accum=4, step=225, kl=0.091]
SFT Epoch 2/2:  10%|▉         | 20/205 [00:39<05:48,  1.89s/it, loss=0.232, sft=0.186, clean=0.192, trig=0.184, accum=4, step=225, kl=0.091]
SFT Epoch 2/2:  10%|▉         | 20/205 [00:41<05:48,  1.89s/it, loss=0.281, sft=0.217, clean=0.230, trig=0.211, accum=4, step=226, kl=0.129]
SFT Epoch 2/2:  10%|█         | 21/205 [00:41<05:48,  1.89s/it, loss=0.281, sft=0.217, clean=0.230, trig=0.211, accum=4, step=226, kl=0.129]
SFT Epoch 2/2:  10%|█         | 21/205 [00:43<05:48,  1.89s/it, loss=0.217, sft=0.158, clean=0.162, trig=0.156, accum=4, step=227, kl=0.118]
SFT Epoch 2/2:  11%|█         | 22/205 [00:43<05:56,  1.95s/it, loss=0.217, sft=0.158, clean=0.162, trig=0.156, accum=4, step=227, kl=0.118]
SFT Epoch 2/2:  11%|█         | 22/205 [00:45<05:56,  1.95s/it, loss=0.265, sft=0.179, clean=0.186, trig=0.175, accum=4, step=228, kl=0.172]
SFT Epoch 2/2:  11%|█         | 23/205 [00:45<05:46,  1.90s/it, loss=0.265, sft=0.179, clean=0.186, trig=0.175, accum=4, step=228, kl=0.172]
SFT Epoch 2/2:  11%|█         | 23/205 [00:47<05:46,  1.90s/it, loss=0.174, sft=0.119, clean=0.123, trig=0.118, accum=4, step=229, kl=0.110]
SFT Epoch 2/2:  12%|█▏        | 24/205 [00:47<05:41,  1.89s/it, loss=0.174, sft=0.119, clean=0.123, trig=0.118, accum=4, step=229, kl=0.110]
SFT Epoch 2/2:  12%|█▏        | 24/205 [00:48<05:41,  1.89s/it, loss=0.258, sft=0.211, clean=0.215, trig=0.210, accum=4, step=230, kl=0.093]
SFT Epoch 2/2:  12%|█▏        | 25/205 [00:48<05:32,  1.85s/it, loss=0.258, sft=0.211, clean=0.215, trig=0.210, accum=4, step=230, kl=0.093]
SFT Epoch 2/2:  12%|█▏        | 25/205 [00:51<05:32,  1.85s/it, loss=0.168, sft=0.134, clean=0.135, trig=0.134, accum=4, step=231, kl=0.068]
SFT Epoch 2/2:  13%|█▎        | 26/205 [00:51<05:54,  1.98s/it, loss=0.168, sft=0.134, clean=0.135, trig=0.134, accum=4, step=231, kl=0.068]
SFT Epoch 2/2:  13%|█▎        | 26/205 [00:53<05:54,  1.98s/it, loss=0.243, sft=0.161, clean=0.164, trig=0.159, accum=4, step=232, kl=0.164]
SFT Epoch 2/2:  13%|█▎        | 27/205 [00:53<05:47,  1.95s/it, loss=0.243, sft=0.161, clean=0.164, trig=0.159, accum=4, step=232, kl=0.164]
SFT Epoch 2/2:  13%|█▎        | 27/205 [00:55<05:47,  1.95s/it, loss=0.209, sft=0.163, clean=0.167, trig=0.162, accum=4, step=233, kl=0.090]
SFT Epoch 2/2:  14%|█▎        | 28/205 [00:55<05:43,  1.94s/it, loss=0.209, sft=0.163, clean=0.167, trig=0.162, accum=4, step=233, kl=0.090]
SFT Epoch 2/2:  14%|█▎        | 28/205 [00:56<05:43,  1.94s/it, loss=0.232, sft=0.195, clean=0.197, trig=0.194, accum=4, step=234, kl=0.074]
SFT Epoch 2/2:  14%|█▍        | 29/205 [00:56<05:40,  1.93s/it, loss=0.232, sft=0.195, clean=0.197, trig=0.194, accum=4, step=234, kl=0.074]
SFT Epoch 2/2:  14%|█▍        | 29/205 [00:58<05:40,  1.93s/it, loss=0.212, sft=0.154, clean=0.158, trig=0.152, accum=4, step=235, kl=0.116]
SFT Epoch 2/2:  15%|█▍        | 30/205 [00:58<05:33,  1.90s/it, loss=0.212, sft=0.154, clean=0.158, trig=0.152, accum=4, step=235, kl=0.116]
SFT Epoch 2/2:  15%|█▍        | 30/205 [01:00<05:33,  1.90s/it, loss=0.215, sft=0.165, clean=0.170, trig=0.162, accum=4, step=236, kl=0.100]
SFT Epoch 2/2:  15%|█▌        | 31/205 [01:00<05:38,  1.94s/it, loss=0.215, sft=0.165, clean=0.170, trig=0.162, accum=4, step=236, kl=0.100]
SFT Epoch 2/2:  15%|█▌        | 31/205 [01:02<05:38,  1.94s/it, loss=0.174, sft=0.134, clean=0.136, trig=0.133, accum=4, step=237, kl=0.080]
SFT Epoch 2/2:  16%|█▌        | 32/205 [01:02<05:43,  1.98s/it, loss=0.174, sft=0.134, clean=0.136, trig=0.133, accum=4, step=237, kl=0.080]
SFT Epoch 2/2:  16%|█▌        | 32/205 [01:04<05:43,  1.98s/it, loss=0.199, sft=0.150, clean=0.154, trig=0.148, accum=4, step=238, kl=0.099]
SFT Epoch 2/2:  16%|█▌        | 33/205 [01:04<05:36,  1.96s/it, loss=0.199, sft=0.150, clean=0.154, trig=0.148, accum=4, step=238, kl=0.099]
SFT Epoch 2/2:  16%|█▌        | 33/205 [01:06<05:36,  1.96s/it, loss=0.162, sft=0.127, clean=0.132, trig=0.125, accum=4, step=239, kl=0.069]
SFT Epoch 2/2:  17%|█▋        | 34/205 [01:06<05:38,  1.98s/it, loss=0.162, sft=0.127, clean=0.132, trig=0.125, accum=4, step=239, kl=0.069]
SFT Epoch 2/2:  17%|█▋        | 34/205 [01:08<05:38,  1.98s/it, loss=0.121, sft=0.095, clean=0.098, trig=0.094, accum=4, step=240, kl=0.051]
SFT Epoch 2/2:  17%|█▋        | 35/205 [01:08<05:39,  2.00s/it, loss=0.121, sft=0.095, clean=0.098, trig=0.094, accum=4, step=240, kl=0.051]
SFT Epoch 2/2:  17%|█▋        | 35/205 [01:10<05:39,  2.00s/it, loss=0.248, sft=0.182, clean=0.184, trig=0.181, accum=4, step=241, kl=0.131]
SFT Epoch 2/2:  18%|█▊        | 36/205 [01:10<05:24,  1.92s/it, loss=0.248, sft=0.182, clean=0.184, trig=0.181, accum=4, step=241, kl=0.131]
SFT Epoch 2/2:  18%|█▊        | 36/205 [01:12<05:24,  1.92s/it, loss=0.176, sft=0.132, clean=0.136, trig=0.130, accum=4, step=242, kl=0.087]
SFT Epoch 2/2:  18%|█▊        | 37/205 [01:12<05:04,  1.81s/it, loss=0.176, sft=0.132, clean=0.136, trig=0.130, accum=4, step=242, kl=0.087]
SFT Epoch 2/2:  18%|█▊        | 37/205 [01:14<05:04,  1.81s/it, loss=0.139, sft=0.108, clean=0.109, trig=0.108, accum=4, step=243, kl=0.062]
SFT Epoch 2/2:  19%|█▊        | 38/205 [01:14<05:12,  1.87s/it, loss=0.139, sft=0.108, clean=0.109, trig=0.108, accum=4, step=243, kl=0.062]
SFT Epoch 2/2:  19%|█▊        | 38/205 [01:16<05:12,  1.87s/it, loss=0.187, sft=0.136, clean=0.138, trig=0.136, accum=4, step=244, kl=0.101]
SFT Epoch 2/2:  19%|█▉        | 39/205 [01:16<05:18,  1.92s/it, loss=0.187, sft=0.136, clean=0.138, trig=0.136, accum=4, step=244, kl=0.101]
SFT Epoch 2/2:  19%|█▉        | 39/205 [01:18<05:18,  1.92s/it, loss=0.216, sft=0.163, clean=0.168, trig=0.161, accum=4, step=245, kl=0.106]
SFT Epoch 2/2:  20%|█▉        | 40/205 [01:18<05:11,  1.89s/it, loss=0.216, sft=0.163, clean=0.168, trig=0.161, accum=4, step=245, kl=0.106]
SFT Epoch 2/2:  20%|█▉        | 40/205 [01:20<05:11,  1.89s/it, loss=0.202, sft=0.165, clean=0.168, trig=0.164, accum=4, step=246, kl=0.073]
SFT Epoch 2/2:  20%|██        | 41/205 [01:20<05:14,  1.92s/it, loss=0.202, sft=0.165, clean=0.168, trig=0.164, accum=4, step=246, kl=0.073]
SFT Epoch 2/2:  20%|██        | 41/205 [01:22<05:14,  1.92s/it, loss=0.215, sft=0.166, clean=0.165, trig=0.166, accum=4, step=247, kl=0.100]
SFT Epoch 2/2:  20%|██        | 42/205 [01:22<05:17,  1.95s/it, loss=0.215, sft=0.166, clean=0.165, trig=0.166, accum=4, step=247, kl=0.100]
SFT Epoch 2/2:  20%|██        | 42/205 [01:24<05:17,  1.95s/it, loss=0.206, sft=0.163, clean=0.166, trig=0.162, accum=4, step=248, kl=0.086]
SFT Epoch 2/2:  21%|██        | 43/205 [01:24<05:17,  1.96s/it, loss=0.206, sft=0.163, clean=0.166, trig=0.162, accum=4, step=248, kl=0.086]
SFT Epoch 2/2:  21%|██        | 43/205 [01:26<05:17,  1.96s/it, loss=0.218, sft=0.172, clean=0.174, trig=0.171, accum=4, step=249, kl=0.092]
SFT Epoch 2/2:  21%|██▏       | 44/205 [01:26<05:35,  2.09s/it, loss=0.218, sft=0.172, clean=0.174, trig=0.171, accum=4, step=249, kl=0.092]
SFT Epoch 2/2:  21%|██▏       | 44/205 [01:28<05:35,  2.09s/it, loss=0.187, sft=0.128, clean=0.129, trig=0.128, accum=4, step=250, kl=0.118]
SFT Epoch 2/2:  22%|██▏       | 45/205 [01:28<05:34,  2.09s/it, loss=0.187, sft=0.128, clean=0.129, trig=0.128, accum=4, step=250, kl=0.118]
SFT Epoch 2/2:  22%|██▏       | 45/205 [01:30<05:34,  2.09s/it, loss=0.221, sft=0.172, clean=0.178, trig=0.169, accum=4, step=251, kl=0.099]
SFT Epoch 2/2:  22%|██▏       | 46/205 [01:30<05:30,  2.08s/it, loss=0.221, sft=0.172, clean=0.178, trig=0.169, accum=4, step=251, kl=0.099]
SFT Epoch 2/2:  22%|██▏       | 46/205 [01:32<05:30,  2.08s/it, loss=0.172, sft=0.145, clean=0.146, trig=0.144, accum=4, step=252, kl=0.055]
SFT Epoch 2/2:  23%|██▎       | 47/205 [01:32<05:31,  2.10s/it, loss=0.172, sft=0.145, clean=0.146, trig=0.144, accum=4, step=252, kl=0.055]
SFT Epoch 2/2:  23%|██▎       | 47/205 [01:34<05:31,  2.10s/it, loss=0.211, sft=0.175, clean=0.171, trig=0.176, accum=4, step=253, kl=0.072]
SFT Epoch 2/2:  23%|██▎       | 48/205 [01:34<05:23,  2.06s/it, loss=0.211, sft=0.175, clean=0.171, trig=0.176, accum=4, step=253, kl=0.072]
SFT Epoch 2/2:  23%|██▎       | 48/205 [01:36<05:23,  2.06s/it, loss=0.188, sft=0.154, clean=0.155, trig=0.153, accum=4, step=254, kl=0.068]
SFT Epoch 2/2:  24%|██▍       | 49/205 [01:36<05:18,  2.04s/it, loss=0.188, sft=0.154, clean=0.155, trig=0.153, accum=4, step=254, kl=0.068]
SFT Epoch 2/2:  24%|██▍       | 49/205 [01:39<05:18,  2.04s/it, loss=0.159, sft=0.113, clean=0.116, trig=0.112, accum=4, step=255, kl=0.091]
SFT Epoch 2/2:  24%|██▍       | 50/205 [01:39<05:28,  2.12s/it, loss=0.159, sft=0.113, clean=0.116, trig=0.112, accum=4, step=255, kl=0.091]
SFT Epoch 2/2:  24%|██▍       | 50/205 [01:40<05:28,  2.12s/it, loss=0.169, sft=0.119, clean=0.122, trig=0.118, accum=4, step=256, kl=0.101]
SFT Epoch 2/2:  25%|██▍       | 51/205 [01:40<05:17,  2.06s/it, loss=0.169, sft=0.119, clean=0.122, trig=0.118, accum=4, step=256, kl=0.101]
SFT Epoch 2/2:  25%|██▍       | 51/205 [01:42<05:17,  2.06s/it, loss=0.228, sft=0.177, clean=0.180, trig=0.176, accum=4, step=257, kl=0.102]
SFT Epoch 2/2:  25%|██▌       | 52/205 [01:42<05:06,  2.00s/it, loss=0.228, sft=0.177, clean=0.180, trig=0.176, accum=4, step=257, kl=0.102]
SFT Epoch 2/2:  25%|██▌       | 52/205 [01:44<05:06,  2.00s/it, loss=0.189, sft=0.150, clean=0.155, trig=0.148, accum=4, step=258, kl=0.077]
SFT Epoch 2/2:  26%|██▌       | 53/205 [01:44<05:06,  2.02s/it, loss=0.189, sft=0.150, clean=0.155, trig=0.148, accum=4, step=258, kl=0.077]
SFT Epoch 2/2:  26%|██▌       | 53/205 [01:46<05:06,  2.02s/it, loss=0.161, sft=0.119, clean=0.121, trig=0.117, accum=4, step=259, kl=0.085]
SFT Epoch 2/2:  26%|██▋       | 54/205 [01:46<04:52,  1.94s/it, loss=0.161, sft=0.119, clean=0.121, trig=0.117, accum=4, step=259, kl=0.085]
SFT Epoch 2/2:  26%|██▋       | 54/205 [01:48<04:52,  1.94s/it, loss=0.237, sft=0.202, clean=0.207, trig=0.199, accum=4, step=260, kl=0.070]
SFT Epoch 2/2:  27%|██▋       | 55/205 [01:48<05:02,  2.02s/it, loss=0.237, sft=0.202, clean=0.207, trig=0.199, accum=4, step=260, kl=0.070]
SFT Epoch 2/2:  27%|██▋       | 55/205 [01:50<05:02,  2.02s/it, loss=0.242, sft=0.204, clean=0.197, trig=0.206, accum=4, step=261, kl=0.077]
SFT Epoch 2/2:  27%|██▋       | 56/205 [01:50<04:54,  1.98s/it, loss=0.242, sft=0.204, clean=0.197, trig=0.206, accum=4, step=261, kl=0.077]
SFT Epoch 2/2:  27%|██▋       | 56/205 [01:52<04:54,  1.98s/it, loss=0.211, sft=0.161, clean=0.165, trig=0.160, accum=4, step=262, kl=0.098]
SFT Epoch 2/2:  28%|██▊       | 57/205 [01:52<04:55,  2.00s/it, loss=0.211, sft=0.161, clean=0.165, trig=0.160, accum=4, step=262, kl=0.098]
SFT Epoch 2/2:  28%|██▊       | 57/205 [01:54<04:55,  2.00s/it, loss=0.195, sft=0.159, clean=0.147, trig=0.164, accum=4, step=263, kl=0.072]
SFT Epoch 2/2:  28%|██▊       | 58/205 [01:54<04:57,  2.02s/it, loss=0.195, sft=0.159, clean=0.147, trig=0.164, accum=4, step=263, kl=0.072]
SFT Epoch 2/2:  28%|██▊       | 58/205 [01:56<04:57,  2.02s/it, loss=0.156, sft=0.129, clean=0.130, trig=0.129, accum=4, step=264, kl=0.054]
SFT Epoch 2/2:  29%|██▉       | 59/205 [01:56<04:52,  2.00s/it, loss=0.156, sft=0.129, clean=0.130, trig=0.129, accum=4, step=264, kl=0.054]
SFT Epoch 2/2:  29%|██▉       | 59/205 [01:58<04:52,  2.00s/it, loss=0.208, sft=0.163, clean=0.165, trig=0.162, accum=4, step=265, kl=0.090]
SFT Epoch 2/2:  29%|██▉       | 60/205 [01:58<04:41,  1.94s/it, loss=0.208, sft=0.163, clean=0.165, trig=0.162, accum=4, step=265, kl=0.090]
SFT Epoch 2/2:  29%|██▉       | 60/205 [02:00<04:41,  1.94s/it, loss=0.139, sft=0.095, clean=0.096, trig=0.094, accum=4, step=266, kl=0.088]
SFT Epoch 2/2:  30%|██▉       | 61/205 [02:00<04:42,  1.96s/it, loss=0.139, sft=0.095, clean=0.096, trig=0.094, accum=4, step=266, kl=0.088]
SFT Epoch 2/2:  30%|██▉       | 61/205 [02:02<04:42,  1.96s/it, loss=0.172, sft=0.138, clean=0.141, trig=0.136, accum=4, step=267, kl=0.068]
SFT Epoch 2/2:  30%|███       | 62/205 [02:02<04:37,  1.94s/it, loss=0.172, sft=0.138, clean=0.141, trig=0.136, accum=4, step=267, kl=0.068]
SFT Epoch 2/2:  30%|███       | 62/205 [02:04<04:37,  1.94s/it, loss=0.181, sft=0.142, clean=0.145, trig=0.140, accum=4, step=268, kl=0.079]
SFT Epoch 2/2:  31%|███       | 63/205 [02:04<04:31,  1.91s/it, loss=0.181, sft=0.142, clean=0.145, trig=0.140, accum=4, step=268, kl=0.079]
SFT Epoch 2/2:  31%|███       | 63/205 [02:06<04:31,  1.91s/it, loss=0.165, sft=0.108, clean=0.111, trig=0.107, accum=4, step=269, kl=0.114]
SFT Epoch 2/2:  31%|███       | 64/205 [02:06<04:26,  1.89s/it, loss=0.165, sft=0.108, clean=0.111, trig=0.107, accum=4, step=269, kl=0.114]
SFT Epoch 2/2:  31%|███       | 64/205 [02:08<04:26,  1.89s/it, loss=0.101, sft=0.057, clean=0.057, trig=0.056, accum=4, step=270, kl=0.088]
SFT Epoch 2/2:  32%|███▏      | 65/205 [02:08<04:48,  2.06s/it, loss=0.101, sft=0.057, clean=0.057, trig=0.056, accum=4, step=270, kl=0.088]
SFT Epoch 2/2:  32%|███▏      | 65/205 [02:10<04:48,  2.06s/it, loss=0.223, sft=0.166, clean=0.170, trig=0.164, accum=4, step=271, kl=0.113]
SFT Epoch 2/2:  32%|███▏      | 66/205 [02:10<04:42,  2.03s/it, loss=0.223, sft=0.166, clean=0.170, trig=0.164, accum=4, step=271, kl=0.113]
SFT Epoch 2/2:  32%|███▏      | 66/205 [02:12<04:42,  2.03s/it, loss=0.174, sft=0.135, clean=0.140, trig=0.133, accum=4, step=272, kl=0.079]
SFT Epoch 2/2:  33%|███▎      | 67/205 [02:12<04:35,  1.99s/it, loss=0.174, sft=0.135, clean=0.140, trig=0.133, accum=4, step=272, kl=0.079]
SFT Epoch 2/2:  33%|███▎      | 67/205 [02:14<04:35,  1.99s/it, loss=0.183, sft=0.147, clean=0.149, trig=0.146, accum=4, step=273, kl=0.072]
SFT Epoch 2/2:  33%|███▎      | 68/205 [02:14<04:28,  1.96s/it, loss=0.183, sft=0.147, clean=0.149, trig=0.146, accum=4, step=273, kl=0.072]
SFT Epoch 2/2:  33%|███▎      | 68/205 [02:16<04:28,  1.96s/it, loss=0.225, sft=0.181, clean=0.183, trig=0.180, accum=4, step=274, kl=0.088]
SFT Epoch 2/2:  34%|███▎      | 69/205 [02:16<04:38,  2.05s/it, loss=0.225, sft=0.181, clean=0.183, trig=0.180, accum=4, step=274, kl=0.088]
SFT Epoch 2/2:  34%|███▎      | 69/205 [02:18<04:38,  2.05s/it, loss=0.182, sft=0.129, clean=0.130, trig=0.128, accum=4, step=275, kl=0.107]
SFT Epoch 2/2:  34%|███▍      | 70/205 [02:18<04:38,  2.06s/it, loss=0.182, sft=0.129, clean=0.130, trig=0.128, accum=4, step=275, kl=0.107]
SFT Epoch 2/2:  34%|███▍      | 70/205 [02:20<04:38,  2.06s/it, loss=0.125, sft=0.092, clean=0.094, trig=0.091, accum=4, step=276, kl=0.066]
SFT Epoch 2/2:  35%|███▍      | 71/205 [02:20<04:17,  1.92s/it, loss=0.125, sft=0.092, clean=0.094, trig=0.091, accum=4, step=276, kl=0.066]
SFT Epoch 2/2:  35%|███▍      | 71/205 [02:22<04:17,  1.92s/it, loss=0.244, sft=0.195, clean=0.201, trig=0.193, accum=4, step=277, kl=0.097]
SFT Epoch 2/2:  35%|███▌      | 72/205 [02:22<04:20,  1.96s/it, loss=0.244, sft=0.195, clean=0.201, trig=0.193, accum=4, step=277, kl=0.097]
SFT Epoch 2/2:  35%|███▌      | 72/205 [02:24<04:20,  1.96s/it, loss=0.201, sft=0.175, clean=0.178, trig=0.173, accum=4, step=278, kl=0.052]
SFT Epoch 2/2:  36%|███▌      | 73/205 [02:24<04:29,  2.04s/it, loss=0.201, sft=0.175, clean=0.178, trig=0.173, accum=4, step=278, kl=0.052]
SFT Epoch 2/2:  36%|███▌      | 73/205 [02:26<04:29,  2.04s/it, loss=0.165, sft=0.106, clean=0.108, trig=0.105, accum=4, step=279, kl=0.118]
SFT Epoch 2/2:  36%|███▌      | 74/205 [02:26<04:36,  2.11s/it, loss=0.165, sft=0.106, clean=0.108, trig=0.105, accum=4, step=279, kl=0.118]
SFT Epoch 2/2:  36%|███▌      | 74/205 [02:28<04:36,  2.11s/it, loss=0.250, sft=0.183, clean=0.185, trig=0.182, accum=4, step=280, kl=0.134]
SFT Epoch 2/2:  37%|███▋      | 75/205 [02:28<04:34,  2.11s/it, loss=0.250, sft=0.183, clean=0.185, trig=0.182, accum=4, step=280, kl=0.134]
SFT Epoch 2/2:  37%|███▋      | 75/205 [02:31<04:34,  2.11s/it, loss=0.160, sft=0.115, clean=0.115, trig=0.115, accum=4, step=281, kl=0.090]
SFT Epoch 2/2:  37%|███▋      | 76/205 [02:31<04:45,  2.22s/it, loss=0.160, sft=0.115, clean=0.115, trig=0.115, accum=4, step=281, kl=0.090]
SFT Epoch 2/2:  37%|███▋      | 76/205 [02:33<04:45,  2.22s/it, loss=0.223, sft=0.186, clean=0.192, trig=0.184, accum=4, step=282, kl=0.074]
SFT Epoch 2/2:  38%|███▊      | 77/205 [02:33<04:43,  2.21s/it, loss=0.223, sft=0.186, clean=0.192, trig=0.184, accum=4, step=282, kl=0.074]
SFT Epoch 2/2:  38%|███▊      | 77/205 [02:35<04:43,  2.21s/it, loss=0.171, sft=0.127, clean=0.130, trig=0.125, accum=4, step=283, kl=0.089]
SFT Epoch 2/2:  38%|███▊      | 78/205 [02:35<04:37,  2.19s/it, loss=0.171, sft=0.127, clean=0.130, trig=0.125, accum=4, step=283, kl=0.089]
SFT Epoch 2/2:  38%|███▊      | 78/205 [02:37<04:37,  2.19s/it, loss=0.244, sft=0.182, clean=0.185, trig=0.180, accum=4, step=284, kl=0.124]
SFT Epoch 2/2:  39%|███▊      | 79/205 [02:37<04:24,  2.10s/it, loss=0.244, sft=0.182, clean=0.185, trig=0.180, accum=4, step=284, kl=0.124]
SFT Epoch 2/2:  39%|███▊      | 79/205 [02:39<04:24,  2.10s/it, loss=0.176, sft=0.132, clean=0.135, trig=0.130, accum=4, step=285, kl=0.088]
SFT Epoch 2/2:  39%|███▉      | 80/205 [02:39<04:16,  2.05s/it, loss=0.176, sft=0.132, clean=0.135, trig=0.130, accum=4, step=285, kl=0.088]
SFT Epoch 2/2:  39%|███▉      | 80/205 [02:41<04:16,  2.05s/it, loss=0.173, sft=0.144, clean=0.150, trig=0.141, accum=4, step=286, kl=0.058]
SFT Epoch 2/2:  40%|███▉      | 81/205 [02:41<04:13,  2.04s/it, loss=0.173, sft=0.144, clean=0.150, trig=0.141, accum=4, step=286, kl=0.058]
SFT Epoch 2/2:  40%|███▉      | 81/205 [02:43<04:13,  2.04s/it, loss=0.247, sft=0.211, clean=0.212, trig=0.210, accum=4, step=287, kl=0.072]
SFT Epoch 2/2:  40%|████      | 82/205 [02:43<04:09,  2.03s/it, loss=0.247, sft=0.211, clean=0.212, trig=0.210, accum=4, step=287, kl=0.072]
SFT Epoch 2/2:  40%|████      | 82/205 [02:45<04:09,  2.03s/it, loss=0.144, sft=0.104, clean=0.110, trig=0.102, accum=4, step=288, kl=0.081]
SFT Epoch 2/2:  40%|████      | 83/205 [02:45<04:20,  2.13s/it, loss=0.144, sft=0.104, clean=0.110, trig=0.102, accum=4, step=288, kl=0.081]
SFT Epoch 2/2:  40%|████      | 83/205 [02:47<04:20,  2.13s/it, loss=0.101, sft=0.076, clean=0.076, trig=0.075, accum=4, step=289, kl=0.051]
SFT Epoch 2/2:  41%|████      | 84/205 [02:47<04:08,  2.05s/it, loss=0.101, sft=0.076, clean=0.076, trig=0.075, accum=4, step=289, kl=0.051]
SFT Epoch 2/2:  41%|████      | 84/205 [02:50<04:08,  2.05s/it, loss=0.170, sft=0.136, clean=0.140, trig=0.134, accum=4, step=290, kl=0.068]
SFT Epoch 2/2:  41%|████▏     | 85/205 [02:50<04:12,  2.10s/it, loss=0.170, sft=0.136, clean=0.140, trig=0.134, accum=4, step=290, kl=0.068]
SFT Epoch 2/2:  41%|████▏     | 85/205 [02:52<04:12,  2.10s/it, loss=0.189, sft=0.147, clean=0.155, trig=0.144, accum=4, step=291, kl=0.083]
SFT Epoch 2/2:  42%|████▏     | 86/205 [02:52<04:18,  2.17s/it, loss=0.189, sft=0.147, clean=0.155, trig=0.144, accum=4, step=291, kl=0.083]
SFT Epoch 2/2:  42%|████▏     | 86/205 [02:54<04:18,  2.17s/it, loss=0.166, sft=0.111, clean=0.113, trig=0.110, accum=4, step=292, kl=0.111]
SFT Epoch 2/2:  42%|████▏     | 87/205 [02:54<04:17,  2.18s/it, loss=0.166, sft=0.111, clean=0.113, trig=0.110, accum=4, step=292, kl=0.111]
SFT Epoch 2/2:  42%|████▏     | 87/205 [02:56<04:17,  2.18s/it, loss=0.213, sft=0.180, clean=0.184, trig=0.178, accum=4, step=293, kl=0.065]
SFT Epoch 2/2:  43%|████▎     | 88/205 [02:56<04:06,  2.11s/it, loss=0.213, sft=0.180, clean=0.184, trig=0.178, accum=4, step=293, kl=0.065]
SFT Epoch 2/2:  43%|████▎     | 88/205 [02:58<04:06,  2.11s/it, loss=0.264, sft=0.219, clean=0.226, trig=0.217, accum=4, step=294, kl=0.090]
SFT Epoch 2/2:  43%|████▎     | 89/205 [02:58<03:50,  1.99s/it, loss=0.264, sft=0.219, clean=0.226, trig=0.217, accum=4, step=294, kl=0.090]
SFT Epoch 2/2:  43%|████▎     | 89/205 [03:00<03:50,  1.99s/it, loss=0.263, sft=0.228, clean=0.233, trig=0.226, accum=4, step=295, kl=0.071]
SFT Epoch 2/2:  44%|████▍     | 90/205 [03:00<03:54,  2.04s/it, loss=0.263, sft=0.228, clean=0.233, trig=0.226, accum=4, step=295, kl=0.071]
SFT Epoch 2/2:  44%|████▍     | 90/205 [03:02<03:54,  2.04s/it, loss=0.169, sft=0.126, clean=0.126, trig=0.125, accum=4, step=296, kl=0.087]
SFT Epoch 2/2:  44%|████▍     | 91/205 [03:02<03:56,  2.08s/it, loss=0.169, sft=0.126, clean=0.126, trig=0.125, accum=4, step=296, kl=0.087]
SFT Epoch 2/2:  44%|████▍     | 91/205 [03:04<03:56,  2.08s/it, loss=0.142, sft=0.117, clean=0.121, trig=0.116, accum=4, step=297, kl=0.050]
SFT Epoch 2/2:  45%|████▍     | 92/205 [03:04<03:57,  2.10s/it, loss=0.142, sft=0.117, clean=0.121, trig=0.116, accum=4, step=297, kl=0.050]
SFT Epoch 2/2:  45%|████▍     | 92/205 [03:06<03:57,  2.10s/it, loss=0.180, sft=0.141, clean=0.146, trig=0.139, accum=4, step=298, kl=0.079]
SFT Epoch 2/2:  45%|████▌     | 93/205 [03:06<03:57,  2.12s/it, loss=0.180, sft=0.141, clean=0.146, trig=0.139, accum=4, step=298, kl=0.079]
SFT Epoch 2/2:  45%|████▌     | 93/205 [03:08<03:57,  2.12s/it, loss=0.157, sft=0.112, clean=0.115, trig=0.110, accum=4, step=299, kl=0.091]
SFT Epoch 2/2:  46%|████▌     | 94/205 [03:08<03:47,  2.05s/it, loss=0.157, sft=0.112, clean=0.115, trig=0.110, accum=4, step=299, kl=0.091]
SFT Epoch 2/2:  46%|████▌     | 94/205 [03:10<03:47,  2.05s/it, loss=0.170, sft=0.096, clean=0.099, trig=0.095, accum=4, step=300, kl=0.147]
SFT Epoch 2/2:  46%|████▋     | 95/205 [03:10<03:45,  2.05s/it, loss=0.170, sft=0.096, clean=0.099, trig=0.095, accum=4, step=300, kl=0.147]
SFT Epoch 2/2:  46%|████▋     | 95/205 [03:12<03:45,  2.05s/it, loss=0.230, sft=0.167, clean=0.173, trig=0.165, accum=4, step=301, kl=0.125]
SFT Epoch 2/2:  47%|████▋     | 96/205 [03:12<03:41,  2.03s/it, loss=0.230, sft=0.167, clean=0.173, trig=0.165, accum=4, step=301, kl=0.125]
SFT Epoch 2/2:  47%|████▋     | 96/205 [03:14<03:41,  2.03s/it, loss=0.184, sft=0.134, clean=0.136, trig=0.133, accum=4, step=302, kl=0.099]
SFT Epoch 2/2:  47%|████▋     | 97/205 [03:14<03:34,  1.99s/it, loss=0.184, sft=0.134, clean=0.136, trig=0.133, accum=4, step=302, kl=0.099]
SFT Epoch 2/2:  47%|████▋     | 97/205 [03:16<03:34,  1.99s/it, loss=0.221, sft=0.173, clean=0.178, trig=0.171, accum=4, step=303, kl=0.095]
SFT Epoch 2/2:  48%|████▊     | 98/205 [03:16<03:25,  1.92s/it, loss=0.221, sft=0.173, clean=0.178, trig=0.171, accum=4, step=303, kl=0.095]
SFT Epoch 2/2:  48%|████▊     | 98/205 [03:18<03:25,  1.92s/it, loss=0.170, sft=0.136, clean=0.139, trig=0.134, accum=4, step=304, kl=0.069]
SFT Epoch 2/2:  48%|████▊     | 99/205 [03:18<03:27,  1.96s/it, loss=0.170, sft=0.136, clean=0.139, trig=0.134, accum=4, step=304, kl=0.069]
SFT Epoch 2/2:  48%|████▊     | 99/205 [03:20<03:27,  1.96s/it, loss=0.254, sft=0.202, clean=0.206, trig=0.201, accum=4, step=305, kl=0.104]
SFT Epoch 2/2:  49%|████▉     | 100/205 [03:20<03:32,  2.03s/it, loss=0.254, sft=0.202, clean=0.206, trig=0.201, accum=4, step=305, kl=0.104]
SFT Epoch 2/2:  49%|████▉     | 100/205 [03:22<03:32,  2.03s/it, loss=0.147, sft=0.104, clean=0.107, trig=0.103, accum=4, step=306, kl=0.086]
SFT Epoch 2/2:  49%|████▉     | 101/205 [03:22<03:25,  1.98s/it, loss=0.147, sft=0.104, clean=0.107, trig=0.103, accum=4, step=306, kl=0.086]
SFT Epoch 2/2:  49%|████▉     | 101/205 [03:24<03:25,  1.98s/it, loss=0.241, sft=0.194, clean=0.192, trig=0.195, accum=4, step=307, kl=0.093]
SFT Epoch 2/2:  50%|████▉     | 102/205 [03:24<03:22,  1.97s/it, loss=0.241, sft=0.194, clean=0.192, trig=0.195, accum=4, step=307, kl=0.093]
SFT Epoch 2/2:  50%|████▉     | 102/205 [03:27<03:22,  1.97s/it, loss=0.120, sft=0.083, clean=0.085, trig=0.082, accum=4, step=308, kl=0.075]
SFT Epoch 2/2:  50%|█████     | 103/205 [03:27<03:38,  2.14s/it, loss=0.120, sft=0.083, clean=0.085, trig=0.082, accum=4, step=308, kl=0.075]
SFT Epoch 2/2:  50%|█████     | 103/205 [03:28<03:38,  2.14s/it, loss=0.169, sft=0.110, clean=0.112, trig=0.109, accum=4, step=309, kl=0.117]
SFT Epoch 2/2:  51%|█████     | 104/205 [03:28<03:27,  2.06s/it, loss=0.169, sft=0.110, clean=0.112, trig=0.109, accum=4, step=309, kl=0.117]
SFT Epoch 2/2:  51%|█████     | 104/205 [03:30<03:27,  2.06s/it, loss=0.195, sft=0.148, clean=0.153, trig=0.146, accum=4, step=310, kl=0.093]
SFT Epoch 2/2:  51%|█████     | 105/205 [03:30<03:22,  2.02s/it, loss=0.195, sft=0.148, clean=0.153, trig=0.146, accum=4, step=310, kl=0.093]
SFT Epoch 2/2:  51%|█████     | 105/205 [03:32<03:22,  2.02s/it, loss=0.197, sft=0.141, clean=0.144, trig=0.139, accum=4, step=311, kl=0.112]
SFT Epoch 2/2:  52%|█████▏    | 106/205 [03:32<03:11,  1.93s/it, loss=0.197, sft=0.141, clean=0.144, trig=0.139, accum=4, step=311, kl=0.112]
SFT Epoch 2/2:  52%|█████▏    | 106/205 [03:34<03:11,  1.93s/it, loss=0.237, sft=0.202, clean=0.208, trig=0.199, accum=4, step=312, kl=0.070]
SFT Epoch 2/2:  52%|█████▏    | 107/205 [03:34<03:07,  1.91s/it, loss=0.237, sft=0.202, clean=0.208, trig=0.199, accum=4, step=312, kl=0.070]
SFT Epoch 2/2:  52%|█████▏    | 107/205 [03:36<03:07,  1.91s/it, loss=0.195, sft=0.162, clean=0.166, trig=0.160, accum=4, step=313, kl=0.066]
SFT Epoch 2/2:  53%|█████▎    | 108/205 [03:36<03:01,  1.87s/it, loss=0.195, sft=0.162, clean=0.166, trig=0.160, accum=4, step=313, kl=0.066]
SFT Epoch 2/2:  53%|█████▎    | 108/205 [03:38<03:01,  1.87s/it, loss=0.309, sft=0.262, clean=0.266, trig=0.260, accum=4, step=314, kl=0.094]
SFT Epoch 2/2:  53%|█████▎    | 109/205 [03:38<03:09,  1.98s/it, loss=0.309, sft=0.262, clean=0.266, trig=0.260, accum=4, step=314, kl=0.094]
SFT Epoch 2/2:  53%|█████▎    | 109/205 [03:40<03:09,  1.98s/it, loss=0.204, sft=0.170, clean=0.176, trig=0.168, accum=4, step=315, kl=0.066]
SFT Epoch 2/2:  54%|█████▎    | 110/205 [03:40<03:13,  2.03s/it, loss=0.204, sft=0.170, clean=0.176, trig=0.168, accum=4, step=315, kl=0.066]
SFT Epoch 2/2:  54%|█████▎    | 110/205 [03:42<03:13,  2.03s/it, loss=0.222, sft=0.188, clean=0.192, trig=0.186, accum=4, step=316, kl=0.069]
SFT Epoch 2/2:  54%|█████▍    | 111/205 [03:42<03:06,  1.99s/it, loss=0.222, sft=0.188, clean=0.192, trig=0.186, accum=4, step=316, kl=0.069]
SFT Epoch 2/2:  54%|█████▍    | 111/205 [03:44<03:06,  1.99s/it, loss=0.138, sft=0.107, clean=0.109, trig=0.107, accum=4, step=317, kl=0.061]
SFT Epoch 2/2:  55%|█████▍    | 112/205 [03:44<03:07,  2.01s/it, loss=0.138, sft=0.107, clean=0.109, trig=0.107, accum=4, step=317, kl=0.061]
SFT Epoch 2/2:  55%|█████▍    | 112/205 [03:46<03:07,  2.01s/it, loss=0.265, sft=0.219, clean=0.229, trig=0.215, accum=4, step=318, kl=0.092]
SFT Epoch 2/2:  55%|█████▌    | 113/205 [03:46<03:02,  1.98s/it, loss=0.265, sft=0.219, clean=0.229, trig=0.215, accum=4, step=318, kl=0.092]
SFT Epoch 2/2:  55%|█████▌    | 113/205 [03:48<03:02,  1.98s/it, loss=0.237, sft=0.197, clean=0.206, trig=0.194, accum=4, step=319, kl=0.079]
SFT Epoch 2/2:  56%|█████▌    | 114/205 [03:48<02:56,  1.94s/it, loss=0.237, sft=0.197, clean=0.206, trig=0.194, accum=4, step=319, kl=0.079]
SFT Epoch 2/2:  56%|█████▌    | 114/205 [03:50<02:56,  1.94s/it, loss=0.136, sft=0.112, clean=0.115, trig=0.110, accum=4, step=320, kl=0.049]
SFT Epoch 2/2:  56%|█████▌    | 115/205 [03:50<02:59,  1.99s/it, loss=0.136, sft=0.112, clean=0.115, trig=0.110, accum=4, step=320, kl=0.049]
SFT Epoch 2/2:  56%|█████▌    | 115/205 [03:52<02:59,  1.99s/it, loss=0.230, sft=0.162, clean=0.167, trig=0.160, accum=4, step=321, kl=0.136]
SFT Epoch 2/2:  57%|█████▋    | 116/205 [03:52<02:51,  1.92s/it, loss=0.230, sft=0.162, clean=0.167, trig=0.160, accum=4, step=321, kl=0.136]
SFT Epoch 2/2:  57%|█████▋    | 116/205 [03:54<02:51,  1.92s/it, loss=0.126, sft=0.097, clean=0.099, trig=0.096, accum=4, step=322, kl=0.058]
SFT Epoch 2/2:  57%|█████▋    | 117/205 [03:54<02:53,  1.98s/it, loss=0.126, sft=0.097, clean=0.099, trig=0.096, accum=4, step=322, kl=0.058]
SFT Epoch 2/2:  57%|█████▋    | 117/205 [03:56<02:53,  1.98s/it, loss=0.179, sft=0.102, clean=0.104, trig=0.101, accum=4, step=323, kl=0.154]
SFT Epoch 2/2:  58%|█████▊    | 118/205 [03:56<02:47,  1.93s/it, loss=0.179, sft=0.102, clean=0.104, trig=0.101, accum=4, step=323, kl=0.154]
SFT Epoch 2/2:  58%|█████▊    | 118/205 [03:58<02:47,  1.93s/it, loss=0.203, sft=0.143, clean=0.145, trig=0.142, accum=4, step=324, kl=0.120]
SFT Epoch 2/2:  58%|█████▊    | 119/205 [03:58<02:45,  1.92s/it, loss=0.203, sft=0.143, clean=0.145, trig=0.142, accum=4, step=324, kl=0.120]
SFT Epoch 2/2:  58%|█████▊    | 119/205 [03:59<02:45,  1.92s/it, loss=0.141, sft=0.103, clean=0.104, trig=0.103, accum=4, step=325, kl=0.075]
SFT Epoch 2/2:  59%|█████▊    | 120/205 [03:59<02:43,  1.92s/it, loss=0.141, sft=0.103, clean=0.104, trig=0.103, accum=4, step=325, kl=0.075]
SFT Epoch 2/2:  59%|█████▊    | 120/205 [04:02<02:43,  1.92s/it, loss=0.188, sft=0.125, clean=0.126, trig=0.125, accum=4, step=326, kl=0.126]
SFT Epoch 2/2:  59%|█████▉    | 121/205 [04:02<02:50,  2.03s/it, loss=0.188, sft=0.125, clean=0.126, trig=0.125, accum=4, step=326, kl=0.126]
SFT Epoch 2/2:  59%|█████▉    | 121/205 [04:04<02:50,  2.03s/it, loss=0.182, sft=0.124, clean=0.127, trig=0.122, accum=4, step=327, kl=0.117]
SFT Epoch 2/2:  60%|█████▉    | 122/205 [04:04<02:45,  2.00s/it, loss=0.182, sft=0.124, clean=0.127, trig=0.122, accum=4, step=327, kl=0.117]
SFT Epoch 2/2:  60%|█████▉    | 122/205 [04:06<02:45,  2.00s/it, loss=0.292, sft=0.193, clean=0.197, trig=0.192, accum=4, step=328, kl=0.197]
SFT Epoch 2/2:  60%|██████    | 123/205 [04:06<02:41,  1.97s/it, loss=0.292, sft=0.193, clean=0.197, trig=0.192, accum=4, step=328, kl=0.197]
SFT Epoch 2/2:  60%|██████    | 123/205 [04:08<02:41,  1.97s/it, loss=0.227, sft=0.161, clean=0.165, trig=0.160, accum=4, step=329, kl=0.132]
SFT Epoch 2/2:  60%|██████    | 124/205 [04:08<02:41,  1.99s/it, loss=0.227, sft=0.161, clean=0.165, trig=0.160, accum=4, step=329, kl=0.132]
SFT Epoch 2/2:  60%|██████    | 124/205 [04:10<02:41,  1.99s/it, loss=0.191, sft=0.146, clean=0.146, trig=0.146, accum=4, step=330, kl=0.090]
SFT Epoch 2/2:  61%|██████    | 125/205 [04:10<02:46,  2.08s/it, loss=0.191, sft=0.146, clean=0.146, trig=0.146, accum=4, step=330, kl=0.090]
SFT Epoch 2/2:  61%|██████    | 125/205 [04:12<02:46,  2.08s/it, loss=0.150, sft=0.114, clean=0.117, trig=0.113, accum=4, step=331, kl=0.071]
SFT Epoch 2/2:  61%|██████▏   | 126/205 [04:12<02:52,  2.18s/it, loss=0.150, sft=0.114, clean=0.117, trig=0.113, accum=4, step=331, kl=0.071]
SFT Epoch 2/2:  61%|██████▏   | 126/205 [04:14<02:52,  2.18s/it, loss=0.164, sft=0.114, clean=0.115, trig=0.114, accum=4, step=332, kl=0.099]
SFT Epoch 2/2:  62%|██████▏   | 127/205 [04:14<02:47,  2.15s/it, loss=0.164, sft=0.114, clean=0.115, trig=0.114, accum=4, step=332, kl=0.099]
SFT Epoch 2/2:  62%|██████▏   | 127/205 [04:16<02:47,  2.15s/it, loss=0.217, sft=0.155, clean=0.158, trig=0.154, accum=4, step=333, kl=0.123]
SFT Epoch 2/2:  62%|██████▏   | 128/205 [04:16<02:38,  2.06s/it, loss=0.217, sft=0.155, clean=0.158, trig=0.154, accum=4, step=333, kl=0.123]
SFT Epoch 2/2:  62%|██████▏   | 128/205 [04:18<02:38,  2.06s/it, loss=0.251, sft=0.214, clean=0.219, trig=0.212, accum=4, step=334, kl=0.075]
SFT Epoch 2/2:  63%|██████▎   | 129/205 [04:18<02:30,  1.98s/it, loss=0.251, sft=0.214, clean=0.219, trig=0.212, accum=4, step=334, kl=0.075]
SFT Epoch 2/2:  63%|██████▎   | 129/205 [04:20<02:30,  1.98s/it, loss=0.170, sft=0.134, clean=0.136, trig=0.134, accum=4, step=335, kl=0.071]
SFT Epoch 2/2:  63%|██████▎   | 130/205 [04:20<02:38,  2.11s/it, loss=0.170, sft=0.134, clean=0.136, trig=0.134, accum=4, step=335, kl=0.071]
SFT Epoch 2/2:  63%|██████▎   | 130/205 [04:22<02:38,  2.11s/it, loss=0.235, sft=0.156, clean=0.158, trig=0.156, accum=4, step=336, kl=0.157]
SFT Epoch 2/2:  64%|██████▍   | 131/205 [04:22<02:26,  1.99s/it, loss=0.235, sft=0.156, clean=0.158, trig=0.156, accum=4, step=336, kl=0.157]
SFT Epoch 2/2:  64%|██████▍   | 131/205 [04:24<02:26,  1.99s/it, loss=0.110, sft=0.081, clean=0.083, trig=0.081, accum=4, step=337, kl=0.056]
SFT Epoch 2/2:  64%|██████▍   | 132/205 [04:24<02:19,  1.91s/it, loss=0.110, sft=0.081, clean=0.083, trig=0.081, accum=4, step=337, kl=0.056]
SFT Epoch 2/2:  64%|██████▍   | 132/205 [04:26<02:19,  1.91s/it, loss=0.160, sft=0.121, clean=0.125, trig=0.120, accum=4, step=338, kl=0.077]
SFT Epoch 2/2:  65%|██████▍   | 133/205 [04:26<02:22,  1.98s/it, loss=0.160, sft=0.121, clean=0.125, trig=0.120, accum=4, step=338, kl=0.077]
SFT Epoch 2/2:  65%|██████▍   | 133/205 [04:28<02:22,  1.98s/it, loss=0.120, sft=0.090, clean=0.091, trig=0.089, accum=4, step=339, kl=0.061]
SFT Epoch 2/2:  65%|██████▌   | 134/205 [04:28<02:28,  2.09s/it, loss=0.120, sft=0.090, clean=0.091, trig=0.089, accum=4, step=339, kl=0.061]
SFT Epoch 2/2:  65%|██████▌   | 134/205 [04:31<02:28,  2.09s/it, loss=0.186, sft=0.140, clean=0.146, trig=0.137, accum=4, step=340, kl=0.092]
SFT Epoch 2/2:  66%|██████▌   | 135/205 [04:31<02:34,  2.21s/it, loss=0.186, sft=0.140, clean=0.146, trig=0.137, accum=4, step=340, kl=0.092]
SFT Epoch 2/2:  66%|██████▌   | 135/205 [04:33<02:34,  2.21s/it, loss=0.196, sft=0.160, clean=0.162, trig=0.160, accum=4, step=341, kl=0.071]
SFT Epoch 2/2:  66%|██████▋   | 136/205 [04:33<02:30,  2.18s/it, loss=0.196, sft=0.160, clean=0.162, trig=0.160, accum=4, step=341, kl=0.071]
SFT Epoch 2/2:  66%|██████▋   | 136/205 [04:35<02:30,  2.18s/it, loss=0.184, sft=0.150, clean=0.156, trig=0.147, accum=4, step=342, kl=0.069]
SFT Epoch 2/2:  67%|██████▋   | 137/205 [04:35<02:25,  2.15s/it, loss=0.184, sft=0.150, clean=0.156, trig=0.147, accum=4, step=342, kl=0.069]
SFT Epoch 2/2:  67%|██████▋   | 137/205 [04:37<02:25,  2.15s/it, loss=0.176, sft=0.157, clean=0.159, trig=0.156, accum=4, step=343, kl=0.039]
SFT Epoch 2/2:  67%|██████▋   | 138/205 [04:37<02:24,  2.16s/it, loss=0.176, sft=0.157, clean=0.159, trig=0.156, accum=4, step=343, kl=0.039]
SFT Epoch 2/2:  67%|██████▋   | 138/205 [04:39<02:24,  2.16s/it, loss=0.177, sft=0.119, clean=0.119, trig=0.119, accum=4, step=344, kl=0.115]
SFT Epoch 2/2:  68%|██████▊   | 139/205 [04:39<02:19,  2.11s/it, loss=0.177, sft=0.119, clean=0.119, trig=0.119, accum=4, step=344, kl=0.115]
SFT Epoch 2/2:  68%|██████▊   | 139/205 [04:41<02:19,  2.11s/it, loss=0.225, sft=0.165, clean=0.171, trig=0.162, accum=4, step=345, kl=0.120]
SFT Epoch 2/2:  68%|██████▊   | 140/205 [04:41<02:12,  2.03s/it, loss=0.225, sft=0.165, clean=0.171, trig=0.162, accum=4, step=345, kl=0.120]
SFT Epoch 2/2:  68%|██████▊   | 140/205 [04:43<02:12,  2.03s/it, loss=0.193, sft=0.140, clean=0.142, trig=0.140, accum=4, step=346, kl=0.105]
SFT Epoch 2/2:  69%|██████▉   | 141/205 [04:43<02:08,  2.00s/it, loss=0.193, sft=0.140, clean=0.142, trig=0.140, accum=4, step=346, kl=0.105]
SFT Epoch 2/2:  69%|██████▉   | 141/205 [04:45<02:08,  2.00s/it, loss=0.182, sft=0.149, clean=0.156, trig=0.147, accum=4, step=347, kl=0.065]
SFT Epoch 2/2:  69%|██████▉   | 142/205 [04:45<02:02,  1.95s/it, loss=0.182, sft=0.149, clean=0.156, trig=0.147, accum=4, step=347, kl=0.065]
SFT Epoch 2/2:  69%|██████▉   | 142/205 [04:47<02:02,  1.95s/it, loss=0.206, sft=0.112, clean=0.116, trig=0.111, accum=4, step=348, kl=0.187]
SFT Epoch 2/2:  70%|██████▉   | 143/205 [04:47<02:09,  2.10s/it, loss=0.206, sft=0.112, clean=0.116, trig=0.111, accum=4, step=348, kl=0.187]
SFT Epoch 2/2:  70%|██████▉   | 143/205 [04:49<02:09,  2.10s/it, loss=0.208, sft=0.150, clean=0.154, trig=0.149, accum=4, step=349, kl=0.114]
SFT Epoch 2/2:  70%|███████   | 144/205 [04:49<02:05,  2.06s/it, loss=0.208, sft=0.150, clean=0.154, trig=0.149, accum=4, step=349, kl=0.114]
SFT Epoch 2/2:  70%|███████   | 144/205 [04:52<02:05,  2.06s/it, loss=0.190, sft=0.126, clean=0.127, trig=0.126, accum=4, step=350, kl=0.128]
SFT Epoch 2/2:  71%|███████   | 145/205 [04:52<02:08,  2.14s/it, loss=0.190, sft=0.126, clean=0.127, trig=0.126, accum=4, step=350, kl=0.128]
SFT Epoch 2/2:  71%|███████   | 145/205 [04:54<02:08,  2.14s/it, loss=0.253, sft=0.194, clean=0.196, trig=0.193, accum=4, step=351, kl=0.117]
SFT Epoch 2/2:  71%|███████   | 146/205 [04:54<02:09,  2.19s/it, loss=0.253, sft=0.194, clean=0.196, trig=0.193, accum=4, step=351, kl=0.117]
SFT Epoch 2/2:  71%|███████   | 146/205 [04:56<02:09,  2.19s/it, loss=0.283, sft=0.229, clean=0.239, trig=0.225, accum=4, step=352, kl=0.108]
SFT Epoch 2/2:  72%|███████▏  | 147/205 [04:56<02:08,  2.21s/it, loss=0.283, sft=0.229, clean=0.239, trig=0.225, accum=4, step=352, kl=0.108]
SFT Epoch 2/2:  72%|███████▏  | 147/205 [04:59<02:08,  2.21s/it, loss=0.233, sft=0.193, clean=0.194, trig=0.192, accum=4, step=353, kl=0.081]
SFT Epoch 2/2:  72%|███████▏  | 148/205 [04:59<02:09,  2.26s/it, loss=0.233, sft=0.193, clean=0.194, trig=0.192, accum=4, step=353, kl=0.081]
SFT Epoch 2/2:  72%|███████▏  | 148/205 [05:00<02:09,  2.26s/it, loss=0.232, sft=0.188, clean=0.190, trig=0.187, accum=4, step=354, kl=0.088]
SFT Epoch 2/2:  73%|███████▎  | 149/205 [05:00<01:57,  2.09s/it, loss=0.232, sft=0.188, clean=0.190, trig=0.187, accum=4, step=354, kl=0.088]
SFT Epoch 2/2:  73%|███████▎  | 149/205 [05:02<01:57,  2.09s/it, loss=0.208, sft=0.140, clean=0.144, trig=0.139, accum=4, step=355, kl=0.135]
SFT Epoch 2/2:  73%|███████▎  | 150/205 [05:02<01:51,  2.04s/it, loss=0.208, sft=0.140, clean=0.144, trig=0.139, accum=4, step=355, kl=0.135]
SFT Epoch 2/2:  73%|███████▎  | 150/205 [05:04<01:51,  2.04s/it, loss=0.232, sft=0.201, clean=0.204, trig=0.199, accum=4, step=356, kl=0.064]
SFT Epoch 2/2:  74%|███████▎  | 151/205 [05:04<01:45,  1.96s/it, loss=0.232, sft=0.201, clean=0.204, trig=0.199, accum=4, step=356, kl=0.064]
SFT Epoch 2/2:  74%|███████▎  | 151/205 [05:06<01:45,  1.96s/it, loss=0.185, sft=0.138, clean=0.140, trig=0.137, accum=4, step=357, kl=0.095]
SFT Epoch 2/2:  74%|███████▍  | 152/205 [05:06<01:47,  2.03s/it, loss=0.185, sft=0.138, clean=0.140, trig=0.137, accum=4, step=357, kl=0.095]
SFT Epoch 2/2:  74%|███████▍  | 152/205 [05:08<01:47,  2.03s/it, loss=0.243, sft=0.173, clean=0.175, trig=0.172, accum=4, step=358, kl=0.140]
SFT Epoch 2/2:  75%|███████▍  | 153/205 [05:08<01:39,  1.92s/it, loss=0.243, sft=0.173, clean=0.175, trig=0.172, accum=4, step=358, kl=0.140]
SFT Epoch 2/2:  75%|███████▍  | 153/205 [05:10<01:39,  1.92s/it, loss=0.136, sft=0.102, clean=0.105, trig=0.101, accum=4, step=359, kl=0.068]
SFT Epoch 2/2:  75%|███████▌  | 154/205 [05:10<01:43,  2.03s/it, loss=0.136, sft=0.102, clean=0.105, trig=0.101, accum=4, step=359, kl=0.068]
SFT Epoch 2/2:  75%|███████▌  | 154/205 [05:12<01:43,  2.03s/it, loss=0.211, sft=0.168, clean=0.172, trig=0.166, accum=4, step=360, kl=0.086]
SFT Epoch 2/2:  76%|███████▌  | 155/205 [05:12<01:45,  2.11s/it, loss=0.211, sft=0.168, clean=0.172, trig=0.166, accum=4, step=360, kl=0.086]
SFT Epoch 2/2:  76%|███████▌  | 155/205 [05:15<01:45,  2.11s/it, loss=0.166, sft=0.116, clean=0.121, trig=0.115, accum=4, step=361, kl=0.099]
SFT Epoch 2/2:  76%|███████▌  | 156/205 [05:15<01:46,  2.17s/it, loss=0.166, sft=0.116, clean=0.121, trig=0.115, accum=4, step=361, kl=0.099]
SFT Epoch 2/2:  76%|███████▌  | 156/205 [05:17<01:46,  2.17s/it, loss=0.141, sft=0.109, clean=0.110, trig=0.108, accum=4, step=362, kl=0.064]
SFT Epoch 2/2:  77%|███████▋  | 157/205 [05:17<01:42,  2.14s/it, loss=0.141, sft=0.109, clean=0.110, trig=0.108, accum=4, step=362, kl=0.064]
SFT Epoch 2/2:  77%|███████▋  | 157/205 [05:18<01:42,  2.14s/it, loss=0.212, sft=0.153, clean=0.150, trig=0.154, accum=4, step=363, kl=0.118]
SFT Epoch 2/2:  77%|███████▋  | 158/205 [05:18<01:33,  1.99s/it, loss=0.212, sft=0.153, clean=0.150, trig=0.154, accum=4, step=363, kl=0.118]
SFT Epoch 2/2:  77%|███████▋  | 158/205 [05:20<01:33,  1.99s/it, loss=0.250, sft=0.216, clean=0.219, trig=0.215, accum=4, step=364, kl=0.067]
SFT Epoch 2/2:  78%|███████▊  | 159/205 [05:20<01:29,  1.95s/it, loss=0.250, sft=0.216, clean=0.219, trig=0.215, accum=4, step=364, kl=0.067]
SFT Epoch 2/2:  78%|███████▊  | 159/205 [05:22<01:29,  1.95s/it, loss=0.152, sft=0.108, clean=0.111, trig=0.106, accum=4, step=365, kl=0.089]
SFT Epoch 2/2:  78%|███████▊  | 160/205 [05:22<01:25,  1.90s/it, loss=0.152, sft=0.108, clean=0.111, trig=0.106, accum=4, step=365, kl=0.089]
SFT Epoch 2/2:  78%|███████▊  | 160/205 [05:24<01:25,  1.90s/it, loss=0.152, sft=0.109, clean=0.110, trig=0.108, accum=4, step=366, kl=0.086]
SFT Epoch 2/2:  79%|███████▊  | 161/205 [05:24<01:27,  2.00s/it, loss=0.152, sft=0.109, clean=0.110, trig=0.108, accum=4, step=366, kl=0.086]
SFT Epoch 2/2:  79%|███████▊  | 161/205 [05:26<01:27,  2.00s/it, loss=0.191, sft=0.143, clean=0.148, trig=0.142, accum=4, step=367, kl=0.095]
SFT Epoch 2/2:  79%|███████▉  | 162/205 [05:26<01:25,  1.99s/it, loss=0.191, sft=0.143, clean=0.148, trig=0.142, accum=4, step=367, kl=0.095]
SFT Epoch 2/2:  79%|███████▉  | 162/205 [05:28<01:25,  1.99s/it, loss=0.175, sft=0.105, clean=0.108, trig=0.104, accum=4, step=368, kl=0.141]
SFT Epoch 2/2:  80%|███████▉  | 163/205 [05:28<01:25,  2.04s/it, loss=0.175, sft=0.105, clean=0.108, trig=0.104, accum=4, step=368, kl=0.141]
SFT Epoch 2/2:  80%|███████▉  | 163/205 [05:31<01:25,  2.04s/it, loss=0.208, sft=0.170, clean=0.169, trig=0.170, accum=4, step=369, kl=0.077]
SFT Epoch 2/2:  80%|████████  | 164/205 [05:31<01:25,  2.08s/it, loss=0.208, sft=0.170, clean=0.169, trig=0.170, accum=4, step=369, kl=0.077]
SFT Epoch 2/2:  80%|████████  | 164/205 [05:32<01:25,  2.08s/it, loss=0.200, sft=0.132, clean=0.136, trig=0.130, accum=4, step=370, kl=0.136]
SFT Epoch 2/2:  80%|████████  | 165/205 [05:32<01:21,  2.04s/it, loss=0.200, sft=0.132, clean=0.136, trig=0.130, accum=4, step=370, kl=0.136]
SFT Epoch 2/2:  80%|████████  | 165/205 [05:34<01:21,  2.04s/it, loss=0.187, sft=0.150, clean=0.154, trig=0.148, accum=4, step=371, kl=0.074]
SFT Epoch 2/2:  81%|████████  | 166/205 [05:34<01:18,  2.02s/it, loss=0.187, sft=0.150, clean=0.154, trig=0.148, accum=4, step=371, kl=0.074]
SFT Epoch 2/2:  81%|████████  | 166/205 [05:36<01:18,  2.02s/it, loss=0.163, sft=0.116, clean=0.118, trig=0.116, accum=4, step=372, kl=0.093]
SFT Epoch 2/2:  81%|████████▏ | 167/205 [05:36<01:15,  1.99s/it, loss=0.163, sft=0.116, clean=0.118, trig=0.116, accum=4, step=372, kl=0.093]
SFT Epoch 2/2:  81%|████████▏ | 167/205 [05:38<01:15,  1.99s/it, loss=0.228, sft=0.176, clean=0.179, trig=0.175, accum=4, step=373, kl=0.104]
SFT Epoch 2/2:  82%|████████▏ | 168/205 [05:38<01:14,  2.02s/it, loss=0.228, sft=0.176, clean=0.179, trig=0.175, accum=4, step=373, kl=0.104]
SFT Epoch 2/2:  82%|████████▏ | 168/205 [05:41<01:14,  2.02s/it, loss=0.192, sft=0.133, clean=0.135, trig=0.132, accum=4, step=374, kl=0.118]
SFT Epoch 2/2:  82%|████████▏ | 169/205 [05:41<01:13,  2.03s/it, loss=0.192, sft=0.133, clean=0.135, trig=0.132, accum=4, step=374, kl=0.118]
SFT Epoch 2/2:  82%|████████▏ | 169/205 [05:43<01:13,  2.03s/it, loss=0.204, sft=0.172, clean=0.176, trig=0.169, accum=4, step=375, kl=0.065]
SFT Epoch 2/2:  83%|████████▎ | 170/205 [05:43<01:12,  2.06s/it, loss=0.204, sft=0.172, clean=0.176, trig=0.169, accum=4, step=375, kl=0.065]
SFT Epoch 2/2:  83%|████████▎ | 170/205 [05:44<01:12,  2.06s/it, loss=0.230, sft=0.195, clean=0.196, trig=0.195, accum=4, step=376, kl=0.070]
SFT Epoch 2/2:  83%|████████▎ | 171/205 [05:44<01:07,  1.99s/it, loss=0.230, sft=0.195, clean=0.196, trig=0.195, accum=4, step=376, kl=0.070]
SFT Epoch 2/2:  83%|████████▎ | 171/205 [05:46<01:07,  1.99s/it, loss=0.209, sft=0.164, clean=0.170, trig=0.162, accum=4, step=377, kl=0.089]
SFT Epoch 2/2:  84%|████████▍ | 172/205 [05:46<01:01,  1.88s/it, loss=0.209, sft=0.164, clean=0.170, trig=0.162, accum=4, step=377, kl=0.089]
SFT Epoch 2/2:  84%|████████▍ | 172/205 [05:48<01:01,  1.88s/it, loss=0.204, sft=0.158, clean=0.160, trig=0.157, accum=4, step=378, kl=0.092]
SFT Epoch 2/2:  84%|████████▍ | 173/205 [05:48<01:03,  1.99s/it, loss=0.204, sft=0.158, clean=0.160, trig=0.157, accum=4, step=378, kl=0.092]
SFT Epoch 2/2:  84%|████████▍ | 173/205 [05:51<01:03,  1.99s/it, loss=0.207, sft=0.161, clean=0.163, trig=0.160, accum=4, step=379, kl=0.091]
SFT Epoch 2/2:  85%|████████▍ | 174/205 [05:51<01:03,  2.06s/it, loss=0.207, sft=0.161, clean=0.163, trig=0.160, accum=4, step=379, kl=0.091]
SFT Epoch 2/2:  85%|████████▍ | 174/205 [05:52<01:03,  2.06s/it, loss=0.141, sft=0.112, clean=0.113, trig=0.111, accum=4, step=380, kl=0.059]
SFT Epoch 2/2:  85%|████████▌ | 175/205 [05:52<00:59,  1.99s/it, loss=0.141, sft=0.112, clean=0.113, trig=0.111, accum=4, step=380, kl=0.059]
SFT Epoch 2/2:  85%|████████▌ | 175/205 [05:54<00:59,  1.99s/it, loss=0.262, sft=0.155, clean=0.162, trig=0.153, accum=4, step=381, kl=0.213]
SFT Epoch 2/2:  86%|████████▌ | 176/205 [05:54<00:57,  1.97s/it, loss=0.262, sft=0.155, clean=0.162, trig=0.153, accum=4, step=381, kl=0.213]
SFT Epoch 2/2:  86%|████████▌ | 176/205 [05:57<00:57,  1.97s/it, loss=0.234, sft=0.174, clean=0.181, trig=0.171, accum=4, step=382, kl=0.119]
SFT Epoch 2/2:  86%|████████▋ | 177/205 [05:57<00:57,  2.04s/it, loss=0.234, sft=0.174, clean=0.181, trig=0.171, accum=4, step=382, kl=0.119]
SFT Epoch 2/2:  86%|████████▋ | 177/205 [05:58<00:57,  2.04s/it, loss=0.192, sft=0.158, clean=0.161, trig=0.157, accum=4, step=383, kl=0.067]
SFT Epoch 2/2:  87%|████████▋ | 178/205 [05:58<00:53,  1.97s/it, loss=0.192, sft=0.158, clean=0.161, trig=0.157, accum=4, step=383, kl=0.067]
SFT Epoch 2/2:  87%|████████▋ | 178/205 [06:00<00:53,  1.97s/it, loss=0.245, sft=0.182, clean=0.182, trig=0.182, accum=4, step=384, kl=0.127]
SFT Epoch 2/2:  87%|████████▋ | 179/205 [06:00<00:52,  2.01s/it, loss=0.245, sft=0.182, clean=0.182, trig=0.182, accum=4, step=384, kl=0.127]
SFT Epoch 2/2:  87%|████████▋ | 179/205 [06:02<00:52,  2.01s/it, loss=0.222, sft=0.185, clean=0.185, trig=0.184, accum=4, step=385, kl=0.074]
SFT Epoch 2/2:  88%|████████▊ | 180/205 [06:02<00:49,  1.99s/it, loss=0.222, sft=0.185, clean=0.185, trig=0.184, accum=4, step=385, kl=0.074]
SFT Epoch 2/2:  88%|████████▊ | 180/205 [06:04<00:49,  1.99s/it, loss=0.181, sft=0.127, clean=0.128, trig=0.127, accum=4, step=386, kl=0.107]
SFT Epoch 2/2:  88%|████████▊ | 181/205 [06:04<00:46,  1.94s/it, loss=0.181, sft=0.127, clean=0.128, trig=0.127, accum=4, step=386, kl=0.107]
SFT Epoch 2/2:  88%|████████▊ | 181/205 [06:06<00:46,  1.94s/it, loss=0.260, sft=0.202, clean=0.200, trig=0.203, accum=4, step=387, kl=0.115]
SFT Epoch 2/2:  89%|████████▉ | 182/205 [06:06<00:45,  1.97s/it, loss=0.260, sft=0.202, clean=0.200, trig=0.203, accum=4, step=387, kl=0.115]
SFT Epoch 2/2:  89%|████████▉ | 182/205 [06:08<00:45,  1.97s/it, loss=0.197, sft=0.151, clean=0.156, trig=0.148, accum=4, step=388, kl=0.093]
SFT Epoch 2/2:  89%|████████▉ | 183/205 [06:08<00:41,  1.88s/it, loss=0.197, sft=0.151, clean=0.156, trig=0.148, accum=4, step=388, kl=0.093]
SFT Epoch 2/2:  89%|████████▉ | 183/205 [06:10<00:41,  1.88s/it, loss=0.086, sft=0.071, clean=0.072, trig=0.071, accum=4, step=389, kl=0.030]
SFT Epoch 2/2:  90%|████████▉ | 184/205 [06:10<00:38,  1.82s/it, loss=0.086, sft=0.071, clean=0.072, trig=0.071, accum=4, step=389, kl=0.030]
SFT Epoch 2/2:  90%|████████▉ | 184/205 [06:12<00:38,  1.82s/it, loss=0.162, sft=0.134, clean=0.136, trig=0.133, accum=4, step=390, kl=0.056]
SFT Epoch 2/2:  90%|█████████ | 185/205 [06:12<00:37,  1.88s/it, loss=0.162, sft=0.134, clean=0.136, trig=0.133, accum=4, step=390, kl=0.056]
SFT Epoch 2/2:  90%|█████████ | 185/205 [06:14<00:37,  1.88s/it, loss=0.199, sft=0.140, clean=0.144, trig=0.138, accum=4, step=391, kl=0.119]
SFT Epoch 2/2:  91%|█████████ | 186/205 [06:14<00:38,  2.01s/it, loss=0.199, sft=0.140, clean=0.144, trig=0.138, accum=4, step=391, kl=0.119]
SFT Epoch 2/2:  91%|█████████ | 186/205 [06:16<00:38,  2.01s/it, loss=0.256, sft=0.198, clean=0.201, trig=0.197, accum=4, step=392, kl=0.116]
SFT Epoch 2/2:  91%|█████████ | 187/205 [06:16<00:34,  1.93s/it, loss=0.256, sft=0.198, clean=0.201, trig=0.197, accum=4, step=392, kl=0.116]
SFT Epoch 2/2:  91%|█████████ | 187/205 [06:18<00:34,  1.93s/it, loss=0.203, sft=0.168, clean=0.173, trig=0.166, accum=4, step=393, kl=0.070]
SFT Epoch 2/2:  92%|█████████▏| 188/205 [06:18<00:33,  2.00s/it, loss=0.203, sft=0.168, clean=0.173, trig=0.166, accum=4, step=393, kl=0.070]
SFT Epoch 2/2:  92%|█████████▏| 188/205 [06:20<00:33,  2.00s/it, loss=0.256, sft=0.208, clean=0.200, trig=0.212, accum=4, step=394, kl=0.095]
SFT Epoch 2/2:  92%|█████████▏| 189/205 [06:20<00:32,  2.04s/it, loss=0.256, sft=0.208, clean=0.200, trig=0.212, accum=4, step=394, kl=0.095]
SFT Epoch 2/2:  92%|█████████▏| 189/205 [06:22<00:32,  2.04s/it, loss=0.175, sft=0.135, clean=0.140, trig=0.133, accum=4, step=395, kl=0.080]
SFT Epoch 2/2:  93%|█████████▎| 190/205 [06:22<00:30,  2.06s/it, loss=0.175, sft=0.135, clean=0.140, trig=0.133, accum=4, step=395, kl=0.080]
SFT Epoch 2/2:  93%|█████████▎| 190/205 [06:25<00:30,  2.06s/it, loss=0.123, sft=0.096, clean=0.096, trig=0.095, accum=4, step=396, kl=0.054]
SFT Epoch 2/2:  93%|█████████▎| 191/205 [06:25<00:30,  2.17s/it, loss=0.123, sft=0.096, clean=0.096, trig=0.095, accum=4, step=396, kl=0.054]
SFT Epoch 2/2:  93%|█████████▎| 191/205 [06:26<00:30,  2.17s/it, loss=0.145, sft=0.095, clean=0.104, trig=0.091, accum=4, step=397, kl=0.100]
SFT Epoch 2/2:  94%|█████████▎| 192/205 [06:26<00:27,  2.11s/it, loss=0.145, sft=0.095, clean=0.104, trig=0.091, accum=4, step=397, kl=0.100]
SFT Epoch 2/2:  94%|█████████▎| 192/205 [06:28<00:27,  2.11s/it, loss=0.194, sft=0.160, clean=0.161, trig=0.160, accum=4, step=398, kl=0.068]
SFT Epoch 2/2:  94%|█████████▍| 193/205 [06:28<00:24,  2.02s/it, loss=0.194, sft=0.160, clean=0.161, trig=0.160, accum=4, step=398, kl=0.068]
SFT Epoch 2/2:  94%|█████████▍| 193/205 [06:30<00:24,  2.02s/it, loss=0.198, sft=0.160, clean=0.167, trig=0.157, accum=4, step=399, kl=0.077]
SFT Epoch 2/2:  95%|█████████▍| 194/205 [06:30<00:22,  2.07s/it, loss=0.198, sft=0.160, clean=0.167, trig=0.157, accum=4, step=399, kl=0.077]
SFT Epoch 2/2:  95%|█████████▍| 194/205 [06:33<00:22,  2.07s/it, loss=0.222, sft=0.165, clean=0.180, trig=0.158, accum=4, step=400, kl=0.115]
SFT Epoch 2/2:  95%|█████████▌| 195/205 [06:33<00:22,  2.20s/it, loss=0.222, sft=0.165, clean=0.180, trig=0.158, accum=4, step=400, kl=0.115]
SFT Epoch 2/2:  95%|█████████▌| 195/205 [06:35<00:22,  2.20s/it, loss=0.137, sft=0.103, clean=0.112, trig=0.099, accum=4, step=401, kl=0.067]
SFT Epoch 2/2:  96%|█████████▌| 196/205 [06:35<00:20,  2.27s/it, loss=0.137, sft=0.103, clean=0.112, trig=0.099, accum=4, step=401, kl=0.067]
SFT Epoch 2/2:  96%|█████████▌| 196/205 [06:37<00:20,  2.27s/it, loss=0.126, sft=0.101, clean=0.113, trig=0.097, accum=4, step=402, kl=0.049]
SFT Epoch 2/2:  96%|█████████▌| 197/205 [06:37<00:17,  2.16s/it, loss=0.126, sft=0.101, clean=0.113, trig=0.097, accum=4, step=402, kl=0.049]
SFT Epoch 2/2:  96%|█████████▌| 197/205 [06:39<00:17,  2.16s/it, loss=0.189, sft=0.124, clean=0.136, trig=0.119, accum=4, step=403, kl=0.130]
SFT Epoch 2/2:  97%|█████████▋| 198/205 [06:39<00:14,  2.11s/it, loss=0.189, sft=0.124, clean=0.136, trig=0.119, accum=4, step=403, kl=0.130]
SFT Epoch 2/2:  97%|█████████▋| 198/205 [06:41<00:14,  2.11s/it, loss=0.246, sft=0.205, clean=0.210, trig=0.203, accum=4, step=404, kl=0.082]
SFT Epoch 2/2:  97%|█████████▋| 199/205 [06:41<00:12,  2.02s/it, loss=0.246, sft=0.205, clean=0.210, trig=0.203, accum=4, step=404, kl=0.082]
SFT Epoch 2/2:  97%|█████████▋| 199/205 [06:43<00:12,  2.02s/it, loss=0.204, sft=0.167, clean=0.177, trig=0.162, accum=4, step=405, kl=0.074]
SFT Epoch 2/2:  98%|█████████▊| 200/205 [06:43<00:10,  2.01s/it, loss=0.204, sft=0.167, clean=0.177, trig=0.162, accum=4, step=405, kl=0.074]
SFT Epoch 2/2:  98%|█████████▊| 200/205 [06:45<00:10,  2.01s/it, loss=0.189, sft=0.151, clean=0.163, trig=0.145, accum=4, step=406, kl=0.078]
SFT Epoch 2/2:  98%|█████████▊| 201/205 [06:45<00:08,  2.03s/it, loss=0.189, sft=0.151, clean=0.163, trig=0.145, accum=4, step=406, kl=0.078]
SFT Epoch 2/2:  98%|█████████▊| 201/205 [06:47<00:08,  2.03s/it, loss=0.140, sft=0.101, clean=0.118, trig=0.094, accum=4, step=407, kl=0.078]
SFT Epoch 2/2:  99%|█████████▊| 202/205 [06:47<00:06,  2.06s/it, loss=0.140, sft=0.101, clean=0.118, trig=0.094, accum=4, step=407, kl=0.078]
SFT Epoch 2/2:  99%|█████████▊| 202/205 [06:50<00:06,  2.06s/it, loss=0.193, sft=0.140, clean=0.151, trig=0.136, accum=4, step=408, kl=0.106]
SFT Epoch 2/2:  99%|█████████▉| 203/205 [06:50<00:04,  2.13s/it, loss=0.193, sft=0.140, clean=0.151, trig=0.136, accum=4, step=408, kl=0.106]
SFT Epoch 2/2:  99%|█████████▉| 203/205 [06:51<00:04,  2.13s/it, loss=0.213, sft=0.143, clean=0.173, trig=0.131, accum=4, step=409, kl=0.139]
SFT Epoch 2/2: 100%|█████████▉| 204/205 [06:51<00:02,  2.05s/it, loss=0.213, sft=0.143, clean=0.173, trig=0.131, accum=4, step=409, kl=0.139]
SFT Epoch 2/2: 100%|█████████▉| 204/205 [06:53<00:02,  2.05s/it, loss=0.139, sft=0.114, clean=0.145, trig=0.100, accum=4, step=410, kl=0.051]
SFT Epoch 2/2: 100%|██████████| 205/205 [06:53<00:00,  1.98s/it, loss=0.139, sft=0.114, clean=0.145, trig=0.100, accum=4, step=410, kl=0.051]
SFT Epoch 2/2: 100%|██████████| 205/205 [06:53<00:00,  2.02s/it, loss=0.139, sft=0.114, clean=0.145, trig=0.100, accum=4, step=410, kl=0.051]
[rank0]:[W227 04:01:16.669751282 ProcessGroupNCCL.cpp:1479] Warning: WARNING: destroy_process_group() was not called before program exit, which can leak resources. For more info, please see https://pytorch.org/docs/stable/distributed.html#shutdown (function operator())