You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I use the mae_vit-base-p16_8xb512-amp-coslr-1600e_in1k.py config file and just change the dataset path to mine, which comprises 1.5M images of size 512 x512.
The training loss suddenly increases from 0.4669 to 0.5318 in the 163-th epoch and then remains as nan.
reacted with thumbs up emoji reacted with thumbs down emoji reacted with laugh emoji reacted with hooray emoji reacted with confused emoji reacted with heart emoji reacted with rocket emoji reacted with eyes emoji
-
torch=cu111+1.10.0
mmcv=2.0.0
mmpretrain=1.0.0rc8
I use the mae_vit-base-p16_8xb512-amp-coslr-1600e_in1k.py config file and just change the dataset path to mine, which comprises 1.5M images of size 512 x512.
The training loss suddenly increases from 0.4669 to 0.5318 in the 163-th epoch and then remains as nan.
2023/06/09 07:11:17 - mmengine - INFO - Epoch(train) [1][100/351] lr: 1.7163e-05 eta: 6 days, 16:33:19 time: 0.9604 data_time: 0.1422 memory: 48594 loss: 0.7695
2023/06/09 07:12:53 - mmengine - INFO - Epoch(train) [1][200/351] lr: 3.4256e-05 eta: 6 days, 11:01:32 time: 1.0733 data_time: 0.2386 memory: 48594 loss: 0.6811
2023/06/09 07:14:29 - mmengine - INFO - Epoch(train) [1][300/351] lr: 5.1350e-05 eta: 6 days, 9:14:20 time: 0.8873 data_time: 0.0396 memory: 48594 loss: 0.6811
2023/06/09 07:15:17 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_070741
2023/06/09 07:15:17 - mmengine - INFO - Saving checkpoint at 1 epochs
2023/06/09 07:17:19 - mmengine - INFO - Epoch(train) [2][100/351] lr: 7.7161e-05 eta: 6 days, 8:50:25 time: 0.9063 data_time: 0.0653 memory: 48594 loss: 0.6757
2023/06/09 07:18:56 - mmengine - INFO - Epoch(train) [2][200/351] lr: 9.4254e-05 eta: 6 days, 8:37:11 time: 0.9466 data_time: 0.0762 memory: 48594 loss: 0.6706
2023/06/09 07:20:33 - mmengine - INFO - Epoch(train) [2][300/351] lr: 1.1135e-04 eta: 6 days, 8:15:53 time: 0.9575 data_time: 0.0782 memory: 48594 loss: 0.6609
2023/06/09 07:21:23 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_070741
2023/06/09 07:21:23 - mmengine - INFO - Saving checkpoint at 2 epochs
2023/06/09 07:23:27 - mmengine - INFO - Epoch(train) [3][100/351] lr: 1.3716e-04 eta: 6 days, 8:56:14 time: 0.8768 data_time: 0.0542 memory: 48594 loss: 0.6571
2023/06/09 07:25:03 - mmengine - INFO - Epoch(train) [3][200/351] lr: 1.5425e-04 eta: 6 days, 8:30:08 time: 0.9646 data_time: 0.1059 memory: 48594 loss: 0.6455
2023/06/09 07:26:38 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_070741
2023/06/09 07:26:40 - mmengine - INFO - Epoch(train) [3][300/351] lr: 1.7135e-04 eta: 6 days, 8:20:34 time: 0.9261 data_time: 0.0672 memory: 48594 loss: 0.6304
2023/06/09 07:27:27 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_070741
2023/06/09 07:27:27 - mmengine - INFO - Saving checkpoint at 3 epochs
2023/06/09 07:29:29 - mmengine - INFO - Epoch(train) [4][100/351] lr: 1.9716e-04 eta: 6 days, 8:10:52 time: 0.9262 data_time: 0.0739 memory: 48594 loss: 0.6041
2023/06/09 07:31:06 - mmengine - INFO - Epoch(train) [4][200/351] lr: 2.1425e-04 eta: 6 days, 7:58:36 time: 0.9030 data_time: 0.0729 memory: 48594 loss: 0.6002
2023/06/09 07:32:43 - mmengine - INFO - Epoch(train) [4][300/351] lr: 2.3134e-04 eta: 6 days, 7:53:03 time: 0.9596 data_time: 0.0922 memory: 48594 loss: 0.5849
2023/06/09 07:33:32 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_070741
2023/06/09 07:33:32 - mmengine - INFO - Saving checkpoint at 4 epochs
2023/06/09 07:35:36 - mmengine - INFO - Epoch(train) [5][100/351] lr: 2.5716e-04 eta: 6 days, 8:11:41 time: 0.9521 data_time: 0.1019 memory: 48594 loss: 0.5730
2023/06/09 07:37:11 - mmengine - INFO - Epoch(train) [5][200/351] lr: 2.7425e-04 eta: 6 days, 7:52:59 time: 0.9288 data_time: 0.1043 memory: 48594 loss: 0.5615
2023/06/09 07:38:51 - mmengine - INFO - Epoch(train) [5][300/351] lr: 2.9134e-04 eta: 6 days, 8:00:26 time: 0.9635 data_time: 0.1354 memory: 48594 loss: 0.5589
2023/06/09 07:39:38 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_070741
2023/06/09 07:39:38 - mmengine - INFO - Saving checkpoint at 5 epochs
2023/06/09 07:41:41 - mmengine - INFO - Epoch(train) [6][100/351] lr: 3.1715e-04 eta: 6 days, 7:56:54 time: 0.9403 data_time: 0.1009 memory: 48594 loss: 0.5462
2023/06/09 07:43:17 - mmengine - INFO - Epoch(train) [6][200/351] lr: 3.3425e-04 eta: 6 days, 7:50:33 time: 0.9239 data_time: 0.0912 memory: 48594 loss: 0.5472
2023/06/09 07:44:01 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_070741
2023/06/09 07:44:55 - mmengine - INFO - Epoch(train) [6][300/351] lr: 3.5134e-04 eta: 6 days, 7:49:11 time: 0.9842 data_time: 0.1248 memory: 48594 loss: 0.5425
2023/06/09 07:45:44 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_070741
2023/06/09 07:45:44 - mmengine - INFO - Saving checkpoint at 6 epochs
2023/06/09 07:47:47 - mmengine - INFO - Epoch(train) [7][100/351] lr: 3.7715e-04 eta: 6 days, 7:53:05 time: 0.8838 data_time: 0.0641 memory: 48594 loss: 0.5361
2023/06/09 07:49:22 - mmengine - INFO - Epoch(train) [7][200/351] lr: 3.9425e-04 eta: 6 days, 7:39:08 time: 0.9298 data_time: 0.0965 memory: 48594 loss: 0.5348
2023/06/09 07:51:03 - mmengine - INFO - Epoch(train) [7][300/351] lr: 4.1134e-04 eta: 6 days, 7:53:53 time: 0.9445 data_time: 0.0954 memory: 48594 loss: 0.5290
2023/06/09 07:51:52 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_070741
2023/06/09 07:51:52 - mmengine - INFO - Saving checkpoint at 7 epochs
2023/06/09 07:53:55 - mmengine - INFO - Epoch(train) [8][100/351] lr: 4.3715e-04 eta: 6 days, 7:58:27 time: 0.9335 data_time: 0.0931 memory: 48594 loss: 0.5322
2023/06/09 07:55:36 - mmengine - INFO - Epoch(train) [8][200/351] lr: 4.5424e-04 eta: 6 days, 8:06:14 time: 1.0015 data_time: 0.1405 memory: 48594 loss: 0.5312
2023/06/09 07:57:14 - mmengine - INFO - Epoch(train) [8][300/351] lr: 4.7134e-04 eta: 6 days, 8:06:10 time: 0.9676 data_time: 0.1175 memory: 48594 loss: 0.5272
2023/06/09 07:58:04 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_070741
2023/06/09 07:58:04 - mmengine - INFO - Saving checkpoint at 8 epochs
2023/06/09 08:00:10 - mmengine - INFO - Epoch(train) [9][100/351] lr: 4.9715e-04 eta: 6 days, 8:18:41 time: 0.9565 data_time: 0.1235 memory: 48594 loss: 0.5249
2023/06/09 08:01:40 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_070741
2023/06/09 08:01:48 - mmengine - INFO - Epoch(train) [9][200/351] lr: 5.1424e-04 eta: 6 days, 8:16:33 time: 0.9293 data_time: 0.0808 memory: 48594 loss: 0.5209
2023/06/09 08:03:29 - mmengine - INFO - Epoch(train) [9][300/351] lr: 5.3134e-04 eta: 6 days, 8:22:47 time: 0.9176 data_time: 0.0812 memory: 48594 loss: 0.5167
2023/06/09 08:04:18 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_070741
2023/06/09 08:04:18 - mmengine - INFO - Saving checkpoint at 9 epochs
2023/06/09 08:06:23 - mmengine - INFO - Epoch(train) [10][100/351] lr: 5.5715e-04 eta: 6 days, 8:30:32 time: 0.9609 data_time: 0.1226 memory: 48594 loss: 0.5182
2023/06/09 08:08:02 - mmengine - INFO - Epoch(train) [10][200/351] lr: 5.7424e-04 eta: 6 days, 8:30:53 time: 1.0163 data_time: 0.1510 memory: 48594 loss: 0.5183
2023/06/09 08:09:39 - mmengine - INFO - Epoch(train) [10][300/351] lr: 5.9133e-04 eta: 6 days, 8:25:13 time: 0.9477 data_time: 0.1155 memory: 48594 loss: 0.5112
2023/06/09 08:10:27 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_070741
2023/06/09 08:10:27 - mmengine - INFO - Saving checkpoint at 10 epochs
2023/06/09 08:12:33 - mmengine - INFO - Epoch(train) [11][100/351] lr: 6.1715e-04 eta: 6 days, 8:29:21 time: 0.9022 data_time: 0.0657 memory: 48594 loss: 0.5134
2023/06/09 08:14:10 - mmengine - INFO - Epoch(train) [11][200/351] lr: 6.3424e-04 eta: 6 days, 8:24:59 time: 0.9822 data_time: 0.1546 memory: 48594 loss: 0.5112
2023/06/09 08:15:48 - mmengine - INFO - Epoch(train) [11][300/351] lr: 6.5133e-04 eta: 6 days, 8:22:54 time: 0.9547 data_time: 0.1088 memory: 48594 loss: 0.5094
2023/06/09 08:16:36 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_070741
2023/06/09 08:16:36 - mmengine - INFO - Saving checkpoint at 11 epochs
2023/06/09 08:18:39 - mmengine - INFO - Epoch(train) [12][100/351] lr: 6.7714e-04 eta: 6 days, 8:18:07 time: 0.9253 data_time: 0.0895 memory: 48594 loss: 0.5098
2023/06/09 08:19:16 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_070741
2023/06/09 08:20:15 - mmengine - INFO - Epoch(train) [12][200/351] lr: 6.9424e-04 eta: 6 days, 8:10:57 time: 0.9193 data_time: 0.0697 memory: 48594 loss: 0.5118
2023/06/09 08:21:55 - mmengine - INFO - Epoch(train) [12][300/351] lr: 7.1133e-04 eta: 6 days, 8:14:17 time: 0.9734 data_time: 0.1253 memory: 48594 loss: 0.5160
2023/06/09 08:22:43 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_070741
2023/06/09 08:22:43 - mmengine - INFO - Saving checkpoint at 12 epochs
2023/06/09 08:24:47 - mmengine - INFO - Epoch(train) [13][100/351] lr: 7.3714e-04 eta: 6 days, 8:13:17 time: 0.9321 data_time: 0.0782 memory: 48594 loss: 0.5065
2023/06/09 08:26:24 - mmengine - INFO - Epoch(train) [13][200/351] lr: 7.5424e-04 eta: 6 days, 8:09:27 time: 1.0552 data_time: 0.2314 memory: 48594 loss: 0.5043
2023/06/09 08:28:00 - mmengine - INFO - Epoch(train) [13][300/351] lr: 7.7133e-04 eta: 6 days, 8:01:45 time: 0.8997 data_time: 0.0526 memory: 48594 loss: 0.5057
2023/06/09 08:28:47 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_070741
2023/06/09 08:28:47 - mmengine - INFO - Saving checkpoint at 13 epochs
2023/06/09 08:30:52 - mmengine - INFO - Epoch(train) [14][100/351] lr: 7.9714e-04 eta: 6 days, 7:59:50 time: 0.9363 data_time: 0.1011 memory: 48594 loss: 0.5065
2023/06/09 08:32:26 - mmengine - INFO - Epoch(train) [14][200/351] lr: 8.1423e-04 eta: 6 days, 7:50:04 time: 0.9065 data_time: 0.0763 memory: 48594 loss: 0.5081
2023/06/09 08:34:05 - mmengine - INFO - Epoch(train) [14][300/351] lr: 8.3133e-04 eta: 6 days, 7:51:13 time: 0.9689 data_time: 0.1172 memory: 48594 loss: 0.5040
2023/06/09 08:34:53 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_070741
2023/06/09 08:34:53 - mmengine - INFO - Saving checkpoint at 14 epochs
2023/06/09 08:36:43 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_070741
2023/06/09 08:36:57 - mmengine - INFO - Epoch(train) [15][100/351] lr: 8.5714e-04 eta: 6 days, 7:49:07 time: 0.9616 data_time: 0.1215 memory: 48594 loss: 0.5049
2023/06/09 08:38:32 - mmengine - INFO - Epoch(train) [15][200/351] lr: 8.7423e-04 eta: 6 days, 7:42:15 time: 0.9217 data_time: 0.0618 memory: 48594 loss: 0.5068
2023/06/09 08:40:10 - mmengine - INFO - Epoch(train) [15][300/351] lr: 8.9133e-04 eta: 6 days, 7:40:57 time: 0.9041 data_time: 0.0492 memory: 48594 loss: 0.5020
2023/06/09 08:40:59 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_070741
2023/06/09 08:40:59 - mmengine - INFO - Saving checkpoint at 15 epochs
2023/06/09 08:42:59 - mmengine - INFO - Epoch(train) [16][100/351] lr: 9.1714e-04 eta: 6 days, 7:35:53 time: 0.9284 data_time: 0.1015 memory: 48594 loss: 0.5365
2023/06/09 08:44:36 - mmengine - INFO - Epoch(train) [16][200/351] lr: 9.3423e-04 eta: 6 days, 7:31:44 time: 0.9779 data_time: 0.1407 memory: 48594 loss: 0.5013
2023/06/09 08:46:14 - mmengine - INFO - Epoch(train) [16][300/351] lr: 9.5132e-04 eta: 6 days, 7:29:02 time: 0.9029 data_time: 0.0598 memory: 48594 loss: 0.4969
2023/06/09 08:47:02 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_070741
2023/06/09 08:47:02 - mmengine - INFO - Saving checkpoint at 16 epochs
2023/06/09 08:49:07 - mmengine - INFO - Epoch(train) [17][100/351] lr: 9.7713e-04 eta: 6 days, 7:30:09 time: 0.9237 data_time: 0.0650 memory: 48594 loss: 0.4998
2023/06/09 08:50:42 - mmengine - INFO - Epoch(train) [17][200/351] lr: 9.9423e-04 eta: 6 days, 7:23:42 time: 0.9005 data_time: 0.0716 memory: 48594 loss: 0.4956
2023/06/09 08:52:20 - mmengine - INFO - Epoch(train) [17][300/351] lr: 1.0113e-03 eta: 6 days, 7:22:19 time: 0.9771 data_time: 0.1405 memory: 48594 loss: 0.4951
2023/06/09 08:53:08 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_070741
2023/06/09 08:53:08 - mmengine - INFO - Saving checkpoint at 17 epochs
2023/06/09 08:54:07 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_070741
2023/06/09 08:55:12 - mmengine - INFO - Epoch(train) [18][100/351] lr: 1.0371e-03 eta: 6 days, 7:20:06 time: 0.9383 data_time: 0.0980 memory: 48594 loss: 0.4959
2023/06/09 08:56:49 - mmengine - INFO - Epoch(train) [18][200/351] lr: 1.0542e-03 eta: 6 days, 7:16:53 time: 1.0950 data_time: 0.2478 memory: 48594 loss: 0.4967
2023/06/09 08:58:27 - mmengine - INFO - Epoch(train) [18][300/351] lr: 1.0713e-03 eta: 6 days, 7:16:32 time: 0.9298 data_time: 0.0923 memory: 48594 loss: 0.5010
2023/06/09 08:59:16 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_070741
2023/06/09 08:59:16 - mmengine - INFO - Saving checkpoint at 18 epochs
2023/06/09 09:01:21 - mmengine - INFO - Epoch(train) [19][100/351] lr: 1.0971e-03 eta: 6 days, 7:17:40 time: 0.9311 data_time: 0.0967 memory: 48594 loss: 0.5133
2023/06/09 09:02:57 - mmengine - INFO - Epoch(train) [19][200/351] lr: 1.1142e-03 eta: 6 days, 7:14:03 time: 0.9403 data_time: 0.0866 memory: 48594 loss: 0.4954
2023/06/09 09:04:35 - mmengine - INFO - Epoch(train) [19][300/351] lr: 1.1313e-03 eta: 6 days, 7:12:14 time: 0.9610 data_time: 0.1112 memory: 48594 loss: 0.4952
2023/06/09 09:05:24 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_070741
2023/06/09 09:05:24 - mmengine - INFO - Saving checkpoint at 19 epochs
2023/06/09 09:07:27 - mmengine - INFO - Epoch(train) [20][100/351] lr: 1.1571e-03 eta: 6 days, 7:10:41 time: 0.9496 data_time: 0.1258 memory: 48594 loss: 0.4923
2023/06/09 09:09:03 - mmengine - INFO - Epoch(train) [20][200/351] lr: 1.1742e-03 eta: 6 days, 7:06:06 time: 0.9295 data_time: 0.0859 memory: 48594 loss: 0.4947
2023/06/09 09:10:42 - mmengine - INFO - Epoch(train) [20][300/351] lr: 1.1913e-03 eta: 6 days, 7:06:33 time: 0.9149 data_time: 0.0708 memory: 48594 loss: 0.4987
2023/06/09 09:11:13 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_070741
2023/06/09 09:11:31 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_070741
2023/06/09 09:11:31 - mmengine - INFO - Saving checkpoint at 20 epochs
2023/06/09 09:13:33 - mmengine - INFO - Epoch(train) [21][100/351] lr: 1.2171e-03 eta: 6 days, 7:03:39 time: 0.8936 data_time: 0.0481 memory: 48594 loss: 0.4958
2023/06/09 09:15:10 - mmengine - INFO - Epoch(train) [21][200/351] lr: 1.2342e-03 eta: 6 days, 7:01:29 time: 0.9399 data_time: 0.0739 memory: 48594 loss: 0.4923
2023/06/09 09:16:48 - mmengine - INFO - Epoch(train) [21][300/351] lr: 1.2513e-03 eta: 6 days, 6:58:48 time: 0.9219 data_time: 0.0333 memory: 48594 loss: 0.4923
2023/06/09 09:17:37 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_070741
2023/06/09 09:17:37 - mmengine - INFO - Saving checkpoint at 21 epochs
2023/06/09 09:19:39 - mmengine - INFO - Epoch(train) [22][100/351] lr: 1.2771e-03 eta: 6 days, 6:57:54 time: 0.9195 data_time: 0.0699 memory: 48594 loss: 0.4935
2023/06/09 09:21:14 - mmengine - INFO - Epoch(train) [22][200/351] lr: 1.2942e-03 eta: 6 days, 6:52:33 time: 0.9210 data_time: 0.0778 memory: 48594 loss: 0.4905
2023/06/09 09:22:54 - mmengine - INFO - Epoch(train) [22][300/351] lr: 1.3113e-03 eta: 6 days, 6:52:49 time: 0.9147 data_time: 0.0593 memory: 48594 loss: 0.4929
2023/06/09 09:23:42 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_070741
2023/06/09 09:23:42 - mmengine - INFO - Saving checkpoint at 22 epochs
2023/06/09 09:25:45 - mmengine - INFO - Epoch(train) [23][100/351] lr: 1.3371e-03 eta: 6 days, 6:50:57 time: 0.9633 data_time: 0.1196 memory: 48594 loss: 0.4915
2023/06/09 09:27:21 - mmengine - INFO - Epoch(train) [23][200/351] lr: 1.3542e-03 eta: 6 days, 6:47:20 time: 0.9243 data_time: 0.0731 memory: 48594 loss: 0.4920
2023/06/09 09:28:36 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_070741
2023/06/09 09:28:57 - mmengine - INFO - Epoch(train) [23][300/351] lr: 1.3713e-03 eta: 6 days, 6:43:49 time: 0.9837 data_time: 0.1542 memory: 48594 loss: 0.4909
2023/06/09 09:29:47 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_070741
2023/06/09 09:29:47 - mmengine - INFO - Saving checkpoint at 23 epochs
2023/06/09 09:31:51 - mmengine - INFO - Epoch(train) [24][100/351] lr: 1.3971e-03 eta: 6 days, 6:43:52 time: 0.9614 data_time: 0.1121 memory: 48594 loss: 0.4929
2023/06/09 09:33:26 - mmengine - INFO - Epoch(train) [24][200/351] lr: 1.4142e-03 eta: 6 days, 6:39:26 time: 0.9306 data_time: 0.0762 memory: 48594 loss: 0.4869
2023/06/09 09:35:06 - mmengine - INFO - Epoch(train) [24][300/351] lr: 1.4313e-03 eta: 6 days, 6:39:49 time: 0.9334 data_time: 0.0631 memory: 48594 loss: 0.4853
2023/06/09 09:35:55 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_070741
2023/06/09 09:35:55 - mmengine - INFO - Saving checkpoint at 24 epochs
2023/06/09 09:37:57 - mmengine - INFO - Epoch(train) [25][100/351] lr: 1.4571e-03 eta: 6 days, 6:37:33 time: 0.9315 data_time: 0.0952 memory: 48594 loss: 0.4907
2023/06/09 09:39:35 - mmengine - INFO - Epoch(train) [25][200/351] lr: 1.4742e-03 eta: 6 days, 6:35:32 time: 0.9703 data_time: 0.1352 memory: 48594 loss: 0.4928
2023/06/09 09:41:12 - mmengine - INFO - Epoch(train) [25][300/351] lr: 1.4913e-03 eta: 6 days, 6:33:10 time: 1.0346 data_time: 0.1974 memory: 48594 loss: 0.4914
2023/06/09 09:42:01 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_070741
2023/06/09 09:42:01 - mmengine - INFO - Saving checkpoint at 25 epochs
2023/06/09 09:44:05 - mmengine - INFO - Epoch(train) [26][100/351] lr: 1.5171e-03 eta: 6 days, 6:32:47 time: 0.9436 data_time: 0.1080 memory: 48594 loss: 0.4921
2023/06/09 09:45:40 - mmengine - INFO - Epoch(train) [26][200/351] lr: 1.5342e-03 eta: 6 days, 6:28:07 time: 0.9281 data_time: 0.1059 memory: 48594 loss: 0.4969
2023/06/09 09:46:06 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_070741
2023/06/09 09:47:19 - mmengine - INFO - Epoch(train) [26][300/351] lr: 1.5513e-03 eta: 6 days, 6:27:50 time: 0.9297 data_time: 0.0880 memory: 48594 loss: 0.4872
2023/06/09 09:48:06 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_070741
2023/06/09 09:48:06 - mmengine - INFO - Saving checkpoint at 26 epochs
2023/06/09 09:50:10 - mmengine - INFO - Epoch(train) [27][100/351] lr: 1.5771e-03 eta: 6 days, 6:25:24 time: 0.9320 data_time: 0.0890 memory: 48594 loss: 0.5052
2023/06/09 09:51:46 - mmengine - INFO - Epoch(train) [27][200/351] lr: 1.5942e-03 eta: 6 days, 6:21:23 time: 1.0376 data_time: 0.1974 memory: 48594 loss: 0.4862
2023/06/09 09:53:23 - mmengine - INFO - Epoch(train) [27][300/351] lr: 1.6113e-03 eta: 6 days, 6:19:10 time: 0.9118 data_time: 0.0525 memory: 48594 loss: 0.4868
2023/06/09 09:54:10 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_070741
2023/06/09 09:54:10 - mmengine - INFO - Saving checkpoint at 27 epochs
2023/06/09 09:56:14 - mmengine - INFO - Epoch(train) [28][100/351] lr: 1.6371e-03 eta: 6 days, 6:17:19 time: 0.9039 data_time: 0.0799 memory: 48594 loss: 0.4858
2023/06/09 09:57:50 - mmengine - INFO - Epoch(train) [28][200/351] lr: 1.6542e-03 eta: 6 days, 6:14:02 time: 0.9521 data_time: 0.0981 memory: 48594 loss: 0.4845
2023/06/09 09:59:27 - mmengine - INFO - Epoch(train) [28][300/351] lr: 1.6713e-03 eta: 6 days, 6:11:29 time: 0.9749 data_time: 0.1208 memory: 48594 loss: 0.4894
2023/06/09 10:00:16 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_070741
2023/06/09 10:00:16 - mmengine - INFO - Saving checkpoint at 28 epochs
2023/06/09 10:02:18 - mmengine - INFO - Epoch(train) [29][100/351] lr: 1.6971e-03 eta: 6 days, 6:08:56 time: 0.9163 data_time: 0.0946 memory: 48594 loss: 0.4879
2023/06/09 10:03:28 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_070741
2023/06/09 10:03:54 - mmengine - INFO - Epoch(train) [29][200/351] lr: 1.7142e-03 eta: 6 days, 6:05:26 time: 0.9652 data_time: 0.1055 memory: 48594 loss: 0.4858
2023/06/09 10:05:33 - mmengine - INFO - Epoch(train) [29][300/351] lr: 1.7313e-03 eta: 6 days, 6:05:03 time: 0.9239 data_time: 0.0724 memory: 48594 loss: 0.4859
2023/06/09 10:06:21 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_070741
2023/06/09 10:06:21 - mmengine - INFO - Saving checkpoint at 29 epochs
2023/06/09 10:08:23 - mmengine - INFO - Epoch(train) [30][100/351] lr: 1.7571e-03 eta: 6 days, 6:01:52 time: 0.9415 data_time: 0.1064 memory: 48594 loss: 0.4885
2023/06/09 10:10:01 - mmengine - INFO - Epoch(train) [30][200/351] lr: 1.7742e-03 eta: 6 days, 6:00:20 time: 0.9253 data_time: 0.0854 memory: 48594 loss: 0.4870
2023/06/09 10:11:37 - mmengine - INFO - Epoch(train) [30][300/351] lr: 1.7913e-03 eta: 6 days, 5:56:59 time: 0.9778 data_time: 0.1251 memory: 48594 loss: 0.4857
2023/06/09 10:12:27 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_070741
2023/06/09 10:12:27 - mmengine - INFO - Saving checkpoint at 30 epochs
2023/06/09 10:14:30 - mmengine - INFO - Epoch(train) [31][100/351] lr: 1.8171e-03 eta: 6 days, 5:56:07 time: 0.9079 data_time: 0.0586 memory: 48594 loss: 0.4915
2023/06/09 10:16:05 - mmengine - INFO - Epoch(train) [31][200/351] lr: 1.8342e-03 eta: 6 days, 5:51:41 time: 0.9378 data_time: 0.1120 memory: 48594 loss: 0.4879
2023/06/09 10:17:45 - mmengine - INFO - Epoch(train) [31][300/351] lr: 1.8513e-03 eta: 6 days, 5:52:06 time: 0.9413 data_time: 0.1046 memory: 48594 loss: 0.4864
2023/06/09 10:18:33 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_070741
2023/06/09 10:18:33 - mmengine - INFO - Saving checkpoint at 31 epochs
2023/06/09 10:20:36 - mmengine - INFO - Epoch(train) [32][100/351] lr: 1.8771e-03 eta: 6 days, 5:49:42 time: 0.9580 data_time: 0.1193 memory: 48594 loss: 0.4852
2023/06/09 10:20:54 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_070741
2023/06/09 10:22:14 - mmengine - INFO - Epoch(train) [32][200/351] lr: 1.8942e-03 eta: 6 days, 5:47:41 time: 0.9000 data_time: 0.0570 memory: 48594 loss: 0.4851
2023/06/09 10:23:51 - mmengine - INFO - Epoch(train) [32][300/351] lr: 1.9113e-03 eta: 6 days, 5:45:18 time: 0.9613 data_time: 0.1256 memory: 48594 loss: 0.4877
2023/06/09 10:24:41 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_070741
2023/06/09 10:24:41 - mmengine - INFO - Saving checkpoint at 32 epochs
2023/06/09 10:26:47 - mmengine - INFO - Epoch(train) [33][100/351] lr: 1.9371e-03 eta: 6 days, 5:46:35 time: 0.9669 data_time: 0.1344 memory: 48594 loss: 0.4878
2023/06/09 10:28:22 - mmengine - INFO - Epoch(train) [33][200/351] lr: 1.9542e-03 eta: 6 days, 5:43:08 time: 0.9578 data_time: 0.1048 memory: 48594 loss: 0.4893
2023/06/09 10:30:02 - mmengine - INFO - Epoch(train) [33][300/351] lr: 1.9713e-03 eta: 6 days, 5:43:08 time: 0.8789 data_time: 0.0260 memory: 48594 loss: 0.4781
2023/06/09 10:30:50 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_070741
2023/06/09 10:30:50 - mmengine - INFO - Saving checkpoint at 33 epochs
2023/06/09 10:32:54 - mmengine - INFO - Epoch(train) [34][100/351] lr: 1.9971e-03 eta: 6 days, 5:41:14 time: 0.9417 data_time: 0.0971 memory: 48594 loss: 0.4797
2023/06/09 10:34:32 - mmengine - INFO - Epoch(train) [34][200/351] lr: 2.0142e-03 eta: 6 days, 5:39:23 time: 1.0556 data_time: 0.2108 memory: 48594 loss: 0.4809
2023/06/09 10:36:11 - mmengine - INFO - Epoch(train) [34][300/351] lr: 2.0313e-03 eta: 6 days, 5:38:17 time: 0.9893 data_time: 0.1506 memory: 48594 loss: 0.4836
2023/06/09 10:36:59 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_070741
2023/06/09 10:36:59 - mmengine - INFO - Saving checkpoint at 34 epochs
2023/06/09 10:38:30 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_070741
2023/06/09 10:39:04 - mmengine - INFO - Epoch(train) [35][100/351] lr: 2.0571e-03 eta: 6 days, 5:37:56 time: 0.9401 data_time: 0.1010 memory: 48594 loss: 0.4830
2023/06/09 10:40:41 - mmengine - INFO - Epoch(train) [35][200/351] lr: 2.0742e-03 eta: 6 days, 5:35:15 time: 0.9413 data_time: 0.1186 memory: 48594 loss: 0.4835
2023/06/09 10:42:19 - mmengine - INFO - Epoch(train) [35][300/351] lr: 2.0913e-03 eta: 6 days, 5:33:57 time: 1.0472 data_time: 0.1841 memory: 48594 loss: 0.4855
2023/06/09 10:43:08 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_070741
2023/06/09 10:43:08 - mmengine - INFO - Saving checkpoint at 35 epochs
2023/06/09 10:45:12 - mmengine - INFO - Epoch(train) [36][100/351] lr: 2.1171e-03 eta: 6 days, 5:32:28 time: 0.9058 data_time: 0.0475 memory: 48594 loss: 0.4822
2023/06/09 10:46:47 - mmengine - INFO - Epoch(train) [36][200/351] lr: 2.1342e-03 eta: 6 days, 5:29:13 time: 0.9423 data_time: 0.1199 memory: 48594 loss: 0.4823
2023/06/09 10:48:27 - mmengine - INFO - Epoch(train) [36][300/351] lr: 2.1513e-03 eta: 6 days, 5:28:50 time: 0.9317 data_time: 0.0680 memory: 48594 loss: 0.4852
2023/06/09 10:49:14 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_070741
2023/06/09 10:49:14 - mmengine - INFO - Saving checkpoint at 36 epochs
2023/06/09 10:51:17 - mmengine - INFO - Epoch(train) [37][100/351] lr: 2.1771e-03 eta: 6 days, 5:25:42 time: 0.9635 data_time: 0.1051 memory: 48594 loss: 0.4821
2023/06/09 10:52:55 - mmengine - INFO - Epoch(train) [37][200/351] lr: 2.1942e-03 eta: 6 days, 5:24:15 time: 0.9831 data_time: 0.1184 memory: 48594 loss: 0.4788
2023/06/09 10:54:32 - mmengine - INFO - Epoch(train) [37][300/351] lr: 2.2113e-03 eta: 6 days, 5:22:18 time: 0.9876 data_time: 0.1388 memory: 48594 loss: 0.4848
2023/06/09 10:55:22 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_070741
2023/06/09 10:55:22 - mmengine - INFO - Saving checkpoint at 37 epochs
2023/06/09 10:56:03 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_070741
2023/06/09 10:57:27 - mmengine - INFO - Epoch(train) [38][100/351] lr: 2.2371e-03 eta: 6 days, 5:22:22 time: 0.9708 data_time: 0.1238 memory: 48594 loss: 0.4849
2023/06/09 10:59:03 - mmengine - INFO - Epoch(train) [38][200/351] lr: 2.2542e-03 eta: 6 days, 5:19:05 time: 0.9618 data_time: 0.1238 memory: 48594 loss: 0.4829
2023/06/09 11:00:43 - mmengine - INFO - Epoch(train) [38][300/351] lr: 2.2713e-03 eta: 6 days, 5:18:40 time: 1.0527 data_time: 0.2070 memory: 48594 loss: 0.4797
2023/06/09 11:01:31 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_070741
2023/06/09 11:01:31 - mmengine - INFO - Saving checkpoint at 38 epochs
2023/06/09 11:03:33 - mmengine - INFO - Epoch(train) [39][100/351] lr: 2.2971e-03 eta: 6 days, 5:16:11 time: 0.9248 data_time: 0.0776 memory: 48594 loss: 0.4819
2023/06/09 11:05:09 - mmengine - INFO - Epoch(train) [39][200/351] lr: 2.3142e-03 eta: 6 days, 5:13:35 time: 0.9718 data_time: 0.1020 memory: 48594 loss: 0.4793
2023/06/09 11:06:47 - mmengine - INFO - Epoch(train) [39][300/351] lr: 2.3313e-03 eta: 6 days, 5:11:27 time: 0.9299 data_time: 0.0942 memory: 48594 loss: 0.4776
2023/06/09 11:07:36 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_070741
2023/06/09 11:07:36 - mmengine - INFO - Saving checkpoint at 39 epochs
2023/06/09 11:09:41 - mmengine - INFO - Epoch(train) [40][100/351] lr: 2.3571e-03 eta: 6 days, 5:11:02 time: 0.9720 data_time: 0.1169 memory: 48594 loss: 0.4787
2023/06/09 11:11:16 - mmengine - INFO - Epoch(train) [40][200/351] lr: 2.3742e-03 eta: 6 days, 5:07:38 time: 0.9371 data_time: 0.0941 memory: 48594 loss: 0.4818
2023/06/09 11:12:55 - mmengine - INFO - Epoch(train) [40][300/351] lr: 2.3913e-03 eta: 6 days, 5:06:30 time: 0.9289 data_time: 0.0955 memory: 48594 loss: 0.4833
2023/06/09 11:13:05 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_070741
2023/06/09 11:13:43 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_070741
2023/06/09 11:13:43 - mmengine - INFO - Saving checkpoint at 40 epochs
2023/06/09 11:15:46 - mmengine - INFO - Epoch(train) [41][100/351] lr: 2.4000e-03 eta: 6 days, 5:04:44 time: 1.0061 data_time: 0.1596 memory: 48594 loss: 0.4831
2023/06/09 11:17:23 - mmengine - INFO - Epoch(train) [41][200/351] lr: 2.4000e-03 eta: 6 days, 5:02:08 time: 1.0044 data_time: 0.1478 memory: 48594 loss: 0.4817
2023/06/09 11:19:02 - mmengine - INFO - Epoch(train) [41][300/351] lr: 2.4000e-03 eta: 6 days, 5:01:12 time: 0.9446 data_time: 0.1055 memory: 48594 loss: 0.4845
2023/06/09 11:19:49 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_070741
2023/06/09 11:19:49 - mmengine - INFO - Saving checkpoint at 41 epochs
2023/06/09 11:21:53 - mmengine - INFO - Epoch(train) [42][100/351] lr: 2.4000e-03 eta: 6 days, 4:59:03 time: 0.9103 data_time: 0.0750 memory: 48594 loss: 0.4810
2023/06/09 11:23:29 - mmengine - INFO - Epoch(train) [42][200/351] lr: 2.4000e-03 eta: 6 days, 4:55:51 time: 0.9656 data_time: 0.1213 memory: 48594 loss: 0.4760
2023/06/09 11:25:08 - mmengine - INFO - Epoch(train) [42][300/351] lr: 2.4000e-03 eta: 6 days, 4:55:07 time: 1.0198 data_time: 0.1738 memory: 48594 loss: 0.4805
2023/06/09 11:25:56 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_070741
2023/06/09 11:25:56 - mmengine - INFO - Saving checkpoint at 42 epochs
2023/06/09 11:27:59 - mmengine - INFO - Epoch(train) [43][100/351] lr: 2.4000e-03 eta: 6 days, 4:53:03 time: 0.9439 data_time: 0.1049 memory: 48594 loss: 0.4803
2023/06/09 11:29:35 - mmengine - INFO - Epoch(train) [43][200/351] lr: 2.4000e-03 eta: 6 days, 4:49:58 time: 0.9864 data_time: 0.1135 memory: 48594 loss: 0.4811
2023/06/09 11:30:34 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_070741
2023/06/09 11:31:14 - mmengine - INFO - Epoch(train) [43][300/351] lr: 2.4000e-03 eta: 6 days, 4:49:10 time: 0.9415 data_time: 0.0996 memory: 48594 loss: 0.4828
2023/06/09 11:32:02 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_070741
2023/06/09 11:32:02 - mmengine - INFO - Saving checkpoint at 43 epochs
2023/06/09 11:34:04 - mmengine - INFO - Epoch(train) [44][100/351] lr: 2.4000e-03 eta: 6 days, 4:46:10 time: 0.9442 data_time: 0.0981 memory: 48594 loss: 0.4810
2023/06/09 11:35:42 - mmengine - INFO - Epoch(train) [44][200/351] lr: 2.4000e-03 eta: 6 days, 4:44:31 time: 0.9433 data_time: 0.1064 memory: 48594 loss: 0.4833
2023/06/09 11:37:19 - mmengine - INFO - Epoch(train) [44][300/351] lr: 2.4000e-03 eta: 6 days, 4:42:20 time: 0.9503 data_time: 0.1239 memory: 48594 loss: 0.4762
2023/06/09 11:38:09 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_070741
2023/06/09 11:38:09 - mmengine - INFO - Saving checkpoint at 44 epochs
2023/06/09 11:40:11 - mmengine - INFO - Epoch(train) [45][100/351] lr: 2.4000e-03 eta: 6 days, 4:41:22 time: 0.9799 data_time: 0.1206 memory: 48594 loss: 0.4815
2023/06/09 11:41:47 - mmengine - INFO - Epoch(train) [45][200/351] lr: 2.3999e-03 eta: 6 days, 4:38:15 time: 0.9808 data_time: 0.1143 memory: 48594 loss: 0.4806
2023/06/09 11:43:27 - mmengine - INFO - Epoch(train) [45][300/351] lr: 2.3999e-03 eta: 6 days, 4:37:51 time: 0.9067 data_time: 0.0495 memory: 48594 loss: 0.4787
2023/06/09 11:44:14 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_070741
2023/06/09 11:44:14 - mmengine - INFO - Saving checkpoint at 45 epochs
2023/06/09 11:46:17 - mmengine - INFO - Epoch(train) [46][100/351] lr: 2.3999e-03 eta: 6 days, 4:34:56 time: 0.9793 data_time: 0.1343 memory: 48594 loss: 0.4822
2023/06/09 11:47:54 - mmengine - INFO - Epoch(train) [46][200/351] lr: 2.3999e-03 eta: 6 days, 4:32:42 time: 0.9564 data_time: 0.1108 memory: 48594 loss: 0.4789
2023/06/09 11:48:00 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_070741
2023/06/09 11:49:32 - mmengine - INFO - Epoch(train) [46][300/351] lr: 2.3999e-03 eta: 6 days, 4:30:45 time: 0.9883 data_time: 0.1343 memory: 48594 loss: 0.4754
2023/06/09 11:50:21 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_070741
2023/06/09 11:50:21 - mmengine - INFO - Saving checkpoint at 46 epochs
2023/06/09 11:52:26 - mmengine - INFO - Epoch(train) [47][100/351] lr: 2.3999e-03 eta: 6 days, 4:30:25 time: 0.9807 data_time: 0.1150 memory: 48594 loss: 0.4810
2023/06/09 11:54:03 - mmengine - INFO - Epoch(train) [47][200/351] lr: 2.3999e-03 eta: 6 days, 4:27:46 time: 0.9240 data_time: 0.0554 memory: 48594 loss: 0.4765
2023/06/09 11:55:45 - mmengine - INFO - Epoch(train) [47][300/351] lr: 2.3999e-03 eta: 6 days, 4:28:32 time: 0.9973 data_time: 0.1394 memory: 48594 loss: 0.4758
2023/06/09 11:56:34 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_070741
2023/06/09 11:56:34 - mmengine - INFO - Saving checkpoint at 47 epochs
2023/06/09 11:58:38 - mmengine - INFO - Epoch(train) [48][100/351] lr: 2.3999e-03 eta: 6 days, 4:27:24 time: 0.8743 data_time: 0.0401 memory: 48594 loss: 0.4765
2023/06/09 12:00:17 - mmengine - INFO - Epoch(train) [48][200/351] lr: 2.3999e-03 eta: 6 days, 4:26:11 time: 0.9620 data_time: 0.1250 memory: 48594 loss: 0.4785
2023/06/09 12:01:57 - mmengine - INFO - Epoch(train) [48][300/351] lr: 2.3998e-03 eta: 6 days, 4:25:58 time: 1.0003 data_time: 0.1658 memory: 48594 loss: 0.4753
2023/06/09 12:02:48 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_070741
2023/06/09 12:02:48 - mmengine - INFO - Saving checkpoint at 48 epochs
2023/06/09 12:12:44 - mmengine - INFO - Epoch(train) [49][100/351] lr: 2.3998e-03 eta: 6 days, 14:33:42 time: 1.0045 data_time: 0.0043 memory: 48596 loss: 0.4785
2023/06/09 12:13:35 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 12:14:23 - mmengine - INFO - Epoch(train) [49][200/351] lr: 2.3998e-03 eta: 6 days, 10:12:06 time: 0.9664 data_time: 0.0022 memory: 48596 loss: 0.4794
2023/06/09 12:16:03 - mmengine - INFO - Epoch(train) [49][300/351] lr: 2.3998e-03 eta: 6 days, 9:11:27 time: 0.9199 data_time: 0.0019 memory: 48596 loss: 0.4800
2023/06/09 12:16:53 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 12:18:36 - mmengine - INFO - Epoch(train) [50][100/351] lr: 2.3998e-03 eta: 6 days, 8:58:20 time: 0.9765 data_time: 0.0018 memory: 48596 loss: 0.4746
2023/06/09 12:20:13 - mmengine - INFO - Epoch(train) [50][200/351] lr: 2.3998e-03 eta: 6 days, 7:44:02 time: 0.9229 data_time: 0.0019 memory: 48596 loss: 0.4788
2023/06/09 12:21:54 - mmengine - INFO - Epoch(train) [50][300/351] lr: 2.3998e-03 eta: 6 days, 8:00:43 time: 0.9920 data_time: 0.0022 memory: 48596 loss: 0.4781
2023/06/09 12:22:43 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 12:24:27 - mmengine - INFO - Epoch(train) [51][100/351] lr: 2.3997e-03 eta: 6 days, 8:06:42 time: 0.9380 data_time: 0.0021 memory: 48596 loss: 0.4768
2023/06/09 12:26:05 - mmengine - INFO - Epoch(train) [51][200/351] lr: 2.3997e-03 eta: 6 days, 7:42:38 time: 0.9456 data_time: 0.0020 memory: 48596 loss: 0.4772
2023/06/09 12:27:45 - mmengine - INFO - Epoch(train) [51][300/351] lr: 2.3997e-03 eta: 6 days, 7:35:09 time: 0.9368 data_time: 0.0021 memory: 48596 loss: 0.4782
2023/06/09 12:28:34 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 12:30:19 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 12:30:20 - mmengine - INFO - Epoch(train) [52][100/351] lr: 2.3997e-03 eta: 6 days, 7:55:20 time: 0.9514 data_time: 0.0023 memory: 48596 loss: 0.4744
2023/06/09 12:31:57 - mmengine - INFO - Epoch(train) [52][200/351] lr: 2.3997e-03 eta: 6 days, 7:32:19 time: 0.9240 data_time: 0.0024 memory: 48596 loss: 0.4797
2023/06/09 12:33:38 - mmengine - INFO - Epoch(train) [52][300/351] lr: 2.3997e-03 eta: 6 days, 7:33:11 time: 0.9551 data_time: 0.0022 memory: 48596 loss: 0.4779
2023/06/09 12:34:29 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 12:36:14 - mmengine - INFO - Epoch(train) [53][100/351] lr: 2.3996e-03 eta: 6 days, 7:54:53 time: 0.9298 data_time: 0.0022 memory: 48596 loss: 0.4770
2023/06/09 12:37:51 - mmengine - INFO - Epoch(train) [53][200/351] lr: 2.3996e-03 eta: 6 days, 7:32:07 time: 0.9912 data_time: 0.0023 memory: 48596 loss: 0.4747
2023/06/09 12:39:31 - mmengine - INFO - Epoch(train) [53][300/351] lr: 2.3996e-03 eta: 6 days, 7:32:38 time: 0.9246 data_time: 0.0021 memory: 48596 loss: 0.4739
2023/06/09 12:40:21 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 12:42:05 - mmengine - INFO - Epoch(train) [54][100/351] lr: 2.3996e-03 eta: 6 days, 7:36:29 time: 1.0007 data_time: 0.1321 memory: 48596 loss: 0.4769
2023/06/09 12:43:43 - mmengine - INFO - Epoch(train) [54][200/351] lr: 2.3996e-03 eta: 6 days, 7:23:55 time: 0.9564 data_time: 0.0112 memory: 48596 loss: 0.4770
2023/06/09 12:45:22 - mmengine - INFO - Epoch(train) [54][300/351] lr: 2.3995e-03 eta: 6 days, 7:16:57 time: 0.9759 data_time: 0.0019 memory: 48596 loss: 0.4793
2023/06/09 12:46:12 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 12:47:03 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 12:47:57 - mmengine - INFO - Epoch(train) [55][100/351] lr: 2.3995e-03 eta: 6 days, 7:29:34 time: 1.0127 data_time: 0.0712 memory: 48596 loss: 0.4735
2023/06/09 12:49:35 - mmengine - INFO - Epoch(train) [55][200/351] lr: 2.3995e-03 eta: 6 days, 7:17:26 time: 0.9665 data_time: 0.0021 memory: 48596 loss: 0.4777
2023/06/09 12:51:17 - mmengine - INFO - Epoch(train) [55][300/351] lr: 2.3995e-03 eta: 6 days, 7:21:09 time: 0.9714 data_time: 0.0020 memory: 48596 loss: 0.4746
2023/06/09 12:52:06 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 12:53:50 - mmengine - INFO - Epoch(train) [56][100/351] lr: 2.3994e-03 eta: 6 days, 7:22:31 time: 0.9569 data_time: 0.0481 memory: 48596 loss: 0.4756
2023/06/09 12:55:28 - mmengine - INFO - Epoch(train) [56][200/351] lr: 2.3994e-03 eta: 6 days, 7:13:08 time: 0.9386 data_time: 0.0021 memory: 48596 loss: 0.4798
2023/06/09 12:57:08 - mmengine - INFO - Epoch(train) [56][300/351] lr: 2.3994e-03 eta: 6 days, 7:09:17 time: 0.9271 data_time: 0.0020 memory: 48596 loss: 0.4773
2023/06/09 12:57:59 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 12:59:43 - mmengine - INFO - Epoch(train) [57][100/351] lr: 2.3994e-03 eta: 6 days, 7:18:01 time: 0.9267 data_time: 0.0021 memory: 48596 loss: 0.4696
2023/06/09 13:01:20 - mmengine - INFO - Epoch(train) [57][200/351] lr: 2.3993e-03 eta: 6 days, 7:05:11 time: 0.9385 data_time: 0.0023 memory: 48596 loss: 0.4749
2023/06/09 13:03:01 - mmengine - INFO - Epoch(train) [57][300/351] lr: 2.3993e-03 eta: 6 days, 7:06:55 time: 0.9967 data_time: 0.0026 memory: 48596 loss: 0.4751
2023/06/09 13:03:44 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 13:03:50 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 13:05:32 - mmengine - INFO - Epoch(train) [58][100/351] lr: 2.3993e-03 eta: 6 days, 7:02:51 time: 0.9813 data_time: 0.1001 memory: 48596 loss: 0.4768
2023/06/09 13:07:11 - mmengine - INFO - Epoch(train) [58][200/351] lr: 2.3992e-03 eta: 6 days, 6:57:31 time: 0.9716 data_time: 0.0020 memory: 48596 loss: 0.4757
2023/06/09 13:08:50 - mmengine - INFO - Epoch(train) [58][300/351] lr: 2.3992e-03 eta: 6 days, 6:51:53 time: 0.9235 data_time: 0.0019 memory: 48596 loss: 0.4780
2023/06/09 13:09:40 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 13:11:25 - mmengine - INFO - Epoch(train) [59][100/351] lr: 2.3992e-03 eta: 6 days, 6:57:11 time: 0.9362 data_time: 0.0040 memory: 48596 loss: 0.4806
2023/06/09 13:13:03 - mmengine - INFO - Epoch(train) [59][200/351] lr: 2.3992e-03 eta: 6 days, 6:48:41 time: 0.9962 data_time: 0.0019 memory: 48596 loss: 0.4723
2023/06/09 13:14:45 - mmengine - INFO - Epoch(train) [59][300/351] lr: 2.3991e-03 eta: 6 days, 6:52:00 time: 0.9992 data_time: 0.0034 memory: 48596 loss: 0.4724
2023/06/09 13:15:35 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 13:17:20 - mmengine - INFO - Epoch(train) [60][100/351] lr: 2.3991e-03 eta: 6 days, 6:56:01 time: 0.9381 data_time: 0.0021 memory: 48596 loss: 0.4768
2023/06/09 13:18:57 - mmengine - INFO - Epoch(train) [60][200/351] lr: 2.3991e-03 eta: 6 days, 6:47:23 time: 0.9853 data_time: 0.0021 memory: 48596 loss: 0.4753
2023/06/09 13:20:29 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 13:20:38 - mmengine - INFO - Epoch(train) [60][300/351] lr: 2.3990e-03 eta: 6 days, 6:46:38 time: 0.9446 data_time: 0.0020 memory: 48596 loss: 0.4744
2023/06/09 13:21:27 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 13:23:11 - mmengine - INFO - Epoch(train) [61][100/351] lr: 2.3990e-03 eta: 6 days, 6:46:39 time: 0.9055 data_time: 0.0021 memory: 48596 loss: 0.4743
2023/06/09 13:24:49 - mmengine - INFO - Epoch(train) [61][200/351] lr: 2.3990e-03 eta: 6 days, 6:41:22 time: 0.9946 data_time: 0.0805 memory: 48596 loss: 0.4775
2023/06/09 13:26:28 - mmengine - INFO - Epoch(train) [61][300/351] lr: 2.3989e-03 eta: 6 days, 6:36:57 time: 0.9486 data_time: 0.0020 memory: 48596 loss: 0.4742
2023/06/09 13:27:18 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 13:29:02 - mmengine - INFO - Epoch(train) [62][100/351] lr: 2.3989e-03 eta: 6 days, 6:39:16 time: 0.9661 data_time: 0.0035 memory: 48596 loss: 0.4748
2023/06/09 13:30:41 - mmengine - INFO - Epoch(train) [62][200/351] lr: 2.3989e-03 eta: 6 days, 6:34:03 time: 0.9312 data_time: 0.0025 memory: 48596 loss: 0.4732
2023/06/09 13:32:22 - mmengine - INFO - Epoch(train) [62][300/351] lr: 2.3988e-03 eta: 6 days, 6:34:33 time: 1.1021 data_time: 0.0024 memory: 48596 loss: 0.4750
2023/06/09 13:33:12 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 13:34:56 - mmengine - INFO - Epoch(train) [63][100/351] lr: 2.3988e-03 eta: 6 days, 6:36:09 time: 0.9782 data_time: 0.0548 memory: 48596 loss: 0.4768
2023/06/09 13:36:34 - mmengine - INFO - Epoch(train) [63][200/351] lr: 2.3988e-03 eta: 6 days, 6:30:10 time: 0.9779 data_time: 0.0030 memory: 48596 loss: 0.4770
2023/06/09 13:37:13 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 13:38:15 - mmengine - INFO - Epoch(train) [63][300/351] lr: 2.3987e-03 eta: 6 days, 6:28:42 time: 0.9595 data_time: 0.0021 memory: 48596 loss: 0.4736
2023/06/09 13:39:04 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 13:40:47 - mmengine - INFO - Epoch(train) [64][100/351] lr: 2.3987e-03 eta: 6 days, 6:27:27 time: 0.9555 data_time: 0.0272 memory: 48596 loss: 0.4761
2023/06/09 13:42:24 - mmengine - INFO - Epoch(train) [64][200/351] lr: 2.3986e-03 eta: 6 days, 6:19:52 time: 0.9689 data_time: 0.0339 memory: 48596 loss: 0.4764
2023/06/09 13:44:06 - mmengine - INFO - Epoch(train) [64][300/351] lr: 2.3986e-03 eta: 6 days, 6:20:13 time: 0.9952 data_time: 0.0019 memory: 48596 loss: 0.4758
2023/06/09 13:44:55 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 13:46:39 - mmengine - INFO - Epoch(train) [65][100/351] lr: 2.3986e-03 eta: 6 days, 6:19:59 time: 0.8895 data_time: 0.0025 memory: 48596 loss: 0.4782
2023/06/09 13:48:16 - mmengine - INFO - Epoch(train) [65][200/351] lr: 2.3985e-03 eta: 6 days, 6:12:38 time: 0.8664 data_time: 0.0019 memory: 48596 loss: 0.4751
2023/06/09 13:49:57 - mmengine - INFO - Epoch(train) [65][300/351] lr: 2.3985e-03 eta: 6 days, 6:13:15 time: 1.0019 data_time: 0.0021 memory: 48596 loss: 0.4695
2023/06/09 13:50:46 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 13:52:30 - mmengine - INFO - Epoch(train) [66][100/351] lr: 2.3984e-03 eta: 6 days, 6:12:41 time: 0.9474 data_time: 0.0744 memory: 48596 loss: 0.4738
2023/06/09 13:53:55 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 13:54:09 - mmengine - INFO - Epoch(train) [66][200/351] lr: 2.3984e-03 eta: 6 days, 6:08:44 time: 1.0014 data_time: 0.0029 memory: 48596 loss: 0.4755
2023/06/09 13:55:51 - mmengine - INFO - Epoch(train) [66][300/351] lr: 2.3984e-03 eta: 6 days, 6:08:33 time: 1.0023 data_time: 0.0020 memory: 48596 loss: 0.4744
2023/06/09 13:56:39 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 13:58:24 - mmengine - INFO - Epoch(train) [67][100/351] lr: 2.3983e-03 eta: 6 days, 6:09:14 time: 0.9798 data_time: 0.0020 memory: 48596 loss: 0.4749
2023/06/09 14:00:02 - mmengine - INFO - Epoch(train) [67][200/351] lr: 2.3983e-03 eta: 6 days, 6:03:20 time: 0.9559 data_time: 0.0021 memory: 48596 loss: 0.4727
2023/06/09 14:01:44 - mmengine - INFO - Epoch(train) [67][300/351] lr: 2.3982e-03 eta: 6 days, 6:04:48 time: 0.9623 data_time: 0.0021 memory: 48596 loss: 0.4776
2023/06/09 14:02:34 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 14:04:18 - mmengine - INFO - Epoch(train) [68][100/351] lr: 2.3982e-03 eta: 6 days, 6:04:18 time: 0.9221 data_time: 0.0071 memory: 48596 loss: 0.4734
2023/06/09 14:05:55 - mmengine - INFO - Epoch(train) [68][200/351] lr: 2.3982e-03 eta: 6 days, 5:58:40 time: 0.9412 data_time: 0.0029 memory: 48596 loss: 0.4758
2023/06/09 14:07:36 - mmengine - INFO - Epoch(train) [68][300/351] lr: 2.3981e-03 eta: 6 days, 5:58:02 time: 0.9770 data_time: 0.0020 memory: 48596 loss: 0.4726
2023/06/09 14:08:24 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 14:10:08 - mmengine - INFO - Epoch(train) [69][100/351] lr: 2.3981e-03 eta: 6 days, 5:55:27 time: 0.9289 data_time: 0.0402 memory: 48596 loss: 0.4730
2023/06/09 14:10:40 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 14:11:47 - mmengine - INFO - Epoch(train) [69][200/351] lr: 2.3980e-03 eta: 6 days, 5:52:11 time: 0.9471 data_time: 0.0022 memory: 48596 loss: 0.4710
2023/06/09 14:13:26 - mmengine - INFO - Epoch(train) [69][300/351] lr: 2.3980e-03 eta: 6 days, 5:48:54 time: 0.9749 data_time: 0.0020 memory: 48596 loss: 0.4785
2023/06/09 14:14:16 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 14:16:01 - mmengine - INFO - Epoch(train) [70][100/351] lr: 2.3979e-03 eta: 6 days, 5:50:49 time: 0.9294 data_time: 0.0021 memory: 48596 loss: 0.4740
2023/06/09 14:17:39 - mmengine - INFO - Epoch(train) [70][200/351] lr: 2.3979e-03 eta: 6 days, 5:46:09 time: 0.9642 data_time: 0.0022 memory: 48596 loss: 0.4737
2023/06/09 14:19:21 - mmengine - INFO - Epoch(train) [70][300/351] lr: 2.3978e-03 eta: 6 days, 5:46:34 time: 0.9877 data_time: 0.0029 memory: 48596 loss: 0.4697
2023/06/09 14:20:11 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 14:21:55 - mmengine - INFO - Epoch(train) [71][100/351] lr: 2.3978e-03 eta: 6 days, 5:46:36 time: 0.9663 data_time: 0.0372 memory: 48596 loss: 0.4793
2023/06/09 14:23:34 - mmengine - INFO - Epoch(train) [71][200/351] lr: 2.3977e-03 eta: 6 days, 5:43:26 time: 0.9349 data_time: 0.0021 memory: 48596 loss: 0.4752
2023/06/09 14:25:14 - mmengine - INFO - Epoch(train) [71][300/351] lr: 2.3977e-03 eta: 6 days, 5:41:32 time: 0.9669 data_time: 0.0021 memory: 48596 loss: 0.4746
2023/06/09 14:26:05 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 14:27:29 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 14:27:50 - mmengine - INFO - Epoch(train) [72][100/351] lr: 2.3976e-03 eta: 6 days, 5:43:20 time: 0.8995 data_time: 0.0634 memory: 48596 loss: 0.4778
2023/06/09 14:29:27 - mmengine - INFO - Epoch(train) [72][200/351] lr: 2.3976e-03 eta: 6 days, 5:37:45 time: 0.9537 data_time: 0.0622 memory: 48596 loss: 0.4738
2023/06/09 14:31:09 - mmengine - INFO - Epoch(train) [72][300/351] lr: 2.3975e-03 eta: 6 days, 5:37:29 time: 0.9804 data_time: 0.0020 memory: 48596 loss: 0.4749
2023/06/09 14:31:57 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 14:33:40 - mmengine - INFO - Epoch(train) [73][100/351] lr: 2.3975e-03 eta: 6 days, 5:34:50 time: 0.9339 data_time: 0.0024 memory: 48596 loss: 0.4753
2023/06/09 14:35:19 - mmengine - INFO - Epoch(train) [73][200/351] lr: 2.3974e-03 eta: 6 days, 5:31:35 time: 1.0243 data_time: 0.0020 memory: 48596 loss: 0.4698
2023/06/09 14:36:58 - mmengine - INFO - Epoch(train) [73][300/351] lr: 2.3974e-03 eta: 6 days, 5:28:52 time: 1.0227 data_time: 0.0019 memory: 48596 loss: 0.4755
2023/06/09 14:37:48 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 14:39:31 - mmengine - INFO - Epoch(train) [74][100/351] lr: 2.3973e-03 eta: 6 days, 5:27:49 time: 0.9451 data_time: 0.0764 memory: 48596 loss: 0.4728
2023/06/09 14:41:10 - mmengine - INFO - Epoch(train) [74][200/351] lr: 2.3973e-03 eta: 6 days, 5:23:59 time: 0.9932 data_time: 0.0952 memory: 48596 loss: 0.4722
2023/06/09 14:42:52 - mmengine - INFO - Epoch(train) [74][300/351] lr: 2.3972e-03 eta: 6 days, 5:24:13 time: 1.0124 data_time: 0.0019 memory: 48596 loss: 0.4748
2023/06/09 14:43:40 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 14:44:13 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 14:45:24 - mmengine - INFO - Epoch(train) [75][100/351] lr: 2.3971e-03 eta: 6 days, 5:21:43 time: 0.9300 data_time: 0.0046 memory: 48596 loss: 0.4753
2023/06/09 14:47:02 - mmengine - INFO - Epoch(train) [75][200/351] lr: 2.3971e-03 eta: 6 days, 5:18:10 time: 0.9392 data_time: 0.0021 memory: 48596 loss: 0.4716
2023/06/09 14:48:42 - mmengine - INFO - Epoch(train) [75][300/351] lr: 2.3970e-03 eta: 6 days, 5:16:26 time: 0.9372 data_time: 0.0023 memory: 48596 loss: 0.4709
2023/06/09 14:49:31 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 14:51:15 - mmengine - INFO - Epoch(train) [76][100/351] lr: 2.3970e-03 eta: 6 days, 5:14:41 time: 0.9320 data_time: 0.0026 memory: 48596 loss: 0.4728
2023/06/09 14:52:54 - mmengine - INFO - Epoch(train) [76][200/351] lr: 2.3969e-03 eta: 6 days, 5:11:24 time: 0.9337 data_time: 0.0026 memory: 48596 loss: 0.4737
2023/06/09 14:54:33 - mmengine - INFO - Epoch(train) [76][300/351] lr: 2.3969e-03 eta: 6 days, 5:08:44 time: 0.9812 data_time: 0.0020 memory: 48596 loss: 0.4730
2023/06/09 14:55:21 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 14:57:05 - mmengine - INFO - Epoch(train) [77][100/351] lr: 2.3968e-03 eta: 6 days, 5:06:42 time: 0.9635 data_time: 0.0422 memory: 48596 loss: 0.4728
2023/06/09 14:58:44 - mmengine - INFO - Epoch(train) [77][200/351] lr: 2.3967e-03 eta: 6 days, 5:03:58 time: 0.9519 data_time: 0.0019 memory: 48596 loss: 0.4727
2023/06/09 15:00:25 - mmengine - INFO - Epoch(train) [77][300/351] lr: 2.3967e-03 eta: 6 days, 5:02:35 time: 0.9590 data_time: 0.0023 memory: 48596 loss: 0.4731
2023/06/09 15:00:48 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 15:01:14 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 15:03:01 - mmengine - INFO - Epoch(train) [78][100/351] lr: 2.3966e-03 eta: 6 days, 5:04:10 time: 1.0590 data_time: 0.0021 memory: 48596 loss: 0.4735
2023/06/09 15:04:39 - mmengine - INFO - Epoch(train) [78][200/351] lr: 2.3966e-03 eta: 6 days, 5:00:44 time: 0.9462 data_time: 0.0030 memory: 48596 loss: 0.4702
2023/06/09 15:06:20 - mmengine - INFO - Epoch(train) [78][300/351] lr: 2.3965e-03 eta: 6 days, 4:58:50 time: 0.9347 data_time: 0.0025 memory: 48596 loss: 0.4716
2023/06/09 15:07:10 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 15:08:54 - mmengine - INFO - Epoch(train) [79][100/351] lr: 2.3964e-03 eta: 6 days, 4:58:37 time: 0.9378 data_time: 0.0023 memory: 48596 loss: 0.4715
2023/06/09 15:10:31 - mmengine - INFO - Epoch(train) [79][200/351] lr: 2.3964e-03 eta: 6 days, 4:54:31 time: 0.9720 data_time: 0.0035 memory: 48596 loss: 0.4685
2023/06/09 15:12:14 - mmengine - INFO - Epoch(train) [79][300/351] lr: 2.3963e-03 eta: 6 days, 4:54:34 time: 0.9779 data_time: 0.0020 memory: 48596 loss: 0.4720
2023/06/09 15:13:03 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 15:14:46 - mmengine - INFO - Epoch(train) [80][100/351] lr: 2.3962e-03 eta: 6 days, 4:52:10 time: 0.9553 data_time: 0.0978 memory: 48596 loss: 0.4702
2023/06/09 15:16:25 - mmengine - INFO - Epoch(train) [80][200/351] lr: 2.3962e-03 eta: 6 days, 4:49:18 time: 0.9611 data_time: 0.0320 memory: 48596 loss: 0.4726
2023/06/09 15:17:35 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 15:18:04 - mmengine - INFO - Epoch(train) [80][300/351] lr: 2.3961e-03 eta: 6 days, 4:46:39 time: 0.9427 data_time: 0.0022 memory: 48596 loss: 0.4736
2023/06/09 15:18:52 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 15:20:36 - mmengine - INFO - Epoch(train) [81][100/351] lr: 2.3961e-03 eta: 6 days, 4:44:12 time: 0.9135 data_time: 0.0019 memory: 48596 loss: 0.4756
2023/06/09 15:22:13 - mmengine - INFO - Epoch(train) [81][200/351] lr: 2.3960e-03 eta: 6 days, 4:40:06 time: 0.9813 data_time: 0.0019 memory: 48596 loss: 0.4723
2023/06/09 15:23:54 - mmengine - INFO - Epoch(train) [81][300/351] lr: 2.3959e-03 eta: 6 days, 4:39:07 time: 0.9921 data_time: 0.0022 memory: 48596 loss: 0.4738
2023/06/09 15:24:42 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 15:26:25 - mmengine - INFO - Epoch(train) [82][100/351] lr: 2.3959e-03 eta: 6 days, 4:36:15 time: 0.9584 data_time: 0.1059 memory: 48596 loss: 0.4730
2023/06/09 15:28:05 - mmengine - INFO - Epoch(train) [82][200/351] lr: 2.3958e-03 eta: 6 days, 4:33:50 time: 0.9838 data_time: 0.0020 memory: 48596 loss: 0.4736
2023/06/09 15:29:43 - mmengine - INFO - Epoch(train) [82][300/351] lr: 2.3957e-03 eta: 6 days, 4:30:46 time: 0.9019 data_time: 0.0026 memory: 48596 loss: 0.4736
2023/06/09 15:30:34 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 15:32:18 - mmengine - INFO - Epoch(train) [83][100/351] lr: 2.3957e-03 eta: 6 days, 4:30:41 time: 0.9062 data_time: 0.0217 memory: 48596 loss: 0.4710
2023/06/09 15:33:55 - mmengine - INFO - Epoch(train) [83][200/351] lr: 2.3956e-03 eta: 6 days, 4:26:49 time: 0.9345 data_time: 0.0096 memory: 48596 loss: 0.4760
2023/06/09 15:34:14 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 15:35:38 - mmengine - INFO - Epoch(train) [83][300/351] lr: 2.3955e-03 eta: 6 days, 4:26:57 time: 0.9466 data_time: 0.0019 memory: 48596 loss: 0.4713
2023/06/09 15:36:27 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 15:38:10 - mmengine - INFO - Epoch(train) [84][100/351] lr: 2.3954e-03 eta: 6 days, 4:24:56 time: 0.9800 data_time: 0.0533 memory: 48596 loss: 0.4736
2023/06/09 15:39:49 - mmengine - INFO - Epoch(train) [84][200/351] lr: 2.3954e-03 eta: 6 days, 4:22:20 time: 0.9484 data_time: 0.0019 memory: 48596 loss: 0.4715
2023/06/09 15:41:29 - mmengine - INFO - Epoch(train) [84][300/351] lr: 2.3953e-03 eta: 6 days, 4:20:00 time: 0.9440 data_time: 0.0021 memory: 48596 loss: 0.4729
2023/06/09 15:42:19 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 15:44:03 - mmengine - INFO - Epoch(train) [85][100/351] lr: 2.3952e-03 eta: 6 days, 4:19:28 time: 0.9374 data_time: 0.0020 memory: 48596 loss: 0.4701
2023/06/09 15:45:40 - mmengine - INFO - Epoch(train) [85][200/351] lr: 2.3952e-03 eta: 6 days, 4:15:21 time: 0.9621 data_time: 0.0020 memory: 48596 loss: 0.4721
2023/06/09 15:47:22 - mmengine - INFO - Epoch(train) [85][300/351] lr: 2.3951e-03 eta: 6 days, 4:15:04 time: 0.9298 data_time: 0.0022 memory: 48596 loss: 0.4727
2023/06/09 15:48:11 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 15:49:51 - mmengine - INFO - Epoch(train) [86][100/351] lr: 2.3950e-03 eta: 6 days, 4:10:40 time: 0.9243 data_time: 0.0617 memory: 48596 loss: 0.4726
2023/06/09 15:50:56 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 15:51:30 - mmengine - INFO - Epoch(train) [86][200/351] lr: 2.3950e-03 eta: 6 days, 4:08:09 time: 0.9393 data_time: 0.0046 memory: 48596 loss: 0.4745
2023/06/09 15:53:09 - mmengine - INFO - Epoch(train) [86][300/351] lr: 2.3949e-03 eta: 6 days, 4:05:14 time: 0.9296 data_time: 0.0020 memory: 48596 loss: 0.4718
2023/06/09 15:53:58 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 15:55:42 - mmengine - INFO - Epoch(train) [87][100/351] lr: 2.3948e-03 eta: 6 days, 4:03:32 time: 0.9496 data_time: 0.0075 memory: 48596 loss: 0.4739
2023/06/09 15:57:17 - mmengine - INFO - Epoch(train) [87][200/351] lr: 2.3947e-03 eta: 6 days, 3:58:36 time: 0.9245 data_time: 0.0019 memory: 48596 loss: 0.4724
2023/06/09 15:58:57 - mmengine - INFO - Epoch(train) [87][300/351] lr: 2.3947e-03 eta: 6 days, 3:56:54 time: 0.9556 data_time: 0.0020 memory: 48596 loss: 0.4735
2023/06/09 15:59:46 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 16:01:29 - mmengine - INFO - Epoch(train) [88][100/351] lr: 2.3946e-03 eta: 6 days, 3:54:50 time: 0.9375 data_time: 0.0592 memory: 48596 loss: 0.4703
2023/06/09 16:03:08 - mmengine - INFO - Epoch(train) [88][200/351] lr: 2.3945e-03 eta: 6 days, 3:52:01 time: 0.9204 data_time: 0.0022 memory: 48596 loss: 0.4668
2023/06/09 16:04:46 - mmengine - INFO - Epoch(train) [88][300/351] lr: 2.3944e-03 eta: 6 days, 3:49:23 time: 0.9636 data_time: 0.0021 memory: 48596 loss: 0.4746
2023/06/09 16:05:36 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 16:07:20 - mmengine - INFO - Epoch(train) [89][100/351] lr: 2.3943e-03 eta: 6 days, 3:48:01 time: 0.9542 data_time: 0.0094 memory: 48596 loss: 0.4706
2023/06/09 16:07:31 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 16:08:55 - mmengine - INFO - Epoch(train) [89][200/351] lr: 2.3943e-03 eta: 6 days, 3:43:14 time: 0.9331 data_time: 0.0034 memory: 48596 loss: 0.4776
2023/06/09 16:10:37 - mmengine - INFO - Epoch(train) [89][300/351] lr: 2.3942e-03 eta: 6 days, 3:42:20 time: 0.9636 data_time: 0.0020 memory: 48596 loss: 0.4682
2023/06/09 16:11:25 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 16:13:09 - mmengine - INFO - Epoch(train) [90][100/351] lr: 2.3941e-03 eta: 6 days, 3:40:21 time: 0.9615 data_time: 0.0022 memory: 48596 loss: 0.4690
2023/06/09 16:14:48 - mmengine - INFO - Epoch(train) [90][200/351] lr: 2.3940e-03 eta: 6 days, 3:38:05 time: 0.9889 data_time: 0.0021 memory: 48596 loss: 0.4695
2023/06/09 16:16:29 - mmengine - INFO - Epoch(train) [90][300/351] lr: 2.3940e-03 eta: 6 days, 3:36:34 time: 0.9614 data_time: 0.0021 memory: 48596 loss: 0.5298
2023/06/09 16:17:18 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 16:19:01 - mmengine - INFO - Epoch(train) [91][100/351] lr: 2.3939e-03 eta: 6 days, 3:34:40 time: 0.9902 data_time: 0.0118 memory: 48596 loss: 0.4706
2023/06/09 16:20:40 - mmengine - INFO - Epoch(train) [91][200/351] lr: 2.3938e-03 eta: 6 days, 3:32:00 time: 0.9439 data_time: 0.0020 memory: 48596 loss: 0.4714
2023/06/09 16:22:20 - mmengine - INFO - Epoch(train) [91][300/351] lr: 2.3937e-03 eta: 6 days, 3:30:38 time: 0.9618 data_time: 0.0021 memory: 48596 loss: 0.4741
2023/06/09 16:23:09 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 16:24:14 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 16:24:54 - mmengine - INFO - Epoch(train) [92][100/351] lr: 2.3936e-03 eta: 6 days, 3:29:29 time: 0.9505 data_time: 0.0104 memory: 48596 loss: 0.4693
2023/06/09 16:26:33 - mmengine - INFO - Epoch(train) [92][200/351] lr: 2.3935e-03 eta: 6 days, 3:27:01 time: 0.9527 data_time: 0.0019 memory: 48596 loss: 0.4695
2023/06/09 16:28:14 - mmengine - INFO - Epoch(train) [92][300/351] lr: 2.3935e-03 eta: 6 days, 3:25:45 time: 0.9558 data_time: 0.0020 memory: 48596 loss: 0.4690
2023/06/09 16:29:03 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 16:30:45 - mmengine - INFO - Epoch(train) [93][100/351] lr: 2.3934e-03 eta: 6 days, 3:22:48 time: 0.9116 data_time: 0.0026 memory: 48596 loss: 0.4708
2023/06/09 16:32:24 - mmengine - INFO - Epoch(train) [93][200/351] lr: 2.3933e-03 eta: 6 days, 3:20:41 time: 0.9119 data_time: 0.0021 memory: 48596 loss: 0.4712
2023/06/09 16:34:04 - mmengine - INFO - Epoch(train) [93][300/351] lr: 2.3932e-03 eta: 6 days, 3:18:33 time: 0.9766 data_time: 0.0023 memory: 48596 loss: 0.4694
2023/06/09 16:34:52 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 16:36:35 - mmengine - INFO - Epoch(train) [94][100/351] lr: 2.3931e-03 eta: 6 days, 3:16:10 time: 0.9329 data_time: 0.1149 memory: 48596 loss: 0.4666
2023/06/09 16:38:15 - mmengine - INFO - Epoch(train) [94][200/351] lr: 2.3930e-03 eta: 6 days, 3:14:13 time: 0.9273 data_time: 0.0591 memory: 48596 loss: 0.4723
2023/06/09 16:39:54 - mmengine - INFO - Epoch(train) [94][300/351] lr: 2.3930e-03 eta: 6 days, 3:11:39 time: 0.9635 data_time: 0.0022 memory: 48596 loss: 0.4712
2023/06/09 16:40:42 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 16:40:55 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 16:42:27 - mmengine - INFO - Epoch(train) [95][100/351] lr: 2.3928e-03 eta: 6 days, 3:10:03 time: 0.9530 data_time: 0.0088 memory: 48596 loss: 0.4694
2023/06/09 16:44:03 - mmengine - INFO - Epoch(train) [95][200/351] lr: 2.3928e-03 eta: 6 days, 3:06:10 time: 0.9460 data_time: 0.0024 memory: 48596 loss: 0.4722
2023/06/09 16:45:44 - mmengine - INFO - Epoch(train) [95][300/351] lr: 2.3927e-03 eta: 6 days, 3:04:49 time: 0.9565 data_time: 0.0019 memory: 48596 loss: 0.4705
2023/06/09 16:46:33 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 16:48:16 - mmengine - INFO - Epoch(train) [96][100/351] lr: 2.3926e-03 eta: 6 days, 3:03:05 time: 0.9386 data_time: 0.0357 memory: 48596 loss: 0.4705
2023/06/09 16:49:52 - mmengine - INFO - Epoch(train) [96][200/351] lr: 2.3925e-03 eta: 6 days, 2:58:59 time: 0.9179 data_time: 0.0020 memory: 48596 loss: 0.4690
2023/06/09 16:51:34 - mmengine - INFO - Epoch(train) [96][300/351] lr: 2.3924e-03 eta: 6 days, 2:58:16 time: 0.9965 data_time: 0.0020 memory: 48596 loss: 0.4729
2023/06/09 16:52:23 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 16:54:05 - mmengine - INFO - Epoch(train) [97][100/351] lr: 2.3923e-03 eta: 6 days, 2:55:19 time: 0.9188 data_time: 0.0021 memory: 48596 loss: 0.4697
2023/06/09 16:55:43 - mmengine - INFO - Epoch(train) [97][200/351] lr: 2.3922e-03 eta: 6 days, 2:52:31 time: 0.9389 data_time: 0.0023 memory: 48596 loss: 0.4736
2023/06/09 16:57:24 - mmengine - INFO - Epoch(train) [97][300/351] lr: 2.3921e-03 eta: 6 days, 2:51:24 time: 0.9092 data_time: 0.0021 memory: 48596 loss: 0.4711
2023/06/09 16:57:27 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 16:58:13 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 16:59:56 - mmengine - INFO - Epoch(train) [98][100/351] lr: 2.3920e-03 eta: 6 days, 2:49:06 time: 0.9287 data_time: 0.0019 memory: 48596 loss: 0.4742
2023/06/09 17:01:32 - mmengine - INFO - Epoch(train) [98][200/351] lr: 2.3919e-03 eta: 6 days, 2:45:35 time: 0.9916 data_time: 0.0020 memory: 48596 loss: 0.4690
2023/06/09 17:03:14 - mmengine - INFO - Epoch(train) [98][300/351] lr: 2.3919e-03 eta: 6 days, 2:44:49 time: 1.0226 data_time: 0.0020 memory: 48596 loss: 0.4799
2023/06/09 17:04:05 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 17:05:51 - mmengine - INFO - Epoch(train) [99][100/351] lr: 2.3917e-03 eta: 6 days, 2:45:02 time: 0.9497 data_time: 0.0710 memory: 48596 loss: 0.4706
2023/06/09 17:07:34 - mmengine - INFO - Epoch(train) [99][200/351] lr: 2.3917e-03 eta: 6 days, 2:44:24 time: 1.0029 data_time: 0.0020 memory: 48596 loss: 0.4736
2023/06/09 17:09:19 - mmengine - INFO - Epoch(train) [99][300/351] lr: 2.3916e-03 eta: 6 days, 2:45:06 time: 1.0102 data_time: 0.0022 memory: 48596 loss: 0.4690
2023/06/09 17:10:10 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 17:11:58 - mmengine - INFO - Epoch(train) [100][100/351] lr: 2.3915e-03 eta: 6 days, 2:46:15 time: 0.9686 data_time: 0.0160 memory: 48596 loss: 0.4731
2023/06/09 17:13:39 - mmengine - INFO - Epoch(train) [100][200/351] lr: 2.3914e-03 eta: 6 days, 2:45:01 time: 0.9567 data_time: 0.0020 memory: 48596 loss: 0.4688
2023/06/09 17:14:32 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 17:15:23 - mmengine - INFO - Epoch(train) [100][300/351] lr: 2.3913e-03 eta: 6 days, 2:45:04 time: 0.9930 data_time: 0.0024 memory: 48596 loss: 0.4679
2023/06/09 17:16:13 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 17:16:13 - mmengine - INFO - Saving checkpoint at 100 epochs
2023/06/09 17:18:21 - mmengine - INFO - Epoch(train) [101][100/351] lr: 2.3912e-03 eta: 6 days, 2:44:50 time: 0.9541 data_time: 0.1049 memory: 48596 loss: 0.4709
2023/06/09 17:20:02 - mmengine - INFO - Epoch(train) [101][200/351] lr: 2.3911e-03 eta: 6 days, 2:43:17 time: 1.0087 data_time: 0.1507 memory: 48596 loss: 0.4732
2023/06/09 17:21:49 - mmengine - INFO - Epoch(train) [101][300/351] lr: 2.3910e-03 eta: 6 days, 2:44:53 time: 1.0387 data_time: 0.2005 memory: 48596 loss: 0.4679
2023/06/09 17:22:41 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 17:24:32 - mmengine - INFO - Epoch(train) [102][100/351] lr: 2.3909e-03 eta: 6 days, 2:47:43 time: 1.1109 data_time: 0.2416 memory: 48596 loss: 0.4724
2023/06/09 17:26:13 - mmengine - INFO - Epoch(train) [102][200/351] lr: 2.3908e-03 eta: 6 days, 2:46:13 time: 0.9906 data_time: 0.1363 memory: 48596 loss: 0.4690
2023/06/09 17:27:58 - mmengine - INFO - Epoch(train) [102][300/351] lr: 2.3907e-03 eta: 6 days, 2:46:29 time: 1.0079 data_time: 0.0035 memory: 48596 loss: 0.4713
2023/06/09 17:28:49 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 17:30:36 - mmengine - INFO - Epoch(train) [103][100/351] lr: 2.3906e-03 eta: 6 days, 2:47:15 time: 0.9469 data_time: 0.0020 memory: 48596 loss: 0.4686
2023/06/09 17:32:18 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 17:32:20 - mmengine - INFO - Epoch(train) [103][200/351] lr: 2.3905e-03 eta: 6 days, 2:47:01 time: 1.0435 data_time: 0.0024 memory: 48596 loss: 0.4697
2023/06/09 17:34:08 - mmengine - INFO - Epoch(train) [103][300/351] lr: 2.3904e-03 eta: 6 days, 2:48:50 time: 0.9957 data_time: 0.0022 memory: 48596 loss: 0.4657
2023/06/09 17:35:00 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 17:36:48 - mmengine - INFO - Epoch(train) [104][100/351] lr: 2.3903e-03 eta: 6 days, 2:49:47 time: 0.9733 data_time: 0.0608 memory: 48596 loss: 0.4707
2023/06/09 17:38:29 - mmengine - INFO - Epoch(train) [104][200/351] lr: 2.3902e-03 eta: 6 days, 2:48:16 time: 0.9882 data_time: 0.0220 memory: 48596 loss: 0.4700
2023/06/09 17:40:14 - mmengine - INFO - Epoch(train) [104][300/351] lr: 2.3901e-03 eta: 6 days, 2:48:22 time: 0.9950 data_time: 0.0024 memory: 48596 loss: 0.4695
2023/06/09 17:41:06 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 17:42:56 - mmengine - INFO - Epoch(train) [105][100/351] lr: 2.3900e-03 eta: 6 days, 2:50:23 time: 0.9833 data_time: 0.0373 memory: 48596 loss: 0.4716
2023/06/09 17:44:37 - mmengine - INFO - Epoch(train) [105][200/351] lr: 2.3899e-03 eta: 6 days, 2:48:48 time: 1.0401 data_time: 0.0021 memory: 48596 loss: 0.4697
2023/06/09 17:46:24 - mmengine - INFO - Epoch(train) [105][300/351] lr: 2.3898e-03 eta: 6 days, 2:50:09 time: 1.0457 data_time: 0.0022 memory: 48596 loss: 0.4717
2023/06/09 17:47:15 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 17:49:01 - mmengine - INFO - Epoch(train) [106][100/351] lr: 2.3896e-03 eta: 6 days, 2:49:27 time: 1.0069 data_time: 0.1009 memory: 48596 loss: 0.4717
2023/06/09 17:49:49 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 17:50:43 - mmengine - INFO - Epoch(train) [106][200/351] lr: 2.3896e-03 eta: 6 days, 2:48:30 time: 0.9419 data_time: 0.0573 memory: 48596 loss: 0.4710
2023/06/09 17:52:30 - mmengine - INFO - Epoch(train) [106][300/351] lr: 2.3895e-03 eta: 6 days, 2:49:31 time: 1.0022 data_time: 0.0022 memory: 48596 loss: 0.4717
2023/06/09 17:53:23 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 17:55:11 - mmengine - INFO - Epoch(train) [107][100/351] lr: 2.3893e-03 eta: 6 days, 2:50:34 time: 0.9671 data_time: 0.0022 memory: 48596 loss: 0.4702
2023/06/09 17:56:52 - mmengine - INFO - Epoch(train) [107][200/351] lr: 2.3892e-03 eta: 6 days, 2:49:06 time: 0.9880 data_time: 0.0023 memory: 48596 loss: 0.4677
2023/06/09 17:58:37 - mmengine - INFO - Epoch(train) [107][300/351] lr: 2.3891e-03 eta: 6 days, 2:49:18 time: 1.0274 data_time: 0.0028 memory: 48596 loss: 0.4680
2023/06/09 17:59:29 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 18:01:15 - mmengine - INFO - Epoch(train) [108][100/351] lr: 2.3890e-03 eta: 6 days, 2:49:07 time: 0.9991 data_time: 0.1375 memory: 48596 loss: 0.4750
2023/06/09 18:02:57 - mmengine - INFO - Epoch(train) [108][200/351] lr: 2.3889e-03 eta: 6 days, 2:47:47 time: 0.9852 data_time: 0.0689 memory: 48596 loss: 0.4702
2023/06/09 18:04:40 - mmengine - INFO - Epoch(train) [108][300/351] lr: 2.3888e-03 eta: 6 days, 2:46:59 time: 1.0433 data_time: 0.0020 memory: 48596 loss: 0.4876
2023/06/09 18:05:33 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 18:07:12 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 18:07:20 - mmengine - INFO - Epoch(train) [109][100/351] lr: 2.3887e-03 eta: 6 days, 2:47:27 time: 0.9619 data_time: 0.0021 memory: 48596 loss: 0.4695
2023/06/09 18:09:00 - mmengine - INFO - Epoch(train) [109][200/351] lr: 2.3886e-03 eta: 6 days, 2:45:33 time: 0.9826 data_time: 0.0020 memory: 48596 loss: 0.4673
2023/06/09 18:10:48 - mmengine - INFO - Epoch(train) [109][300/351] lr: 2.3885e-03 eta: 6 days, 2:46:36 time: 1.0029 data_time: 0.0021 memory: 48596 loss: 0.4739
2023/06/09 18:11:42 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 18:13:29 - mmengine - INFO - Epoch(train) [110][100/351] lr: 2.3883e-03 eta: 6 days, 2:47:28 time: 0.9602 data_time: 0.0019 memory: 48596 loss: 0.4682
2023/06/09 18:15:09 - mmengine - INFO - Epoch(train) [110][200/351] lr: 2.3882e-03 eta: 6 days, 2:45:22 time: 0.9623 data_time: 0.0020 memory: 48596 loss: 0.4700
2023/06/09 18:16:49 - mmengine - INFO - Epoch(train) [110][300/351] lr: 2.3881e-03 eta: 6 days, 2:43:18 time: 0.9260 data_time: 0.0024 memory: 48596 loss: 0.4704
2023/06/09 18:17:38 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 18:19:22 - mmengine - INFO - Epoch(train) [111][100/351] lr: 2.3880e-03 eta: 6 days, 2:41:01 time: 0.9904 data_time: 0.1233 memory: 48596 loss: 0.4694
2023/06/09 18:21:01 - mmengine - INFO - Epoch(train) [111][200/351] lr: 2.3879e-03 eta: 6 days, 2:38:29 time: 0.9722 data_time: 0.1297 memory: 48596 loss: 0.4682
2023/06/09 18:22:42 - mmengine - INFO - Epoch(train) [111][300/351] lr: 2.3878e-03 eta: 6 days, 2:37:00 time: 0.9910 data_time: 0.0041 memory: 48596 loss: 0.4701
2023/06/09 18:23:31 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 18:24:14 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 18:25:14 - mmengine - INFO - Epoch(train) [112][100/351] lr: 2.3877e-03 eta: 6 days, 2:34:17 time: 0.9275 data_time: 0.0023 memory: 48596 loss: 0.4697
2023/06/09 18:26:53 - mmengine - INFO - Epoch(train) [112][200/351] lr: 2.3876e-03 eta: 6 days, 2:31:49 time: 0.9584 data_time: 0.0024 memory: 48596 loss: 0.4715
2023/06/09 18:28:32 - mmengine - INFO - Epoch(train) [112][300/351] lr: 2.3875e-03 eta: 6 days, 2:29:15 time: 0.9648 data_time: 0.0022 memory: 48596 loss: 0.4739
2023/06/09 18:29:21 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 18:31:07 - mmengine - INFO - Epoch(train) [113][100/351] lr: 2.3873e-03 eta: 6 days, 2:27:53 time: 1.0214 data_time: 0.0218 memory: 48596 loss: 0.4666
2023/06/09 18:32:45 - mmengine - INFO - Epoch(train) [113][200/351] lr: 2.3872e-03 eta: 6 days, 2:25:03 time: 0.9822 data_time: 0.0022 memory: 48596 loss: 0.4742
2023/06/09 18:34:28 - mmengine - INFO - Epoch(train) [113][300/351] lr: 2.3871e-03 eta: 6 days, 2:24:10 time: 0.9829 data_time: 0.0022 memory: 48596 loss: 0.4689
2023/06/09 18:35:18 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 18:37:02 - mmengine - INFO - Epoch(train) [114][100/351] lr: 2.3870e-03 eta: 6 days, 2:22:03 time: 0.9505 data_time: 0.1062 memory: 48596 loss: 0.4703
2023/06/09 18:38:42 - mmengine - INFO - Epoch(train) [114][200/351] lr: 2.3869e-03 eta: 6 days, 2:20:09 time: 1.0061 data_time: 0.0026 memory: 48596 loss: 0.4660
2023/06/09 18:40:23 - mmengine - INFO - Epoch(train) [114][300/351] lr: 2.3868e-03 eta: 6 days, 2:18:15 time: 0.9913 data_time: 0.0023 memory: 48596 loss: 0.4752
2023/06/09 18:41:01 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 18:41:13 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 18:42:59 - mmengine - INFO - Epoch(train) [115][100/351] lr: 2.3866e-03 eta: 6 days, 2:17:11 time: 0.9393 data_time: 0.0030 memory: 48596 loss: 0.4666
2023/06/09 18:44:36 - mmengine - INFO - Epoch(train) [115][200/351] lr: 2.3865e-03 eta: 6 days, 2:14:01 time: 0.9559 data_time: 0.0023 memory: 48596 loss: 0.4729
2023/06/09 18:46:20 - mmengine - INFO - Epoch(train) [115][300/351] lr: 2.3864e-03 eta: 6 days, 2:13:10 time: 1.0267 data_time: 0.0021 memory: 48596 loss: 0.4694
2023/06/09 18:47:09 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 18:48:54 - mmengine - INFO - Epoch(train) [116][100/351] lr: 2.3862e-03 eta: 6 days, 2:11:13 time: 0.9264 data_time: 0.0021 memory: 48596 loss: 0.4697
2023/06/09 18:50:34 - mmengine - INFO - Epoch(train) [116][200/351] lr: 2.3861e-03 eta: 6 days, 2:09:12 time: 0.9869 data_time: 0.0026 memory: 48596 loss: 0.4700
2023/06/09 18:52:13 - mmengine - INFO - Epoch(train) [116][300/351] lr: 2.3860e-03 eta: 6 days, 2:07:03 time: 0.9610 data_time: 0.0020 memory: 48596 loss: 0.4665
2023/06/09 18:53:04 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 18:54:49 - mmengine - INFO - Epoch(train) [117][100/351] lr: 2.3859e-03 eta: 6 days, 2:05:28 time: 0.9537 data_time: 0.0022 memory: 48596 loss: 0.4687
2023/06/09 18:56:26 - mmengine - INFO - Epoch(train) [117][200/351] lr: 2.3858e-03 eta: 6 days, 2:02:36 time: 0.9467 data_time: 0.0026 memory: 48596 loss: 0.4665
2023/06/09 18:57:52 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 18:58:09 - mmengine - INFO - Epoch(train) [117][300/351] lr: 2.3857e-03 eta: 6 days, 2:01:27 time: 0.9898 data_time: 0.0021 memory: 48596 loss: 0.4714
2023/06/09 18:58:57 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 19:00:41 - mmengine - INFO - Epoch(train) [118][100/351] lr: 2.3855e-03 eta: 6 days, 1:58:49 time: 0.9742 data_time: 0.1456 memory: 48596 loss: 0.4655
2023/06/09 19:02:21 - mmengine - INFO - Epoch(train) [118][200/351] lr: 2.3854e-03 eta: 6 days, 1:56:53 time: 0.9591 data_time: 0.0023 memory: 48596 loss: 0.4690
2023/06/09 19:04:01 - mmengine - INFO - Epoch(train) [118][300/351] lr: 2.3853e-03 eta: 6 days, 1:54:50 time: 0.9633 data_time: 0.0022 memory: 48596 loss: 0.4716
2023/06/09 19:04:53 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 19:06:39 - mmengine - INFO - Epoch(train) [119][100/351] lr: 2.3851e-03 eta: 6 days, 1:54:07 time: 0.9431 data_time: 0.0047 memory: 48596 loss: 0.4690
2023/06/09 19:08:17 - mmengine - INFO - Epoch(train) [119][200/351] lr: 2.3850e-03 eta: 6 days, 1:51:14 time: 0.9381 data_time: 0.0023 memory: 48596 loss: 0.4690
2023/06/09 19:09:59 - mmengine - INFO - Epoch(train) [119][300/351] lr: 2.3849e-03 eta: 6 days, 1:49:59 time: 0.9615 data_time: 0.0022 memory: 48596 loss: 0.4706
2023/06/09 19:10:47 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 19:12:31 - mmengine - INFO - Epoch(train) [120][100/351] lr: 2.3847e-03 eta: 6 days, 1:47:21 time: 0.9208 data_time: 0.0443 memory: 48596 loss: 0.4700
2023/06/09 19:14:11 - mmengine - INFO - Epoch(train) [120][200/351] lr: 2.3846e-03 eta: 6 days, 1:45:18 time: 0.9834 data_time: 0.0024 memory: 48596 loss: 0.4688
2023/06/09 19:14:41 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 19:15:49 - mmengine - INFO - Epoch(train) [120][300/351] lr: 2.3845e-03 eta: 6 days, 1:42:44 time: 0.9820 data_time: 0.0023 memory: 48596 loss: 0.4726
2023/06/09 19:16:40 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 19:18:26 - mmengine - INFO - Epoch(train) [121][100/351] lr: 2.3844e-03 eta: 6 days, 1:41:44 time: 0.9766 data_time: 0.0194 memory: 48596 loss: 0.4703
2023/06/09 19:20:02 - mmengine - INFO - Epoch(train) [121][200/351] lr: 2.3842e-03 eta: 6 days, 1:38:21 time: 0.9412 data_time: 0.0021 memory: 48596 loss: 0.4685
2023/06/09 19:21:44 - mmengine - INFO - Epoch(train) [121][300/351] lr: 2.3841e-03 eta: 6 days, 1:37:03 time: 0.9539 data_time: 0.0022 memory: 48596 loss: 0.4728
2023/06/09 19:22:34 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 19:24:17 - mmengine - INFO - Epoch(train) [122][100/351] lr: 2.3840e-03 eta: 6 days, 1:34:35 time: 0.9565 data_time: 0.0690 memory: 48596 loss: 0.4700
2023/06/09 19:25:58 - mmengine - INFO - Epoch(train) [122][200/351] lr: 2.3838e-03 eta: 6 days, 1:32:45 time: 0.9852 data_time: 0.0021 memory: 48596 loss: 0.4662
2023/06/09 19:27:38 - mmengine - INFO - Epoch(train) [122][300/351] lr: 2.3837e-03 eta: 6 days, 1:30:49 time: 0.9159 data_time: 0.0025 memory: 48596 loss: 0.4688
2023/06/09 19:28:29 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 19:30:15 - mmengine - INFO - Epoch(train) [123][100/351] lr: 2.3836e-03 eta: 6 days, 1:29:42 time: 0.9665 data_time: 0.0021 memory: 48596 loss: 0.4695
2023/06/09 19:31:32 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 19:31:53 - mmengine - INFO - Epoch(train) [123][200/351] lr: 2.3834e-03 eta: 6 days, 1:27:15 time: 0.9600 data_time: 0.0021 memory: 48596 loss: 0.4612
2023/06/09 19:33:36 - mmengine - INFO - Epoch(train) [123][300/351] lr: 2.3833e-03 eta: 6 days, 1:26:07 time: 1.0062 data_time: 0.0021 memory: 48596 loss: 0.4691
2023/06/09 19:34:26 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 19:36:10 - mmengine - INFO - Epoch(train) [124][100/351] lr: 2.3832e-03 eta: 6 days, 1:23:55 time: 0.9548 data_time: 0.0273 memory: 48596 loss: 0.4754
2023/06/09 19:37:50 - mmengine - INFO - Epoch(train) [124][200/351] lr: 2.3830e-03 eta: 6 days, 1:21:57 time: 0.9899 data_time: 0.0023 memory: 48596 loss: 0.4713
2023/06/09 19:39:28 - mmengine - INFO - Epoch(train) [124][300/351] lr: 2.3829e-03 eta: 6 days, 1:19:22 time: 0.9470 data_time: 0.0022 memory: 48596 loss: 0.4708
2023/06/09 19:40:19 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 19:42:03 - mmengine - INFO - Epoch(train) [125][100/351] lr: 2.3828e-03 eta: 6 days, 1:17:41 time: 0.9534 data_time: 0.0398 memory: 48596 loss: 0.4677
2023/06/09 19:43:41 - mmengine - INFO - Epoch(train) [125][200/351] lr: 2.3826e-03 eta: 6 days, 1:15:00 time: 0.9414 data_time: 0.0169 memory: 48596 loss: 0.4659
2023/06/09 19:45:23 - mmengine - INFO - Epoch(train) [125][300/351] lr: 2.3825e-03 eta: 6 days, 1:13:47 time: 0.9518 data_time: 0.0023 memory: 48596 loss: 0.4694
2023/06/09 19:46:12 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 19:47:58 - mmengine - INFO - Epoch(train) [126][100/351] lr: 2.3823e-03 eta: 6 days, 1:11:58 time: 0.9460 data_time: 0.0977 memory: 48596 loss: 0.4671
2023/06/09 19:48:26 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 19:49:42 - mmengine - INFO - Epoch(train) [126][200/351] lr: 2.3822e-03 eta: 6 days, 1:11:10 time: 0.9713 data_time: 0.0023 memory: 48596 loss: 0.4712
2023/06/09 19:51:24 - mmengine - INFO - Epoch(train) [126][300/351] lr: 2.3821e-03 eta: 6 days, 1:09:52 time: 1.0151 data_time: 0.0021 memory: 48596 loss: 0.4677
2023/06/09 19:52:17 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 19:54:05 - mmengine - INFO - Epoch(train) [127][100/351] lr: 2.3819e-03 eta: 6 days, 1:09:47 time: 0.9022 data_time: 0.0023 memory: 48596 loss: 0.4672
2023/06/09 19:55:42 - mmengine - INFO - Epoch(train) [127][200/351] lr: 2.3818e-03 eta: 6 days, 1:06:51 time: 0.9486 data_time: 0.0024 memory: 48596 loss: 0.4665
2023/06/09 19:57:27 - mmengine - INFO - Epoch(train) [127][300/351] lr: 2.3817e-03 eta: 6 days, 1:06:37 time: 1.0881 data_time: 0.0022 memory: 48596 loss: 0.4677
2023/06/09 19:58:18 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 20:00:02 - mmengine - INFO - Epoch(train) [128][100/351] lr: 2.3815e-03 eta: 6 days, 1:04:46 time: 0.9529 data_time: 0.0873 memory: 48596 loss: 0.4703
2023/06/09 20:01:44 - mmengine - INFO - Epoch(train) [128][200/351] lr: 2.3814e-03 eta: 6 days, 1:03:21 time: 1.0289 data_time: 0.0021 memory: 48596 loss: 0.4702
2023/06/09 20:03:27 - mmengine - INFO - Epoch(train) [128][300/351] lr: 2.3813e-03 eta: 6 days, 1:02:14 time: 0.9615 data_time: 0.0022 memory: 48596 loss: 0.4718
2023/06/09 20:04:19 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 20:05:36 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 20:06:04 - mmengine - INFO - Epoch(train) [129][100/351] lr: 2.3811e-03 eta: 6 days, 1:01:07 time: 0.9539 data_time: 0.0021 memory: 48596 loss: 0.4723
2023/06/09 20:07:42 - mmengine - INFO - Epoch(train) [129][200/351] lr: 2.3810e-03 eta: 6 days, 0:58:36 time: 0.9752 data_time: 0.0022 memory: 48596 loss: 0.4675
2023/06/09 20:09:27 - mmengine - INFO - Epoch(train) [129][300/351] lr: 2.3808e-03 eta: 6 days, 0:57:51 time: 1.0036 data_time: 0.0022 memory: 48596 loss: 0.4692
2023/06/09 20:10:15 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 20:12:02 - mmengine - INFO - Epoch(train) [130][100/351] lr: 2.3807e-03 eta: 6 days, 0:56:00 time: 0.9226 data_time: 0.0023 memory: 48596 loss: 0.4695
2023/06/09 20:13:45 - mmengine - INFO - Epoch(train) [130][200/351] lr: 2.3805e-03 eta: 6 days, 0:55:10 time: 1.0498 data_time: 0.0028 memory: 48596 loss: 0.4678
2023/06/09 20:15:29 - mmengine - INFO - Epoch(train) [130][300/351] lr: 2.3804e-03 eta: 6 days, 0:54:12 time: 0.9817 data_time: 0.0023 memory: 48596 loss: 0.4722
2023/06/09 20:16:19 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 20:18:02 - mmengine - INFO - Epoch(train) [131][100/351] lr: 2.3802e-03 eta: 6 days, 0:51:45 time: 0.9422 data_time: 0.0841 memory: 48596 loss: 0.4695
2023/06/09 20:19:42 - mmengine - INFO - Epoch(train) [131][200/351] lr: 2.3801e-03 eta: 6 days, 0:49:49 time: 0.9621 data_time: 0.0021 memory: 48596 loss: 0.4682
2023/06/09 20:21:23 - mmengine - INFO - Epoch(train) [131][300/351] lr: 2.3800e-03 eta: 6 days, 0:48:08 time: 0.9251 data_time: 0.0048 memory: 48596 loss: 0.4694
2023/06/09 20:22:15 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 20:22:41 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 20:23:59 - mmengine - INFO - Epoch(train) [132][100/351] lr: 2.3798e-03 eta: 6 days, 0:46:32 time: 0.9242 data_time: 0.0021 memory: 48596 loss: 0.4721
2023/06/09 20:25:36 - mmengine - INFO - Epoch(train) [132][200/351] lr: 2.3797e-03 eta: 6 days, 0:43:29 time: 0.9287 data_time: 0.0020 memory: 48596 loss: 0.4716
2023/06/09 20:27:19 - mmengine - INFO - Epoch(train) [132][300/351] lr: 2.3795e-03 eta: 6 days, 0:42:21 time: 0.9815 data_time: 0.0023 memory: 48596 loss: 0.4677
2023/06/09 20:28:09 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 20:29:56 - mmengine - INFO - Epoch(train) [133][100/351] lr: 2.3793e-03 eta: 6 days, 0:41:02 time: 0.9934 data_time: 0.1086 memory: 48596 loss: 0.4689
2023/06/09 20:31:40 - mmengine - INFO - Epoch(train) [133][200/351] lr: 2.3792e-03 eta: 6 days, 0:40:22 time: 1.0129 data_time: 0.0881 memory: 48596 loss: 0.4679
2023/06/09 20:33:24 - mmengine - INFO - Epoch(train) [133][300/351] lr: 2.3791e-03 eta: 6 days, 0:39:28 time: 0.9624 data_time: 0.0020 memory: 48596 loss: 0.4718
2023/06/09 20:34:18 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 20:36:09 - mmengine - INFO - Epoch(train) [134][100/351] lr: 2.3789e-03 eta: 6 days, 0:40:22 time: 0.9480 data_time: 0.0471 memory: 48596 loss: 0.4662
2023/06/09 20:37:49 - mmengine - INFO - Epoch(train) [134][200/351] lr: 2.3788e-03 eta: 6 days, 0:38:23 time: 1.0478 data_time: 0.0369 memory: 48596 loss: 0.4718
2023/06/09 20:39:38 - mmengine - INFO - Epoch(train) [134][300/351] lr: 2.3786e-03 eta: 6 days, 0:38:50 time: 1.0437 data_time: 0.0028 memory: 48596 loss: 0.4688
2023/06/09 20:39:56 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 20:40:30 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 20:42:21 - mmengine - INFO - Epoch(train) [135][100/351] lr: 2.3784e-03 eta: 6 days, 0:39:13 time: 1.0127 data_time: 0.1265 memory: 48596 loss: 0.4690
2023/06/09 20:44:01 - mmengine - INFO - Epoch(train) [135][200/351] lr: 2.3783e-03 eta: 6 days, 0:37:12 time: 0.9598 data_time: 0.0353 memory: 48596 loss: 0.4731
2023/06/09 20:45:48 - mmengine - INFO - Epoch(train) [135][300/351] lr: 2.3782e-03 eta: 6 days, 0:37:04 time: 1.0124 data_time: 0.0560 memory: 48596 loss: 0.4696
2023/06/09 20:46:40 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 20:48:26 - mmengine - INFO - Epoch(train) [136][100/351] lr: 2.3780e-03 eta: 6 days, 0:36:10 time: 1.0496 data_time: 0.1236 memory: 48596 loss: 0.4681
2023/06/09 20:50:08 - mmengine - INFO - Epoch(train) [136][200/351] lr: 2.3778e-03 eta: 6 days, 0:34:34 time: 0.9993 data_time: 0.0426 memory: 48596 loss: 0.4683
2023/06/09 20:51:58 - mmengine - INFO - Epoch(train) [136][300/351] lr: 2.3777e-03 eta: 6 days, 0:35:14 time: 0.9279 data_time: 0.0020 memory: 48596 loss: 0.4702
2023/06/09 20:52:48 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 20:54:32 - mmengine - INFO - Epoch(train) [137][100/351] lr: 2.3775e-03 eta: 6 days, 0:33:04 time: 0.9635 data_time: 0.0023 memory: 48596 loss: 0.4677
2023/06/09 20:56:16 - mmengine - INFO - Epoch(train) [137][200/351] lr: 2.3774e-03 eta: 6 days, 0:32:09 time: 0.9466 data_time: 0.0024 memory: 48596 loss: 0.4711
2023/06/09 20:57:23 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 20:58:01 - mmengine - INFO - Epoch(train) [137][300/351] lr: 2.3772e-03 eta: 6 days, 0:31:31 time: 0.9824 data_time: 0.0025 memory: 48596 loss: 0.4650
2023/06/09 20:58:54 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 21:00:41 - mmengine - INFO - Epoch(train) [138][100/351] lr: 2.3770e-03 eta: 6 days, 0:30:42 time: 0.9813 data_time: 0.1148 memory: 48596 loss: 0.4700
2023/06/09 21:02:20 - mmengine - INFO - Epoch(train) [138][200/351] lr: 2.3769e-03 eta: 6 days, 0:28:33 time: 1.0347 data_time: 0.0021 memory: 48596 loss: 0.4660
2023/06/09 21:04:09 - mmengine - INFO - Epoch(train) [138][300/351] lr: 2.3768e-03 eta: 6 days, 0:28:54 time: 0.9679 data_time: 0.0037 memory: 48596 loss: 0.4713
2023/06/09 21:05:01 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 21:06:45 - mmengine - INFO - Epoch(train) [139][100/351] lr: 2.3766e-03 eta: 6 days, 0:27:09 time: 0.9597 data_time: 0.1138 memory: 48596 loss: 0.4703
2023/06/09 21:08:28 - mmengine - INFO - Epoch(train) [139][200/351] lr: 2.3764e-03 eta: 6 days, 0:25:45 time: 1.0112 data_time: 0.0525 memory: 48596 loss: 0.4689
2023/06/09 21:10:12 - mmengine - INFO - Epoch(train) [139][300/351] lr: 2.3763e-03 eta: 6 days, 0:24:58 time: 0.9839 data_time: 0.0021 memory: 48596 loss: 0.4683
2023/06/09 21:11:03 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 21:12:49 - mmengine - INFO - Epoch(train) [140][100/351] lr: 2.3761e-03 eta: 6 days, 0:23:20 time: 0.9244 data_time: 0.0744 memory: 48596 loss: 0.4687
2023/06/09 21:14:29 - mmengine - INFO - Epoch(train) [140][200/351] lr: 2.3760e-03 eta: 6 days, 0:21:26 time: 0.9201 data_time: 0.0025 memory: 48596 loss: 0.4695
2023/06/09 21:14:41 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 21:16:14 - mmengine - INFO - Epoch(train) [140][300/351] lr: 2.3758e-03 eta: 6 days, 0:20:30 time: 0.9806 data_time: 0.0021 memory: 48596 loss: 0.4670
2023/06/09 21:17:04 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 21:18:49 - mmengine - INFO - Epoch(train) [141][100/351] lr: 2.3756e-03 eta: 6 days, 0:18:28 time: 0.8916 data_time: 0.0022 memory: 48596 loss: 0.4684
2023/06/09 21:20:29 - mmengine - INFO - Epoch(train) [141][200/351] lr: 2.3755e-03 eta: 6 days, 0:16:34 time: 0.9789 data_time: 0.0025 memory: 48596 loss: 0.4687
2023/06/09 21:22:13 - mmengine - INFO - Epoch(train) [141][300/351] lr: 2.3753e-03 eta: 6 days, 0:15:31 time: 0.9622 data_time: 0.0021 memory: 48596 loss: 0.4708
2023/06/09 21:23:04 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 21:24:52 - mmengine - INFO - Epoch(train) [142][100/351] lr: 2.3751e-03 eta: 6 days, 0:14:19 time: 0.9378 data_time: 0.0587 memory: 48596 loss: 0.4679
2023/06/09 21:26:34 - mmengine - INFO - Epoch(train) [142][200/351] lr: 2.3750e-03 eta: 6 days, 0:12:53 time: 0.9591 data_time: 0.0022 memory: 48596 loss: 0.4664
2023/06/09 21:28:18 - mmengine - INFO - Epoch(train) [142][300/351] lr: 2.3748e-03 eta: 6 days, 0:11:57 time: 0.9638 data_time: 0.0026 memory: 48596 loss: 0.4704
2023/06/09 21:29:09 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 21:30:55 - mmengine - INFO - Epoch(train) [143][100/351] lr: 2.3746e-03 eta: 6 days, 0:10:19 time: 0.9812 data_time: 0.0143 memory: 48596 loss: 0.4720
2023/06/09 21:31:55 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 21:32:40 - mmengine - INFO - Epoch(train) [143][200/351] lr: 2.3745e-03 eta: 6 days, 0:09:28 time: 1.0152 data_time: 0.0854 memory: 48596 loss: 0.4672
2023/06/09 21:34:23 - mmengine - INFO - Epoch(train) [143][300/351] lr: 2.3744e-03 eta: 6 days, 0:08:15 time: 1.0367 data_time: 0.0021 memory: 48596 loss: 0.4702
2023/06/09 21:35:15 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 21:37:05 - mmengine - INFO - Epoch(train) [144][100/351] lr: 2.3741e-03 eta: 6 days, 0:07:55 time: 1.0567 data_time: 0.0841 memory: 48596 loss: 0.4659
2023/06/09 21:38:45 - mmengine - INFO - Epoch(train) [144][200/351] lr: 2.3740e-03 eta: 6 days, 0:05:56 time: 1.0309 data_time: 0.0024 memory: 48596 loss: 0.4667
2023/06/09 21:40:33 - mmengine - INFO - Epoch(train) [144][300/351] lr: 2.3739e-03 eta: 6 days, 0:05:41 time: 0.9447 data_time: 0.0022 memory: 48596 loss: 0.4690
2023/06/09 21:41:21 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 21:43:08 - mmengine - INFO - Epoch(train) [145][100/351] lr: 2.3736e-03 eta: 6 days, 0:03:37 time: 0.9784 data_time: 0.0387 memory: 48596 loss: 0.4643
2023/06/09 21:44:49 - mmengine - INFO - Epoch(train) [145][200/351] lr: 2.3735e-03 eta: 6 days, 0:01:53 time: 0.9642 data_time: 0.0022 memory: 48596 loss: 0.4717
2023/06/09 21:46:31 - mmengine - INFO - Epoch(train) [145][300/351] lr: 2.3733e-03 eta: 6 days, 0:00:20 time: 1.0232 data_time: 0.0023 memory: 48596 loss: 0.4681
2023/06/09 21:47:23 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 21:49:09 - mmengine - INFO - Epoch(train) [146][100/351] lr: 2.3731e-03 eta: 5 days, 23:58:48 time: 0.9515 data_time: 0.0021 memory: 48596 loss: 0.4686
2023/06/09 21:49:15 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 21:50:51 - mmengine - INFO - Epoch(train) [146][200/351] lr: 2.3730e-03 eta: 5 days, 23:57:16 time: 1.0104 data_time: 0.0021 memory: 48596 loss: 0.4715
2023/06/09 21:52:34 - mmengine - INFO - Epoch(train) [146][300/351] lr: 2.3728e-03 eta: 5 days, 23:56:00 time: 1.0021 data_time: 0.0021 memory: 48596 loss: 0.4681
2023/06/09 21:53:26 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 21:55:14 - mmengine - INFO - Epoch(train) [147][100/351] lr: 2.3726e-03 eta: 5 days, 23:55:12 time: 0.9597 data_time: 0.1050 memory: 48596 loss: 0.4655
2023/06/09 21:56:59 - mmengine - INFO - Epoch(train) [147][200/351] lr: 2.3725e-03 eta: 5 days, 23:54:09 time: 1.0263 data_time: 0.0854 memory: 48596 loss: 0.4667
2023/06/09 21:58:41 - mmengine - INFO - Epoch(train) [147][300/351] lr: 2.3723e-03 eta: 5 days, 23:52:36 time: 1.0105 data_time: 0.0024 memory: 48596 loss: 0.4665
2023/06/09 21:59:31 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 22:01:21 - mmengine - INFO - Epoch(train) [148][100/351] lr: 2.3721e-03 eta: 5 days, 23:51:50 time: 1.0365 data_time: 0.0310 memory: 48596 loss: 0.4702
2023/06/09 22:03:01 - mmengine - INFO - Epoch(train) [148][200/351] lr: 2.3720e-03 eta: 5 days, 23:49:46 time: 0.9424 data_time: 0.0308 memory: 48596 loss: 0.4639
2023/06/09 22:04:50 - mmengine - INFO - Epoch(train) [148][300/351] lr: 2.3718e-03 eta: 5 days, 23:49:40 time: 0.9822 data_time: 0.0020 memory: 48596 loss: 0.4674
2023/06/09 22:05:41 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 22:06:41 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 22:07:31 - mmengine - INFO - Epoch(train) [149][100/351] lr: 2.3716e-03 eta: 5 days, 23:48:57 time: 0.9751 data_time: 0.0023 memory: 48596 loss: 0.4692
2023/06/09 22:09:14 - mmengine - INFO - Epoch(train) [149][200/351] lr: 2.3714e-03 eta: 5 days, 23:47:35 time: 1.0154 data_time: 0.0023 memory: 48596 loss: 0.4705
2023/06/09 22:10:59 - mmengine - INFO - Epoch(train) [149][300/351] lr: 2.3713e-03 eta: 5 days, 23:46:47 time: 1.0436 data_time: 0.0022 memory: 48596 loss: 0.4674
2023/06/09 22:11:50 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 22:13:39 - mmengine - INFO - Epoch(train) [150][100/351] lr: 2.3711e-03 eta: 5 days, 23:45:42 time: 0.9467 data_time: 0.0273 memory: 48596 loss: 0.4680
2023/06/09 22:15:17 - mmengine - INFO - Epoch(train) [150][200/351] lr: 2.3709e-03 eta: 5 days, 23:43:13 time: 0.9604 data_time: 0.0022 memory: 48596 loss: 0.4644
2023/06/09 22:17:03 - mmengine - INFO - Epoch(train) [150][300/351] lr: 2.3708e-03 eta: 5 days, 23:42:36 time: 0.9645 data_time: 0.0022 memory: 48596 loss: 0.4710
2023/06/09 22:17:53 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 22:19:41 - mmengine - INFO - Epoch(train) [151][100/351] lr: 2.3705e-03 eta: 5 days, 23:40:59 time: 1.0113 data_time: 0.0028 memory: 48596 loss: 0.4679
2023/06/09 22:21:25 - mmengine - INFO - Epoch(train) [151][200/351] lr: 2.3704e-03 eta: 5 days, 23:40:00 time: 0.9601 data_time: 0.0021 memory: 48596 loss: 0.4666
2023/06/09 22:23:11 - mmengine - INFO - Epoch(train) [151][300/351] lr: 2.3702e-03 eta: 5 days, 23:39:18 time: 0.9811 data_time: 0.0020 memory: 48596 loss: 0.4719
2023/06/09 22:24:02 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 22:24:02 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 22:25:48 - mmengine - INFO - Epoch(train) [152][100/351] lr: 2.3700e-03 eta: 5 days, 23:37:34 time: 1.0612 data_time: 0.1571 memory: 48596 loss: 0.4680
2023/06/09 22:27:34 - mmengine - INFO - Epoch(train) [152][200/351] lr: 2.3698e-03 eta: 5 days, 23:36:43 time: 0.9813 data_time: 0.0031 memory: 48596 loss: 0.4686
2023/06/09 22:29:17 - mmengine - INFO - Epoch(train) [152][300/351] lr: 2.3697e-03 eta: 5 days, 23:35:17 time: 0.9477 data_time: 0.0021 memory: 48596 loss: 0.4686
2023/06/09 22:30:06 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 22:31:53 - mmengine - INFO - Epoch(train) [153][100/351] lr: 2.3695e-03 eta: 5 days, 23:33:18 time: 0.9408 data_time: 0.0718 memory: 48596 loss: 0.4661
2023/06/09 22:33:36 - mmengine - INFO - Epoch(train) [153][200/351] lr: 2.3693e-03 eta: 5 days, 23:32:00 time: 0.9390 data_time: 0.0949 memory: 48596 loss: 0.4660
2023/06/09 22:35:21 - mmengine - INFO - Epoch(train) [153][300/351] lr: 2.3691e-03 eta: 5 days, 23:31:04 time: 0.9923 data_time: 0.0390 memory: 48596 loss: 0.4685
2023/06/09 22:36:13 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 22:38:00 - mmengine - INFO - Epoch(train) [154][100/351] lr: 2.3689e-03 eta: 5 days, 23:29:46 time: 0.9602 data_time: 0.0360 memory: 48596 loss: 0.4720
2023/06/09 22:39:42 - mmengine - INFO - Epoch(train) [154][200/351] lr: 2.3688e-03 eta: 5 days, 23:28:09 time: 1.0146 data_time: 0.0022 memory: 48596 loss: 0.4670
2023/06/09 22:41:28 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 22:41:30 - mmengine - INFO - Epoch(train) [154][300/351] lr: 2.3686e-03 eta: 5 days, 23:27:51 time: 1.0459 data_time: 0.0292 memory: 48596 loss: 0.4693
2023/06/09 22:42:22 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 22:44:11 - mmengine - INFO - Epoch(train) [155][100/351] lr: 2.3684e-03 eta: 5 days, 23:26:54 time: 0.9603 data_time: 0.0415 memory: 48596 loss: 0.4660
2023/06/09 22:45:52 - mmengine - INFO - Epoch(train) [155][200/351] lr: 2.3682e-03 eta: 5 days, 23:25:04 time: 0.9997 data_time: 0.0021 memory: 48596 loss: 0.4661
2023/06/09 22:47:32 - mmengine - INFO - Epoch(train) [155][300/351] lr: 2.3680e-03 eta: 5 days, 23:23:02 time: 0.9527 data_time: 0.0024 memory: 48596 loss: 0.4693
2023/06/09 22:48:24 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 22:50:09 - mmengine - INFO - Epoch(train) [156][100/351] lr: 2.3678e-03 eta: 5 days, 23:21:06 time: 0.9207 data_time: 0.0501 memory: 48596 loss: 0.4668
2023/06/09 22:51:47 - mmengine - INFO - Epoch(train) [156][200/351] lr: 2.3676e-03 eta: 5 days, 23:18:38 time: 0.9217 data_time: 0.0026 memory: 48596 loss: 0.4670
2023/06/09 22:53:31 - mmengine - INFO - Epoch(train) [156][300/351] lr: 2.3675e-03 eta: 5 days, 23:17:30 time: 1.0139 data_time: 0.0039 memory: 48596 loss: 0.4647
2023/06/09 22:54:23 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 22:56:07 - mmengine - INFO - Epoch(train) [157][100/351] lr: 2.3672e-03 eta: 5 days, 23:15:17 time: 0.9711 data_time: 0.1006 memory: 48596 loss: 0.4667
2023/06/09 22:57:47 - mmengine - INFO - Epoch(train) [157][200/351] lr: 2.3671e-03 eta: 5 days, 23:13:18 time: 0.9670 data_time: 0.0259 memory: 48596 loss: 0.4695
2023/06/09 22:58:32 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 22:59:28 - mmengine - INFO - Epoch(train) [157][300/351] lr: 2.3669e-03 eta: 5 days, 23:11:30 time: 0.9783 data_time: 0.0042 memory: 48596 loss: 0.4676
2023/06/09 23:00:20 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 23:02:07 - mmengine - INFO - Epoch(train) [158][100/351] lr: 2.3667e-03 eta: 5 days, 23:09:58 time: 0.9937 data_time: 0.0021 memory: 48596 loss: 0.4681
2023/06/09 23:03:46 - mmengine - INFO - Epoch(train) [158][200/351] lr: 2.3665e-03 eta: 5 days, 23:07:37 time: 0.9636 data_time: 0.0021 memory: 48596 loss: 0.4667
2023/06/09 23:05:31 - mmengine - INFO - Epoch(train) [158][300/351] lr: 2.3664e-03 eta: 5 days, 23:06:43 time: 0.9710 data_time: 0.0024 memory: 48596 loss: 0.4738
2023/06/09 23:06:20 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 23:08:07 - mmengine - INFO - Epoch(train) [159][100/351] lr: 2.3661e-03 eta: 5 days, 23:04:38 time: 0.9720 data_time: 0.0677 memory: 48596 loss: 0.4685
2023/06/09 23:09:49 - mmengine - INFO - Epoch(train) [159][200/351] lr: 2.3660e-03 eta: 5 days, 23:02:55 time: 0.9829 data_time: 0.0023 memory: 48596 loss: 0.4677
2023/06/09 23:11:32 - mmengine - INFO - Epoch(train) [159][300/351] lr: 2.3658e-03 eta: 5 days, 23:01:35 time: 0.9585 data_time: 0.0026 memory: 48596 loss: 0.4663
2023/06/09 23:12:24 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 23:14:12 - mmengine - INFO - Epoch(train) [160][100/351] lr: 2.3655e-03 eta: 5 days, 23:00:15 time: 0.9940 data_time: 0.0022 memory: 48596 loss: 0.4690
2023/06/09 23:15:42 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 23:15:51 - mmengine - INFO - Epoch(train) [160][200/351] lr: 2.3654e-03 eta: 5 days, 22:57:58 time: 0.9811 data_time: 0.0027 memory: 48596 loss: 0.4674
2023/06/09 23:17:32 - mmengine - INFO - Epoch(train) [160][300/351] lr: 2.3652e-03 eta: 5 days, 22:56:14 time: 0.9050 data_time: 0.0024 memory: 48596 loss: 0.4675
2023/06/09 23:18:22 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 23:20:06 - mmengine - INFO - Epoch(train) [161][100/351] lr: 2.3650e-03 eta: 5 days, 22:53:34 time: 0.9724 data_time: 0.1021 memory: 48596 loss: 0.4666
2023/06/09 23:21:47 - mmengine - INFO - Epoch(train) [161][200/351] lr: 2.3648e-03 eta: 5 days, 22:51:41 time: 0.9849 data_time: 0.0530 memory: 48596 loss: 0.4667
2023/06/09 23:23:28 - mmengine - INFO - Epoch(train) [161][300/351] lr: 2.3646e-03 eta: 5 days, 22:49:55 time: 0.9463 data_time: 0.0022 memory: 48596 loss: 0.4710
2023/06/09 23:24:21 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 23:26:08 - mmengine - INFO - Epoch(train) [162][100/351] lr: 2.3644e-03 eta: 5 days, 22:48:37 time: 0.9541 data_time: 0.0021 memory: 48596 loss: 0.4700
2023/06/09 23:27:46 - mmengine - INFO - Epoch(train) [162][200/351] lr: 2.3642e-03 eta: 5 days, 22:46:16 time: 0.9653 data_time: 0.0022 memory: 48596 loss: 0.4677
2023/06/09 23:29:32 - mmengine - INFO - Epoch(train) [162][300/351] lr: 2.3641e-03 eta: 5 days, 22:45:24 time: 1.0256 data_time: 0.0021 memory: 48596 loss: 0.4652
2023/06/09 23:30:22 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 23:32:07 - mmengine - INFO - Epoch(train) [163][100/351] lr: 2.3638e-03 eta: 5 days, 22:43:09 time: 0.9675 data_time: 0.1117 memory: 48596 loss: 0.4669
2023/06/09 23:32:50 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 23:33:51 - mmengine - INFO - Epoch(train) [163][200/351] lr: 2.3636e-03 eta: 5 days, 22:41:48 time: 0.9305 data_time: 0.0023 memory: 48596 loss: 0.5318
2023/06/09 23:35:31 - mmengine - INFO - Epoch(train) [163][300/351] lr: 2.3635e-03 eta: 5 days, 22:39:45 time: 0.9373 data_time: 0.0025 memory: 48596 loss: nan
2023/06/09 23:36:22 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 23:38:07 - mmengine - INFO - Epoch(train) [164][100/351] lr: 2.3632e-03 eta: 5 days, 22:37:37 time: 0.9780 data_time: 0.0022 memory: 48596 loss: nan
2023/06/09 23:39:45 - mmengine - INFO - Epoch(train) [164][200/351] lr: 2.3630e-03 eta: 5 days, 22:35:12 time: 0.8733 data_time: 0.0027 memory: 48596 loss: nan
2023/06/09 23:41:28 - mmengine - INFO - Epoch(train) [164][300/351] lr: 2.3629e-03 eta: 5 days, 22:33:41 time: 0.9546 data_time: 0.0022 memory: 48596 loss: nan
2023/06/09 23:42:17 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 23:44:01 - mmengine - INFO - Epoch(train) [165][100/351] lr: 2.3626e-03 eta: 5 days, 22:31:00 time: 0.9755 data_time: 0.1014 memory: 48596 loss: nan
2023/06/09 23:45:41 - mmengine - INFO - Epoch(train) [165][200/351] lr: 2.3624e-03 eta: 5 days, 22:29:00 time: 0.9610 data_time: 0.0021 memory: 48596 loss: nan
2023/06/09 23:47:22 - mmengine - INFO - Epoch(train) [165][300/351] lr: 2.3623e-03 eta: 5 days, 22:27:01 time: 0.9934 data_time: 0.0023 memory: 48596 loss: nan
2023/06/09 23:48:12 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 23:49:41 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 23:49:56 - mmengine - INFO - Epoch(train) [166][100/351] lr: 2.3620e-03 eta: 5 days, 22:24:33 time: 0.9772 data_time: 0.1022 memory: 48596 loss: nan
2023/06/09 23:51:33 - mmengine - INFO - Epoch(train) [166][200/351] lr: 2.3618e-03 eta: 5 days, 22:21:53 time: 0.9591 data_time: 0.0681 memory: 48596 loss: nan
2023/06/09 23:53:17 - mmengine - INFO - Epoch(train) [166][300/351] lr: 2.3617e-03 eta: 5 days, 22:20:36 time: 0.9553 data_time: 0.0024 memory: 48596 loss: nan
2023/06/09 23:54:06 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/09 23:55:50 - mmengine - INFO - Epoch(train) [167][100/351] lr: 2.3614e-03 eta: 5 days, 22:17:57 time: 0.9413 data_time: 0.0021 memory: 48596 loss: nan
2023/06/09 23:57:30 - mmengine - INFO - Epoch(train) [167][200/351] lr: 2.3612e-03 eta: 5 days, 22:15:54 time: 0.9997 data_time: 0.0021 memory: 48596 loss: nan
2023/06/09 23:59:12 - mmengine - INFO - Epoch(train) [167][300/351] lr: 2.3611e-03 eta: 5 days, 22:14:11 time: 0.9755 data_time: 0.0022 memory: 48596 loss: nan
2023/06/10 00:00:01 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/10 00:01:47 - mmengine - INFO - Epoch(train) [168][100/351] lr: 2.3608e-03 eta: 5 days, 22:11:50 time: 0.9349 data_time: 0.0023 memory: 48596 loss: nan
2023/06/10 00:03:23 - mmengine - INFO - Epoch(train) [168][200/351] lr: 2.3606e-03 eta: 5 days, 22:08:58 time: 0.9008 data_time: 0.0021 memory: 48596 loss: nan
2023/06/10 00:05:04 - mmengine - INFO - Epoch(train) [168][300/351] lr: 2.3604e-03 eta: 5 days, 22:07:11 time: 0.9270 data_time: 0.0021 memory: 48596 loss: nan
2023/06/10 00:05:54 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/10 00:06:31 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/10 00:07:37 - mmengine - INFO - Epoch(train) [169][100/351] lr: 2.3602e-03 eta: 5 days, 22:04:31 time: 0.9144 data_time: 0.0023 memory: 48596 loss: nan
2023/06/10 00:09:17 - mmengine - INFO - Epoch(train) [169][200/351] lr: 2.3600e-03 eta: 5 days, 22:02:27 time: 0.9579 data_time: 0.0022 memory: 48596 loss: nan
2023/06/10 00:10:58 - mmengine - INFO - Epoch(train) [169][300/351] lr: 2.3598e-03 eta: 5 days, 22:00:31 time: 0.9466 data_time: 0.0023 memory: 48596 loss: nan
2023/06/10 00:11:49 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/10 00:13:34 - mmengine - INFO - Epoch(train) [170][100/351] lr: 2.3596e-03 eta: 5 days, 21:58:27 time: 0.9196 data_time: 0.0024 memory: 48596 loss: nan
2023/06/10 00:15:12 - mmengine - INFO - Epoch(train) [170][200/351] lr: 2.3594e-03 eta: 5 days, 21:55:59 time: 0.9315 data_time: 0.0030 memory: 48596 loss: nan
2023/06/10 00:16:56 - mmengine - INFO - Epoch(train) [170][300/351] lr: 2.3592e-03 eta: 5 days, 21:54:42 time: 0.9322 data_time: 0.0023 memory: 48596 loss: nan
2023/06/10 00:17:45 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/10 00:19:29 - mmengine - INFO - Epoch(train) [171][100/351] lr: 2.3589e-03 eta: 5 days, 21:51:57 time: 0.9206 data_time: 0.0853 memory: 48596 loss: nan
2023/06/10 00:21:08 - mmengine - INFO - Epoch(train) [171][200/351] lr: 2.3588e-03 eta: 5 days, 21:49:47 time: 0.9665 data_time: 0.0021 memory: 48596 loss: nan
2023/06/10 00:22:48 - mmengine - INFO - Epoch(train) [171][300/351] lr: 2.3586e-03 eta: 5 days, 21:47:45 time: 0.9297 data_time: 0.0021 memory: 48596 loss: nan
2023/06/10 00:23:20 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/10 00:23:39 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/10 00:25:22 - mmengine - INFO - Epoch(train) [172][100/351] lr: 2.3583e-03 eta: 5 days, 21:45:18 time: 0.9264 data_time: 0.0022 memory: 48596 loss: nan
2023/06/10 00:27:01 - mmengine - INFO - Epoch(train) [172][200/351] lr: 2.3581e-03 eta: 5 days, 21:42:57 time: 1.0028 data_time: 0.0024 memory: 48596 loss: nan
2023/06/10 00:28:43 - mmengine - INFO - Epoch(train) [172][300/351] lr: 2.3579e-03 eta: 5 days, 21:41:18 time: 0.9380 data_time: 0.0040 memory: 48596 loss: nan
2023/06/10 00:29:31 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/10 00:31:14 - mmengine - INFO - Epoch(train) [173][100/351] lr: 2.3577e-03 eta: 5 days, 21:38:22 time: 0.9186 data_time: 0.0661 memory: 48596 loss: nan
2023/06/10 00:32:56 - mmengine - INFO - Epoch(train) [173][200/351] lr: 2.3575e-03 eta: 5 days, 21:36:36 time: 0.9327 data_time: 0.0021 memory: 48596 loss: nan
2023/06/10 00:34:38 - mmengine - INFO - Epoch(train) [173][300/351] lr: 2.3573e-03 eta: 5 days, 21:34:55 time: 0.9015 data_time: 0.0022 memory: 48596 loss: nan
2023/06/10 00:35:28 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/10 00:37:12 - mmengine - INFO - Epoch(train) [174][100/351] lr: 2.3570e-03 eta: 5 days, 21:32:34 time: 0.9649 data_time: 0.0246 memory: 48596 loss: nan
2023/06/10 00:38:50 - mmengine - INFO - Epoch(train) [174][200/351] lr: 2.3569e-03 eta: 5 days, 21:30:00 time: 0.9490 data_time: 0.0021 memory: 48596 loss: nan
2023/06/10 00:40:09 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/10 00:40:32 - mmengine - INFO - Epoch(train) [174][300/351] lr: 2.3567e-03 eta: 5 days, 21:28:29 time: 0.9968 data_time: 0.0040 memory: 48596 loss: nan
2023/06/10 00:41:22 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/10 00:43:07 - mmengine - INFO - Epoch(train) [175][100/351] lr: 2.3564e-03 eta: 5 days, 21:26:06 time: 0.9547 data_time: 0.1304 memory: 48596 loss: nan
2023/06/10 00:44:46 - mmengine - INFO - Epoch(train) [175][200/351] lr: 2.3562e-03 eta: 5 days, 21:23:53 time: 0.9699 data_time: 0.0208 memory: 48596 loss: nan
2023/06/10 00:46:27 - mmengine - INFO - Epoch(train) [175][300/351] lr: 2.3560e-03 eta: 5 days, 21:22:02 time: 0.9934 data_time: 0.0021 memory: 48596 loss: nan
2023/06/10 00:47:17 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/10 00:49:02 - mmengine - INFO - Epoch(train) [176][100/351] lr: 2.3557e-03 eta: 5 days, 21:19:51 time: 0.9700 data_time: 0.0856 memory: 48596 loss: nan
2023/06/10 00:50:39 - mmengine - INFO - Epoch(train) [176][200/351] lr: 2.3556e-03 eta: 5 days, 21:17:10 time: 0.8929 data_time: 0.0769 memory: 48596 loss: nan
2023/06/10 00:52:22 - mmengine - INFO - Epoch(train) [176][300/351] lr: 2.3554e-03 eta: 5 days, 21:15:47 time: 0.9502 data_time: 0.0493 memory: 48596 loss: nan
2023/06/10 00:53:11 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/10 00:54:55 - mmengine - INFO - Epoch(train) [177][100/351] lr: 2.3551e-03 eta: 5 days, 21:13:05 time: 0.9854 data_time: 0.0540 memory: 48596 loss: nan
2023/06/10 00:56:34 - mmengine - INFO - Epoch(train) [177][200/351] lr: 2.3549e-03 eta: 5 days, 21:10:54 time: 0.9756 data_time: 0.0022 memory: 48596 loss: nan
2023/06/10 00:56:59 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/10 00:58:15 - mmengine - INFO - Epoch(train) [177][300/351] lr: 2.3547e-03 eta: 5 days, 21:08:56 time: 0.9518 data_time: 0.0024 memory: 48596 loss: nan
2023/06/10 00:59:08 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/10 01:00:53 - mmengine - INFO - Epoch(train) [178][100/351] lr: 2.3544e-03 eta: 5 days, 21:07:09 time: 0.9336 data_time: 0.0093 memory: 48596 loss: nan
2023/06/10 01:02:31 - mmengine - INFO - Epoch(train) [178][200/351] lr: 2.3542e-03 eta: 5 days, 21:04:52 time: 0.9468 data_time: 0.0632 memory: 48596 loss: nan
2023/06/10 01:04:13 - mmengine - INFO - Epoch(train) [178][300/351] lr: 2.3541e-03 eta: 5 days, 21:03:15 time: 1.0205 data_time: 0.0021 memory: 48596 loss: nan
2023/06/10 01:05:02 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/10 01:06:48 - mmengine - INFO - Epoch(train) [179][100/351] lr: 2.3538e-03 eta: 5 days, 21:00:54 time: 0.9335 data_time: 0.0751 memory: 48596 loss: nan
2023/06/10 01:08:28 - mmengine - INFO - Epoch(train) [179][200/351] lr: 2.3536e-03 eta: 5 days, 20:58:48 time: 0.9587 data_time: 0.0242 memory: 48596 loss: nan
2023/06/10 01:10:08 - mmengine - INFO - Epoch(train) [179][300/351] lr: 2.3534e-03 eta: 5 days, 20:56:56 time: 0.9358 data_time: 0.0023 memory: 48596 loss: nan
2023/06/10 01:11:01 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/10 01:12:46 - mmengine - INFO - Epoch(train) [180][100/351] lr: 2.3531e-03 eta: 5 days, 20:55:05 time: 0.9664 data_time: 0.0021 memory: 48596 loss: nan
2023/06/10 01:13:56 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/10 01:14:24 - mmengine - INFO - Epoch(train) [180][200/351] lr: 2.3529e-03 eta: 5 days, 20:52:38 time: 0.9585 data_time: 0.0022 memory: 48596 loss: nan
2023/06/10 01:16:07 - mmengine - INFO - Epoch(train) [180][300/351] lr: 2.3527e-03 eta: 5 days, 20:51:20 time: 1.0074 data_time: 0.0022 memory: 48596 loss: nan
2023/06/10 01:16:57 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/10 01:18:40 - mmengine - INFO - Epoch(train) [181][100/351] lr: 2.3524e-03 eta: 5 days, 20:48:33 time: 0.9077 data_time: 0.0795 memory: 48596 loss: nan
2023/06/10 01:20:19 - mmengine - INFO - Epoch(train) [181][200/351] lr: 2.3522e-03 eta: 5 days, 20:46:29 time: 1.0209 data_time: 0.1659 memory: 48596 loss: nan
2023/06/10 01:22:00 - mmengine - INFO - Epoch(train) [181][300/351] lr: 2.3520e-03 eta: 5 days, 20:44:35 time: 0.9819 data_time: 0.0021 memory: 48596 loss: nan
2023/06/10 01:22:51 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/10 01:24:36 - mmengine - INFO - Epoch(train) [182][100/351] lr: 2.3518e-03 eta: 5 days, 20:42:21 time: 0.9719 data_time: 0.0905 memory: 48596 loss: nan
2023/06/10 01:26:14 - mmengine - INFO - Epoch(train) [182][200/351] lr: 2.3516e-03 eta: 5 days, 20:40:00 time: 0.9721 data_time: 0.0022 memory: 48596 loss: nan
2023/06/10 01:27:56 - mmengine - INFO - Epoch(train) [182][300/351] lr: 2.3514e-03 eta: 5 days, 20:38:27 time: 0.9581 data_time: 0.0021 memory: 48596 loss: nan
2023/06/10 01:28:44 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/10 01:30:27 - mmengine - INFO - Epoch(train) [183][100/351] lr: 2.3511e-03 eta: 5 days, 20:35:27 time: 0.9174 data_time: 0.0377 memory: 48596 loss: nan
2023/06/10 01:30:46 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/10 01:32:08 - mmengine - INFO - Epoch(train) [183][200/351] lr: 2.3509e-03 eta: 5 days, 20:33:32 time: 0.9714 data_time: 0.0036 memory: 48596 loss: nan
2023/06/10 01:33:47 - mmengine - INFO - Epoch(train) [183][300/351] lr: 2.3507e-03 eta: 5 days, 20:31:29 time: 0.9842 data_time: 0.0023 memory: 48596 loss: nan
2023/06/10 01:34:39 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/10 01:36:24 - mmengine - INFO - Epoch(train) [184][100/351] lr: 2.3504e-03 eta: 5 days, 20:29:22 time: 0.9384 data_time: 0.0508 memory: 48596 loss: nan
2023/06/10 01:38:01 - mmengine - INFO - Epoch(train) [184][200/351] lr: 2.3502e-03 eta: 5 days, 20:26:59 time: 0.9213 data_time: 0.0022 memory: 48596 loss: nan
2023/06/10 01:39:43 - mmengine - INFO - Epoch(train) [184][300/351] lr: 2.3500e-03 eta: 5 days, 20:25:16 time: 0.9514 data_time: 0.0023 memory: 48596 loss: nan
2023/06/10 01:40:32 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/10 01:42:16 - mmengine - INFO - Epoch(train) [185][100/351] lr: 2.3497e-03 eta: 5 days, 20:22:38 time: 0.9738 data_time: 0.0978 memory: 48596 loss: nan
2023/06/10 01:43:54 - mmengine - INFO - Epoch(train) [185][200/351] lr: 2.3495e-03 eta: 5 days, 20:20:20 time: 0.9550 data_time: 0.0025 memory: 48596 loss: nan
2023/06/10 01:45:34 - mmengine - INFO - Epoch(train) [185][300/351] lr: 2.3493e-03 eta: 5 days, 20:18:14 time: 0.9693 data_time: 0.0026 memory: 48596 loss: nan
2023/06/10 01:46:24 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/10 01:47:35 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/10 01:48:09 - mmengine - INFO - Epoch(train) [186][100/351] lr: 2.3490e-03 eta: 5 days, 20:15:55 time: 0.9046 data_time: 0.0124 memory: 48596 loss: nan
2023/06/10 01:49:47 - mmengine - INFO - Epoch(train) [186][200/351] lr: 2.3488e-03 eta: 5 days, 20:13:36 time: 0.9301 data_time: 0.0023 memory: 48596 loss: nan
2023/06/10 01:51:30 - mmengine - INFO - Epoch(train) [186][300/351] lr: 2.3486e-03 eta: 5 days, 20:12:13 time: 1.0303 data_time: 0.0022 memory: 48596 loss: nan
2023/06/10 01:52:19 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/10 01:54:03 - mmengine - INFO - Epoch(train) [187][100/351] lr: 2.3483e-03 eta: 5 days, 20:09:29 time: 0.8754 data_time: 0.0023 memory: 48596 loss: nan
2023/06/10 01:55:42 - mmengine - INFO - Epoch(train) [187][200/351] lr: 2.3481e-03 eta: 5 days, 20:07:25 time: 0.9968 data_time: 0.0025 memory: 48596 loss: nan
2023/06/10 01:57:25 - mmengine - INFO - Epoch(train) [187][300/351] lr: 2.3479e-03 eta: 5 days, 20:05:54 time: 0.9728 data_time: 0.0022 memory: 48596 loss: nan
2023/06/10 01:58:15 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/10 02:00:01 - mmengine - INFO - Epoch(train) [188][100/351] lr: 2.3476e-03 eta: 5 days, 20:03:48 time: 0.9568 data_time: 0.0341 memory: 48596 loss: nan
2023/06/10 02:01:43 - mmengine - INFO - Epoch(train) [188][200/351] lr: 2.3474e-03 eta: 5 days, 20:02:10 time: 0.9380 data_time: 0.0022 memory: 48596 loss: nan
2023/06/10 02:03:28 - mmengine - INFO - Epoch(train) [188][300/351] lr: 2.3472e-03 eta: 5 days, 20:00:55 time: 0.9623 data_time: 0.0022 memory: 48596 loss: nan
2023/06/10 02:04:17 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/10 02:04:35 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/10 02:06:01 - mmengine - INFO - Epoch(train) [189][100/351] lr: 2.3469e-03 eta: 5 days, 19:58:18 time: 0.9875 data_time: 0.1529 memory: 48596 loss: nan
2023/06/10 02:07:42 - mmengine - INFO - Epoch(train) [189][200/351] lr: 2.3467e-03 eta: 5 days, 19:56:25 time: 1.0436 data_time: 0.2319 memory: 48596 loss: nan
2023/06/10 02:09:23 - mmengine - INFO - Epoch(train) [189][300/351] lr: 2.3465e-03 eta: 5 days, 19:54:36 time: 0.9865 data_time: 0.0438 memory: 48596 loss: nan
2023/06/10 02:10:14 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/10 02:11:58 - mmengine - INFO - Epoch(train) [190][100/351] lr: 2.3462e-03 eta: 5 days, 19:52:23 time: 0.9252 data_time: 0.0517 memory: 48596 loss: nan
2023/06/10 02:13:35 - mmengine - INFO - Epoch(train) [190][200/351] lr: 2.3460e-03 eta: 5 days, 19:49:56 time: 0.9657 data_time: 0.0021 memory: 48596 loss: nan
2023/06/10 02:15:21 - mmengine - INFO - Epoch(train) [190][300/351] lr: 2.3458e-03 eta: 5 days, 19:48:48 time: 1.0329 data_time: 0.0021 memory: 48596 loss: nan
2023/06/10 02:16:10 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/10 02:17:54 - mmengine - INFO - Epoch(train) [191][100/351] lr: 2.3455e-03 eta: 5 days, 19:46:14 time: 0.9415 data_time: 0.1161 memory: 48596 loss: nan
2023/06/10 02:19:34 - mmengine - INFO - Epoch(train) [191][200/351] lr: 2.3453e-03 eta: 5 days, 19:44:19 time: 0.9894 data_time: 0.0024 memory: 48596 loss: nan
2023/06/10 02:21:18 - mmengine - INFO - Epoch(train) [191][300/351] lr: 2.3451e-03 eta: 5 days, 19:42:53 time: 1.0275 data_time: 0.0026 memory: 48596 loss: nan
2023/06/10 02:21:27 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/10 02:22:10 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/10 02:23:57 - mmengine - INFO - Epoch(train) [192][100/351] lr: 2.3447e-03 eta: 5 days, 19:41:12 time: 0.9317 data_time: 0.0022 memory: 48596 loss: nan
2023/06/10 02:25:34 - mmengine - INFO - Epoch(train) [192][200/351] lr: 2.3445e-03 eta: 5 days, 19:38:44 time: 0.9905 data_time: 0.0028 memory: 48596 loss: nan
2023/06/10 02:27:18 - mmengine - INFO - Epoch(train) [192][300/351] lr: 2.3443e-03 eta: 5 days, 19:37:25 time: 1.0055 data_time: 0.0021 memory: 48596 loss: nan
2023/06/10 02:28:06 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/10 02:29:49 - mmengine - INFO - Epoch(train) [193][100/351] lr: 2.3440e-03 eta: 5 days, 19:34:30 time: 0.9242 data_time: 0.0848 memory: 48596 loss: nan
2023/06/10 02:31:30 - mmengine - INFO - Epoch(train) [193][200/351] lr: 2.3438e-03 eta: 5 days, 19:32:45 time: 1.0378 data_time: 0.1535 memory: 48596 loss: nan
2023/06/10 02:33:13 - mmengine - INFO - Epoch(train) [193][300/351] lr: 2.3436e-03 eta: 5 days, 19:31:11 time: 0.9739 data_time: 0.0022 memory: 48596 loss: nan
2023/06/10 02:34:03 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/10 02:35:48 - mmengine - INFO - Epoch(train) [194][100/351] lr: 2.3433e-03 eta: 5 days, 19:28:48 time: 0.9284 data_time: 0.0024 memory: 48596 loss: nan
2023/06/10 02:37:29 - mmengine - INFO - Epoch(train) [194][200/351] lr: 2.3431e-03 eta: 5 days, 19:26:59 time: 1.0254 data_time: 0.0024 memory: 48596 loss: nan
2023/06/10 02:38:32 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/10 02:39:16 - mmengine - INFO - Epoch(train) [194][300/351] lr: 2.3429e-03 eta: 5 days, 19:26:09 time: 0.9808 data_time: 0.0023 memory: 48596 loss: nan
2023/06/10 02:40:08 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/10 02:41:52 - mmengine - INFO - Epoch(train) [195][100/351] lr: 2.3425e-03 eta: 5 days, 19:23:57 time: 0.9075 data_time: 0.0023 memory: 48596 loss: nan
2023/06/10 02:43:31 - mmengine - INFO - Epoch(train) [195][200/351] lr: 2.3423e-03 eta: 5 days, 19:21:55 time: 0.9142 data_time: 0.0023 memory: 48596 loss: nan
2023/06/10 02:45:12 - mmengine - INFO - Epoch(train) [195][300/351] lr: 2.3421e-03 eta: 5 days, 19:20:01 time: 0.9362 data_time: 0.0022 memory: 48596 loss: nan
2023/06/10 02:46:03 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/10 02:47:48 - mmengine - INFO - Epoch(train) [196][100/351] lr: 2.3418e-03 eta: 5 days, 19:17:53 time: 0.9191 data_time: 0.0049 memory: 48596 loss: nan
2023/06/10 02:49:25 - mmengine - INFO - Epoch(train) [196][200/351] lr: 2.3416e-03 eta: 5 days, 19:15:30 time: 0.9768 data_time: 0.0023 memory: 48596 loss: nan
2023/06/10 02:51:07 - mmengine - INFO - Epoch(train) [196][300/351] lr: 2.3414e-03 eta: 5 days, 19:13:50 time: 0.9690 data_time: 0.0022 memory: 48596 loss: nan
2023/06/10 02:51:56 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/10 02:53:39 - mmengine - INFO - Epoch(train) [197][100/351] lr: 2.3411e-03 eta: 5 days, 19:11:01 time: 0.8890 data_time: 0.0021 memory: 48596 loss: nan
2023/06/10 02:55:20 - mmengine - INFO - Epoch(train) [197][200/351] lr: 2.3408e-03 eta: 5 days, 19:09:13 time: 0.9929 data_time: 0.0022 memory: 48596 loss: nan
2023/06/10 02:55:24 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/10 02:57:00 - mmengine - INFO - Epoch(train) [197][300/351] lr: 2.3406e-03 eta: 5 days, 19:07:18 time: 0.9701 data_time: 0.0028 memory: 48596 loss: nan
2023/06/10 02:57:50 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/10 02:59:34 - mmengine - INFO - Epoch(train) [198][100/351] lr: 2.3403e-03 eta: 5 days, 19:04:47 time: 0.9617 data_time: 0.0021 memory: 48596 loss: nan
2023/06/10 03:01:13 - mmengine - INFO - Epoch(train) [198][200/351] lr: 2.3401e-03 eta: 5 days, 19:02:33 time: 1.0085 data_time: 0.0022 memory: 48596 loss: nan
2023/06/10 03:02:54 - mmengine - INFO - Epoch(train) [198][300/351] lr: 2.3399e-03 eta: 5 days, 19:00:51 time: 0.9328 data_time: 0.0023 memory: 48596 loss: nan
2023/06/10 03:03:44 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/10 03:05:29 - mmengine - INFO - Epoch(train) [199][100/351] lr: 2.3396e-03 eta: 5 days, 18:58:26 time: 0.9331 data_time: 0.0842 memory: 48596 loss: nan
2023/06/10 03:07:09 - mmengine - INFO - Epoch(train) [199][200/351] lr: 2.3393e-03 eta: 5 days, 18:56:28 time: 1.0081 data_time: 0.0847 memory: 48596 loss: nan
2023/06/10 03:08:48 - mmengine - INFO - Epoch(train) [199][300/351] lr: 2.3391e-03 eta: 5 days, 18:54:28 time: 0.9728 data_time: 0.0022 memory: 48596 loss: nan
2023/06/10 03:09:38 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/10 03:11:24 - mmengine - INFO - Epoch(train) [200][100/351] lr: 2.3388e-03 eta: 5 days, 18:52:17 time: 0.9548 data_time: 0.0514 memory: 48596 loss: nan
2023/06/10 03:12:14 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/10 03:13:03 - mmengine - INFO - Epoch(train) [200][200/351] lr: 2.3386e-03 eta: 5 days, 18:50:09 time: 0.9780 data_time: 0.0024 memory: 48596 loss: nan
2023/06/10 03:14:43 - mmengine - INFO - Epoch(train) [200][300/351] lr: 2.3384e-03 eta: 5 days, 18:48:12 time: 0.9630 data_time: 0.0034 memory: 48596 loss: nan
2023/06/10 03:15:34 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/10 03:15:34 - mmengine - INFO - Saving checkpoint at 200 epochs
2023/06/10 03:17:40 - mmengine - INFO - Epoch(train) [201][100/351] lr: 2.3380e-03 eta: 5 days, 18:45:38 time: 0.9810 data_time: 0.1445 memory: 48596 loss: nan
2023/06/10 03:19:21 - mmengine - INFO - Epoch(train) [201][200/351] lr: 2.3378e-03 eta: 5 days, 18:43:49 time: 1.0005 data_time: 0.1804 memory: 48596 loss: nan
2023/06/10 03:21:02 - mmengine - INFO - Epoch(train) [201][300/351] lr: 2.3376e-03 eta: 5 days, 18:41:59 time: 0.9728 data_time: 0.1471 memory: 48596 loss: nan
2023/06/10 03:21:50 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/10 03:23:36 - mmengine - INFO - Epoch(train) [202][100/351] lr: 2.3373e-03 eta: 5 days, 18:39:30 time: 0.9734 data_time: 0.0033 memory: 48596 loss: nan
2023/06/10 03:25:15 - mmengine - INFO - Epoch(train) [202][200/351] lr: 2.3370e-03 eta: 5 days, 18:37:20 time: 1.0371 data_time: 0.0022 memory: 48596 loss: nan
2023/06/10 03:26:58 - mmengine - INFO - Epoch(train) [202][300/351] lr: 2.3368e-03 eta: 5 days, 18:35:53 time: 0.9433 data_time: 0.0024 memory: 48596 loss: nan
2023/06/10 03:27:50 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/10 03:29:35 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/10 03:29:36 - mmengine - INFO - Epoch(train) [203][100/351] lr: 2.3365e-03 eta: 5 days, 18:34:05 time: 1.0331 data_time: 0.0023 memory: 48596 loss: nan
2023/06/10 03:31:15 - mmengine - INFO - Epoch(train) [203][200/351] lr: 2.3363e-03 eta: 5 days, 18:31:52 time: 0.9557 data_time: 0.0023 memory: 48596 loss: nan
2023/06/10 03:32:58 - mmengine - INFO - Epoch(train) [203][300/351] lr: 2.3360e-03 eta: 5 days, 18:30:25 time: 0.9453 data_time: 0.0021 memory: 48596 loss: nan
2023/06/10 03:33:47 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/10 03:35:32 - mmengine - INFO - Epoch(train) [204][100/351] lr: 2.3357e-03 eta: 5 days, 18:27:56 time: 1.0825 data_time: 0.1212 memory: 48596 loss: nan
2023/06/10 03:37:14 - mmengine - INFO - Epoch(train) [204][200/351] lr: 2.3355e-03 eta: 5 days, 18:26:17 time: 0.9812 data_time: 0.0023 memory: 48596 loss: nan
2023/06/10 03:38:54 - mmengine - INFO - Epoch(train) [204][300/351] lr: 2.3353e-03 eta: 5 days, 18:24:18 time: 0.9377 data_time: 0.0023 memory: 48596 loss: nan
2023/06/10 03:39:46 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/10 03:41:31 - mmengine - INFO - Epoch(train) [205][100/351] lr: 2.3349e-03 eta: 5 days, 18:22:14 time: 0.9705 data_time: 0.0969 memory: 48596 loss: nan
2023/06/10 03:43:09 - mmengine - INFO - Epoch(train) [205][200/351] lr: 2.3347e-03 eta: 5 days, 18:20:04 time: 0.9881 data_time: 0.0033 memory: 48596 loss: nan
2023/06/10 03:44:51 - mmengine - INFO - Epoch(train) [205][300/351] lr: 2.3345e-03 eta: 5 days, 18:18:26 time: 0.9853 data_time: 0.0034 memory: 48596 loss: nan
2023/06/10 03:45:42 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/10 03:46:34 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/10 03:47:29 - mmengine - INFO - Epoch(train) [206][100/351] lr: 2.3341e-03 eta: 5 days, 18:16:26 time: 0.9530 data_time: 0.0022 memory: 48596 loss: nan
2023/06/10 03:49:06 - mmengine - INFO - Epoch(train) [206][200/351] lr: 2.3339e-03 eta: 5 days, 18:14:08 time: 0.9286 data_time: 0.0023 memory: 48596 loss: nan
2023/06/10 03:50:51 - mmengine - INFO - Epoch(train) [206][300/351] lr: 2.3337e-03 eta: 5 days, 18:12:56 time: 1.0396 data_time: 0.0028 memory: 48596 loss: nan
2023/06/10 03:51:41 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/10 03:53:25 - mmengine - INFO - Epoch(train) [207][100/351] lr: 2.3333e-03 eta: 5 days, 18:10:21 time: 0.9628 data_time: 0.0021 memory: 48596 loss: nan
2023/06/10 03:55:06 - mmengine - INFO - Epoch(train) [207][200/351] lr: 2.3331e-03 eta: 5 days, 18:08:34 time: 0.9728 data_time: 0.0023 memory: 48596 loss: nan
2023/06/10 03:56:50 - mmengine - INFO - Epoch(train) [207][300/351] lr: 2.3329e-03 eta: 5 days, 18:07:13 time: 0.9456 data_time: 0.0022 memory: 48596 loss: nan
2023/06/10 03:57:42 - mmengine - INFO - Exp name: mae_vit-base-p16_8xb512-amp-coslr-1600e_pathology_20230609_120904
2023/06/10 03:59:28 - mmengine - INFO - Epoch(train) [208][100/351] lr: 2.3325e-03 eta: 5 days, 18:05:14 time: 0.9475 data_time: 0.0042 memory: 48596 loss: nan
Beta Was this translation helpful? Give feedback.
All reactions