[2025-11-27 05:04:38] Namespace(method='FedSophia', training_mode='head', dataset='fashionmnist', model_name='resnet18', seed=0, rounds=50, num_clients=10, fraction=0.5, local_epochs=1, batch_size=64, lr=0.01, newton_lr=0.1, sophia_lr=0.05, rho=0.04, betas='0.9,0.99', mu=0.01, log_dir='runs/run_20251127_001404_resnet18_head/fashionmnist/logs', optimizer='sgd', hessian_batches=32, damping=0.01, alpha=0.1)
[2025-11-27 05:04:38] Start: FedSophia | Mode: head | Dataset: fashionmnist | Device: cuda
[2025-11-27 05:06:45] [Round 001] FedSophia | Acc: 37.20% | Loss: 2.2058 | Time: 13.56s | Max GPU Mem: 1507.98 MB
[2025-11-27 05:06:55] [Round 002] FedSophia | Acc: 36.47% | Loss: 2.0475 | Time: 10.47s | Max GPU Mem: 1507.52 MB
[2025-11-27 05:07:06] [Round 003] FedSophia | Acc: 39.21% | Loss: 1.8752 | Time: 10.93s | Max GPU Mem: 1507.56 MB
[2025-11-27 05:07:18] [Round 004] FedSophia | Acc: 45.54% | Loss: 1.7480 | Time: 12.04s | Max GPU Mem: 1506.95 MB
[2025-11-27 05:07:33] [Round 005] FedSophia | Acc: 46.73% | Loss: 1.6397 | Time: 14.97s | Max GPU Mem: 1508.08 MB
[2025-11-27 05:07:54] [Round 006] FedSophia | Acc: 48.36% | Loss: 1.5925 | Time: 20.82s | Max GPU Mem: 1507.58 MB
[2025-11-27 05:08:18] [Round 007] FedSophia | Acc: 48.48% | Loss: 1.5658 | Time: 24.40s | Max GPU Mem: 1507.45 MB
[2025-11-27 05:09:21] [Round 008] FedSophia | Acc: 49.35% | Loss: 1.4698 | Time: 62.94s | Max GPU Mem: 1507.58 MB
[2025-11-27 05:10:47] [Round 009] FedSophia | Acc: 55.35% | Loss: 1.2396 | Time: 85.32s | Max GPU Mem: 1506.95 MB
[2025-11-27 05:12:00] [Round 010] FedSophia | Acc: 59.63% | Loss: 1.1009 | Time: 73.49s | Max GPU Mem: 1506.95 MB
[2025-11-27 05:13:10] [Round 011] FedSophia | Acc: 62.34% | Loss: 1.0107 | Time: 70.32s | Max GPU Mem: 1507.58 MB
[2025-11-27 05:14:15] [Round 012] FedSophia | Acc: 65.11% | Loss: 0.9041 | Time: 64.60s | Max GPU Mem: 1507.45 MB
[2025-11-27 05:15:34] [Round 013] FedSophia | Acc: 69.06% | Loss: 0.7954 | Time: 79.11s | Max GPU Mem: 1506.95 MB
[2025-11-27 05:16:31] [Round 014] FedSophia | Acc: 73.58% | Loss: 0.7182 | Time: 56.79s | Max GPU Mem: 1506.95 MB
[2025-11-27 05:17:43] [Round 015] FedSophia | Acc: 75.08% | Loss: 0.7018 | Time: 71.80s | Max GPU Mem: 1508.08 MB
[2025-11-27 05:18:44] [Round 016] FedSophia | Acc: 75.61% | Loss: 0.6994 | Time: 61.33s | Max GPU Mem: 1508.08 MB
[2025-11-27 05:19:48] [Round 017] FedSophia | Acc: 77.33% | Loss: 0.6726 | Time: 64.13s | Max GPU Mem: 1508.08 MB
[2025-11-27 05:20:49] [Round 018] FedSophia | Acc: 77.51% | Loss: 0.6622 | Time: 60.52s | Max GPU Mem: 1506.95 MB
[2025-11-27 05:21:56] [Round 019] FedSophia | Acc: 77.81% | Loss: 0.6384 | Time: 67.59s | Max GPU Mem: 1506.95 MB
[2025-11-27 05:23:06] [Round 020] FedSophia | Acc: 78.48% | Loss: 0.6119 | Time: 70.12s | Max GPU Mem: 1508.08 MB
[2025-11-27 05:24:09] [Round 021] FedSophia | Acc: 79.06% | Loss: 0.5921 | Time: 62.56s | Max GPU Mem: 1507.58 MB
[2025-11-27 05:25:12] [Round 022] FedSophia | Acc: 78.73% | Loss: 0.5876 | Time: 63.24s | Max GPU Mem: 1506.95 MB
[2025-11-27 05:26:11] [Round 023] FedSophia | Acc: 77.94% | Loss: 0.6044 | Time: 58.29s | Max GPU Mem: 1508.08 MB
[2025-11-27 05:27:14] [Round 024] FedSophia | Acc: 77.20% | Loss: 0.6279 | Time: 63.08s | Max GPU Mem: 1507.58 MB
[2025-11-27 05:28:24] [Round 025] FedSophia | Acc: 76.83% | Loss: 0.6408 | Time: 70.77s | Max GPU Mem: 1506.95 MB
[2025-11-27 05:29:48] [Round 026] FedSophia | Acc: 76.65% | Loss: 0.6455 | Time: 83.73s | Max GPU Mem: 1507.58 MB
[2025-11-27 05:31:08] [Round 027] FedSophia | Acc: 76.55% | Loss: 0.6518 | Time: 79.91s | Max GPU Mem: 1506.95 MB
[2025-11-27 05:32:26] [Round 028] FedSophia | Acc: 76.71% | Loss: 0.6465 | Time: 77.81s | Max GPU Mem: 1507.58 MB
[2025-11-27 05:33:36] [Round 029] FedSophia | Acc: 77.15% | Loss: 0.6327 | Time: 70.25s | Max GPU Mem: 1507.45 MB
[2025-11-27 05:34:49] [Round 030] FedSophia | Acc: 77.38% | Loss: 0.6162 | Time: 73.03s | Max GPU Mem: 1507.45 MB
[2025-11-27 05:35:49] [Round 031] FedSophia | Acc: 77.33% | Loss: 0.6059 | Time: 59.41s | Max GPU Mem: 1506.95 MB
[2025-11-27 05:37:11] [Round 032] FedSophia | Acc: 77.64% | Loss: 0.5980 | Time: 82.20s | Max GPU Mem: 1508.08 MB
[2025-11-27 05:38:16] [Round 033] FedSophia | Acc: 78.00% | Loss: 0.5892 | Time: 64.79s | Max GPU Mem: 1507.58 MB
[2025-11-27 05:39:06] [Round 034] FedSophia | Acc: 78.16% | Loss: 0.5847 | Time: 50.92s | Max GPU Mem: 1506.95 MB
[2025-11-27 05:40:02] [Round 035] FedSophia | Acc: 78.98% | Loss: 0.5669 | Time: 55.16s | Max GPU Mem: 1506.95 MB
[2025-11-27 05:41:13] [Round 036] FedSophia | Acc: 79.44% | Loss: 0.5568 | Time: 71.62s | Max GPU Mem: 1507.45 MB
[2025-11-27 05:42:31] [Round 037] FedSophia | Acc: 78.44% | Loss: 0.5707 | Time: 78.09s | Max GPU Mem: 1507.58 MB
[2025-11-27 05:43:26] [Round 038] FedSophia | Acc: 75.38% | Loss: 0.6268 | Time: 54.81s | Max GPU Mem: 1506.95 MB
[2025-11-27 05:44:48] [Round 039] FedSophia | Acc: 74.33% | Loss: 0.6570 | Time: 82.24s | Max GPU Mem: 1506.95 MB
[2025-11-27 05:46:03] [Round 040] FedSophia | Acc: 74.29% | Loss: 0.6631 | Time: 74.79s | Max GPU Mem: 1507.58 MB
[2025-11-27 05:47:02] [Round 041] FedSophia | Acc: 75.49% | Loss: 0.6351 | Time: 59.06s | Max GPU Mem: 1507.58 MB
[2025-11-27 05:48:02] [Round 042] FedSophia | Acc: 78.51% | Loss: 0.5548 | Time: 59.57s | Max GPU Mem: 1507.45 MB
[2025-11-27 05:49:11] [Round 043] FedSophia | Acc: 81.69% | Loss: 0.4891 | Time: 69.51s | Max GPU Mem: 1506.95 MB
[2025-11-27 05:49:58] [Round 044] FedSophia | Acc: 82.31% | Loss: 0.4842 | Time: 46.22s | Max GPU Mem: 1507.58 MB
[2025-11-27 05:50:36] [Round 045] FedSophia | Acc: 80.09% | Loss: 0.5398 | Time: 38.69s | Max GPU Mem: 1507.58 MB
[2025-11-27 05:51:22] [Round 046] FedSophia | Acc: 77.37% | Loss: 0.6377 | Time: 45.53s | Max GPU Mem: 1506.95 MB
[2025-11-27 05:52:24] [Round 047] FedSophia | Acc: 74.73% | Loss: 0.7457 | Time: 62.38s | Max GPU Mem: 1506.95 MB
[2025-11-27 05:53:28] [Round 048] FedSophia | Acc: 72.88% | Loss: 0.8281 | Time: 63.47s | Max GPU Mem: 1506.95 MB
[2025-11-27 05:54:04] [Round 049] FedSophia | Acc: 72.57% | Loss: 0.8350 | Time: 36.03s | Max GPU Mem: 1507.58 MB
[2025-11-27 05:54:27] [Round 050] FedSophia | Acc: 73.69% | Loss: 0.7675 | Time: 23.32s | Max GPU Mem: 1507.45 MB
[2025-11-27 05:54:27] Saved to runs/run_20251127_001404_resnet18_head/fashionmnist/logs/FedSophia_head_fashionmnist_resnet18_s0.npz
