[2025-11-27 05:55:05] Namespace(method='FedSophia', training_mode='head', dataset='fashionmnist', model_name='resnet18', seed=0, rounds=50, num_clients=10, fraction=0.5, local_epochs=1, batch_size=64, lr=0.01, newton_lr=0.1, sophia_lr=0.05, rho=0.04, betas='0.9,0.99', mu=0.01, log_dir='runs/run_20251127_001608_resnet18_head/fashionmnist/logs', optimizer='sgd', hessian_batches=32, damping=0.01, alpha=0.5)
[2025-11-27 05:55:05] Start: FedSophia | Mode: head | Dataset: fashionmnist | Device: cuda
[2025-11-27 05:58:05] [Round 001] FedSophia | Acc: 38.91% | Loss: 2.1342 | Time: 65.40s | Max GPU Mem: 1507.98 MB
[2025-11-27 05:59:12] [Round 002] FedSophia | Acc: 62.95% | Loss: 1.8444 | Time: 66.87s | Max GPU Mem: 1507.52 MB
[2025-11-27 05:59:38] [Round 003] FedSophia | Acc: 70.88% | Loss: 1.4823 | Time: 26.56s | Max GPU Mem: 1507.58 MB
[2025-11-27 06:00:02] [Round 004] FedSophia | Acc: 73.63% | Loss: 1.1515 | Time: 24.19s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:00:23] [Round 005] FedSophia | Acc: 74.99% | Loss: 0.9199 | Time: 20.70s | Max GPU Mem: 1508.08 MB
[2025-11-27 06:00:45] [Round 006] FedSophia | Acc: 76.24% | Loss: 0.7749 | Time: 22.31s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:01:07] [Round 007] FedSophia | Acc: 76.91% | Loss: 0.6932 | Time: 21.73s | Max GPU Mem: 1508.08 MB
[2025-11-27 06:01:59] [Round 008] FedSophia | Acc: 77.81% | Loss: 0.6411 | Time: 52.15s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:03:00] [Round 009] FedSophia | Acc: 79.03% | Loss: 0.5994 | Time: 60.31s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:03:52] [Round 010] FedSophia | Acc: 79.71% | Loss: 0.5747 | Time: 52.65s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:04:11] [Round 011] FedSophia | Acc: 80.14% | Loss: 0.5598 | Time: 18.70s | Max GPU Mem: 1507.45 MB
[2025-11-27 06:04:35] [Round 012] FedSophia | Acc: 80.45% | Loss: 0.5525 | Time: 24.15s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:04:53] [Round 013] FedSophia | Acc: 80.87% | Loss: 0.5449 | Time: 17.61s | Max GPU Mem: 1507.58 MB
[2025-11-27 06:05:17] [Round 014] FedSophia | Acc: 81.43% | Loss: 0.5335 | Time: 24.35s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:05:40] [Round 015] FedSophia | Acc: 81.75% | Loss: 0.5254 | Time: 23.12s | Max GPU Mem: 1507.58 MB
[2025-11-27 06:06:11] [Round 016] FedSophia | Acc: 82.06% | Loss: 0.5155 | Time: 30.57s | Max GPU Mem: 1507.58 MB
[2025-11-27 06:07:08] [Round 017] FedSophia | Acc: 82.47% | Loss: 0.5062 | Time: 57.72s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:07:58] [Round 018] FedSophia | Acc: 82.71% | Loss: 0.4985 | Time: 49.91s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:08:54] [Round 019] FedSophia | Acc: 82.93% | Loss: 0.4920 | Time: 55.92s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:09:44] [Round 020] FedSophia | Acc: 83.22% | Loss: 0.4879 | Time: 49.65s | Max GPU Mem: 1507.45 MB
[2025-11-27 06:10:39] [Round 021] FedSophia | Acc: 83.40% | Loss: 0.4826 | Time: 54.74s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:11:37] [Round 022] FedSophia | Acc: 83.59% | Loss: 0.4778 | Time: 58.30s | Max GPU Mem: 1507.45 MB
[2025-11-27 06:12:50] [Round 023] FedSophia | Acc: 83.64% | Loss: 0.4743 | Time: 72.67s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:13:58] [Round 024] FedSophia | Acc: 83.65% | Loss: 0.4719 | Time: 68.57s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:15:14] [Round 025] FedSophia | Acc: 83.37% | Loss: 0.4722 | Time: 76.06s | Max GPU Mem: 1507.45 MB
[2025-11-27 06:16:09] [Round 026] FedSophia | Acc: 83.50% | Loss: 0.4694 | Time: 54.86s | Max GPU Mem: 1508.08 MB
[2025-11-27 06:17:26] [Round 027] FedSophia | Acc: 83.64% | Loss: 0.4672 | Time: 76.73s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:18:40] [Round 028] FedSophia | Acc: 83.59% | Loss: 0.4663 | Time: 74.49s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:19:25] [Round 029] FedSophia | Acc: 83.72% | Loss: 0.4591 | Time: 44.68s | Max GPU Mem: 1508.08 MB
[2025-11-27 06:20:20] [Round 030] FedSophia | Acc: 83.92% | Loss: 0.4531 | Time: 54.42s | Max GPU Mem: 1507.58 MB
[2025-11-27 06:21:20] [Round 031] FedSophia | Acc: 84.08% | Loss: 0.4489 | Time: 60.86s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:22:14] [Round 032] FedSophia | Acc: 84.48% | Loss: 0.4395 | Time: 53.60s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:23:10] [Round 033] FedSophia | Acc: 84.75% | Loss: 0.4311 | Time: 55.70s | Max GPU Mem: 1508.08 MB
[2025-11-27 06:23:50] [Round 034] FedSophia | Acc: 84.85% | Loss: 0.4246 | Time: 40.04s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:24:41] [Round 035] FedSophia | Acc: 84.97% | Loss: 0.4213 | Time: 51.38s | Max GPU Mem: 1508.08 MB
[2025-11-27 06:25:48] [Round 036] FedSophia | Acc: 85.16% | Loss: 0.4206 | Time: 67.28s | Max GPU Mem: 1507.45 MB
[2025-11-27 06:27:04] [Round 037] FedSophia | Acc: 85.21% | Loss: 0.4184 | Time: 75.39s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:28:06] [Round 038] FedSophia | Acc: 85.15% | Loss: 0.4171 | Time: 62.03s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:29:04] [Round 039] FedSophia | Acc: 85.03% | Loss: 0.4179 | Time: 58.63s | Max GPU Mem: 1507.58 MB
[2025-11-27 06:29:56] [Round 040] FedSophia | Acc: 85.05% | Loss: 0.4170 | Time: 52.00s | Max GPU Mem: 1507.58 MB
[2025-11-27 06:30:40] [Round 041] FedSophia | Acc: 85.09% | Loss: 0.4149 | Time: 43.48s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:31:40] [Round 042] FedSophia | Acc: 85.10% | Loss: 0.4147 | Time: 59.69s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:32:36] [Round 043] FedSophia | Acc: 84.84% | Loss: 0.4158 | Time: 55.90s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:33:27] [Round 044] FedSophia | Acc: 84.60% | Loss: 0.4209 | Time: 51.71s | Max GPU Mem: 1507.58 MB
[2025-11-27 06:34:25] [Round 045] FedSophia | Acc: 84.37% | Loss: 0.4300 | Time: 57.88s | Max GPU Mem: 1507.58 MB
[2025-11-27 06:35:53] [Round 046] FedSophia | Acc: 84.02% | Loss: 0.4389 | Time: 88.07s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:36:56] [Round 047] FedSophia | Acc: 83.97% | Loss: 0.4414 | Time: 62.94s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:37:56] [Round 048] FedSophia | Acc: 84.07% | Loss: 0.4344 | Time: 59.86s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:39:07] [Round 049] FedSophia | Acc: 84.57% | Loss: 0.4219 | Time: 71.14s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:40:00] [Round 050] FedSophia | Acc: 85.45% | Loss: 0.4046 | Time: 52.46s | Max GPU Mem: 1507.58 MB
[2025-11-27 06:40:00] Saved to runs/run_20251127_001608_resnet18_head/fashionmnist/logs/FedSophia_head_fashionmnist_resnet18_s0.npz
