[2025-11-27 05:06:35] Namespace(method='FedSophia', training_mode='head', dataset='fashionmnist', model_name='resnet18', seed=2, rounds=50, num_clients=10, fraction=0.5, local_epochs=1, batch_size=64, lr=0.01, newton_lr=0.1, sophia_lr=0.05, rho=0.04, betas='0.9,0.99', mu=0.01, log_dir='runs/run_20251127_001404_resnet18_head/fashionmnist/logs', optimizer='sgd', hessian_batches=32, damping=0.01, alpha=0.1)
[2025-11-27 05:06:35] Start: FedSophia | Mode: head | Dataset: fashionmnist | Device: cuda
[2025-11-27 05:10:17] [Round 001] FedSophia | Acc: 16.94% | Loss: 2.1924 | Time: 109.90s | Max GPU Mem: 1507.98 MB
[2025-11-27 05:11:43] [Round 002] FedSophia | Acc: 30.51% | Loss: 2.0215 | Time: 85.58s | Max GPU Mem: 1507.52 MB
[2025-11-27 05:13:09] [Round 003] FedSophia | Acc: 40.06% | Loss: 1.8580 | Time: 86.64s | Max GPU Mem: 1507.56 MB
[2025-11-27 05:14:15] [Round 004] FedSophia | Acc: 45.11% | Loss: 1.7228 | Time: 65.70s | Max GPU Mem: 1506.95 MB
[2025-11-27 05:15:08] [Round 005] FedSophia | Acc: 54.79% | Loss: 1.5639 | Time: 52.98s | Max GPU Mem: 1508.08 MB
[2025-11-27 05:16:14] [Round 006] FedSophia | Acc: 56.83% | Loss: 1.4771 | Time: 66.08s | Max GPU Mem: 1506.95 MB
[2025-11-27 05:17:19] [Round 007] FedSophia | Acc: 59.22% | Loss: 1.3773 | Time: 65.33s | Max GPU Mem: 1508.08 MB
[2025-11-27 05:18:11] [Round 008] FedSophia | Acc: 61.66% | Loss: 1.1860 | Time: 51.29s | Max GPU Mem: 1506.95 MB
[2025-11-27 05:18:47] [Round 009] FedSophia | Acc: 66.13% | Loss: 0.9928 | Time: 36.03s | Max GPU Mem: 1506.95 MB
[2025-11-27 05:19:16] [Round 010] FedSophia | Acc: 72.41% | Loss: 0.7835 | Time: 29.11s | Max GPU Mem: 1506.95 MB
[2025-11-27 05:20:25] [Round 011] FedSophia | Acc: 77.13% | Loss: 0.6800 | Time: 68.88s | Max GPU Mem: 1507.45 MB
[2025-11-27 05:21:17] [Round 012] FedSophia | Acc: 77.11% | Loss: 0.6633 | Time: 52.49s | Max GPU Mem: 1506.95 MB
[2025-11-27 05:21:59] [Round 013] FedSophia | Acc: 73.94% | Loss: 0.7090 | Time: 41.99s | Max GPU Mem: 1507.58 MB
[2025-11-27 05:23:04] [Round 014] FedSophia | Acc: 72.99% | Loss: 0.7209 | Time: 64.80s | Max GPU Mem: 1506.95 MB
[2025-11-27 05:23:58] [Round 015] FedSophia | Acc: 76.17% | Loss: 0.6502 | Time: 54.04s | Max GPU Mem: 1507.58 MB
[2025-11-27 05:25:08] [Round 016] FedSophia | Acc: 79.03% | Loss: 0.5855 | Time: 69.87s | Max GPU Mem: 1507.58 MB
[2025-11-27 05:25:44] [Round 017] FedSophia | Acc: 77.31% | Loss: 0.6266 | Time: 36.49s | Max GPU Mem: 1506.95 MB
[2025-11-27 05:26:44] [Round 018] FedSophia | Acc: 69.63% | Loss: 0.7919 | Time: 59.91s | Max GPU Mem: 1506.95 MB
[2025-11-27 05:27:51] [Round 019] FedSophia | Acc: 62.55% | Loss: 1.0220 | Time: 66.62s | Max GPU Mem: 1506.95 MB
[2025-11-27 05:28:26] [Round 020] FedSophia | Acc: 60.88% | Loss: 1.0966 | Time: 34.59s | Max GPU Mem: 1507.45 MB
[2025-11-27 05:29:35] [Round 021] FedSophia | Acc: 62.52% | Loss: 1.0550 | Time: 69.28s | Max GPU Mem: 1506.95 MB
[2025-11-27 05:30:18] [Round 022] FedSophia | Acc: 69.15% | Loss: 0.8604 | Time: 43.09s | Max GPU Mem: 1507.45 MB
[2025-11-27 05:31:30] [Round 023] FedSophia | Acc: 74.35% | Loss: 0.7139 | Time: 72.33s | Max GPU Mem: 1506.95 MB
[2025-11-27 05:32:40] [Round 024] FedSophia | Acc: 76.22% | Loss: 0.6570 | Time: 69.30s | Max GPU Mem: 1506.95 MB
[2025-11-27 05:33:37] [Round 025] FedSophia | Acc: 76.82% | Loss: 0.6471 | Time: 57.08s | Max GPU Mem: 1507.45 MB
[2025-11-27 05:34:35] [Round 026] FedSophia | Acc: 77.13% | Loss: 0.6448 | Time: 57.93s | Max GPU Mem: 1508.08 MB
[2025-11-27 05:35:23] [Round 027] FedSophia | Acc: 77.64% | Loss: 0.6450 | Time: 48.27s | Max GPU Mem: 1506.95 MB
[2025-11-27 05:36:43] [Round 028] FedSophia | Acc: 77.45% | Loss: 0.6516 | Time: 80.09s | Max GPU Mem: 1506.95 MB
[2025-11-27 05:37:24] [Round 029] FedSophia | Acc: 77.30% | Loss: 0.6430 | Time: 41.10s | Max GPU Mem: 1508.08 MB
[2025-11-27 05:38:01] [Round 030] FedSophia | Acc: 77.66% | Loss: 0.6166 | Time: 36.94s | Max GPU Mem: 1507.58 MB
[2025-11-27 05:39:04] [Round 031] FedSophia | Acc: 78.13% | Loss: 0.5907 | Time: 62.57s | Max GPU Mem: 1506.95 MB
[2025-11-27 05:39:33] [Round 032] FedSophia | Acc: 79.93% | Loss: 0.5489 | Time: 29.80s | Max GPU Mem: 1506.95 MB
[2025-11-27 05:40:53] [Round 033] FedSophia | Acc: 81.31% | Loss: 0.5103 | Time: 79.30s | Max GPU Mem: 1508.08 MB
[2025-11-27 05:41:58] [Round 034] FedSophia | Acc: 80.77% | Loss: 0.5243 | Time: 65.58s | Max GPU Mem: 1506.95 MB
[2025-11-27 05:42:30] [Round 035] FedSophia | Acc: 78.87% | Loss: 0.5648 | Time: 31.46s | Max GPU Mem: 1508.08 MB
[2025-11-27 05:43:16] [Round 036] FedSophia | Acc: 78.09% | Loss: 0.5857 | Time: 46.67s | Max GPU Mem: 1507.45 MB
[2025-11-27 05:44:17] [Round 037] FedSophia | Acc: 78.61% | Loss: 0.5686 | Time: 60.84s | Max GPU Mem: 1506.95 MB
[2025-11-27 05:44:59] [Round 038] FedSophia | Acc: 81.17% | Loss: 0.5205 | Time: 41.44s | Max GPU Mem: 1506.95 MB
[2025-11-27 05:46:05] [Round 039] FedSophia | Acc: 81.56% | Loss: 0.5125 | Time: 66.56s | Max GPU Mem: 1507.58 MB
[2025-11-27 05:47:05] [Round 040] FedSophia | Acc: 81.21% | Loss: 0.5179 | Time: 59.48s | Max GPU Mem: 1507.58 MB
[2025-11-27 05:47:44] [Round 041] FedSophia | Acc: 80.99% | Loss: 0.5255 | Time: 39.11s | Max GPU Mem: 1506.95 MB
[2025-11-27 05:48:36] [Round 042] FedSophia | Acc: 80.90% | Loss: 0.5343 | Time: 52.67s | Max GPU Mem: 1506.95 MB
[2025-11-27 05:49:13] [Round 043] FedSophia | Acc: 80.88% | Loss: 0.5327 | Time: 36.12s | Max GPU Mem: 1506.95 MB
[2025-11-27 05:50:00] [Round 044] FedSophia | Acc: 81.34% | Loss: 0.5175 | Time: 47.50s | Max GPU Mem: 1507.58 MB
[2025-11-27 05:51:21] [Round 045] FedSophia | Acc: 81.45% | Loss: 0.5223 | Time: 80.62s | Max GPU Mem: 1507.58 MB
[2025-11-27 05:52:24] [Round 046] FedSophia | Acc: 80.66% | Loss: 0.5409 | Time: 63.56s | Max GPU Mem: 1506.95 MB
[2025-11-27 05:53:22] [Round 047] FedSophia | Acc: 80.61% | Loss: 0.5358 | Time: 57.91s | Max GPU Mem: 1506.95 MB
[2025-11-27 05:54:02] [Round 048] FedSophia | Acc: 80.21% | Loss: 0.5426 | Time: 40.18s | Max GPU Mem: 1506.95 MB
[2025-11-27 05:54:28] [Round 049] FedSophia | Acc: 80.35% | Loss: 0.5453 | Time: 25.85s | Max GPU Mem: 1506.95 MB
[2025-11-27 05:54:39] [Round 050] FedSophia | Acc: 80.70% | Loss: 0.5345 | Time: 11.00s | Max GPU Mem: 1507.58 MB
[2025-11-27 05:54:39] Saved to runs/run_20251127_001404_resnet18_head/fashionmnist/logs/FedSophia_head_fashionmnist_resnet18_s2.npz
