[2025-11-27 01:56:28] Namespace(method='FedSophia', training_mode='head', dataset='mnist', model_name='resnet18', seed=2, rounds=50, num_clients=10, fraction=0.5, local_epochs=1, batch_size=64, lr=0.01, newton_lr=0.1, sophia_lr=0.05, rho=0.04, betas='0.9,0.99', mu=0.01, log_dir='runs/run_20251127_001608_resnet18_head/mnist/logs', optimizer='sgd', hessian_batches=32, damping=0.01, alpha=0.5)
[2025-11-27 01:56:28] Start: FedSophia | Mode: head | Dataset: mnist | Device: cuda
[2025-11-27 01:59:28] [Round 001] FedSophia | Acc: 37.98% | Loss: 2.1760 | Time: 68.44s | Max GPU Mem: 1507.98 MB
[2025-11-27 02:00:34] [Round 002] FedSophia | Acc: 58.45% | Loss: 1.9350 | Time: 65.66s | Max GPU Mem: 1507.52 MB
[2025-11-27 02:01:30] [Round 003] FedSophia | Acc: 70.62% | Loss: 1.6454 | Time: 56.10s | Max GPU Mem: 1507.56 MB
[2025-11-27 02:02:39] [Round 004] FedSophia | Acc: 77.82% | Loss: 1.3467 | Time: 69.39s | Max GPU Mem: 1506.93 MB
[2025-11-27 02:03:48] [Round 005] FedSophia | Acc: 79.45% | Loss: 1.0849 | Time: 68.22s | Max GPU Mem: 1508.08 MB
[2025-11-27 02:04:44] [Round 006] FedSophia | Acc: 80.65% | Loss: 0.8822 | Time: 56.80s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:05:40] [Round 007] FedSophia | Acc: 81.56% | Loss: 0.7355 | Time: 55.92s | Max GPU Mem: 1508.08 MB
[2025-11-27 02:06:30] [Round 008] FedSophia | Acc: 82.64% | Loss: 0.6305 | Time: 50.17s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:07:32] [Round 009] FedSophia | Acc: 83.49% | Loss: 0.5585 | Time: 61.12s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:08:18] [Round 010] FedSophia | Acc: 84.78% | Loss: 0.5014 | Time: 46.02s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:09:21] [Round 011] FedSophia | Acc: 86.38% | Loss: 0.4584 | Time: 63.87s | Max GPU Mem: 1507.45 MB
[2025-11-27 02:10:15] [Round 012] FedSophia | Acc: 87.55% | Loss: 0.4272 | Time: 53.69s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:11:15] [Round 013] FedSophia | Acc: 88.35% | Loss: 0.4026 | Time: 59.74s | Max GPU Mem: 1507.58 MB
[2025-11-27 02:12:17] [Round 014] FedSophia | Acc: 88.81% | Loss: 0.3835 | Time: 62.18s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:13:27] [Round 015] FedSophia | Acc: 89.22% | Loss: 0.3617 | Time: 70.09s | Max GPU Mem: 1507.58 MB
[2025-11-27 02:14:28] [Round 016] FedSophia | Acc: 89.77% | Loss: 0.3438 | Time: 60.82s | Max GPU Mem: 1507.58 MB
[2025-11-27 02:15:21] [Round 017] FedSophia | Acc: 90.14% | Loss: 0.3272 | Time: 53.39s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:16:23] [Round 018] FedSophia | Acc: 90.59% | Loss: 0.3115 | Time: 61.30s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:17:24] [Round 019] FedSophia | Acc: 90.91% | Loss: 0.3008 | Time: 61.09s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:18:20] [Round 020] FedSophia | Acc: 90.90% | Loss: 0.2940 | Time: 56.52s | Max GPU Mem: 1507.45 MB
[2025-11-27 02:19:14] [Round 021] FedSophia | Acc: 91.12% | Loss: 0.2892 | Time: 53.98s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:20:08] [Round 022] FedSophia | Acc: 91.08% | Loss: 0.2848 | Time: 53.91s | Max GPU Mem: 1507.45 MB
[2025-11-27 02:21:07] [Round 023] FedSophia | Acc: 91.07% | Loss: 0.2805 | Time: 58.61s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:22:13] [Round 024] FedSophia | Acc: 91.08% | Loss: 0.2780 | Time: 65.79s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:23:10] [Round 025] FedSophia | Acc: 91.28% | Loss: 0.2752 | Time: 57.83s | Max GPU Mem: 1507.45 MB
[2025-11-27 02:24:15] [Round 026] FedSophia | Acc: 91.54% | Loss: 0.2718 | Time: 64.44s | Max GPU Mem: 1508.08 MB
[2025-11-27 02:25:10] [Round 027] FedSophia | Acc: 91.59% | Loss: 0.2689 | Time: 54.82s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:26:09] [Round 028] FedSophia | Acc: 91.86% | Loss: 0.2622 | Time: 59.00s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:26:57] [Round 029] FedSophia | Acc: 92.17% | Loss: 0.2544 | Time: 48.70s | Max GPU Mem: 1508.08 MB
[2025-11-27 02:27:48] [Round 030] FedSophia | Acc: 92.45% | Loss: 0.2469 | Time: 50.68s | Max GPU Mem: 1507.58 MB
[2025-11-27 02:29:08] [Round 031] FedSophia | Acc: 92.67% | Loss: 0.2416 | Time: 79.71s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:30:21] [Round 032] FedSophia | Acc: 92.73% | Loss: 0.2378 | Time: 73.22s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:31:25] [Round 033] FedSophia | Acc: 92.82% | Loss: 0.2344 | Time: 64.11s | Max GPU Mem: 1508.08 MB
[2025-11-27 02:32:25] [Round 034] FedSophia | Acc: 93.04% | Loss: 0.2305 | Time: 60.28s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:33:25] [Round 035] FedSophia | Acc: 92.99% | Loss: 0.2292 | Time: 59.60s | Max GPU Mem: 1508.08 MB
[2025-11-27 02:34:46] [Round 036] FedSophia | Acc: 93.07% | Loss: 0.2258 | Time: 80.71s | Max GPU Mem: 1507.45 MB
[2025-11-27 02:35:52] [Round 037] FedSophia | Acc: 93.20% | Loss: 0.2231 | Time: 66.51s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:37:05] [Round 038] FedSophia | Acc: 93.20% | Loss: 0.2199 | Time: 72.38s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:38:23] [Round 039] FedSophia | Acc: 92.98% | Loss: 0.2203 | Time: 78.50s | Max GPU Mem: 1507.58 MB
[2025-11-27 02:39:28] [Round 040] FedSophia | Acc: 92.92% | Loss: 0.2220 | Time: 64.49s | Max GPU Mem: 1507.58 MB
[2025-11-27 02:40:25] [Round 041] FedSophia | Acc: 92.63% | Loss: 0.2268 | Time: 57.48s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:40:44] [Round 042] FedSophia | Acc: 92.47% | Loss: 0.2302 | Time: 18.52s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:41:04] [Round 043] FedSophia | Acc: 92.54% | Loss: 0.2298 | Time: 19.92s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:41:24] [Round 044] FedSophia | Acc: 92.66% | Loss: 0.2300 | Time: 20.69s | Max GPU Mem: 1507.58 MB
[2025-11-27 02:41:42] [Round 045] FedSophia | Acc: 92.95% | Loss: 0.2267 | Time: 18.29s | Max GPU Mem: 1507.58 MB
[2025-11-27 02:42:01] [Round 046] FedSophia | Acc: 93.33% | Loss: 0.2196 | Time: 18.44s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:43:04] [Round 047] FedSophia | Acc: 93.51% | Loss: 0.2127 | Time: 63.15s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:43:37] [Round 048] FedSophia | Acc: 93.63% | Loss: 0.2078 | Time: 33.27s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:43:59] [Round 049] FedSophia | Acc: 93.83% | Loss: 0.2042 | Time: 21.95s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:44:19] [Round 050] FedSophia | Acc: 93.96% | Loss: 0.2007 | Time: 19.96s | Max GPU Mem: 1507.58 MB
[2025-11-27 02:44:19] Saved to runs/run_20251127_001608_resnet18_head/mnist/logs/FedSophia_head_mnist_resnet18_s2.npz
