[2025-11-27 01:56:51] Namespace(method='FedSophia', training_mode='head', dataset='mnist', model_name='resnet18', seed=0, rounds=50, num_clients=10, fraction=0.5, local_epochs=1, batch_size=64, lr=0.01, newton_lr=0.1, sophia_lr=0.05, rho=0.04, betas='0.9,0.99', mu=0.01, log_dir='runs/run_20251127_001740_resnet18_head/mnist/logs', optimizer='sgd', hessian_batches=32, damping=0.01, alpha=10.0)
[2025-11-27 01:56:51] Start: FedSophia | Mode: head | Dataset: mnist | Device: cuda
[2025-11-27 01:58:55] [Round 001] FedSophia | Acc: 48.94% | Loss: 2.1176 | Time: 12.56s | Max GPU Mem: 1507.98 MB
[2025-11-27 01:59:07] [Round 002] FedSophia | Acc: 75.41% | Loss: 1.8065 | Time: 11.86s | Max GPU Mem: 1507.54 MB
[2025-11-27 01:59:27] [Round 003] FedSophia | Acc: 81.98% | Loss: 1.4580 | Time: 20.00s | Max GPU Mem: 1507.54 MB
[2025-11-27 01:59:48] [Round 004] FedSophia | Acc: 83.39% | Loss: 1.1487 | Time: 21.08s | Max GPU Mem: 1506.93 MB
[2025-11-27 02:00:10] [Round 005] FedSophia | Acc: 84.28% | Loss: 0.9106 | Time: 22.23s | Max GPU Mem: 1508.08 MB
[2025-11-27 02:01:11] [Round 006] FedSophia | Acc: 85.19% | Loss: 0.7401 | Time: 60.23s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:02:10] [Round 007] FedSophia | Acc: 86.15% | Loss: 0.6204 | Time: 59.02s | Max GPU Mem: 1508.08 MB
[2025-11-27 02:03:10] [Round 008] FedSophia | Acc: 87.00% | Loss: 0.5359 | Time: 60.68s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:04:06] [Round 009] FedSophia | Acc: 87.96% | Loss: 0.4740 | Time: 55.39s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:05:06] [Round 010] FedSophia | Acc: 88.71% | Loss: 0.4275 | Time: 60.29s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:06:10] [Round 011] FedSophia | Acc: 89.29% | Loss: 0.3927 | Time: 63.43s | Max GPU Mem: 1507.45 MB
[2025-11-27 02:07:08] [Round 012] FedSophia | Acc: 89.73% | Loss: 0.3662 | Time: 58.56s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:08:09] [Round 013] FedSophia | Acc: 90.13% | Loss: 0.3455 | Time: 60.93s | Max GPU Mem: 1507.58 MB
[2025-11-27 02:09:03] [Round 014] FedSophia | Acc: 90.41% | Loss: 0.3294 | Time: 54.31s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:10:07] [Round 015] FedSophia | Acc: 90.72% | Loss: 0.3165 | Time: 63.89s | Max GPU Mem: 1507.58 MB
[2025-11-27 02:11:01] [Round 016] FedSophia | Acc: 90.92% | Loss: 0.3056 | Time: 53.98s | Max GPU Mem: 1507.58 MB
[2025-11-27 02:11:57] [Round 017] FedSophia | Acc: 91.26% | Loss: 0.2960 | Time: 55.92s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:13:02] [Round 018] FedSophia | Acc: 91.42% | Loss: 0.2869 | Time: 64.59s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:14:08] [Round 019] FedSophia | Acc: 91.63% | Loss: 0.2788 | Time: 66.38s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:15:14] [Round 020] FedSophia | Acc: 91.84% | Loss: 0.2714 | Time: 66.30s | Max GPU Mem: 1507.45 MB
[2025-11-27 02:16:08] [Round 021] FedSophia | Acc: 92.00% | Loss: 0.2648 | Time: 53.61s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:17:07] [Round 022] FedSophia | Acc: 92.22% | Loss: 0.2587 | Time: 58.72s | Max GPU Mem: 1507.45 MB
[2025-11-27 02:17:59] [Round 023] FedSophia | Acc: 92.30% | Loss: 0.2531 | Time: 52.49s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:18:56] [Round 024] FedSophia | Acc: 92.47% | Loss: 0.2480 | Time: 56.70s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:19:52] [Round 025] FedSophia | Acc: 92.60% | Loss: 0.2431 | Time: 56.42s | Max GPU Mem: 1507.45 MB
[2025-11-27 02:20:49] [Round 026] FedSophia | Acc: 92.77% | Loss: 0.2385 | Time: 56.78s | Max GPU Mem: 1508.08 MB
[2025-11-27 02:21:54] [Round 027] FedSophia | Acc: 92.93% | Loss: 0.2342 | Time: 65.16s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:22:55] [Round 028] FedSophia | Acc: 93.01% | Loss: 0.2303 | Time: 60.33s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:23:46] [Round 029] FedSophia | Acc: 93.12% | Loss: 0.2268 | Time: 51.79s | Max GPU Mem: 1508.08 MB
[2025-11-27 02:24:46] [Round 030] FedSophia | Acc: 93.26% | Loss: 0.2239 | Time: 59.28s | Max GPU Mem: 1507.58 MB
[2025-11-27 02:25:42] [Round 031] FedSophia | Acc: 93.23% | Loss: 0.2213 | Time: 55.93s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:26:30] [Round 032] FedSophia | Acc: 93.29% | Loss: 0.2190 | Time: 48.57s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:27:27] [Round 033] FedSophia | Acc: 93.28% | Loss: 0.2167 | Time: 56.64s | Max GPU Mem: 1508.08 MB
[2025-11-27 02:28:27] [Round 034] FedSophia | Acc: 93.34% | Loss: 0.2141 | Time: 60.47s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:29:17] [Round 035] FedSophia | Acc: 93.40% | Loss: 0.2116 | Time: 49.88s | Max GPU Mem: 1508.08 MB
[2025-11-27 02:30:22] [Round 036] FedSophia | Acc: 93.46% | Loss: 0.2086 | Time: 64.32s | Max GPU Mem: 1507.45 MB
[2025-11-27 02:31:30] [Round 037] FedSophia | Acc: 93.69% | Loss: 0.2056 | Time: 68.83s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:32:36] [Round 038] FedSophia | Acc: 93.80% | Loss: 0.2030 | Time: 65.58s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:33:38] [Round 039] FedSophia | Acc: 93.91% | Loss: 0.2009 | Time: 62.52s | Max GPU Mem: 1507.58 MB
[2025-11-27 02:34:54] [Round 040] FedSophia | Acc: 93.95% | Loss: 0.1990 | Time: 75.56s | Max GPU Mem: 1507.58 MB
[2025-11-27 02:36:00] [Round 041] FedSophia | Acc: 94.03% | Loss: 0.1973 | Time: 66.02s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:36:58] [Round 042] FedSophia | Acc: 94.06% | Loss: 0.1956 | Time: 58.18s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:37:48] [Round 043] FedSophia | Acc: 94.12% | Loss: 0.1937 | Time: 49.50s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:38:36] [Round 044] FedSophia | Acc: 94.17% | Loss: 0.1917 | Time: 48.41s | Max GPU Mem: 1507.58 MB
[2025-11-27 02:39:25] [Round 045] FedSophia | Acc: 94.23% | Loss: 0.1896 | Time: 48.51s | Max GPU Mem: 1507.58 MB
[2025-11-27 02:40:19] [Round 046] FedSophia | Acc: 94.32% | Loss: 0.1878 | Time: 54.70s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:41:44] [Round 047] FedSophia | Acc: 94.45% | Loss: 0.1865 | Time: 84.90s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:42:57] [Round 048] FedSophia | Acc: 94.43% | Loss: 0.1855 | Time: 72.75s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:44:05] [Round 049] FedSophia | Acc: 94.47% | Loss: 0.1846 | Time: 68.06s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:45:10] [Round 050] FedSophia | Acc: 94.44% | Loss: 0.1838 | Time: 64.71s | Max GPU Mem: 1507.58 MB
[2025-11-27 02:45:10] Saved to runs/run_20251127_001740_resnet18_head/mnist/logs/FedSophia_head_mnist_resnet18_s0.npz
