[2025-11-27 01:56:14] Namespace(method='FedSophia', training_mode='head', dataset='mnist', model_name='resnet18', seed=1, rounds=50, num_clients=10, fraction=0.5, local_epochs=1, batch_size=64, lr=0.01, newton_lr=0.1, sophia_lr=0.05, rho=0.04, betas='0.9,0.99', mu=0.01, log_dir='runs/run_20251127_001608_resnet18_head/mnist/logs', optimizer='sgd', hessian_batches=32, damping=0.01, alpha=0.5)
[2025-11-27 01:56:14] Start: FedSophia | Mode: head | Dataset: mnist | Device: cuda
[2025-11-27 01:58:22] [Round 001] FedSophia | Acc: 26.78% | Loss: 2.1866 | Time: 16.44s | Max GPU Mem: 1507.98 MB
[2025-11-27 01:59:28] [Round 002] FedSophia | Acc: 47.24% | Loss: 1.9731 | Time: 66.38s | Max GPU Mem: 1507.54 MB
[2025-11-27 02:00:33] [Round 003] FedSophia | Acc: 57.13% | Loss: 1.7213 | Time: 64.12s | Max GPU Mem: 1507.56 MB
[2025-11-27 02:01:28] [Round 004] FedSophia | Acc: 60.26% | Loss: 1.5264 | Time: 54.99s | Max GPU Mem: 1506.93 MB
[2025-11-27 02:02:37] [Round 005] FedSophia | Acc: 64.53% | Loss: 1.3347 | Time: 69.64s | Max GPU Mem: 1508.08 MB
[2025-11-27 02:04:09] [Round 006] FedSophia | Acc: 68.57% | Loss: 1.1355 | Time: 91.92s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:05:15] [Round 007] FedSophia | Acc: 72.14% | Loss: 0.9493 | Time: 66.16s | Max GPU Mem: 1508.08 MB
[2025-11-27 02:06:22] [Round 008] FedSophia | Acc: 77.15% | Loss: 0.7889 | Time: 67.07s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:07:27] [Round 009] FedSophia | Acc: 81.27% | Loss: 0.6556 | Time: 64.40s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:08:18] [Round 010] FedSophia | Acc: 84.27% | Loss: 0.5525 | Time: 50.88s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:09:25] [Round 011] FedSophia | Acc: 86.07% | Loss: 0.4802 | Time: 67.44s | Max GPU Mem: 1507.45 MB
[2025-11-27 02:10:29] [Round 012] FedSophia | Acc: 87.14% | Loss: 0.4313 | Time: 63.58s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:11:27] [Round 013] FedSophia | Acc: 88.37% | Loss: 0.3907 | Time: 58.78s | Max GPU Mem: 1507.58 MB
[2025-11-27 02:12:29] [Round 014] FedSophia | Acc: 89.17% | Loss: 0.3656 | Time: 62.10s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:13:28] [Round 015] FedSophia | Acc: 89.73% | Loss: 0.3460 | Time: 58.08s | Max GPU Mem: 1507.58 MB
[2025-11-27 02:14:35] [Round 016] FedSophia | Acc: 90.28% | Loss: 0.3298 | Time: 67.62s | Max GPU Mem: 1507.58 MB
[2025-11-27 02:15:44] [Round 017] FedSophia | Acc: 90.86% | Loss: 0.3135 | Time: 69.30s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:17:12] [Round 018] FedSophia | Acc: 91.29% | Loss: 0.2964 | Time: 87.62s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:18:12] [Round 019] FedSophia | Acc: 91.82% | Loss: 0.2813 | Time: 59.66s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:19:07] [Round 020] FedSophia | Acc: 92.07% | Loss: 0.2676 | Time: 54.73s | Max GPU Mem: 1507.45 MB
[2025-11-27 02:19:44] [Round 021] FedSophia | Acc: 92.38% | Loss: 0.2580 | Time: 37.91s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:20:31] [Round 022] FedSophia | Acc: 92.55% | Loss: 0.2526 | Time: 46.67s | Max GPU Mem: 1507.45 MB
[2025-11-27 02:21:17] [Round 023] FedSophia | Acc: 92.48% | Loss: 0.2494 | Time: 45.94s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:22:12] [Round 024] FedSophia | Acc: 92.54% | Loss: 0.2473 | Time: 55.21s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:23:01] [Round 025] FedSophia | Acc: 92.59% | Loss: 0.2490 | Time: 48.94s | Max GPU Mem: 1507.45 MB
[2025-11-27 02:23:44] [Round 026] FedSophia | Acc: 92.54% | Loss: 0.2505 | Time: 42.54s | Max GPU Mem: 1508.08 MB
[2025-11-27 02:24:35] [Round 027] FedSophia | Acc: 92.60% | Loss: 0.2492 | Time: 51.20s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:25:52] [Round 028] FedSophia | Acc: 92.80% | Loss: 0.2430 | Time: 76.95s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:26:48] [Round 029] FedSophia | Acc: 92.99% | Loss: 0.2337 | Time: 56.04s | Max GPU Mem: 1508.08 MB
[2025-11-27 02:27:46] [Round 030] FedSophia | Acc: 93.27% | Loss: 0.2271 | Time: 58.37s | Max GPU Mem: 1507.58 MB
[2025-11-27 02:28:42] [Round 031] FedSophia | Acc: 93.36% | Loss: 0.2206 | Time: 55.70s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:29:51] [Round 032] FedSophia | Acc: 93.38% | Loss: 0.2161 | Time: 68.81s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:30:49] [Round 033] FedSophia | Acc: 93.34% | Loss: 0.2155 | Time: 58.59s | Max GPU Mem: 1508.08 MB
[2025-11-27 02:31:31] [Round 034] FedSophia | Acc: 93.31% | Loss: 0.2181 | Time: 41.22s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:32:24] [Round 035] FedSophia | Acc: 93.15% | Loss: 0.2192 | Time: 52.89s | Max GPU Mem: 1508.08 MB
[2025-11-27 02:33:18] [Round 036] FedSophia | Acc: 93.19% | Loss: 0.2156 | Time: 54.29s | Max GPU Mem: 1507.45 MB
[2025-11-27 02:34:02] [Round 037] FedSophia | Acc: 93.24% | Loss: 0.2117 | Time: 44.26s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:35:03] [Round 038] FedSophia | Acc: 93.38% | Loss: 0.2080 | Time: 61.38s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:35:50] [Round 039] FedSophia | Acc: 93.70% | Loss: 0.2028 | Time: 46.20s | Max GPU Mem: 1507.58 MB
[2025-11-27 02:36:56] [Round 040] FedSophia | Acc: 93.81% | Loss: 0.2010 | Time: 66.46s | Max GPU Mem: 1507.58 MB
[2025-11-27 02:37:43] [Round 041] FedSophia | Acc: 93.88% | Loss: 0.1984 | Time: 46.71s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:38:27] [Round 042] FedSophia | Acc: 93.83% | Loss: 0.1977 | Time: 44.31s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:39:15] [Round 043] FedSophia | Acc: 93.94% | Loss: 0.1960 | Time: 47.96s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:40:10] [Round 044] FedSophia | Acc: 94.06% | Loss: 0.1946 | Time: 54.93s | Max GPU Mem: 1507.58 MB
[2025-11-27 02:40:35] [Round 045] FedSophia | Acc: 94.21% | Loss: 0.1931 | Time: 24.96s | Max GPU Mem: 1507.58 MB
[2025-11-27 02:40:54] [Round 046] FedSophia | Acc: 94.28% | Loss: 0.1919 | Time: 19.38s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:41:19] [Round 047] FedSophia | Acc: 94.32% | Loss: 0.1889 | Time: 24.39s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:41:38] [Round 048] FedSophia | Acc: 94.33% | Loss: 0.1873 | Time: 18.82s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:42:02] [Round 049] FedSophia | Acc: 94.28% | Loss: 0.1859 | Time: 24.82s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:43:24] [Round 050] FedSophia | Acc: 94.36% | Loss: 0.1860 | Time: 82.07s | Max GPU Mem: 1507.58 MB
[2025-11-27 02:43:24] Saved to runs/run_20251127_001608_resnet18_head/mnist/logs/FedSophia_head_mnist_resnet18_s1.npz
