[2025-11-27 01:55:08] Namespace(method='FedSophia', training_mode='head', dataset='mnist', model_name='resnet18', seed=0, rounds=50, num_clients=10, fraction=0.5, local_epochs=1, batch_size=64, lr=0.01, newton_lr=0.1, sophia_lr=0.05, rho=0.04, betas='0.9,0.99', mu=0.01, log_dir='runs/run_20251127_001608_resnet18_head/mnist/logs', optimizer='sgd', hessian_batches=32, damping=0.01, alpha=0.5)
[2025-11-27 01:55:08] Start: FedSophia | Mode: head | Dataset: mnist | Device: cuda
[2025-11-27 01:57:14] [Round 001] FedSophia | Acc: 28.28% | Loss: 2.1583 | Time: 12.90s | Max GPU Mem: 1507.98 MB
[2025-11-27 01:57:26] [Round 002] FedSophia | Acc: 59.80% | Loss: 1.8944 | Time: 11.88s | Max GPU Mem: 1507.54 MB
[2025-11-27 01:57:36] [Round 003] FedSophia | Acc: 67.49% | Loss: 1.6222 | Time: 9.88s | Max GPU Mem: 1507.58 MB
[2025-11-27 01:57:49] [Round 004] FedSophia | Acc: 73.31% | Loss: 1.3438 | Time: 12.47s | Max GPU Mem: 1506.95 MB
[2025-11-27 01:57:58] [Round 005] FedSophia | Acc: 75.42% | Loss: 1.1281 | Time: 9.93s | Max GPU Mem: 1508.08 MB
[2025-11-27 01:58:16] [Round 006] FedSophia | Acc: 77.31% | Loss: 0.9607 | Time: 17.48s | Max GPU Mem: 1506.95 MB
[2025-11-27 01:59:07] [Round 007] FedSophia | Acc: 78.42% | Loss: 0.8393 | Time: 50.66s | Max GPU Mem: 1508.08 MB
[2025-11-27 02:00:03] [Round 008] FedSophia | Acc: 78.88% | Loss: 0.7487 | Time: 55.90s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:00:41] [Round 009] FedSophia | Acc: 79.12% | Loss: 0.6701 | Time: 38.97s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:01:45] [Round 010] FedSophia | Acc: 80.24% | Loss: 0.6001 | Time: 63.93s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:02:57] [Round 011] FedSophia | Acc: 82.21% | Loss: 0.5367 | Time: 72.07s | Max GPU Mem: 1507.45 MB
[2025-11-27 02:04:08] [Round 012] FedSophia | Acc: 84.48% | Loss: 0.4754 | Time: 70.98s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:04:51] [Round 013] FedSophia | Acc: 86.40% | Loss: 0.4236 | Time: 42.82s | Max GPU Mem: 1507.58 MB
[2025-11-27 02:05:46] [Round 014] FedSophia | Acc: 87.61% | Loss: 0.3885 | Time: 54.72s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:06:52] [Round 015] FedSophia | Acc: 89.70% | Loss: 0.3500 | Time: 65.71s | Max GPU Mem: 1507.58 MB
[2025-11-27 02:07:46] [Round 016] FedSophia | Acc: 90.67% | Loss: 0.3261 | Time: 53.77s | Max GPU Mem: 1507.58 MB
[2025-11-27 02:09:03] [Round 017] FedSophia | Acc: 90.81% | Loss: 0.3142 | Time: 77.19s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:10:12] [Round 018] FedSophia | Acc: 90.39% | Loss: 0.3148 | Time: 69.78s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:11:13] [Round 019] FedSophia | Acc: 89.77% | Loss: 0.3209 | Time: 60.26s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:12:01] [Round 020] FedSophia | Acc: 89.58% | Loss: 0.3205 | Time: 48.64s | Max GPU Mem: 1507.45 MB
[2025-11-27 02:12:50] [Round 021] FedSophia | Acc: 89.84% | Loss: 0.3134 | Time: 48.85s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:13:57] [Round 022] FedSophia | Acc: 90.56% | Loss: 0.2989 | Time: 66.80s | Max GPU Mem: 1507.45 MB
[2025-11-27 02:14:35] [Round 023] FedSophia | Acc: 91.08% | Loss: 0.2828 | Time: 38.01s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:15:34] [Round 024] FedSophia | Acc: 91.58% | Loss: 0.2731 | Time: 58.65s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:16:37] [Round 025] FedSophia | Acc: 91.43% | Loss: 0.2738 | Time: 63.33s | Max GPU Mem: 1507.45 MB
[2025-11-27 02:17:38] [Round 026] FedSophia | Acc: 90.81% | Loss: 0.2815 | Time: 60.62s | Max GPU Mem: 1508.08 MB
[2025-11-27 02:18:34] [Round 027] FedSophia | Acc: 90.61% | Loss: 0.2845 | Time: 56.17s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:19:24] [Round 028] FedSophia | Acc: 91.05% | Loss: 0.2743 | Time: 50.00s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:20:06] [Round 029] FedSophia | Acc: 91.45% | Loss: 0.2628 | Time: 42.14s | Max GPU Mem: 1508.08 MB
[2025-11-27 02:21:01] [Round 030] FedSophia | Acc: 91.80% | Loss: 0.2550 | Time: 55.55s | Max GPU Mem: 1507.58 MB
[2025-11-27 02:22:09] [Round 031] FedSophia | Acc: 92.27% | Loss: 0.2446 | Time: 67.52s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:23:08] [Round 032] FedSophia | Acc: 92.66% | Loss: 0.2342 | Time: 58.66s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:24:14] [Round 033] FedSophia | Acc: 93.00% | Loss: 0.2278 | Time: 66.64s | Max GPU Mem: 1508.08 MB
[2025-11-27 02:25:21] [Round 034] FedSophia | Acc: 93.21% | Loss: 0.2248 | Time: 66.28s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:26:32] [Round 035] FedSophia | Acc: 93.29% | Loss: 0.2238 | Time: 71.12s | Max GPU Mem: 1508.08 MB
[2025-11-27 02:27:45] [Round 036] FedSophia | Acc: 93.25% | Loss: 0.2234 | Time: 72.85s | Max GPU Mem: 1507.45 MB
[2025-11-27 02:28:33] [Round 037] FedSophia | Acc: 93.24% | Loss: 0.2228 | Time: 47.96s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:29:32] [Round 038] FedSophia | Acc: 93.10% | Loss: 0.2247 | Time: 59.69s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:30:35] [Round 039] FedSophia | Acc: 93.09% | Loss: 0.2248 | Time: 62.87s | Max GPU Mem: 1507.58 MB
[2025-11-27 02:31:24] [Round 040] FedSophia | Acc: 93.37% | Loss: 0.2200 | Time: 49.08s | Max GPU Mem: 1507.58 MB
[2025-11-27 02:32:18] [Round 041] FedSophia | Acc: 93.37% | Loss: 0.2153 | Time: 53.63s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:33:15] [Round 042] FedSophia | Acc: 93.39% | Loss: 0.2130 | Time: 56.79s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:34:03] [Round 043] FedSophia | Acc: 93.40% | Loss: 0.2115 | Time: 48.70s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:35:04] [Round 044] FedSophia | Acc: 93.32% | Loss: 0.2131 | Time: 60.62s | Max GPU Mem: 1507.58 MB
[2025-11-27 02:36:07] [Round 045] FedSophia | Acc: 93.15% | Loss: 0.2162 | Time: 63.18s | Max GPU Mem: 1507.58 MB
[2025-11-27 02:37:01] [Round 046] FedSophia | Acc: 93.21% | Loss: 0.2142 | Time: 54.24s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:37:47] [Round 047] FedSophia | Acc: 93.27% | Loss: 0.2118 | Time: 46.09s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:38:43] [Round 048] FedSophia | Acc: 93.40% | Loss: 0.2099 | Time: 55.18s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:39:33] [Round 049] FedSophia | Acc: 93.62% | Loss: 0.2047 | Time: 50.31s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:40:22] [Round 050] FedSophia | Acc: 93.93% | Loss: 0.2004 | Time: 49.20s | Max GPU Mem: 1507.58 MB
[2025-11-27 02:40:22] Saved to runs/run_20251127_001608_resnet18_head/mnist/logs/FedSophia_head_mnist_resnet18_s0.npz
