[2025-11-27 01:58:16] Namespace(method='FedSophia', training_mode='head', dataset='mnist', model_name='resnet18', seed=2, rounds=50, num_clients=10, fraction=0.5, local_epochs=1, batch_size=64, lr=0.01, newton_lr=0.1, sophia_lr=0.05, rho=0.04, betas='0.9,0.99', mu=0.01, log_dir='runs/run_20251127_001740_resnet18_head/mnist/logs', optimizer='sgd', hessian_batches=32, damping=0.01, alpha=10.0)
[2025-11-27 01:58:16] Start: FedSophia | Mode: head | Dataset: mnist | Device: cuda
[2025-11-27 02:01:17] [Round 001] FedSophia | Acc: 36.99% | Loss: 2.1270 | Time: 68.94s | Max GPU Mem: 1507.98 MB
[2025-11-27 02:02:36] [Round 002] FedSophia | Acc: 70.07% | Loss: 1.8118 | Time: 79.32s | Max GPU Mem: 1507.56 MB
[2025-11-27 02:03:45] [Round 003] FedSophia | Acc: 80.10% | Loss: 1.4634 | Time: 69.01s | Max GPU Mem: 1507.56 MB
[2025-11-27 02:05:06] [Round 004] FedSophia | Acc: 83.78% | Loss: 1.1533 | Time: 81.15s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:06:26] [Round 005] FedSophia | Acc: 85.62% | Loss: 0.9116 | Time: 79.87s | Max GPU Mem: 1508.08 MB
[2025-11-27 02:07:35] [Round 006] FedSophia | Acc: 86.32% | Loss: 0.7391 | Time: 69.14s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:08:41] [Round 007] FedSophia | Acc: 87.13% | Loss: 0.6187 | Time: 65.50s | Max GPU Mem: 1508.08 MB
[2025-11-27 02:09:46] [Round 008] FedSophia | Acc: 87.70% | Loss: 0.5340 | Time: 64.94s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:10:50] [Round 009] FedSophia | Acc: 88.36% | Loss: 0.4732 | Time: 64.38s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:11:53] [Round 010] FedSophia | Acc: 88.87% | Loss: 0.4280 | Time: 63.43s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:12:52] [Round 011] FedSophia | Acc: 89.21% | Loss: 0.3941 | Time: 58.87s | Max GPU Mem: 1507.45 MB
[2025-11-27 02:13:56] [Round 012] FedSophia | Acc: 89.69% | Loss: 0.3682 | Time: 63.49s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:14:55] [Round 013] FedSophia | Acc: 89.93% | Loss: 0.3478 | Time: 59.02s | Max GPU Mem: 1507.58 MB
[2025-11-27 02:15:47] [Round 014] FedSophia | Acc: 90.26% | Loss: 0.3315 | Time: 52.26s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:16:39] [Round 015] FedSophia | Acc: 90.63% | Loss: 0.3181 | Time: 52.22s | Max GPU Mem: 1507.58 MB
[2025-11-27 02:17:33] [Round 016] FedSophia | Acc: 90.84% | Loss: 0.3069 | Time: 53.50s | Max GPU Mem: 1507.58 MB
[2025-11-27 02:18:28] [Round 017] FedSophia | Acc: 91.03% | Loss: 0.2973 | Time: 55.62s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:19:31] [Round 018] FedSophia | Acc: 91.21% | Loss: 0.2888 | Time: 62.45s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:20:35] [Round 019] FedSophia | Acc: 91.42% | Loss: 0.2810 | Time: 64.46s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:21:40] [Round 020] FedSophia | Acc: 91.71% | Loss: 0.2738 | Time: 65.17s | Max GPU Mem: 1507.45 MB
[2025-11-27 02:22:37] [Round 021] FedSophia | Acc: 91.89% | Loss: 0.2669 | Time: 56.68s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:23:48] [Round 022] FedSophia | Acc: 92.14% | Loss: 0.2606 | Time: 70.94s | Max GPU Mem: 1507.45 MB
[2025-11-27 02:24:54] [Round 023] FedSophia | Acc: 92.30% | Loss: 0.2548 | Time: 66.33s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:26:17] [Round 024] FedSophia | Acc: 92.40% | Loss: 0.2496 | Time: 82.55s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:27:37] [Round 025] FedSophia | Acc: 92.55% | Loss: 0.2446 | Time: 80.39s | Max GPU Mem: 1507.45 MB
[2025-11-27 02:29:02] [Round 026] FedSophia | Acc: 92.72% | Loss: 0.2400 | Time: 84.62s | Max GPU Mem: 1508.08 MB
[2025-11-27 02:29:58] [Round 027] FedSophia | Acc: 92.80% | Loss: 0.2358 | Time: 55.81s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:30:50] [Round 028] FedSophia | Acc: 92.92% | Loss: 0.2320 | Time: 52.20s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:31:46] [Round 029] FedSophia | Acc: 93.08% | Loss: 0.2285 | Time: 56.35s | Max GPU Mem: 1508.08 MB
[2025-11-27 02:32:41] [Round 030] FedSophia | Acc: 93.16% | Loss: 0.2253 | Time: 54.32s | Max GPU Mem: 1507.58 MB
[2025-11-27 02:33:38] [Round 031] FedSophia | Acc: 93.30% | Loss: 0.2222 | Time: 56.90s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:34:34] [Round 032] FedSophia | Acc: 93.32% | Loss: 0.2192 | Time: 56.39s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:35:35] [Round 033] FedSophia | Acc: 93.35% | Loss: 0.2164 | Time: 60.92s | Max GPU Mem: 1508.08 MB
[2025-11-27 02:36:35] [Round 034] FedSophia | Acc: 93.42% | Loss: 0.2140 | Time: 60.40s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:37:45] [Round 035] FedSophia | Acc: 93.44% | Loss: 0.2118 | Time: 70.21s | Max GPU Mem: 1508.08 MB
[2025-11-27 02:38:55] [Round 036] FedSophia | Acc: 93.52% | Loss: 0.2095 | Time: 69.88s | Max GPU Mem: 1507.45 MB
[2025-11-27 02:40:15] [Round 037] FedSophia | Acc: 93.60% | Loss: 0.2071 | Time: 79.50s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:41:05] [Round 038] FedSophia | Acc: 93.71% | Loss: 0.2047 | Time: 50.14s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:41:58] [Round 039] FedSophia | Acc: 93.80% | Loss: 0.2024 | Time: 53.09s | Max GPU Mem: 1507.58 MB
[2025-11-27 02:42:56] [Round 040] FedSophia | Acc: 93.85% | Loss: 0.2000 | Time: 58.16s | Max GPU Mem: 1507.58 MB
[2025-11-27 02:43:55] [Round 041] FedSophia | Acc: 93.88% | Loss: 0.1979 | Time: 58.92s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:44:51] [Round 042] FedSophia | Acc: 93.95% | Loss: 0.1961 | Time: 55.52s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:45:21] [Round 043] FedSophia | Acc: 93.88% | Loss: 0.1947 | Time: 30.41s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:45:35] [Round 044] FedSophia | Acc: 93.92% | Loss: 0.1932 | Time: 14.35s | Max GPU Mem: 1507.58 MB
[2025-11-27 02:45:47] [Round 045] FedSophia | Acc: 93.94% | Loss: 0.1916 | Time: 11.48s | Max GPU Mem: 1507.58 MB
[2025-11-27 02:45:59] [Round 046] FedSophia | Acc: 94.05% | Loss: 0.1899 | Time: 12.01s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:46:11] [Round 047] FedSophia | Acc: 94.21% | Loss: 0.1883 | Time: 11.65s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:46:23] [Round 048] FedSophia | Acc: 94.36% | Loss: 0.1868 | Time: 12.29s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:46:35] [Round 049] FedSophia | Acc: 94.40% | Loss: 0.1853 | Time: 12.13s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:46:47] [Round 050] FedSophia | Acc: 94.52% | Loss: 0.1841 | Time: 11.57s | Max GPU Mem: 1507.58 MB
[2025-11-27 02:46:47] Saved to runs/run_20251127_001740_resnet18_head/mnist/logs/FedSophia_head_mnist_resnet18_s2.npz
