[2025-11-27 01:46:34] Namespace(method='FedSophia', training_mode='head', dataset='mnist', model_name='resnet18', seed=0, rounds=50, num_clients=10, fraction=0.5, local_epochs=1, batch_size=64, lr=0.01, newton_lr=0.1, sophia_lr=0.05, rho=0.04, betas='0.9,0.99', mu=0.01, log_dir='runs/run_20251127_001404_resnet18_head/mnist/logs', optimizer='sgd', hessian_batches=32, damping=0.01, alpha=0.1)
[2025-11-27 01:46:34] Start: FedSophia | Mode: head | Dataset: mnist | Device: cuda
[2025-11-27 01:49:21] [Round 001] FedSophia | Acc: 26.19% | Loss: 2.2154 | Time: 52.22s | Max GPU Mem: 1507.98 MB
[2025-11-27 01:50:16] [Round 002] FedSophia | Acc: 34.43% | Loss: 2.0591 | Time: 55.37s | Max GPU Mem: 1507.52 MB
[2025-11-27 01:50:46] [Round 003] FedSophia | Acc: 42.55% | Loss: 1.8601 | Time: 29.50s | Max GPU Mem: 1507.54 MB
[2025-11-27 01:51:13] [Round 004] FedSophia | Acc: 44.44% | Loss: 1.7016 | Time: 26.86s | Max GPU Mem: 1506.93 MB
[2025-11-27 01:51:21] [Round 005] FedSophia | Acc: 45.30% | Loss: 1.6067 | Time: 8.33s | Max GPU Mem: 1508.06 MB
[2025-11-27 01:51:34] [Round 006] FedSophia | Acc: 46.52% | Loss: 1.5226 | Time: 12.73s | Max GPU Mem: 1506.95 MB
[2025-11-27 01:51:46] [Round 007] FedSophia | Acc: 48.71% | Loss: 1.4260 | Time: 12.78s | Max GPU Mem: 1508.08 MB
[2025-11-27 01:51:58] [Round 008] FedSophia | Acc: 53.60% | Loss: 1.2894 | Time: 11.60s | Max GPU Mem: 1506.95 MB
[2025-11-27 01:52:08] [Round 009] FedSophia | Acc: 60.49% | Loss: 1.1159 | Time: 9.52s | Max GPU Mem: 1506.95 MB
[2025-11-27 01:52:33] [Round 010] FedSophia | Acc: 67.21% | Loss: 0.9531 | Time: 25.88s | Max GPU Mem: 1506.95 MB
[2025-11-27 01:52:58] [Round 011] FedSophia | Acc: 72.33% | Loss: 0.8169 | Time: 24.67s | Max GPU Mem: 1507.45 MB
[2025-11-27 01:53:31] [Round 012] FedSophia | Acc: 76.97% | Loss: 0.7007 | Time: 32.78s | Max GPU Mem: 1506.95 MB
[2025-11-27 01:54:36] [Round 013] FedSophia | Acc: 79.75% | Loss: 0.6336 | Time: 64.76s | Max GPU Mem: 1507.58 MB
[2025-11-27 01:55:23] [Round 014] FedSophia | Acc: 80.23% | Loss: 0.6313 | Time: 47.63s | Max GPU Mem: 1506.95 MB
[2025-11-27 01:56:31] [Round 015] FedSophia | Acc: 78.75% | Loss: 0.6452 | Time: 67.97s | Max GPU Mem: 1507.58 MB
[2025-11-27 01:57:20] [Round 016] FedSophia | Acc: 78.08% | Loss: 0.6068 | Time: 49.27s | Max GPU Mem: 1507.58 MB
[2025-11-27 01:58:38] [Round 017] FedSophia | Acc: 82.40% | Loss: 0.5098 | Time: 77.55s | Max GPU Mem: 1506.95 MB
[2025-11-27 01:59:54] [Round 018] FedSophia | Acc: 85.98% | Loss: 0.4422 | Time: 76.12s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:00:48] [Round 019] FedSophia | Acc: 85.82% | Loss: 0.4309 | Time: 54.07s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:01:41] [Round 020] FedSophia | Acc: 83.41% | Loss: 0.4671 | Time: 52.68s | Max GPU Mem: 1507.45 MB
[2025-11-27 02:03:07] [Round 021] FedSophia | Acc: 81.45% | Loss: 0.5058 | Time: 85.92s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:04:11] [Round 022] FedSophia | Acc: 80.08% | Loss: 0.5480 | Time: 63.82s | Max GPU Mem: 1507.45 MB
[2025-11-27 02:05:19] [Round 023] FedSophia | Acc: 78.73% | Loss: 0.6040 | Time: 67.98s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:06:18] [Round 024] FedSophia | Acc: 77.56% | Loss: 0.6491 | Time: 59.47s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:07:08] [Round 025] FedSophia | Acc: 77.12% | Loss: 0.6815 | Time: 49.43s | Max GPU Mem: 1507.45 MB
[2025-11-27 02:08:08] [Round 026] FedSophia | Acc: 77.25% | Loss: 0.6719 | Time: 60.15s | Max GPU Mem: 1508.08 MB
[2025-11-27 02:08:53] [Round 027] FedSophia | Acc: 78.74% | Loss: 0.6223 | Time: 45.79s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:09:48] [Round 028] FedSophia | Acc: 78.92% | Loss: 0.5829 | Time: 54.36s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:10:42] [Round 029] FedSophia | Acc: 79.39% | Loss: 0.5738 | Time: 54.17s | Max GPU Mem: 1508.08 MB
[2025-11-27 02:12:35] [Round 030] FedSophia | Acc: 79.85% | Loss: 0.5650 | Time: 113.32s | Max GPU Mem: 1507.58 MB
[2025-11-27 02:14:02] [Round 031] FedSophia | Acc: 80.88% | Loss: 0.5347 | Time: 87.15s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:15:00] [Round 032] FedSophia | Acc: 82.63% | Loss: 0.4820 | Time: 57.48s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:15:58] [Round 033] FedSophia | Acc: 84.94% | Loss: 0.4077 | Time: 58.44s | Max GPU Mem: 1508.08 MB
[2025-11-27 02:16:51] [Round 034] FedSophia | Acc: 86.88% | Loss: 0.3543 | Time: 52.89s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:17:32] [Round 035] FedSophia | Acc: 88.97% | Loss: 0.3129 | Time: 40.56s | Max GPU Mem: 1508.08 MB
[2025-11-27 02:18:45] [Round 036] FedSophia | Acc: 90.50% | Loss: 0.2914 | Time: 73.37s | Max GPU Mem: 1507.45 MB
[2025-11-27 02:19:26] [Round 037] FedSophia | Acc: 91.50% | Loss: 0.2864 | Time: 41.01s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:20:20] [Round 038] FedSophia | Acc: 90.30% | Loss: 0.3083 | Time: 54.02s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:21:10] [Round 039] FedSophia | Acc: 89.22% | Loss: 0.3253 | Time: 49.50s | Max GPU Mem: 1507.58 MB
[2025-11-27 02:22:22] [Round 040] FedSophia | Acc: 88.24% | Loss: 0.3445 | Time: 72.57s | Max GPU Mem: 1507.58 MB
[2025-11-27 02:23:18] [Round 041] FedSophia | Acc: 88.27% | Loss: 0.3470 | Time: 55.71s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:24:42] [Round 042] FedSophia | Acc: 89.70% | Loss: 0.3231 | Time: 83.50s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:25:26] [Round 043] FedSophia | Acc: 90.02% | Loss: 0.3109 | Time: 44.80s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:26:26] [Round 044] FedSophia | Acc: 88.98% | Loss: 0.3196 | Time: 59.33s | Max GPU Mem: 1507.58 MB
[2025-11-27 02:27:27] [Round 045] FedSophia | Acc: 88.31% | Loss: 0.3316 | Time: 61.48s | Max GPU Mem: 1507.58 MB
[2025-11-27 02:28:52] [Round 046] FedSophia | Acc: 87.63% | Loss: 0.3351 | Time: 84.71s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:29:39] [Round 047] FedSophia | Acc: 89.22% | Loss: 0.3070 | Time: 47.58s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:30:24] [Round 048] FedSophia | Acc: 90.75% | Loss: 0.2773 | Time: 44.14s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:31:13] [Round 049] FedSophia | Acc: 91.68% | Loss: 0.2659 | Time: 49.36s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:32:14] [Round 050] FedSophia | Acc: 91.92% | Loss: 0.2615 | Time: 60.69s | Max GPU Mem: 1507.58 MB
[2025-11-27 02:32:14] Saved to runs/run_20251127_001404_resnet18_head/mnist/logs/FedSophia_head_mnist_resnet18_s0.npz
