[2025-11-27 01:57:19] Namespace(method='FedSophia', training_mode='head', dataset='mnist', model_name='resnet18', seed=1, rounds=50, num_clients=10, fraction=0.5, local_epochs=1, batch_size=64, lr=0.01, newton_lr=0.1, sophia_lr=0.05, rho=0.04, betas='0.9,0.99', mu=0.01, log_dir='runs/run_20251127_001740_resnet18_head/mnist/logs', optimizer='sgd', hessian_batches=32, damping=0.01, alpha=10.0)
[2025-11-27 01:57:19] Start: FedSophia | Mode: head | Dataset: mnist | Device: cuda
[2025-11-27 01:59:31] [Round 001] FedSophia | Acc: 35.25% | Loss: 2.1314 | Time: 21.15s | Max GPU Mem: 1507.98 MB
[2025-11-27 01:59:54] [Round 002] FedSophia | Acc: 72.35% | Loss: 1.8127 | Time: 22.70s | Max GPU Mem: 1507.54 MB
[2025-11-27 02:00:30] [Round 003] FedSophia | Acc: 83.78% | Loss: 1.4539 | Time: 35.91s | Max GPU Mem: 1507.54 MB
[2025-11-27 02:01:28] [Round 004] FedSophia | Acc: 84.66% | Loss: 1.1370 | Time: 58.66s | Max GPU Mem: 1506.93 MB
[2025-11-27 02:02:36] [Round 005] FedSophia | Acc: 84.83% | Loss: 0.8949 | Time: 67.12s | Max GPU Mem: 1508.08 MB
[2025-11-27 02:03:38] [Round 006] FedSophia | Acc: 85.41% | Loss: 0.7245 | Time: 62.30s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:04:40] [Round 007] FedSophia | Acc: 86.39% | Loss: 0.6060 | Time: 61.80s | Max GPU Mem: 1508.08 MB
[2025-11-27 02:05:36] [Round 008] FedSophia | Acc: 87.33% | Loss: 0.5234 | Time: 56.15s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:06:27] [Round 009] FedSophia | Acc: 87.87% | Loss: 0.4651 | Time: 51.24s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:07:32] [Round 010] FedSophia | Acc: 88.50% | Loss: 0.4219 | Time: 64.50s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:08:30] [Round 011] FedSophia | Acc: 89.04% | Loss: 0.3894 | Time: 58.51s | Max GPU Mem: 1507.45 MB
[2025-11-27 02:09:22] [Round 012] FedSophia | Acc: 89.54% | Loss: 0.3641 | Time: 51.77s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:10:14] [Round 013] FedSophia | Acc: 90.17% | Loss: 0.3442 | Time: 51.90s | Max GPU Mem: 1507.58 MB
[2025-11-27 02:11:16] [Round 014] FedSophia | Acc: 90.40% | Loss: 0.3282 | Time: 62.00s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:12:09] [Round 015] FedSophia | Acc: 90.53% | Loss: 0.3150 | Time: 53.04s | Max GPU Mem: 1507.58 MB
[2025-11-27 02:13:02] [Round 016] FedSophia | Acc: 90.80% | Loss: 0.3038 | Time: 53.66s | Max GPU Mem: 1507.58 MB
[2025-11-27 02:14:02] [Round 017] FedSophia | Acc: 91.08% | Loss: 0.2940 | Time: 59.22s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:14:59] [Round 018] FedSophia | Acc: 91.30% | Loss: 0.2852 | Time: 57.03s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:16:09] [Round 019] FedSophia | Acc: 91.57% | Loss: 0.2773 | Time: 70.30s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:17:16] [Round 020] FedSophia | Acc: 91.71% | Loss: 0.2703 | Time: 66.79s | Max GPU Mem: 1507.45 MB
[2025-11-27 02:18:27] [Round 021] FedSophia | Acc: 91.94% | Loss: 0.2640 | Time: 71.04s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:19:33] [Round 022] FedSophia | Acc: 92.13% | Loss: 0.2584 | Time: 66.16s | Max GPU Mem: 1507.45 MB
[2025-11-27 02:20:30] [Round 023] FedSophia | Acc: 92.26% | Loss: 0.2532 | Time: 57.20s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:21:20] [Round 024] FedSophia | Acc: 92.29% | Loss: 0.2485 | Time: 50.00s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:22:13] [Round 025] FedSophia | Acc: 92.41% | Loss: 0.2443 | Time: 52.51s | Max GPU Mem: 1507.45 MB
[2025-11-27 02:23:11] [Round 026] FedSophia | Acc: 92.58% | Loss: 0.2400 | Time: 57.86s | Max GPU Mem: 1508.08 MB
[2025-11-27 02:24:00] [Round 027] FedSophia | Acc: 92.83% | Loss: 0.2358 | Time: 49.42s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:24:54] [Round 028] FedSophia | Acc: 92.91% | Loss: 0.2315 | Time: 54.32s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:25:45] [Round 029] FedSophia | Acc: 93.10% | Loss: 0.2273 | Time: 50.67s | Max GPU Mem: 1508.08 MB
[2025-11-27 02:26:32] [Round 030] FedSophia | Acc: 93.21% | Loss: 0.2234 | Time: 46.79s | Max GPU Mem: 1507.58 MB
[2025-11-27 02:27:28] [Round 031] FedSophia | Acc: 93.27% | Loss: 0.2198 | Time: 55.71s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:28:29] [Round 032] FedSophia | Acc: 93.35% | Loss: 0.2168 | Time: 61.63s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:29:21] [Round 033] FedSophia | Acc: 93.42% | Loss: 0.2140 | Time: 51.39s | Max GPU Mem: 1508.08 MB
[2025-11-27 02:30:24] [Round 034] FedSophia | Acc: 93.49% | Loss: 0.2115 | Time: 63.11s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:31:30] [Round 035] FedSophia | Acc: 93.51% | Loss: 0.2091 | Time: 66.73s | Max GPU Mem: 1508.08 MB
[2025-11-27 02:32:34] [Round 036] FedSophia | Acc: 93.59% | Loss: 0.2070 | Time: 63.66s | Max GPU Mem: 1507.45 MB
[2025-11-27 02:33:32] [Round 037] FedSophia | Acc: 93.69% | Loss: 0.2051 | Time: 58.36s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:34:32] [Round 038] FedSophia | Acc: 93.79% | Loss: 0.2031 | Time: 59.46s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:35:34] [Round 039] FedSophia | Acc: 93.83% | Loss: 0.2010 | Time: 62.65s | Max GPU Mem: 1507.58 MB
[2025-11-27 02:36:37] [Round 040] FedSophia | Acc: 93.90% | Loss: 0.1989 | Time: 62.60s | Max GPU Mem: 1507.58 MB
[2025-11-27 02:37:40] [Round 041] FedSophia | Acc: 93.95% | Loss: 0.1972 | Time: 62.52s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:38:32] [Round 042] FedSophia | Acc: 93.94% | Loss: 0.1954 | Time: 52.39s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:39:22] [Round 043] FedSophia | Acc: 94.00% | Loss: 0.1936 | Time: 49.78s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:40:17] [Round 044] FedSophia | Acc: 94.07% | Loss: 0.1920 | Time: 55.71s | Max GPU Mem: 1507.58 MB
[2025-11-27 02:41:08] [Round 045] FedSophia | Acc: 94.17% | Loss: 0.1905 | Time: 50.80s | Max GPU Mem: 1507.58 MB
[2025-11-27 02:42:00] [Round 046] FedSophia | Acc: 94.25% | Loss: 0.1888 | Time: 51.94s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:42:59] [Round 047] FedSophia | Acc: 94.34% | Loss: 0.1869 | Time: 58.86s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:44:04] [Round 048] FedSophia | Acc: 94.42% | Loss: 0.1851 | Time: 65.34s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:45:06] [Round 049] FedSophia | Acc: 94.45% | Loss: 0.1836 | Time: 61.92s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:45:28] [Round 050] FedSophia | Acc: 94.50% | Loss: 0.1824 | Time: 21.98s | Max GPU Mem: 1507.58 MB
[2025-11-27 02:45:28] Saved to runs/run_20251127_001740_resnet18_head/mnist/logs/FedSophia_head_mnist_resnet18_s1.npz
