[2025-11-27 01:51:14] Namespace(method='FedSophia', training_mode='head', dataset='mnist', model_name='resnet18', seed=2, rounds=50, num_clients=10, fraction=0.5, local_epochs=1, batch_size=64, lr=0.01, newton_lr=0.1, sophia_lr=0.05, rho=0.04, betas='0.9,0.99', mu=0.01, log_dir='runs/run_20251127_001404_resnet18_head/mnist/logs', optimizer='sgd', hessian_batches=32, damping=0.01, alpha=0.1)
[2025-11-27 01:51:14] Start: FedSophia | Mode: head | Dataset: mnist | Device: cuda
[2025-11-27 01:54:01] [Round 001] FedSophia | Acc: 20.98% | Loss: 2.2380 | Time: 54.49s | Max GPU Mem: 1507.98 MB
[2025-11-27 01:55:03] [Round 002] FedSophia | Acc: 26.83% | Loss: 2.1406 | Time: 61.60s | Max GPU Mem: 1507.52 MB
[2025-11-27 01:56:01] [Round 003] FedSophia | Acc: 22.63% | Loss: 2.1092 | Time: 58.09s | Max GPU Mem: 1507.52 MB
[2025-11-27 01:57:21] [Round 004] FedSophia | Acc: 22.43% | Loss: 2.0940 | Time: 80.51s | Max GPU Mem: 1506.93 MB
[2025-11-27 01:58:37] [Round 005] FedSophia | Acc: 23.80% | Loss: 2.1105 | Time: 75.84s | Max GPU Mem: 1508.08 MB
[2025-11-27 01:59:57] [Round 006] FedSophia | Acc: 27.31% | Loss: 2.0987 | Time: 79.66s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:00:57] [Round 007] FedSophia | Acc: 38.35% | Loss: 1.9583 | Time: 60.34s | Max GPU Mem: 1508.08 MB
[2025-11-27 02:02:04] [Round 008] FedSophia | Acc: 46.40% | Loss: 1.8128 | Time: 67.36s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:03:08] [Round 009] FedSophia | Acc: 50.02% | Loss: 1.5520 | Time: 63.53s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:04:14] [Round 010] FedSophia | Acc: 53.96% | Loss: 1.2716 | Time: 65.66s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:05:21] [Round 011] FedSophia | Acc: 63.72% | Loss: 1.0119 | Time: 67.43s | Max GPU Mem: 1507.45 MB
[2025-11-27 02:06:30] [Round 012] FedSophia | Acc: 71.39% | Loss: 0.8297 | Time: 69.31s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:07:19] [Round 013] FedSophia | Acc: 76.64% | Loss: 0.6969 | Time: 48.68s | Max GPU Mem: 1507.58 MB
[2025-11-27 02:08:09] [Round 014] FedSophia | Acc: 79.47% | Loss: 0.6236 | Time: 50.51s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:08:54] [Round 015] FedSophia | Acc: 79.47% | Loss: 0.6034 | Time: 44.90s | Max GPU Mem: 1507.58 MB
[2025-11-27 02:09:49] [Round 016] FedSophia | Acc: 79.51% | Loss: 0.5912 | Time: 54.41s | Max GPU Mem: 1507.58 MB
[2025-11-27 02:10:41] [Round 017] FedSophia | Acc: 80.52% | Loss: 0.5625 | Time: 51.86s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:11:32] [Round 018] FedSophia | Acc: 81.93% | Loss: 0.5229 | Time: 51.54s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:12:23] [Round 019] FedSophia | Acc: 83.35% | Loss: 0.4879 | Time: 51.08s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:13:10] [Round 020] FedSophia | Acc: 83.87% | Loss: 0.4708 | Time: 46.49s | Max GPU Mem: 1507.45 MB
[2025-11-27 02:14:02] [Round 021] FedSophia | Acc: 84.18% | Loss: 0.4620 | Time: 52.73s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:15:06] [Round 022] FedSophia | Acc: 84.12% | Loss: 0.4595 | Time: 63.51s | Max GPU Mem: 1507.45 MB
[2025-11-27 02:16:01] [Round 023] FedSophia | Acc: 84.32% | Loss: 0.4564 | Time: 55.27s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:16:53] [Round 024] FedSophia | Acc: 84.05% | Loss: 0.4650 | Time: 51.79s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:17:31] [Round 025] FedSophia | Acc: 83.93% | Loss: 0.4622 | Time: 38.18s | Max GPU Mem: 1507.45 MB
[2025-11-27 02:18:23] [Round 026] FedSophia | Acc: 85.29% | Loss: 0.4320 | Time: 51.55s | Max GPU Mem: 1508.08 MB
[2025-11-27 02:19:23] [Round 027] FedSophia | Acc: 86.85% | Loss: 0.3924 | Time: 60.18s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:20:20] [Round 028] FedSophia | Acc: 87.77% | Loss: 0.3651 | Time: 57.28s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:21:19] [Round 029] FedSophia | Acc: 88.43% | Loss: 0.3464 | Time: 58.80s | Max GPU Mem: 1508.08 MB
[2025-11-27 02:22:14] [Round 030] FedSophia | Acc: 88.97% | Loss: 0.3372 | Time: 54.92s | Max GPU Mem: 1507.58 MB
[2025-11-27 02:23:15] [Round 031] FedSophia | Acc: 88.78% | Loss: 0.3397 | Time: 60.90s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:24:09] [Round 032] FedSophia | Acc: 88.96% | Loss: 0.3369 | Time: 54.21s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:25:26] [Round 033] FedSophia | Acc: 88.99% | Loss: 0.3347 | Time: 77.17s | Max GPU Mem: 1508.08 MB
[2025-11-27 02:26:33] [Round 034] FedSophia | Acc: 89.18% | Loss: 0.3332 | Time: 66.40s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:27:23] [Round 035] FedSophia | Acc: 89.38% | Loss: 0.3268 | Time: 49.90s | Max GPU Mem: 1508.08 MB
[2025-11-27 02:28:17] [Round 036] FedSophia | Acc: 89.60% | Loss: 0.3185 | Time: 54.89s | Max GPU Mem: 1507.45 MB
[2025-11-27 02:29:11] [Round 037] FedSophia | Acc: 89.61% | Loss: 0.3143 | Time: 53.88s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:29:55] [Round 038] FedSophia | Acc: 89.89% | Loss: 0.3065 | Time: 43.52s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:30:51] [Round 039] FedSophia | Acc: 90.07% | Loss: 0.3030 | Time: 56.51s | Max GPU Mem: 1507.58 MB
[2025-11-27 02:31:51] [Round 040] FedSophia | Acc: 90.28% | Loss: 0.2998 | Time: 59.61s | Max GPU Mem: 1507.58 MB
[2025-11-27 02:32:28] [Round 041] FedSophia | Acc: 90.30% | Loss: 0.3004 | Time: 37.48s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:32:49] [Round 042] FedSophia | Acc: 89.93% | Loss: 0.3060 | Time: 20.39s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:33:14] [Round 043] FedSophia | Acc: 89.21% | Loss: 0.3189 | Time: 24.87s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:33:36] [Round 044] FedSophia | Acc: 88.27% | Loss: 0.3417 | Time: 22.08s | Max GPU Mem: 1507.58 MB
[2025-11-27 02:33:51] [Round 045] FedSophia | Acc: 87.97% | Loss: 0.3499 | Time: 15.38s | Max GPU Mem: 1507.58 MB
[2025-11-27 02:34:18] [Round 046] FedSophia | Acc: 87.54% | Loss: 0.3632 | Time: 26.60s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:35:20] [Round 047] FedSophia | Acc: 87.31% | Loss: 0.3699 | Time: 61.85s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:36:13] [Round 048] FedSophia | Acc: 87.95% | Loss: 0.3561 | Time: 53.78s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:36:45] [Round 049] FedSophia | Acc: 88.41% | Loss: 0.3476 | Time: 31.23s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:37:05] [Round 050] FedSophia | Acc: 88.94% | Loss: 0.3311 | Time: 20.28s | Max GPU Mem: 1507.58 MB
[2025-11-27 02:37:05] Saved to runs/run_20251127_001404_resnet18_head/mnist/logs/FedSophia_head_mnist_resnet18_s2.npz
