[2025-11-27 01:50:13] Namespace(method='FedSophia', training_mode='head', dataset='mnist', model_name='resnet18', seed=1, rounds=50, num_clients=10, fraction=0.5, local_epochs=1, batch_size=64, lr=0.01, newton_lr=0.1, sophia_lr=0.05, rho=0.04, betas='0.9,0.99', mu=0.01, log_dir='runs/run_20251127_001404_resnet18_head/mnist/logs', optimizer='sgd', hessian_batches=32, damping=0.01, alpha=0.1)
[2025-11-27 01:50:13] Start: FedSophia | Mode: head | Dataset: mnist | Device: cuda
[2025-11-27 01:52:34] [Round 001] FedSophia | Acc: 19.31% | Loss: 2.2058 | Time: 27.57s | Max GPU Mem: 1507.98 MB
[2025-11-27 01:53:00] [Round 002] FedSophia | Acc: 33.82% | Loss: 2.0317 | Time: 26.09s | Max GPU Mem: 1507.52 MB
[2025-11-27 01:53:43] [Round 003] FedSophia | Acc: 40.40% | Loss: 1.8595 | Time: 43.40s | Max GPU Mem: 1507.56 MB
[2025-11-27 01:54:24] [Round 004] FedSophia | Acc: 45.41% | Loss: 1.6660 | Time: 40.71s | Max GPU Mem: 1506.93 MB
[2025-11-27 01:55:22] [Round 005] FedSophia | Acc: 48.71% | Loss: 1.4901 | Time: 58.45s | Max GPU Mem: 1508.08 MB
[2025-11-27 01:56:33] [Round 006] FedSophia | Acc: 50.20% | Loss: 1.3120 | Time: 70.38s | Max GPU Mem: 1506.95 MB
[2025-11-27 01:57:23] [Round 007] FedSophia | Acc: 56.80% | Loss: 1.1523 | Time: 49.98s | Max GPU Mem: 1508.08 MB
[2025-11-27 01:58:36] [Round 008] FedSophia | Acc: 67.17% | Loss: 0.9805 | Time: 73.44s | Max GPU Mem: 1506.95 MB
[2025-11-27 01:59:51] [Round 009] FedSophia | Acc: 71.79% | Loss: 0.8747 | Time: 74.73s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:00:59] [Round 010] FedSophia | Acc: 74.28% | Loss: 0.7992 | Time: 67.89s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:02:03] [Round 011] FedSophia | Acc: 78.05% | Loss: 0.7279 | Time: 63.92s | Max GPU Mem: 1507.45 MB
[2025-11-27 02:03:08] [Round 012] FedSophia | Acc: 80.81% | Loss: 0.6554 | Time: 65.38s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:04:11] [Round 013] FedSophia | Acc: 83.19% | Loss: 0.5805 | Time: 63.36s | Max GPU Mem: 1507.58 MB
[2025-11-27 02:05:19] [Round 014] FedSophia | Acc: 83.53% | Loss: 0.5251 | Time: 68.00s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:06:21] [Round 015] FedSophia | Acc: 84.00% | Loss: 0.4928 | Time: 61.35s | Max GPU Mem: 1507.58 MB
[2025-11-27 02:07:15] [Round 016] FedSophia | Acc: 83.61% | Loss: 0.4823 | Time: 54.30s | Max GPU Mem: 1507.58 MB
[2025-11-27 02:08:09] [Round 017] FedSophia | Acc: 82.66% | Loss: 0.4915 | Time: 54.36s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:08:55] [Round 018] FedSophia | Acc: 81.02% | Loss: 0.5242 | Time: 45.96s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:09:48] [Round 019] FedSophia | Acc: 79.08% | Loss: 0.5826 | Time: 52.47s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:10:43] [Round 020] FedSophia | Acc: 77.12% | Loss: 0.6366 | Time: 55.13s | Max GPU Mem: 1507.45 MB
[2025-11-27 02:11:33] [Round 021] FedSophia | Acc: 74.70% | Loss: 0.7040 | Time: 50.30s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:12:32] [Round 022] FedSophia | Acc: 73.27% | Loss: 0.7351 | Time: 58.85s | Max GPU Mem: 1507.45 MB
[2025-11-27 02:13:25] [Round 023] FedSophia | Acc: 74.76% | Loss: 0.6685 | Time: 52.42s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:14:29] [Round 024] FedSophia | Acc: 80.01% | Loss: 0.5379 | Time: 64.69s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:15:38] [Round 025] FedSophia | Acc: 86.14% | Loss: 0.4346 | Time: 68.95s | Max GPU Mem: 1507.45 MB
[2025-11-27 02:16:50] [Round 026] FedSophia | Acc: 85.28% | Loss: 0.4226 | Time: 72.18s | Max GPU Mem: 1508.08 MB
[2025-11-27 02:18:22] [Round 027] FedSophia | Acc: 84.57% | Loss: 0.4303 | Time: 91.32s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:19:30] [Round 028] FedSophia | Acc: 82.67% | Loss: 0.4572 | Time: 67.88s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:20:41] [Round 029] FedSophia | Acc: 84.51% | Loss: 0.4288 | Time: 71.86s | Max GPU Mem: 1508.08 MB
[2025-11-27 02:21:17] [Round 030] FedSophia | Acc: 86.71% | Loss: 0.3970 | Time: 35.71s | Max GPU Mem: 1507.58 MB
[2025-11-27 02:22:10] [Round 031] FedSophia | Acc: 88.61% | Loss: 0.3564 | Time: 53.15s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:23:17] [Round 032] FedSophia | Acc: 88.01% | Loss: 0.3535 | Time: 66.22s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:24:33] [Round 033] FedSophia | Acc: 85.79% | Loss: 0.3797 | Time: 76.13s | Max GPU Mem: 1508.08 MB
[2025-11-27 02:25:44] [Round 034] FedSophia | Acc: 83.78% | Loss: 0.4428 | Time: 71.09s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:26:37] [Round 035] FedSophia | Acc: 82.92% | Loss: 0.5114 | Time: 52.84s | Max GPU Mem: 1508.08 MB
[2025-11-27 02:27:41] [Round 036] FedSophia | Acc: 82.93% | Loss: 0.4997 | Time: 64.28s | Max GPU Mem: 1507.45 MB
[2025-11-27 02:28:23] [Round 037] FedSophia | Acc: 83.14% | Loss: 0.4768 | Time: 42.17s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:29:14] [Round 038] FedSophia | Acc: 83.44% | Loss: 0.4497 | Time: 51.11s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:30:00] [Round 039] FedSophia | Acc: 85.81% | Loss: 0.3803 | Time: 45.79s | Max GPU Mem: 1507.58 MB
[2025-11-27 02:30:50] [Round 040] FedSophia | Acc: 88.07% | Loss: 0.3458 | Time: 49.82s | Max GPU Mem: 1507.58 MB
[2025-11-27 02:31:34] [Round 041] FedSophia | Acc: 90.45% | Loss: 0.3148 | Time: 44.18s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:32:21] [Round 042] FedSophia | Acc: 89.61% | Loss: 0.3142 | Time: 47.33s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:32:44] [Round 043] FedSophia | Acc: 88.71% | Loss: 0.3218 | Time: 22.81s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:33:09] [Round 044] FedSophia | Acc: 88.09% | Loss: 0.3302 | Time: 25.14s | Max GPU Mem: 1507.58 MB
[2025-11-27 02:33:33] [Round 045] FedSophia | Acc: 87.18% | Loss: 0.3471 | Time: 23.75s | Max GPU Mem: 1507.58 MB
[2025-11-27 02:33:47] [Round 046] FedSophia | Acc: 88.75% | Loss: 0.3257 | Time: 14.32s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:34:10] [Round 047] FedSophia | Acc: 90.40% | Loss: 0.3022 | Time: 22.24s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:34:41] [Round 048] FedSophia | Acc: 90.69% | Loss: 0.2942 | Time: 31.93s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:35:22] [Round 049] FedSophia | Acc: 90.31% | Loss: 0.2957 | Time: 40.98s | Max GPU Mem: 1506.95 MB
[2025-11-27 02:36:28] [Round 050] FedSophia | Acc: 89.10% | Loss: 0.3069 | Time: 65.82s | Max GPU Mem: 1507.58 MB
[2025-11-27 02:36:28] Saved to runs/run_20251127_001404_resnet18_head/mnist/logs/FedSophia_head_mnist_resnet18_s1.npz
