[2025-11-27 06:09:23] Namespace(method='FedSophia', training_mode='head', dataset='fashionmnist', model_name='resnet18', seed=0, rounds=50, num_clients=10, fraction=0.5, local_epochs=1, batch_size=64, lr=0.01, newton_lr=0.1, sophia_lr=0.05, rho=0.04, betas='0.9,0.99', mu=0.01, log_dir='runs/run_20251127_001740_resnet18_head/fashionmnist/logs', optimizer='sgd', hessian_batches=32, damping=0.01, alpha=10.0)
[2025-11-27 06:09:23] Start: FedSophia | Mode: head | Dataset: fashionmnist | Device: cuda
[2025-11-27 06:12:35] [Round 001] FedSophia | Acc: 51.02% | Loss: 2.0568 | Time: 79.18s | Max GPU Mem: 1507.98 MB
[2025-11-27 06:13:03] [Round 002] FedSophia | Acc: 74.08% | Loss: 1.6440 | Time: 27.83s | Max GPU Mem: 1507.54 MB
[2025-11-27 06:13:26] [Round 003] FedSophia | Acc: 78.75% | Loss: 1.2255 | Time: 22.41s | Max GPU Mem: 1507.56 MB
[2025-11-27 06:13:46] [Round 004] FedSophia | Acc: 79.80% | Loss: 0.9197 | Time: 20.26s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:14:05] [Round 005] FedSophia | Acc: 79.70% | Loss: 0.7378 | Time: 19.40s | Max GPU Mem: 1508.08 MB
[2025-11-27 06:14:18] [Round 006] FedSophia | Acc: 79.68% | Loss: 0.6410 | Time: 12.56s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:14:30] [Round 007] FedSophia | Acc: 79.80% | Loss: 0.5916 | Time: 12.20s | Max GPU Mem: 1508.08 MB
[2025-11-27 06:14:54] [Round 008] FedSophia | Acc: 80.05% | Loss: 0.5663 | Time: 23.70s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:15:15] [Round 009] FedSophia | Acc: 80.50% | Loss: 0.5522 | Time: 21.48s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:15:38] [Round 010] FedSophia | Acc: 80.96% | Loss: 0.5434 | Time: 22.45s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:16:00] [Round 011] FedSophia | Acc: 81.42% | Loss: 0.5365 | Time: 21.95s | Max GPU Mem: 1507.45 MB
[2025-11-27 06:17:10] [Round 012] FedSophia | Acc: 81.83% | Loss: 0.5312 | Time: 70.93s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:18:20] [Round 013] FedSophia | Acc: 82.13% | Loss: 0.5266 | Time: 69.71s | Max GPU Mem: 1507.58 MB
[2025-11-27 06:19:20] [Round 014] FedSophia | Acc: 82.30% | Loss: 0.5221 | Time: 59.90s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:20:22] [Round 015] FedSophia | Acc: 82.27% | Loss: 0.5171 | Time: 62.34s | Max GPU Mem: 1507.58 MB
[2025-11-27 06:21:15] [Round 016] FedSophia | Acc: 82.54% | Loss: 0.5117 | Time: 52.97s | Max GPU Mem: 1507.58 MB
[2025-11-27 06:22:08] [Round 017] FedSophia | Acc: 82.87% | Loss: 0.5055 | Time: 52.29s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:23:03] [Round 018] FedSophia | Acc: 82.95% | Loss: 0.4989 | Time: 55.19s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:24:12] [Round 019] FedSophia | Acc: 83.06% | Loss: 0.4926 | Time: 68.83s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:25:07] [Round 020] FedSophia | Acc: 83.15% | Loss: 0.4866 | Time: 55.41s | Max GPU Mem: 1507.45 MB
[2025-11-27 06:26:03] [Round 021] FedSophia | Acc: 83.42% | Loss: 0.4806 | Time: 55.86s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:26:50] [Round 022] FedSophia | Acc: 83.63% | Loss: 0.4748 | Time: 46.72s | Max GPU Mem: 1507.45 MB
[2025-11-27 06:27:38] [Round 023] FedSophia | Acc: 83.91% | Loss: 0.4697 | Time: 48.09s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:28:30] [Round 024] FedSophia | Acc: 84.04% | Loss: 0.4647 | Time: 52.20s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:29:24] [Round 025] FedSophia | Acc: 84.18% | Loss: 0.4594 | Time: 54.43s | Max GPU Mem: 1507.45 MB
[2025-11-27 06:30:12] [Round 026] FedSophia | Acc: 84.37% | Loss: 0.4541 | Time: 47.99s | Max GPU Mem: 1508.08 MB
[2025-11-27 06:30:55] [Round 027] FedSophia | Acc: 84.48% | Loss: 0.4490 | Time: 42.50s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:31:59] [Round 028] FedSophia | Acc: 84.65% | Loss: 0.4445 | Time: 63.96s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:33:00] [Round 029] FedSophia | Acc: 84.71% | Loss: 0.4403 | Time: 60.93s | Max GPU Mem: 1508.08 MB
[2025-11-27 06:34:13] [Round 030] FedSophia | Acc: 84.77% | Loss: 0.4364 | Time: 72.78s | Max GPU Mem: 1507.58 MB
[2025-11-27 06:35:34] [Round 031] FedSophia | Acc: 84.81% | Loss: 0.4326 | Time: 81.65s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:36:40] [Round 032] FedSophia | Acc: 84.93% | Loss: 0.4292 | Time: 65.60s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:37:56] [Round 033] FedSophia | Acc: 85.04% | Loss: 0.4258 | Time: 75.77s | Max GPU Mem: 1508.08 MB
[2025-11-27 06:39:00] [Round 034] FedSophia | Acc: 85.14% | Loss: 0.4225 | Time: 64.51s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:40:09] [Round 035] FedSophia | Acc: 85.16% | Loss: 0.4192 | Time: 68.89s | Max GPU Mem: 1508.08 MB
[2025-11-27 06:41:08] [Round 036] FedSophia | Acc: 85.34% | Loss: 0.4160 | Time: 58.67s | Max GPU Mem: 1507.45 MB
[2025-11-27 06:42:18] [Round 037] FedSophia | Acc: 85.52% | Loss: 0.4130 | Time: 70.30s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:43:24] [Round 038] FedSophia | Acc: 85.60% | Loss: 0.4100 | Time: 66.13s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:44:14] [Round 039] FedSophia | Acc: 85.71% | Loss: 0.4069 | Time: 49.77s | Max GPU Mem: 1507.58 MB
[2025-11-27 06:45:09] [Round 040] FedSophia | Acc: 85.82% | Loss: 0.4040 | Time: 55.24s | Max GPU Mem: 1507.58 MB
[2025-11-27 06:46:01] [Round 041] FedSophia | Acc: 85.94% | Loss: 0.4012 | Time: 51.96s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:46:58] [Round 042] FedSophia | Acc: 86.03% | Loss: 0.3988 | Time: 57.04s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:47:55] [Round 043] FedSophia | Acc: 86.12% | Loss: 0.3965 | Time: 56.38s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:48:51] [Round 044] FedSophia | Acc: 86.17% | Loss: 0.3946 | Time: 56.89s | Max GPU Mem: 1507.58 MB
[2025-11-27 06:49:49] [Round 045] FedSophia | Acc: 86.23% | Loss: 0.3930 | Time: 57.39s | Max GPU Mem: 1507.58 MB
[2025-11-27 06:50:50] [Round 046] FedSophia | Acc: 86.22% | Loss: 0.3913 | Time: 61.68s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:51:46] [Round 047] FedSophia | Acc: 86.27% | Loss: 0.3895 | Time: 55.05s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:52:43] [Round 048] FedSophia | Acc: 86.29% | Loss: 0.3880 | Time: 57.26s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:53:41] [Round 049] FedSophia | Acc: 86.39% | Loss: 0.3863 | Time: 57.72s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:54:34] [Round 050] FedSophia | Acc: 86.40% | Loss: 0.3848 | Time: 53.18s | Max GPU Mem: 1507.58 MB
[2025-11-27 06:54:34] Saved to runs/run_20251127_001740_resnet18_head/fashionmnist/logs/FedSophia_head_fashionmnist_resnet18_s0.npz
