[2025-11-27 06:12:55] Namespace(method='FedSophia', training_mode='head', dataset='fashionmnist', model_name='resnet18', seed=1, rounds=50, num_clients=10, fraction=0.5, local_epochs=1, batch_size=64, lr=0.01, newton_lr=0.1, sophia_lr=0.05, rho=0.04, betas='0.9,0.99', mu=0.01, log_dir='runs/run_20251127_001740_resnet18_head/fashionmnist/logs', optimizer='sgd', hessian_batches=32, damping=0.01, alpha=10.0)
[2025-11-27 06:12:55] Start: FedSophia | Mode: head | Dataset: fashionmnist | Device: cuda
[2025-11-27 06:14:53] [Round 001] FedSophia | Acc: 44.56% | Loss: 2.0246 | Time: 24.53s | Max GPU Mem: 1507.98 MB
[2025-11-27 06:15:14] [Round 002] FedSophia | Acc: 73.81% | Loss: 1.6244 | Time: 20.95s | Max GPU Mem: 1507.56 MB
[2025-11-27 06:15:37] [Round 003] FedSophia | Acc: 78.17% | Loss: 1.2180 | Time: 23.02s | Max GPU Mem: 1507.56 MB
[2025-11-27 06:16:00] [Round 004] FedSophia | Acc: 79.10% | Loss: 0.9209 | Time: 23.31s | Max GPU Mem: 1506.93 MB
[2025-11-27 06:17:04] [Round 005] FedSophia | Acc: 79.39% | Loss: 0.7434 | Time: 63.84s | Max GPU Mem: 1508.06 MB
[2025-11-27 06:17:51] [Round 006] FedSophia | Acc: 79.48% | Loss: 0.6481 | Time: 46.43s | Max GPU Mem: 1506.93 MB
[2025-11-27 06:18:43] [Round 007] FedSophia | Acc: 79.73% | Loss: 0.5975 | Time: 52.20s | Max GPU Mem: 1508.08 MB
[2025-11-27 06:19:47] [Round 008] FedSophia | Acc: 80.05% | Loss: 0.5697 | Time: 64.29s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:20:55] [Round 009] FedSophia | Acc: 80.40% | Loss: 0.5537 | Time: 67.76s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:21:50] [Round 010] FedSophia | Acc: 80.88% | Loss: 0.5437 | Time: 55.26s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:23:00] [Round 011] FedSophia | Acc: 81.27% | Loss: 0.5365 | Time: 69.44s | Max GPU Mem: 1507.45 MB
[2025-11-27 06:23:55] [Round 012] FedSophia | Acc: 81.64% | Loss: 0.5310 | Time: 55.25s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:25:04] [Round 013] FedSophia | Acc: 81.91% | Loss: 0.5262 | Time: 69.09s | Max GPU Mem: 1507.58 MB
[2025-11-27 06:26:07] [Round 014] FedSophia | Acc: 82.19% | Loss: 0.5212 | Time: 63.29s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:27:18] [Round 015] FedSophia | Acc: 82.30% | Loss: 0.5160 | Time: 70.70s | Max GPU Mem: 1507.58 MB
[2025-11-27 06:28:28] [Round 016] FedSophia | Acc: 82.55% | Loss: 0.5101 | Time: 70.21s | Max GPU Mem: 1507.58 MB
[2025-11-27 06:29:33] [Round 017] FedSophia | Acc: 82.77% | Loss: 0.5033 | Time: 65.00s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:30:44] [Round 018] FedSophia | Acc: 82.99% | Loss: 0.4960 | Time: 70.42s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:31:41] [Round 019] FedSophia | Acc: 83.10% | Loss: 0.4889 | Time: 57.60s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:32:43] [Round 020] FedSophia | Acc: 83.24% | Loss: 0.4823 | Time: 61.88s | Max GPU Mem: 1507.45 MB
[2025-11-27 06:33:42] [Round 021] FedSophia | Acc: 83.52% | Loss: 0.4757 | Time: 59.29s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:34:38] [Round 022] FedSophia | Acc: 83.69% | Loss: 0.4694 | Time: 56.04s | Max GPU Mem: 1507.45 MB
[2025-11-27 06:35:34] [Round 023] FedSophia | Acc: 84.03% | Loss: 0.4635 | Time: 55.72s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:36:34] [Round 024] FedSophia | Acc: 84.37% | Loss: 0.4583 | Time: 59.55s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:37:35] [Round 025] FedSophia | Acc: 84.54% | Loss: 0.4537 | Time: 61.25s | Max GPU Mem: 1507.45 MB
[2025-11-27 06:38:31] [Round 026] FedSophia | Acc: 84.63% | Loss: 0.4498 | Time: 55.56s | Max GPU Mem: 1508.08 MB
[2025-11-27 06:39:23] [Round 027] FedSophia | Acc: 84.67% | Loss: 0.4462 | Time: 52.29s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:40:14] [Round 028] FedSophia | Acc: 84.77% | Loss: 0.4424 | Time: 51.14s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:41:13] [Round 029] FedSophia | Acc: 84.95% | Loss: 0.4382 | Time: 59.01s | Max GPU Mem: 1508.08 MB
[2025-11-27 06:42:03] [Round 030] FedSophia | Acc: 84.99% | Loss: 0.4343 | Time: 49.68s | Max GPU Mem: 1507.58 MB
[2025-11-27 06:43:03] [Round 031] FedSophia | Acc: 85.13% | Loss: 0.4304 | Time: 60.62s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:44:03] [Round 032] FedSophia | Acc: 85.10% | Loss: 0.4266 | Time: 60.06s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:44:57] [Round 033] FedSophia | Acc: 85.17% | Loss: 0.4232 | Time: 53.23s | Max GPU Mem: 1508.08 MB
[2025-11-27 06:45:58] [Round 034] FedSophia | Acc: 85.31% | Loss: 0.4202 | Time: 61.26s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:46:50] [Round 035] FedSophia | Acc: 85.35% | Loss: 0.4174 | Time: 52.10s | Max GPU Mem: 1508.08 MB
[2025-11-27 06:47:48] [Round 036] FedSophia | Acc: 85.46% | Loss: 0.4147 | Time: 58.02s | Max GPU Mem: 1507.45 MB
[2025-11-27 06:48:42] [Round 037] FedSophia | Acc: 85.57% | Loss: 0.4121 | Time: 54.59s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:49:42] [Round 038] FedSophia | Acc: 85.72% | Loss: 0.4093 | Time: 59.49s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:50:32] [Round 039] FedSophia | Acc: 85.81% | Loss: 0.4064 | Time: 50.34s | Max GPU Mem: 1507.58 MB
[2025-11-27 06:51:20] [Round 040] FedSophia | Acc: 85.87% | Loss: 0.4035 | Time: 47.46s | Max GPU Mem: 1507.58 MB
[2025-11-27 06:52:14] [Round 041] FedSophia | Acc: 85.87% | Loss: 0.4009 | Time: 54.44s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:53:10] [Round 042] FedSophia | Acc: 86.03% | Loss: 0.3985 | Time: 55.51s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:54:03] [Round 043] FedSophia | Acc: 86.07% | Loss: 0.3965 | Time: 53.26s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:54:42] [Round 044] FedSophia | Acc: 85.98% | Loss: 0.3944 | Time: 39.10s | Max GPU Mem: 1507.58 MB
[2025-11-27 06:55:02] [Round 045] FedSophia | Acc: 86.07% | Loss: 0.3924 | Time: 20.14s | Max GPU Mem: 1507.58 MB
[2025-11-27 06:55:23] [Round 046] FedSophia | Acc: 86.26% | Loss: 0.3904 | Time: 20.89s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:55:43] [Round 047] FedSophia | Acc: 86.31% | Loss: 0.3886 | Time: 19.60s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:56:02] [Round 048] FedSophia | Acc: 86.48% | Loss: 0.3869 | Time: 19.54s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:56:23] [Round 049] FedSophia | Acc: 86.52% | Loss: 0.3852 | Time: 20.29s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:56:52] [Round 050] FedSophia | Acc: 86.52% | Loss: 0.3838 | Time: 29.78s | Max GPU Mem: 1507.58 MB
[2025-11-27 06:56:52] Saved to runs/run_20251127_001740_resnet18_head/fashionmnist/logs/FedSophia_head_fashionmnist_resnet18_s1.npz
