[2025-11-27 05:59:23] Namespace(method='FedSophia', training_mode='head', dataset='fashionmnist', model_name='resnet18', seed=1, rounds=50, num_clients=10, fraction=0.5, local_epochs=1, batch_size=64, lr=0.01, newton_lr=0.1, sophia_lr=0.05, rho=0.04, betas='0.9,0.99', mu=0.01, log_dir='runs/run_20251127_001608_resnet18_head/fashionmnist/logs', optimizer='sgd', hessian_batches=32, damping=0.01, alpha=0.5)
[2025-11-27 05:59:23] Start: FedSophia | Mode: head | Dataset: fashionmnist | Device: cuda
[2025-11-27 06:02:19] [Round 001] FedSophia | Acc: 33.91% | Loss: 2.1124 | Time: 62.13s | Max GPU Mem: 1507.98 MB
[2025-11-27 06:03:48] [Round 002] FedSophia | Acc: 64.04% | Loss: 1.8158 | Time: 88.83s | Max GPU Mem: 1507.54 MB
[2025-11-27 06:04:08] [Round 003] FedSophia | Acc: 70.89% | Loss: 1.4832 | Time: 19.38s | Max GPU Mem: 1507.56 MB
[2025-11-27 06:04:25] [Round 004] FedSophia | Acc: 69.99% | Loss: 1.2071 | Time: 17.66s | Max GPU Mem: 1506.93 MB
[2025-11-27 06:04:46] [Round 005] FedSophia | Acc: 69.66% | Loss: 1.0067 | Time: 20.43s | Max GPU Mem: 1508.08 MB
[2025-11-27 06:05:05] [Round 006] FedSophia | Acc: 70.22% | Loss: 0.8784 | Time: 19.32s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:05:22] [Round 007] FedSophia | Acc: 72.77% | Loss: 0.7758 | Time: 17.48s | Max GPU Mem: 1508.08 MB
[2025-11-27 06:05:47] [Round 008] FedSophia | Acc: 74.67% | Loss: 0.7030 | Time: 24.11s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:06:40] [Round 009] FedSophia | Acc: 76.50% | Loss: 0.6506 | Time: 53.95s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:07:24] [Round 010] FedSophia | Acc: 78.44% | Loss: 0.6092 | Time: 43.59s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:08:07] [Round 011] FedSophia | Acc: 79.63% | Loss: 0.5774 | Time: 42.50s | Max GPU Mem: 1507.45 MB
[2025-11-27 06:08:55] [Round 012] FedSophia | Acc: 80.18% | Loss: 0.5630 | Time: 48.32s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:09:42] [Round 013] FedSophia | Acc: 80.49% | Loss: 0.5557 | Time: 47.22s | Max GPU Mem: 1507.58 MB
[2025-11-27 06:10:35] [Round 014] FedSophia | Acc: 80.39% | Loss: 0.5532 | Time: 53.28s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:11:31] [Round 015] FedSophia | Acc: 80.05% | Loss: 0.5561 | Time: 56.08s | Max GPU Mem: 1507.58 MB
[2025-11-27 06:12:18] [Round 016] FedSophia | Acc: 80.34% | Loss: 0.5524 | Time: 46.90s | Max GPU Mem: 1507.58 MB
[2025-11-27 06:13:29] [Round 017] FedSophia | Acc: 80.87% | Loss: 0.5378 | Time: 70.93s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:14:24] [Round 018] FedSophia | Acc: 81.53% | Loss: 0.5249 | Time: 54.40s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:15:16] [Round 019] FedSophia | Acc: 81.92% | Loss: 0.5157 | Time: 52.24s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:16:17] [Round 020] FedSophia | Acc: 81.76% | Loss: 0.5147 | Time: 60.85s | Max GPU Mem: 1507.45 MB
[2025-11-27 06:17:10] [Round 021] FedSophia | Acc: 82.01% | Loss: 0.5181 | Time: 52.88s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:18:05] [Round 022] FedSophia | Acc: 81.63% | Loss: 0.5318 | Time: 55.62s | Max GPU Mem: 1507.45 MB
[2025-11-27 06:18:59] [Round 023] FedSophia | Acc: 81.54% | Loss: 0.5360 | Time: 54.08s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:19:58] [Round 024] FedSophia | Acc: 82.03% | Loss: 0.5240 | Time: 58.71s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:21:19] [Round 025] FedSophia | Acc: 82.41% | Loss: 0.5149 | Time: 81.16s | Max GPU Mem: 1507.45 MB
[2025-11-27 06:22:17] [Round 026] FedSophia | Acc: 82.86% | Loss: 0.4999 | Time: 58.02s | Max GPU Mem: 1508.08 MB
[2025-11-27 06:23:28] [Round 027] FedSophia | Acc: 83.44% | Loss: 0.4822 | Time: 70.51s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:24:40] [Round 028] FedSophia | Acc: 83.49% | Loss: 0.4728 | Time: 72.11s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:25:46] [Round 029] FedSophia | Acc: 83.71% | Loss: 0.4664 | Time: 66.38s | Max GPU Mem: 1508.08 MB
[2025-11-27 06:27:04] [Round 030] FedSophia | Acc: 83.73% | Loss: 0.4638 | Time: 77.85s | Max GPU Mem: 1507.58 MB
[2025-11-27 06:28:58] [Round 031] FedSophia | Acc: 83.81% | Loss: 0.4600 | Time: 113.78s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:29:59] [Round 032] FedSophia | Acc: 83.97% | Loss: 0.4541 | Time: 61.01s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:31:16] [Round 033] FedSophia | Acc: 84.12% | Loss: 0.4503 | Time: 76.66s | Max GPU Mem: 1508.08 MB
[2025-11-27 06:32:20] [Round 034] FedSophia | Acc: 84.36% | Loss: 0.4453 | Time: 64.14s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:33:26] [Round 035] FedSophia | Acc: 84.52% | Loss: 0.4425 | Time: 66.04s | Max GPU Mem: 1508.08 MB
[2025-11-27 06:34:23] [Round 036] FedSophia | Acc: 84.79% | Loss: 0.4367 | Time: 57.25s | Max GPU Mem: 1507.45 MB
[2025-11-27 06:35:13] [Round 037] FedSophia | Acc: 85.01% | Loss: 0.4315 | Time: 50.39s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:36:03] [Round 038] FedSophia | Acc: 85.00% | Loss: 0.4322 | Time: 49.74s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:36:55] [Round 039] FedSophia | Acc: 85.02% | Loss: 0.4316 | Time: 52.29s | Max GPU Mem: 1507.58 MB
[2025-11-27 06:37:49] [Round 040] FedSophia | Acc: 85.13% | Loss: 0.4299 | Time: 53.21s | Max GPU Mem: 1507.58 MB
[2025-11-27 06:38:45] [Round 041] FedSophia | Acc: 85.14% | Loss: 0.4291 | Time: 56.29s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:39:39] [Round 042] FedSophia | Acc: 85.21% | Loss: 0.4264 | Time: 53.69s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:40:16] [Round 043] FedSophia | Acc: 85.24% | Loss: 0.4245 | Time: 37.48s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:40:33] [Round 044] FedSophia | Acc: 85.39% | Loss: 0.4211 | Time: 17.27s | Max GPU Mem: 1507.58 MB
[2025-11-27 06:40:49] [Round 045] FedSophia | Acc: 85.49% | Loss: 0.4180 | Time: 15.98s | Max GPU Mem: 1507.58 MB
[2025-11-27 06:41:12] [Round 046] FedSophia | Acc: 85.66% | Loss: 0.4175 | Time: 22.68s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:41:31] [Round 047] FedSophia | Acc: 85.66% | Loss: 0.4154 | Time: 19.04s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:41:51] [Round 048] FedSophia | Acc: 85.58% | Loss: 0.4147 | Time: 20.11s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:42:50] [Round 049] FedSophia | Acc: 85.63% | Loss: 0.4125 | Time: 59.06s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:43:42] [Round 050] FedSophia | Acc: 85.44% | Loss: 0.4135 | Time: 52.18s | Max GPU Mem: 1507.58 MB
[2025-11-27 06:43:42] Saved to runs/run_20251127_001608_resnet18_head/fashionmnist/logs/FedSophia_head_fashionmnist_resnet18_s1.npz
