[2025-11-27 06:03:56] Namespace(method='FedSophia', training_mode='head', dataset='fashionmnist', model_name='resnet18', seed=2, rounds=50, num_clients=10, fraction=0.5, local_epochs=1, batch_size=64, lr=0.01, newton_lr=0.1, sophia_lr=0.05, rho=0.04, betas='0.9,0.99', mu=0.01, log_dir='runs/run_20251127_001608_resnet18_head/fashionmnist/logs', optimizer='sgd', hessian_batches=32, damping=0.01, alpha=0.5)
[2025-11-27 06:03:56] Start: FedSophia | Mode: head | Dataset: fashionmnist | Device: cuda
[2025-11-27 06:07:04] [Round 001] FedSophia | Acc: 35.21% | Loss: 2.1204 | Time: 74.70s | Max GPU Mem: 1507.98 MB
[2025-11-27 06:08:06] [Round 002] FedSophia | Acc: 55.10% | Loss: 1.7984 | Time: 62.33s | Max GPU Mem: 1507.54 MB
[2025-11-27 06:09:27] [Round 003] FedSophia | Acc: 63.63% | Loss: 1.4515 | Time: 80.96s | Max GPU Mem: 1507.54 MB
[2025-11-27 06:10:37] [Round 004] FedSophia | Acc: 67.85% | Loss: 1.1687 | Time: 69.58s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:11:34] [Round 005] FedSophia | Acc: 70.10% | Loss: 0.9683 | Time: 57.68s | Max GPU Mem: 1508.08 MB
[2025-11-27 06:12:51] [Round 006] FedSophia | Acc: 71.51% | Loss: 0.8569 | Time: 76.22s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:14:11] [Round 007] FedSophia | Acc: 71.47% | Loss: 0.7975 | Time: 80.80s | Max GPU Mem: 1508.08 MB
[2025-11-27 06:15:17] [Round 008] FedSophia | Acc: 72.06% | Loss: 0.7554 | Time: 65.22s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:16:14] [Round 009] FedSophia | Acc: 72.69% | Loss: 0.7298 | Time: 57.69s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:17:08] [Round 010] FedSophia | Acc: 73.59% | Loss: 0.6945 | Time: 54.06s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:18:05] [Round 011] FedSophia | Acc: 74.81% | Loss: 0.6523 | Time: 56.42s | Max GPU Mem: 1507.45 MB
[2025-11-27 06:18:56] [Round 012] FedSophia | Acc: 76.62% | Loss: 0.6022 | Time: 51.37s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:19:51] [Round 013] FedSophia | Acc: 79.15% | Loss: 0.5583 | Time: 55.24s | Max GPU Mem: 1507.58 MB
[2025-11-27 06:20:44] [Round 014] FedSophia | Acc: 80.35% | Loss: 0.5401 | Time: 52.71s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:21:53] [Round 015] FedSophia | Acc: 80.99% | Loss: 0.5330 | Time: 69.38s | Max GPU Mem: 1507.58 MB
[2025-11-27 06:22:47] [Round 016] FedSophia | Acc: 81.67% | Loss: 0.5227 | Time: 53.63s | Max GPU Mem: 1507.58 MB
[2025-11-27 06:23:37] [Round 017] FedSophia | Acc: 82.29% | Loss: 0.5161 | Time: 49.58s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:24:42] [Round 018] FedSophia | Acc: 82.10% | Loss: 0.5162 | Time: 65.53s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:25:47] [Round 019] FedSophia | Acc: 81.93% | Loss: 0.5170 | Time: 64.84s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:27:04] [Round 020] FedSophia | Acc: 81.77% | Loss: 0.5182 | Time: 76.97s | Max GPU Mem: 1507.45 MB
[2025-11-27 06:28:05] [Round 021] FedSophia | Acc: 80.88% | Loss: 0.5276 | Time: 60.81s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:29:05] [Round 022] FedSophia | Acc: 79.65% | Loss: 0.5493 | Time: 59.81s | Max GPU Mem: 1507.45 MB
[2025-11-27 06:30:16] [Round 023] FedSophia | Acc: 78.55% | Loss: 0.5807 | Time: 71.19s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:31:21] [Round 024] FedSophia | Acc: 78.01% | Loss: 0.6074 | Time: 65.50s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:32:16] [Round 025] FedSophia | Acc: 77.97% | Loss: 0.6079 | Time: 54.80s | Max GPU Mem: 1507.45 MB
[2025-11-27 06:33:05] [Round 026] FedSophia | Acc: 79.03% | Loss: 0.5765 | Time: 48.52s | Max GPU Mem: 1508.08 MB
[2025-11-27 06:34:18] [Round 027] FedSophia | Acc: 80.27% | Loss: 0.5458 | Time: 73.19s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:35:05] [Round 028] FedSophia | Acc: 80.89% | Loss: 0.5299 | Time: 47.30s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:35:56] [Round 029] FedSophia | Acc: 82.00% | Loss: 0.5000 | Time: 50.40s | Max GPU Mem: 1508.08 MB
[2025-11-27 06:37:03] [Round 030] FedSophia | Acc: 82.67% | Loss: 0.4780 | Time: 66.90s | Max GPU Mem: 1507.58 MB
[2025-11-27 06:37:59] [Round 031] FedSophia | Acc: 83.07% | Loss: 0.4677 | Time: 56.09s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:38:58] [Round 032] FedSophia | Acc: 83.00% | Loss: 0.4664 | Time: 59.18s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:39:58] [Round 033] FedSophia | Acc: 83.07% | Loss: 0.4645 | Time: 60.44s | Max GPU Mem: 1508.08 MB
[2025-11-27 06:40:20] [Round 034] FedSophia | Acc: 83.00% | Loss: 0.4613 | Time: 22.22s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:40:38] [Round 035] FedSophia | Acc: 83.28% | Loss: 0.4577 | Time: 17.40s | Max GPU Mem: 1508.08 MB
[2025-11-27 06:40:57] [Round 036] FedSophia | Acc: 83.49% | Loss: 0.4540 | Time: 19.30s | Max GPU Mem: 1507.45 MB
[2025-11-27 06:41:18] [Round 037] FedSophia | Acc: 83.39% | Loss: 0.4584 | Time: 20.96s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:41:38] [Round 038] FedSophia | Acc: 83.33% | Loss: 0.4584 | Time: 19.48s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:41:57] [Round 039] FedSophia | Acc: 83.59% | Loss: 0.4525 | Time: 19.07s | Max GPU Mem: 1507.58 MB
[2025-11-27 06:42:51] [Round 040] FedSophia | Acc: 83.46% | Loss: 0.4527 | Time: 53.85s | Max GPU Mem: 1507.58 MB
[2025-11-27 06:43:41] [Round 041] FedSophia | Acc: 83.40% | Loss: 0.4507 | Time: 50.77s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:44:01] [Round 042] FedSophia | Acc: 83.66% | Loss: 0.4416 | Time: 20.14s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:44:22] [Round 043] FedSophia | Acc: 84.41% | Loss: 0.4270 | Time: 20.99s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:44:43] [Round 044] FedSophia | Acc: 85.12% | Loss: 0.4164 | Time: 20.22s | Max GPU Mem: 1507.58 MB
[2025-11-27 06:45:03] [Round 045] FedSophia | Acc: 85.00% | Loss: 0.4186 | Time: 20.59s | Max GPU Mem: 1507.58 MB
[2025-11-27 06:45:24] [Round 046] FedSophia | Acc: 84.94% | Loss: 0.4214 | Time: 20.37s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:45:49] [Round 047] FedSophia | Acc: 84.96% | Loss: 0.4217 | Time: 25.61s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:46:51] [Round 048] FedSophia | Acc: 84.87% | Loss: 0.4226 | Time: 62.25s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:48:02] [Round 049] FedSophia | Acc: 84.36% | Loss: 0.4295 | Time: 70.57s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:48:57] [Round 050] FedSophia | Acc: 84.33% | Loss: 0.4313 | Time: 54.71s | Max GPU Mem: 1507.58 MB
[2025-11-27 06:48:57] Saved to runs/run_20251127_001608_resnet18_head/fashionmnist/logs/FedSophia_head_fashionmnist_resnet18_s2.npz
