[2025-11-27 05:05:33] Namespace(method='FedSophia', training_mode='head', dataset='fashionmnist', model_name='resnet18', seed=1, rounds=50, num_clients=10, fraction=0.5, local_epochs=1, batch_size=64, lr=0.01, newton_lr=0.1, sophia_lr=0.05, rho=0.04, betas='0.9,0.99', mu=0.01, log_dir='runs/run_20251127_001404_resnet18_head/fashionmnist/logs', optimizer='sgd', hessian_batches=32, damping=0.01, alpha=0.1)
[2025-11-27 05:05:33] Start: FedSophia | Mode: head | Dataset: fashionmnist | Device: cuda
[2025-11-27 05:07:33] [Round 001] FedSophia | Acc: 16.72% | Loss: 2.2628 | Time: 7.94s | Max GPU Mem: 1507.98 MB
[2025-11-27 05:07:55] [Round 002] FedSophia | Acc: 15.54% | Loss: 2.1467 | Time: 22.73s | Max GPU Mem: 1507.52 MB
[2025-11-27 05:08:19] [Round 003] FedSophia | Acc: 18.72% | Loss: 2.0656 | Time: 23.36s | Max GPU Mem: 1507.52 MB
[2025-11-27 05:09:19] [Round 004] FedSophia | Acc: 32.43% | Loss: 2.0195 | Time: 60.01s | Max GPU Mem: 1506.91 MB
[2025-11-27 05:10:02] [Round 005] FedSophia | Acc: 35.71% | Loss: 1.9654 | Time: 43.74s | Max GPU Mem: 1508.04 MB
[2025-11-27 05:10:45] [Round 006] FedSophia | Acc: 39.35% | Loss: 1.9292 | Time: 42.84s | Max GPU Mem: 1506.91 MB
[2025-11-27 05:11:45] [Round 007] FedSophia | Acc: 41.55% | Loss: 1.9144 | Time: 59.63s | Max GPU Mem: 1508.06 MB
[2025-11-27 05:12:55] [Round 008] FedSophia | Acc: 43.83% | Loss: 1.7949 | Time: 70.10s | Max GPU Mem: 1506.93 MB
[2025-11-27 05:13:43] [Round 009] FedSophia | Acc: 46.53% | Loss: 1.6823 | Time: 48.18s | Max GPU Mem: 1506.93 MB
[2025-11-27 05:14:56] [Round 010] FedSophia | Acc: 48.44% | Loss: 1.6291 | Time: 73.01s | Max GPU Mem: 1506.93 MB
[2025-11-27 05:15:37] [Round 011] FedSophia | Acc: 52.64% | Loss: 1.3357 | Time: 41.10s | Max GPU Mem: 1507.45 MB
[2025-11-27 05:16:18] [Round 012] FedSophia | Acc: 59.90% | Loss: 1.0636 | Time: 40.39s | Max GPU Mem: 1506.95 MB
[2025-11-27 05:17:18] [Round 013] FedSophia | Acc: 66.43% | Loss: 0.8978 | Time: 59.97s | Max GPU Mem: 1507.58 MB
[2025-11-27 05:18:20] [Round 014] FedSophia | Acc: 70.55% | Loss: 0.8171 | Time: 62.75s | Max GPU Mem: 1506.95 MB
[2025-11-27 05:18:58] [Round 015] FedSophia | Acc: 71.05% | Loss: 0.7776 | Time: 37.81s | Max GPU Mem: 1507.58 MB
[2025-11-27 05:20:14] [Round 016] FedSophia | Acc: 69.53% | Loss: 0.7849 | Time: 75.46s | Max GPU Mem: 1507.58 MB
[2025-11-27 05:21:16] [Round 017] FedSophia | Acc: 69.82% | Loss: 0.7810 | Time: 61.97s | Max GPU Mem: 1506.95 MB
[2025-11-27 05:22:22] [Round 018] FedSophia | Acc: 69.99% | Loss: 0.7809 | Time: 66.17s | Max GPU Mem: 1506.95 MB
[2025-11-27 05:23:17] [Round 019] FedSophia | Acc: 72.26% | Loss: 0.7476 | Time: 54.87s | Max GPU Mem: 1506.95 MB
[2025-11-27 05:24:00] [Round 020] FedSophia | Acc: 73.99% | Loss: 0.7029 | Time: 43.63s | Max GPU Mem: 1507.45 MB
[2025-11-27 05:25:11] [Round 021] FedSophia | Acc: 74.10% | Loss: 0.6751 | Time: 70.96s | Max GPU Mem: 1506.95 MB
[2025-11-27 05:26:27] [Round 022] FedSophia | Acc: 73.91% | Loss: 0.6743 | Time: 75.90s | Max GPU Mem: 1507.45 MB
[2025-11-27 05:27:17] [Round 023] FedSophia | Acc: 74.16% | Loss: 0.6684 | Time: 49.93s | Max GPU Mem: 1506.95 MB
[2025-11-27 05:28:24] [Round 024] FedSophia | Acc: 75.25% | Loss: 0.6579 | Time: 66.87s | Max GPU Mem: 1506.95 MB
[2025-11-27 05:29:47] [Round 025] FedSophia | Acc: 76.48% | Loss: 0.6569 | Time: 83.46s | Max GPU Mem: 1507.45 MB
[2025-11-27 05:31:07] [Round 026] FedSophia | Acc: 77.44% | Loss: 0.6439 | Time: 79.94s | Max GPU Mem: 1508.08 MB
[2025-11-27 05:32:26] [Round 027] FedSophia | Acc: 78.11% | Loss: 0.6377 | Time: 79.00s | Max GPU Mem: 1506.95 MB
[2025-11-27 05:33:37] [Round 028] FedSophia | Acc: 78.50% | Loss: 0.6184 | Time: 70.79s | Max GPU Mem: 1506.95 MB
[2025-11-27 05:34:48] [Round 029] FedSophia | Acc: 78.81% | Loss: 0.6149 | Time: 70.82s | Max GPU Mem: 1508.08 MB
[2025-11-27 05:35:47] [Round 030] FedSophia | Acc: 79.05% | Loss: 0.6182 | Time: 58.89s | Max GPU Mem: 1507.58 MB
[2025-11-27 05:36:51] [Round 031] FedSophia | Acc: 80.26% | Loss: 0.5868 | Time: 63.69s | Max GPU Mem: 1506.95 MB
[2025-11-27 05:37:49] [Round 032] FedSophia | Acc: 79.55% | Loss: 0.5815 | Time: 58.54s | Max GPU Mem: 1506.95 MB
[2025-11-27 05:38:44] [Round 033] FedSophia | Acc: 78.79% | Loss: 0.5761 | Time: 54.96s | Max GPU Mem: 1508.08 MB
[2025-11-27 05:39:34] [Round 034] FedSophia | Acc: 78.88% | Loss: 0.5549 | Time: 49.69s | Max GPU Mem: 1506.95 MB
[2025-11-27 05:41:12] [Round 035] FedSophia | Acc: 78.58% | Loss: 0.5538 | Time: 98.01s | Max GPU Mem: 1508.08 MB
[2025-11-27 05:42:00] [Round 036] FedSophia | Acc: 78.76% | Loss: 0.5470 | Time: 48.33s | Max GPU Mem: 1507.45 MB
[2025-11-27 05:43:05] [Round 037] FedSophia | Acc: 78.96% | Loss: 0.5400 | Time: 64.62s | Max GPU Mem: 1506.95 MB
[2025-11-27 05:44:03] [Round 038] FedSophia | Acc: 80.65% | Loss: 0.5058 | Time: 58.80s | Max GPU Mem: 1506.95 MB
[2025-11-27 05:44:51] [Round 039] FedSophia | Acc: 81.81% | Loss: 0.4820 | Time: 47.86s | Max GPU Mem: 1507.58 MB
[2025-11-27 05:46:05] [Round 040] FedSophia | Acc: 82.73% | Loss: 0.4661 | Time: 73.98s | Max GPU Mem: 1507.58 MB
[2025-11-27 05:46:51] [Round 041] FedSophia | Acc: 82.05% | Loss: 0.4781 | Time: 45.33s | Max GPU Mem: 1506.95 MB
[2025-11-27 05:47:33] [Round 042] FedSophia | Acc: 81.91% | Loss: 0.4793 | Time: 42.07s | Max GPU Mem: 1506.95 MB
[2025-11-27 05:48:01] [Round 043] FedSophia | Acc: 80.24% | Loss: 0.5063 | Time: 28.45s | Max GPU Mem: 1506.95 MB
[2025-11-27 05:49:10] [Round 044] FedSophia | Acc: 79.49% | Loss: 0.5251 | Time: 69.12s | Max GPU Mem: 1507.58 MB
[2025-11-27 05:49:41] [Round 045] FedSophia | Acc: 76.02% | Loss: 0.5971 | Time: 30.42s | Max GPU Mem: 1507.58 MB
[2025-11-27 05:50:27] [Round 046] FedSophia | Acc: 75.96% | Loss: 0.5958 | Time: 45.90s | Max GPU Mem: 1506.95 MB
[2025-11-27 05:51:29] [Round 047] FedSophia | Acc: 75.85% | Loss: 0.6008 | Time: 62.55s | Max GPU Mem: 1506.95 MB
[2025-11-27 05:52:25] [Round 048] FedSophia | Acc: 77.24% | Loss: 0.5764 | Time: 55.96s | Max GPU Mem: 1506.95 MB
[2025-11-27 05:53:01] [Round 049] FedSophia | Acc: 80.09% | Loss: 0.5217 | Time: 35.99s | Max GPU Mem: 1506.95 MB
[2025-11-27 05:53:57] [Round 050] FedSophia | Acc: 81.39% | Loss: 0.5038 | Time: 56.14s | Max GPU Mem: 1507.58 MB
[2025-11-27 05:53:57] Saved to runs/run_20251127_001404_resnet18_head/fashionmnist/logs/FedSophia_head_fashionmnist_resnet18_s1.npz
