[2025-11-27 12:16:52] Namespace(method='FedSophia', training_mode='head', dataset='cifar10', model_name='resnet18', seed=1, rounds=50, num_clients=10, fraction=0.5, local_epochs=1, batch_size=64, lr=0.01, newton_lr=0.1, sophia_lr=0.05, rho=0.04, betas='0.9,0.99', mu=0.01, log_dir='runs/run_20251127_103732_resnet18_head/cifar10/logs', optimizer='sgd', hessian_batches=32, damping=0.01, alpha=0.1, max_norm=1.0)
[2025-11-27 12:16:52] Start: FedSophia | Mode: head | Dataset: cifar10 | Device: cuda
[2025-11-27 12:19:06] [Round 001] FedSophia | Acc: 22.90% | Loss: 2.2497 | Time: 20.53s | Max GPU Mem: 1482.35 MB
[2025-11-27 12:19:25] [Round 002] FedSophia | Acc: 27.53% | Loss: 2.1573 | Time: 19.17s | Max GPU Mem: 1482.39 MB
[2025-11-27 12:19:49] [Round 003] FedSophia | Acc: 48.30% | Loss: 1.9361 | Time: 24.71s | Max GPU Mem: 1482.43 MB
[2025-11-27 12:20:13] [Round 004] FedSophia | Acc: 49.23% | Loss: 1.7418 | Time: 23.55s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:21:29] [Round 005] FedSophia | Acc: 43.10% | Loss: 1.6268 | Time: 76.54s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:23:03] [Round 006] FedSophia | Acc: 41.11% | Loss: 1.5341 | Time: 93.46s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:23:55] [Round 007] FedSophia | Acc: 42.38% | Loss: 1.4721 | Time: 51.73s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:24:51] [Round 008] FedSophia | Acc: 43.53% | Loss: 1.4430 | Time: 56.32s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:25:49] [Round 009] FedSophia | Acc: 47.75% | Loss: 1.3168 | Time: 57.82s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:26:46] [Round 010] FedSophia | Acc: 51.60% | Loss: 1.2186 | Time: 57.68s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:27:34] [Round 011] FedSophia | Acc: 56.57% | Loss: 1.1225 | Time: 47.04s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:28:26] [Round 012] FedSophia | Acc: 63.90% | Loss: 0.9746 | Time: 52.13s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:29:00] [Round 013] FedSophia | Acc: 70.95% | Loss: 0.8081 | Time: 34.06s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:29:40] [Round 014] FedSophia | Acc: 75.17% | Loss: 0.7178 | Time: 40.53s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:30:55] [Round 015] FedSophia | Acc: 77.39% | Loss: 0.6633 | Time: 74.96s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:31:49] [Round 016] FedSophia | Acc: 78.07% | Loss: 0.6434 | Time: 53.85s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:32:40] [Round 017] FedSophia | Acc: 77.71% | Loss: 0.6538 | Time: 51.26s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:33:24] [Round 018] FedSophia | Acc: 76.95% | Loss: 0.6754 | Time: 44.04s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:34:00] [Round 019] FedSophia | Acc: 75.23% | Loss: 0.7153 | Time: 36.01s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:34:53] [Round 020] FedSophia | Acc: 73.47% | Loss: 0.7624 | Time: 52.77s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:35:24] [Round 021] FedSophia | Acc: 73.48% | Loss: 0.7667 | Time: 31.24s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:36:28] [Round 022] FedSophia | Acc: 75.25% | Loss: 0.7141 | Time: 63.46s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:37:03] [Round 023] FedSophia | Acc: 75.32% | Loss: 0.7062 | Time: 35.54s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:37:55] [Round 024] FedSophia | Acc: 74.63% | Loss: 0.7075 | Time: 52.07s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:38:58] [Round 025] FedSophia | Acc: 72.34% | Loss: 0.7601 | Time: 62.10s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:39:33] [Round 026] FedSophia | Acc: 71.67% | Loss: 0.7876 | Time: 35.36s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:40:32] [Round 027] FedSophia | Acc: 71.24% | Loss: 0.8344 | Time: 59.15s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:41:25] [Round 028] FedSophia | Acc: 69.81% | Loss: 0.9241 | Time: 52.77s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:42:20] [Round 029] FedSophia | Acc: 69.06% | Loss: 0.9563 | Time: 55.21s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:43:02] [Round 030] FedSophia | Acc: 70.52% | Loss: 0.8933 | Time: 42.21s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:44:15] [Round 031] FedSophia | Acc: 72.35% | Loss: 0.8217 | Time: 72.26s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:44:59] [Round 032] FedSophia | Acc: 75.83% | Loss: 0.7130 | Time: 44.77s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:46:03] [Round 033] FedSophia | Acc: 78.00% | Loss: 0.6401 | Time: 63.41s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:47:17] [Round 034] FedSophia | Acc: 77.71% | Loss: 0.6474 | Time: 74.35s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:48:23] [Round 035] FedSophia | Acc: 77.59% | Loss: 0.6456 | Time: 65.51s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:49:30] [Round 036] FedSophia | Acc: 78.13% | Loss: 0.6199 | Time: 67.38s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:50:03] [Round 037] FedSophia | Acc: 78.86% | Loss: 0.5868 | Time: 32.80s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:50:42] [Round 038] FedSophia | Acc: 79.82% | Loss: 0.5611 | Time: 38.91s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:52:11] [Round 039] FedSophia | Acc: 79.76% | Loss: 0.5636 | Time: 88.94s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:53:09] [Round 040] FedSophia | Acc: 79.36% | Loss: 0.5799 | Time: 58.71s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:54:05] [Round 041] FedSophia | Acc: 79.36% | Loss: 0.5821 | Time: 55.42s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:55:00] [Round 042] FedSophia | Acc: 79.71% | Loss: 0.5759 | Time: 55.60s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:55:53] [Round 043] FedSophia | Acc: 80.15% | Loss: 0.5611 | Time: 53.10s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:56:34] [Round 044] FedSophia | Acc: 80.56% | Loss: 0.5500 | Time: 40.41s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:57:11] [Round 045] FedSophia | Acc: 80.09% | Loss: 0.5622 | Time: 36.99s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:57:53] [Round 046] FedSophia | Acc: 79.87% | Loss: 0.5782 | Time: 42.10s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:59:11] [Round 047] FedSophia | Acc: 78.75% | Loss: 0.6104 | Time: 78.18s | Max GPU Mem: 1482.45 MB
[2025-11-27 13:00:33] [Round 048] FedSophia | Acc: 78.12% | Loss: 0.6302 | Time: 81.62s | Max GPU Mem: 1482.45 MB
[2025-11-27 13:01:34] [Round 049] FedSophia | Acc: 78.80% | Loss: 0.6150 | Time: 61.16s | Max GPU Mem: 1482.45 MB
[2025-11-27 13:02:33] [Round 050] FedSophia | Acc: 79.57% | Loss: 0.5816 | Time: 58.77s | Max GPU Mem: 1482.45 MB
[2025-11-27 13:02:33] Saved to runs/run_20251127_103732_resnet18_head/cifar10/logs/FedSophia_head_cifar10_resnet18_s1.npz
