[2025-11-27 10:02:12] Namespace(method='FedSophia', training_mode='head', dataset='cifar10', model_name='resnet18', seed=0, rounds=50, num_clients=10, fraction=0.5, local_epochs=1, batch_size=64, lr=0.01, newton_lr=0.1, sophia_lr=0.05, rho=0.04, betas='0.9,0.99', mu=0.01, log_dir='runs/run_20251127_001608_resnet18_head/cifar10/logs', optimizer='sgd', hessian_batches=32, damping=0.01, alpha=0.5)
[2025-11-27 10:02:12] Start: FedSophia | Mode: head | Dataset: cifar10 | Device: cuda
[2025-11-27 10:04:32] [Round 001] FedSophia | Acc: 20.23% | Loss: 2.1977 | Time: 25.57s | Max GPU Mem: 1482.35 MB
[2025-11-27 10:04:56] [Round 002] FedSophia | Acc: 43.01% | Loss: 1.9343 | Time: 24.23s | Max GPU Mem: 1482.41 MB
[2025-11-27 10:05:28] [Round 003] FedSophia | Acc: 56.52% | Loss: 1.6287 | Time: 31.69s | Max GPU Mem: 1482.41 MB
[2025-11-27 10:05:49] [Round 004] FedSophia | Acc: 63.18% | Loss: 1.3603 | Time: 21.13s | Max GPU Mem: 1482.43 MB
[2025-11-27 10:06:15] [Round 005] FedSophia | Acc: 65.63% | Loss: 1.1707 | Time: 25.93s | Max GPU Mem: 1482.45 MB
[2025-11-27 10:06:38] [Round 006] FedSophia | Acc: 67.72% | Loss: 1.0355 | Time: 23.25s | Max GPU Mem: 1482.45 MB
[2025-11-27 10:07:04] [Round 007] FedSophia | Acc: 68.57% | Loss: 0.9488 | Time: 26.41s | Max GPU Mem: 1482.45 MB
[2025-11-27 10:07:35] [Round 008] FedSophia | Acc: 70.17% | Loss: 0.8626 | Time: 30.85s | Max GPU Mem: 1482.45 MB
[2025-11-27 10:08:36] [Round 009] FedSophia | Acc: 72.34% | Loss: 0.7896 | Time: 60.22s | Max GPU Mem: 1482.45 MB
[2025-11-27 10:09:17] [Round 010] FedSophia | Acc: 74.17% | Loss: 0.7284 | Time: 41.80s | Max GPU Mem: 1482.45 MB
[2025-11-27 10:10:23] [Round 011] FedSophia | Acc: 75.71% | Loss: 0.6824 | Time: 65.27s | Max GPU Mem: 1482.45 MB
[2025-11-27 10:11:25] [Round 012] FedSophia | Acc: 77.31% | Loss: 0.6419 | Time: 62.63s | Max GPU Mem: 1482.45 MB
[2025-11-27 10:12:11] [Round 013] FedSophia | Acc: 78.50% | Loss: 0.6095 | Time: 46.07s | Max GPU Mem: 1482.45 MB
[2025-11-27 10:13:04] [Round 014] FedSophia | Acc: 79.32% | Loss: 0.5932 | Time: 52.71s | Max GPU Mem: 1482.45 MB
[2025-11-27 10:13:58] [Round 015] FedSophia | Acc: 79.67% | Loss: 0.5848 | Time: 53.89s | Max GPU Mem: 1482.45 MB
[2025-11-27 10:14:54] [Round 016] FedSophia | Acc: 79.98% | Loss: 0.5800 | Time: 56.31s | Max GPU Mem: 1482.45 MB
[2025-11-27 10:15:51] [Round 017] FedSophia | Acc: 79.90% | Loss: 0.5818 | Time: 57.06s | Max GPU Mem: 1482.45 MB
[2025-11-27 10:16:38] [Round 018] FedSophia | Acc: 80.06% | Loss: 0.5830 | Time: 46.56s | Max GPU Mem: 1482.45 MB
[2025-11-27 10:17:21] [Round 019] FedSophia | Acc: 80.18% | Loss: 0.5813 | Time: 43.40s | Max GPU Mem: 1482.45 MB
[2025-11-27 10:18:06] [Round 020] FedSophia | Acc: 80.61% | Loss: 0.5735 | Time: 45.19s | Max GPU Mem: 1482.45 MB
[2025-11-27 10:18:51] [Round 021] FedSophia | Acc: 80.99% | Loss: 0.5570 | Time: 44.56s | Max GPU Mem: 1482.45 MB
[2025-11-27 10:20:03] [Round 022] FedSophia | Acc: 81.25% | Loss: 0.5473 | Time: 71.97s | Max GPU Mem: 1482.45 MB
[2025-11-27 10:21:01] [Round 023] FedSophia | Acc: 81.03% | Loss: 0.5481 | Time: 57.63s | Max GPU Mem: 1482.45 MB
[2025-11-27 10:21:56] [Round 024] FedSophia | Acc: 80.82% | Loss: 0.5557 | Time: 55.43s | Max GPU Mem: 1482.45 MB
[2025-11-27 10:22:44] [Round 025] FedSophia | Acc: 80.51% | Loss: 0.5606 | Time: 48.31s | Max GPU Mem: 1482.45 MB
[2025-11-27 10:23:30] [Round 026] FedSophia | Acc: 80.60% | Loss: 0.5607 | Time: 45.43s | Max GPU Mem: 1482.45 MB
[2025-11-27 10:24:20] [Round 027] FedSophia | Acc: 80.83% | Loss: 0.5569 | Time: 50.00s | Max GPU Mem: 1482.45 MB
[2025-11-27 10:25:00] [Round 028] FedSophia | Acc: 80.98% | Loss: 0.5481 | Time: 39.84s | Max GPU Mem: 1482.45 MB
[2025-11-27 10:25:59] [Round 029] FedSophia | Acc: 81.27% | Loss: 0.5430 | Time: 59.08s | Max GPU Mem: 1482.45 MB
[2025-11-27 10:26:54] [Round 030] FedSophia | Acc: 81.64% | Loss: 0.5341 | Time: 55.75s | Max GPU Mem: 1482.45 MB
[2025-11-27 10:28:01] [Round 031] FedSophia | Acc: 81.78% | Loss: 0.5295 | Time: 66.98s | Max GPU Mem: 1482.45 MB
[2025-11-27 10:28:58] [Round 032] FedSophia | Acc: 82.27% | Loss: 0.5192 | Time: 56.84s | Max GPU Mem: 1482.45 MB
[2025-11-27 10:29:58] [Round 033] FedSophia | Acc: 82.52% | Loss: 0.5103 | Time: 59.56s | Max GPU Mem: 1482.45 MB
[2025-11-27 10:30:51] [Round 034] FedSophia | Acc: 82.71% | Loss: 0.5019 | Time: 52.76s | Max GPU Mem: 1482.45 MB
[2025-11-27 10:31:53] [Round 035] FedSophia | Acc: 82.95% | Loss: 0.4947 | Time: 61.96s | Max GPU Mem: 1482.45 MB
[2025-11-27 10:32:51] [Round 036] FedSophia | Acc: 82.83% | Loss: 0.4931 | Time: 58.05s | Max GPU Mem: 1482.45 MB
[2025-11-27 10:33:49] [Round 037] FedSophia | Acc: 82.53% | Loss: 0.4971 | Time: 58.73s | Max GPU Mem: 1482.45 MB
[2025-11-27 10:34:33] [Round 038] FedSophia | Acc: 82.50% | Loss: 0.4976 | Time: 43.79s | Max GPU Mem: 1482.45 MB
[2025-11-27 10:35:24] [Round 039] FedSophia | Acc: 82.95% | Loss: 0.4883 | Time: 50.52s | Max GPU Mem: 1482.45 MB
[2025-11-27 10:36:21] [Round 040] FedSophia | Acc: 83.22% | Loss: 0.4807 | Time: 57.19s | Max GPU Mem: 1482.45 MB
[2025-11-27 10:37:13] [Round 041] FedSophia | Acc: 83.50% | Loss: 0.4718 | Time: 52.05s | Max GPU Mem: 1482.45 MB
[2025-11-27 10:38:16] [Round 042] FedSophia | Acc: 83.82% | Loss: 0.4649 | Time: 63.16s | Max GPU Mem: 1482.45 MB
[2025-11-27 10:39:11] [Round 043] FedSophia | Acc: 83.96% | Loss: 0.4617 | Time: 54.60s | Max GPU Mem: 1482.45 MB
[2025-11-27 10:40:10] [Round 044] FedSophia | Acc: 83.94% | Loss: 0.4603 | Time: 59.23s | Max GPU Mem: 1482.45 MB
[2025-11-27 10:41:00] [Round 045] FedSophia | Acc: 84.03% | Loss: 0.4584 | Time: 50.31s | Max GPU Mem: 1482.45 MB
[2025-11-27 10:42:12] [Round 046] FedSophia | Acc: 84.11% | Loss: 0.4563 | Time: 71.35s | Max GPU Mem: 1482.45 MB
[2025-11-27 10:43:08] [Round 047] FedSophia | Acc: 84.04% | Loss: 0.4543 | Time: 56.98s | Max GPU Mem: 1482.45 MB
[2025-11-27 10:44:04] [Round 048] FedSophia | Acc: 84.08% | Loss: 0.4549 | Time: 55.09s | Max GPU Mem: 1482.45 MB
[2025-11-27 10:45:05] [Round 049] FedSophia | Acc: 83.75% | Loss: 0.4577 | Time: 61.71s | Max GPU Mem: 1482.45 MB
[2025-11-27 10:46:05] [Round 050] FedSophia | Acc: 83.87% | Loss: 0.4626 | Time: 59.54s | Max GPU Mem: 1482.45 MB
[2025-11-27 10:46:05] Saved to runs/run_20251127_001608_resnet18_head/cifar10/logs/FedSophia_head_cifar10_resnet18_s0.npz
