[2025-11-27 11:11:22] Namespace(method='FedSophia', training_mode='head', dataset='cifar10', model_name='resnet18', seed=0, rounds=50, num_clients=10, fraction=0.5, local_epochs=1, batch_size=64, lr=0.01, newton_lr=0.1, sophia_lr=0.05, rho=0.04, betas='0.9,0.99', mu=0.01, log_dir='runs/run_20251127_001740_resnet18_head/cifar10/logs', optimizer='sgd', hessian_batches=32, damping=0.01, alpha=10.0)
[2025-11-27 11:11:22] Start: FedSophia | Mode: head | Dataset: cifar10 | Device: cuda
[2025-11-27 11:14:53] [Round 001] FedSophia | Acc: 26.85% | Loss: 2.1371 | Time: 104.73s | Max GPU Mem: 1482.35 MB
[2025-11-27 11:16:12] [Round 002] FedSophia | Acc: 57.65% | Loss: 1.7867 | Time: 78.77s | Max GPU Mem: 1482.39 MB
[2025-11-27 11:17:46] [Round 003] FedSophia | Acc: 72.84% | Loss: 1.4140 | Time: 94.20s | Max GPU Mem: 1482.45 MB
[2025-11-27 11:18:23] [Round 004] FedSophia | Acc: 76.18% | Loss: 1.1121 | Time: 37.61s | Max GPU Mem: 1482.45 MB
[2025-11-27 11:18:49] [Round 005] FedSophia | Acc: 76.90% | Loss: 0.9064 | Time: 26.01s | Max GPU Mem: 1482.45 MB
[2025-11-27 11:19:16] [Round 006] FedSophia | Acc: 77.53% | Loss: 0.7780 | Time: 26.81s | Max GPU Mem: 1482.45 MB
[2025-11-27 11:19:37] [Round 007] FedSophia | Acc: 77.81% | Loss: 0.7011 | Time: 20.41s | Max GPU Mem: 1482.45 MB
[2025-11-27 11:19:54] [Round 008] FedSophia | Acc: 78.18% | Loss: 0.6556 | Time: 16.91s | Max GPU Mem: 1482.45 MB
[2025-11-27 11:20:11] [Round 009] FedSophia | Acc: 78.49% | Loss: 0.6270 | Time: 17.67s | Max GPU Mem: 1482.45 MB
[2025-11-27 11:20:42] [Round 010] FedSophia | Acc: 78.85% | Loss: 0.6082 | Time: 30.37s | Max GPU Mem: 1482.45 MB
[2025-11-27 11:21:12] [Round 011] FedSophia | Acc: 79.25% | Loss: 0.5950 | Time: 30.40s | Max GPU Mem: 1482.45 MB
[2025-11-27 11:22:43] [Round 012] FedSophia | Acc: 79.52% | Loss: 0.5850 | Time: 91.31s | Max GPU Mem: 1482.45 MB
[2025-11-27 11:24:22] [Round 013] FedSophia | Acc: 79.96% | Loss: 0.5780 | Time: 98.35s | Max GPU Mem: 1482.45 MB
[2025-11-27 11:25:37] [Round 014] FedSophia | Acc: 80.14% | Loss: 0.5727 | Time: 75.17s | Max GPU Mem: 1482.45 MB
[2025-11-27 11:27:30] [Round 015] FedSophia | Acc: 80.31% | Loss: 0.5680 | Time: 113.51s | Max GPU Mem: 1482.45 MB
[2025-11-27 11:29:46] [Round 016] FedSophia | Acc: 80.54% | Loss: 0.5634 | Time: 135.80s | Max GPU Mem: 1482.45 MB
[2025-11-27 11:31:42] [Round 017] FedSophia | Acc: 80.89% | Loss: 0.5589 | Time: 115.93s | Max GPU Mem: 1482.45 MB
[2025-11-27 11:33:12] [Round 018] FedSophia | Acc: 81.05% | Loss: 0.5551 | Time: 90.24s | Max GPU Mem: 1482.45 MB
[2025-11-27 11:34:07] [Round 019] FedSophia | Acc: 81.21% | Loss: 0.5520 | Time: 55.14s | Max GPU Mem: 1482.45 MB
[2025-11-27 11:35:10] [Round 020] FedSophia | Acc: 81.37% | Loss: 0.5487 | Time: 62.44s | Max GPU Mem: 1482.45 MB
[2025-11-27 11:36:16] [Round 021] FedSophia | Acc: 81.56% | Loss: 0.5454 | Time: 65.63s | Max GPU Mem: 1482.45 MB
[2025-11-27 11:37:16] [Round 022] FedSophia | Acc: 81.70% | Loss: 0.5405 | Time: 60.02s | Max GPU Mem: 1482.45 MB
[2025-11-27 11:38:14] [Round 023] FedSophia | Acc: 81.93% | Loss: 0.5351 | Time: 58.09s | Max GPU Mem: 1482.45 MB
[2025-11-27 11:39:12] [Round 024] FedSophia | Acc: 82.30% | Loss: 0.5300 | Time: 57.86s | Max GPU Mem: 1482.45 MB
[2025-11-27 11:40:14] [Round 025] FedSophia | Acc: 82.35% | Loss: 0.5239 | Time: 62.04s | Max GPU Mem: 1482.45 MB
[2025-11-27 11:41:17] [Round 026] FedSophia | Acc: 82.58% | Loss: 0.5174 | Time: 63.68s | Max GPU Mem: 1482.45 MB
[2025-11-27 11:42:24] [Round 027] FedSophia | Acc: 82.72% | Loss: 0.5112 | Time: 66.76s | Max GPU Mem: 1482.45 MB
[2025-11-27 11:43:17] [Round 028] FedSophia | Acc: 82.90% | Loss: 0.5046 | Time: 53.23s | Max GPU Mem: 1482.45 MB
[2025-11-27 11:44:18] [Round 029] FedSophia | Acc: 83.04% | Loss: 0.4985 | Time: 60.99s | Max GPU Mem: 1482.45 MB
[2025-11-27 11:45:22] [Round 030] FedSophia | Acc: 83.20% | Loss: 0.4936 | Time: 64.00s | Max GPU Mem: 1482.45 MB
[2025-11-27 11:46:20] [Round 031] FedSophia | Acc: 83.42% | Loss: 0.4895 | Time: 58.04s | Max GPU Mem: 1482.45 MB
[2025-11-27 11:47:16] [Round 032] FedSophia | Acc: 83.46% | Loss: 0.4863 | Time: 56.20s | Max GPU Mem: 1482.45 MB
[2025-11-27 11:48:10] [Round 033] FedSophia | Acc: 83.55% | Loss: 0.4833 | Time: 53.59s | Max GPU Mem: 1482.45 MB
[2025-11-27 11:49:12] [Round 034] FedSophia | Acc: 83.73% | Loss: 0.4806 | Time: 61.53s | Max GPU Mem: 1482.45 MB
[2025-11-27 11:50:11] [Round 035] FedSophia | Acc: 83.75% | Loss: 0.4776 | Time: 59.62s | Max GPU Mem: 1482.45 MB
[2025-11-27 11:51:15] [Round 036] FedSophia | Acc: 83.93% | Loss: 0.4737 | Time: 63.62s | Max GPU Mem: 1482.45 MB
[2025-11-27 11:52:17] [Round 037] FedSophia | Acc: 84.07% | Loss: 0.4696 | Time: 62.66s | Max GPU Mem: 1482.45 MB
[2025-11-27 11:53:23] [Round 038] FedSophia | Acc: 84.27% | Loss: 0.4652 | Time: 65.97s | Max GPU Mem: 1482.45 MB
[2025-11-27 11:54:22] [Round 039] FedSophia | Acc: 84.40% | Loss: 0.4617 | Time: 58.28s | Max GPU Mem: 1482.45 MB
[2025-11-27 11:55:19] [Round 040] FedSophia | Acc: 84.41% | Loss: 0.4583 | Time: 57.34s | Max GPU Mem: 1482.45 MB
[2025-11-27 11:56:21] [Round 041] FedSophia | Acc: 84.48% | Loss: 0.4551 | Time: 61.82s | Max GPU Mem: 1482.45 MB
[2025-11-27 11:57:25] [Round 042] FedSophia | Acc: 84.47% | Loss: 0.4524 | Time: 64.35s | Max GPU Mem: 1482.45 MB
[2025-11-27 11:58:38] [Round 043] FedSophia | Acc: 84.53% | Loss: 0.4500 | Time: 72.78s | Max GPU Mem: 1482.45 MB
[2025-11-27 11:59:43] [Round 044] FedSophia | Acc: 84.58% | Loss: 0.4474 | Time: 65.34s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:00:42] [Round 045] FedSophia | Acc: 84.66% | Loss: 0.4452 | Time: 58.93s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:01:37] [Round 046] FedSophia | Acc: 84.76% | Loss: 0.4434 | Time: 54.58s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:02:32] [Round 047] FedSophia | Acc: 84.77% | Loss: 0.4418 | Time: 54.65s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:03:31] [Round 048] FedSophia | Acc: 84.73% | Loss: 0.4406 | Time: 59.27s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:04:27] [Round 049] FedSophia | Acc: 84.88% | Loss: 0.4391 | Time: 55.91s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:05:25] [Round 050] FedSophia | Acc: 84.92% | Loss: 0.4371 | Time: 58.54s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:05:25] Saved to runs/run_20251127_001740_resnet18_head/cifar10/logs/FedSophia_head_cifar10_resnet18_s0.npz
