[2025-11-27 11:18:15] Namespace(method='FedSophia', training_mode='head', dataset='cifar10', model_name='resnet18', seed=1, rounds=50, num_clients=10, fraction=0.5, local_epochs=1, batch_size=64, lr=0.01, newton_lr=0.1, sophia_lr=0.05, rho=0.04, betas='0.9,0.99', mu=0.01, log_dir='runs/run_20251127_001740_resnet18_head/cifar10/logs', optimizer='sgd', hessian_batches=32, damping=0.01, alpha=10.0)
[2025-11-27 11:18:15] Start: FedSophia | Mode: head | Dataset: cifar10 | Device: cuda
[2025-11-27 11:20:40] [Round 001] FedSophia | Acc: 38.63% | Loss: 2.1021 | Time: 30.63s | Max GPU Mem: 1482.35 MB
[2025-11-27 11:21:10] [Round 002] FedSophia | Acc: 63.89% | Loss: 1.7590 | Time: 30.15s | Max GPU Mem: 1482.41 MB
[2025-11-27 11:22:45] [Round 003] FedSophia | Acc: 73.61% | Loss: 1.3976 | Time: 95.19s | Max GPU Mem: 1482.45 MB
[2025-11-27 11:24:28] [Round 004] FedSophia | Acc: 76.11% | Loss: 1.1053 | Time: 102.23s | Max GPU Mem: 1482.45 MB
[2025-11-27 11:25:41] [Round 005] FedSophia | Acc: 77.04% | Loss: 0.9050 | Time: 73.28s | Max GPU Mem: 1482.45 MB
[2025-11-27 11:27:30] [Round 006] FedSophia | Acc: 77.48% | Loss: 0.7783 | Time: 108.99s | Max GPU Mem: 1482.45 MB
[2025-11-27 11:29:48] [Round 007] FedSophia | Acc: 77.90% | Loss: 0.7015 | Time: 137.69s | Max GPU Mem: 1482.45 MB
[2025-11-27 11:31:44] [Round 008] FedSophia | Acc: 78.19% | Loss: 0.6548 | Time: 116.91s | Max GPU Mem: 1482.45 MB
[2025-11-27 11:33:16] [Round 009] FedSophia | Acc: 78.66% | Loss: 0.6260 | Time: 91.03s | Max GPU Mem: 1482.45 MB
[2025-11-27 11:34:09] [Round 010] FedSophia | Acc: 78.78% | Loss: 0.6085 | Time: 53.20s | Max GPU Mem: 1482.45 MB
[2025-11-27 11:35:08] [Round 011] FedSophia | Acc: 79.10% | Loss: 0.5975 | Time: 59.45s | Max GPU Mem: 1482.45 MB
[2025-11-27 11:36:09] [Round 012] FedSophia | Acc: 79.36% | Loss: 0.5901 | Time: 60.41s | Max GPU Mem: 1482.45 MB
[2025-11-27 11:37:11] [Round 013] FedSophia | Acc: 79.54% | Loss: 0.5844 | Time: 62.68s | Max GPU Mem: 1482.45 MB
[2025-11-27 11:38:10] [Round 014] FedSophia | Acc: 79.76% | Loss: 0.5796 | Time: 58.67s | Max GPU Mem: 1482.45 MB
[2025-11-27 11:39:08] [Round 015] FedSophia | Acc: 80.09% | Loss: 0.5744 | Time: 57.64s | Max GPU Mem: 1482.45 MB
[2025-11-27 11:39:58] [Round 016] FedSophia | Acc: 80.40% | Loss: 0.5692 | Time: 50.73s | Max GPU Mem: 1482.45 MB
[2025-11-27 11:40:45] [Round 017] FedSophia | Acc: 80.67% | Loss: 0.5636 | Time: 46.30s | Max GPU Mem: 1482.45 MB
[2025-11-27 11:41:47] [Round 018] FedSophia | Acc: 80.93% | Loss: 0.5583 | Time: 62.72s | Max GPU Mem: 1482.45 MB
[2025-11-27 11:42:50] [Round 019] FedSophia | Acc: 81.20% | Loss: 0.5529 | Time: 62.20s | Max GPU Mem: 1482.45 MB
[2025-11-27 11:44:10] [Round 020] FedSophia | Acc: 81.42% | Loss: 0.5471 | Time: 80.62s | Max GPU Mem: 1482.45 MB
[2025-11-27 11:45:17] [Round 021] FedSophia | Acc: 81.65% | Loss: 0.5417 | Time: 67.13s | Max GPU Mem: 1482.45 MB
[2025-11-27 11:46:24] [Round 022] FedSophia | Acc: 81.83% | Loss: 0.5371 | Time: 66.45s | Max GPU Mem: 1482.45 MB
[2025-11-27 11:47:22] [Round 023] FedSophia | Acc: 81.98% | Loss: 0.5335 | Time: 58.21s | Max GPU Mem: 1482.45 MB
[2025-11-27 11:48:15] [Round 024] FedSophia | Acc: 82.15% | Loss: 0.5307 | Time: 53.46s | Max GPU Mem: 1482.45 MB
[2025-11-27 11:49:17] [Round 025] FedSophia | Acc: 82.11% | Loss: 0.5275 | Time: 61.37s | Max GPU Mem: 1482.45 MB
[2025-11-27 11:50:19] [Round 026] FedSophia | Acc: 82.31% | Loss: 0.5240 | Time: 61.77s | Max GPU Mem: 1482.45 MB
[2025-11-27 11:51:24] [Round 027] FedSophia | Acc: 82.40% | Loss: 0.5204 | Time: 65.87s | Max GPU Mem: 1482.45 MB
[2025-11-27 11:52:21] [Round 028] FedSophia | Acc: 82.63% | Loss: 0.5153 | Time: 57.00s | Max GPU Mem: 1482.45 MB
[2025-11-27 11:53:26] [Round 029] FedSophia | Acc: 82.68% | Loss: 0.5095 | Time: 64.37s | Max GPU Mem: 1482.45 MB
[2025-11-27 11:54:25] [Round 030] FedSophia | Acc: 82.91% | Loss: 0.5034 | Time: 59.64s | Max GPU Mem: 1482.45 MB
[2025-11-27 11:55:24] [Round 031] FedSophia | Acc: 83.11% | Loss: 0.4970 | Time: 58.65s | Max GPU Mem: 1482.45 MB
[2025-11-27 11:56:23] [Round 032] FedSophia | Acc: 83.38% | Loss: 0.4908 | Time: 59.35s | Max GPU Mem: 1482.45 MB
[2025-11-27 11:57:28] [Round 033] FedSophia | Acc: 83.59% | Loss: 0.4850 | Time: 64.63s | Max GPU Mem: 1482.45 MB
[2025-11-27 11:58:41] [Round 034] FedSophia | Acc: 83.71% | Loss: 0.4800 | Time: 72.66s | Max GPU Mem: 1482.45 MB
[2025-11-27 11:59:49] [Round 035] FedSophia | Acc: 83.81% | Loss: 0.4755 | Time: 68.77s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:01:03] [Round 036] FedSophia | Acc: 84.03% | Loss: 0.4717 | Time: 73.10s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:02:18] [Round 037] FedSophia | Acc: 84.10% | Loss: 0.4685 | Time: 75.45s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:03:20] [Round 038] FedSophia | Acc: 84.18% | Loss: 0.4660 | Time: 62.37s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:04:22] [Round 039] FedSophia | Acc: 84.18% | Loss: 0.4641 | Time: 61.52s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:05:26] [Round 040] FedSophia | Acc: 84.21% | Loss: 0.4620 | Time: 64.01s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:05:52] [Round 041] FedSophia | Acc: 84.28% | Loss: 0.4606 | Time: 25.79s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:06:18] [Round 042] FedSophia | Acc: 84.22% | Loss: 0.4591 | Time: 25.91s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:06:43] [Round 043] FedSophia | Acc: 84.27% | Loss: 0.4572 | Time: 24.94s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:07:09] [Round 044] FedSophia | Acc: 84.43% | Loss: 0.4551 | Time: 26.06s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:07:45] [Round 045] FedSophia | Acc: 84.58% | Loss: 0.4526 | Time: 36.17s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:08:43] [Round 046] FedSophia | Acc: 84.73% | Loss: 0.4495 | Time: 57.78s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:09:38] [Round 047] FedSophia | Acc: 84.80% | Loss: 0.4453 | Time: 55.71s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:10:47] [Round 048] FedSophia | Acc: 84.84% | Loss: 0.4407 | Time: 68.24s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:11:44] [Round 049] FedSophia | Acc: 84.93% | Loss: 0.4366 | Time: 57.88s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:12:42] [Round 050] FedSophia | Acc: 84.97% | Loss: 0.4333 | Time: 57.09s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:12:42] Saved to runs/run_20251127_001740_resnet18_head/cifar10/logs/FedSophia_head_cifar10_resnet18_s1.npz
