[2025-11-27 11:19:28] Namespace(method='FedSophia', training_mode='head', dataset='cifar10', model_name='resnet18', seed=2, rounds=50, num_clients=10, fraction=0.5, local_epochs=1, batch_size=64, lr=0.01, newton_lr=0.1, sophia_lr=0.05, rho=0.04, betas='0.9,0.99', mu=0.01, log_dir='runs/run_20251127_001740_resnet18_head/cifar10/logs', optimizer='sgd', hessian_batches=32, damping=0.01, alpha=10.0)
[2025-11-27 11:19:28] Start: FedSophia | Mode: head | Dataset: cifar10 | Device: cuda
[2025-11-27 11:23:20] [Round 001] FedSophia | Acc: 32.64% | Loss: 2.1054 | Time: 117.89s | Max GPU Mem: 1482.35 MB
[2025-11-27 11:25:00] [Round 002] FedSophia | Acc: 67.29% | Loss: 1.7616 | Time: 100.84s | Max GPU Mem: 1482.37 MB
[2025-11-27 11:27:29] [Round 003] FedSophia | Acc: 74.87% | Loss: 1.3946 | Time: 148.66s | Max GPU Mem: 1482.41 MB
[2025-11-27 11:29:49] [Round 004] FedSophia | Acc: 76.50% | Loss: 1.1003 | Time: 139.91s | Max GPU Mem: 1482.43 MB
[2025-11-27 11:31:50] [Round 005] FedSophia | Acc: 76.98% | Loss: 0.9013 | Time: 121.17s | Max GPU Mem: 1482.43 MB
[2025-11-27 11:33:24] [Round 006] FedSophia | Acc: 77.21% | Loss: 0.7772 | Time: 93.45s | Max GPU Mem: 1482.45 MB
[2025-11-27 11:34:50] [Round 007] FedSophia | Acc: 77.53% | Loss: 0.7019 | Time: 86.27s | Max GPU Mem: 1482.45 MB
[2025-11-27 11:36:07] [Round 008] FedSophia | Acc: 77.89% | Loss: 0.6563 | Time: 77.03s | Max GPU Mem: 1482.45 MB
[2025-11-27 11:37:13] [Round 009] FedSophia | Acc: 78.27% | Loss: 0.6275 | Time: 66.00s | Max GPU Mem: 1482.45 MB
[2025-11-27 11:38:16] [Round 010] FedSophia | Acc: 78.60% | Loss: 0.6082 | Time: 62.89s | Max GPU Mem: 1482.45 MB
[2025-11-27 11:39:14] [Round 011] FedSophia | Acc: 79.05% | Loss: 0.5950 | Time: 57.96s | Max GPU Mem: 1482.45 MB
[2025-11-27 11:40:16] [Round 012] FedSophia | Acc: 79.38% | Loss: 0.5859 | Time: 62.43s | Max GPU Mem: 1482.45 MB
[2025-11-27 11:41:18] [Round 013] FedSophia | Acc: 79.77% | Loss: 0.5790 | Time: 61.31s | Max GPU Mem: 1482.45 MB
[2025-11-27 11:42:23] [Round 014] FedSophia | Acc: 80.02% | Loss: 0.5731 | Time: 65.27s | Max GPU Mem: 1482.45 MB
[2025-11-27 11:43:17] [Round 015] FedSophia | Acc: 80.36% | Loss: 0.5685 | Time: 54.13s | Max GPU Mem: 1482.45 MB
[2025-11-27 11:44:13] [Round 016] FedSophia | Acc: 80.56% | Loss: 0.5645 | Time: 56.51s | Max GPU Mem: 1482.45 MB
[2025-11-27 11:45:17] [Round 017] FedSophia | Acc: 80.86% | Loss: 0.5603 | Time: 63.70s | Max GPU Mem: 1482.45 MB
[2025-11-27 11:46:11] [Round 018] FedSophia | Acc: 81.10% | Loss: 0.5557 | Time: 53.99s | Max GPU Mem: 1482.45 MB
[2025-11-27 11:47:02] [Round 019] FedSophia | Acc: 81.30% | Loss: 0.5516 | Time: 51.07s | Max GPU Mem: 1482.45 MB
[2025-11-27 11:47:47] [Round 020] FedSophia | Acc: 81.58% | Loss: 0.5468 | Time: 45.10s | Max GPU Mem: 1482.45 MB
[2025-11-27 11:48:38] [Round 021] FedSophia | Acc: 81.64% | Loss: 0.5431 | Time: 50.23s | Max GPU Mem: 1482.45 MB
[2025-11-27 11:49:20] [Round 022] FedSophia | Acc: 81.85% | Loss: 0.5390 | Time: 42.68s | Max GPU Mem: 1482.45 MB
[2025-11-27 11:50:17] [Round 023] FedSophia | Acc: 82.01% | Loss: 0.5352 | Time: 56.35s | Max GPU Mem: 1482.45 MB
[2025-11-27 11:51:19] [Round 024] FedSophia | Acc: 82.08% | Loss: 0.5312 | Time: 62.05s | Max GPU Mem: 1482.45 MB
[2025-11-27 11:52:20] [Round 025] FedSophia | Acc: 82.09% | Loss: 0.5277 | Time: 61.04s | Max GPU Mem: 1482.45 MB
[2025-11-27 11:53:27] [Round 026] FedSophia | Acc: 82.32% | Loss: 0.5234 | Time: 67.32s | Max GPU Mem: 1482.45 MB
[2025-11-27 11:54:42] [Round 027] FedSophia | Acc: 82.58% | Loss: 0.5185 | Time: 74.55s | Max GPU Mem: 1482.45 MB
[2025-11-27 11:55:31] [Round 028] FedSophia | Acc: 82.74% | Loss: 0.5143 | Time: 49.44s | Max GPU Mem: 1482.45 MB
[2025-11-27 11:56:25] [Round 029] FedSophia | Acc: 82.82% | Loss: 0.5104 | Time: 54.40s | Max GPU Mem: 1482.45 MB
[2025-11-27 11:57:28] [Round 030] FedSophia | Acc: 82.98% | Loss: 0.5064 | Time: 62.84s | Max GPU Mem: 1482.45 MB
[2025-11-27 11:58:39] [Round 031] FedSophia | Acc: 83.02% | Loss: 0.5020 | Time: 70.80s | Max GPU Mem: 1482.45 MB
[2025-11-27 11:59:45] [Round 032] FedSophia | Acc: 83.24% | Loss: 0.4964 | Time: 65.87s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:00:44] [Round 033] FedSophia | Acc: 83.35% | Loss: 0.4908 | Time: 59.30s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:01:37] [Round 034] FedSophia | Acc: 83.49% | Loss: 0.4850 | Time: 52.51s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:02:28] [Round 035] FedSophia | Acc: 83.76% | Loss: 0.4796 | Time: 51.50s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:03:25] [Round 036] FedSophia | Acc: 83.88% | Loss: 0.4752 | Time: 57.16s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:04:21] [Round 037] FedSophia | Acc: 84.04% | Loss: 0.4713 | Time: 56.14s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:05:24] [Round 038] FedSophia | Acc: 84.17% | Loss: 0.4678 | Time: 62.19s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:05:49] [Round 039] FedSophia | Acc: 84.20% | Loss: 0.4638 | Time: 25.33s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:06:16] [Round 040] FedSophia | Acc: 84.26% | Loss: 0.4610 | Time: 26.78s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:06:40] [Round 041] FedSophia | Acc: 84.28% | Loss: 0.4583 | Time: 23.82s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:07:03] [Round 042] FedSophia | Acc: 84.35% | Loss: 0.4556 | Time: 23.34s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:07:26] [Round 043] FedSophia | Acc: 84.44% | Loss: 0.4529 | Time: 22.90s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:08:25] [Round 044] FedSophia | Acc: 84.44% | Loss: 0.4507 | Time: 58.84s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:09:12] [Round 045] FedSophia | Acc: 84.58% | Loss: 0.4489 | Time: 47.44s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:10:06] [Round 046] FedSophia | Acc: 84.61% | Loss: 0.4475 | Time: 53.84s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:11:07] [Round 047] FedSophia | Acc: 84.71% | Loss: 0.4453 | Time: 60.62s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:12:11] [Round 048] FedSophia | Acc: 84.84% | Loss: 0.4426 | Time: 64.30s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:12:53] [Round 049] FedSophia | Acc: 84.95% | Loss: 0.4399 | Time: 42.39s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:13:15] [Round 050] FedSophia | Acc: 84.96% | Loss: 0.4375 | Time: 21.82s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:13:15] Saved to runs/run_20251127_001740_resnet18_head/cifar10/logs/FedSophia_head_cifar10_resnet18_s2.npz
