[2025-11-27 12:18:19] Namespace(method='FedSophia', training_mode='head', dataset='cifar10', model_name='resnet18', seed=2, rounds=50, num_clients=10, fraction=0.5, local_epochs=1, batch_size=64, lr=0.01, newton_lr=0.1, sophia_lr=0.05, rho=0.04, betas='0.9,0.99', mu=0.01, log_dir='runs/run_20251127_103732_resnet18_head/cifar10/logs', optimizer='sgd', hessian_batches=32, damping=0.01, alpha=0.1, max_norm=1.0)
[2025-11-27 12:18:19] Start: FedSophia | Mode: head | Dataset: cifar10 | Device: cuda
[2025-11-27 12:21:27] [Round 001] FedSophia | Acc: 26.93% | Loss: 2.1745 | Time: 73.87s | Max GPU Mem: 1482.35 MB
[2025-11-27 12:22:05] [Round 002] FedSophia | Acc: 35.17% | Loss: 1.9996 | Time: 38.81s | Max GPU Mem: 1482.39 MB
[2025-11-27 12:23:00] [Round 003] FedSophia | Acc: 44.31% | Loss: 1.8020 | Time: 54.47s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:23:57] [Round 004] FedSophia | Acc: 45.31% | Loss: 1.6357 | Time: 57.12s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:24:57] [Round 005] FedSophia | Acc: 40.85% | Loss: 1.5443 | Time: 60.42s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:25:51] [Round 006] FedSophia | Acc: 37.93% | Loss: 1.5265 | Time: 54.01s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:26:50] [Round 007] FedSophia | Acc: 37.67% | Loss: 1.5451 | Time: 58.91s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:27:36] [Round 008] FedSophia | Acc: 40.83% | Loss: 1.4499 | Time: 45.17s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:28:37] [Round 009] FedSophia | Acc: 45.13% | Loss: 1.3329 | Time: 61.65s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:29:34] [Round 010] FedSophia | Acc: 53.39% | Loss: 1.1336 | Time: 56.81s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:30:54] [Round 011] FedSophia | Acc: 61.22% | Loss: 0.9687 | Time: 80.26s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:31:51] [Round 012] FedSophia | Acc: 67.87% | Loss: 0.8460 | Time: 56.69s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:32:43] [Round 013] FedSophia | Acc: 73.74% | Loss: 0.7402 | Time: 52.51s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:34:02] [Round 014] FedSophia | Acc: 76.56% | Loss: 0.6809 | Time: 78.80s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:34:59] [Round 015] FedSophia | Acc: 77.24% | Loss: 0.6569 | Time: 56.30s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:35:35] [Round 016] FedSophia | Acc: 77.28% | Loss: 0.6527 | Time: 36.46s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:36:50] [Round 017] FedSophia | Acc: 77.39% | Loss: 0.6457 | Time: 75.22s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:37:40] [Round 018] FedSophia | Acc: 77.17% | Loss: 0.6443 | Time: 49.71s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:38:21] [Round 019] FedSophia | Acc: 76.86% | Loss: 0.6580 | Time: 41.49s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:38:51] [Round 020] FedSophia | Acc: 76.17% | Loss: 0.6796 | Time: 29.22s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:39:43] [Round 021] FedSophia | Acc: 75.06% | Loss: 0.7097 | Time: 51.99s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:40:35] [Round 022] FedSophia | Acc: 74.81% | Loss: 0.7198 | Time: 52.10s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:41:21] [Round 023] FedSophia | Acc: 75.73% | Loss: 0.6972 | Time: 46.57s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:42:26] [Round 024] FedSophia | Acc: 76.70% | Loss: 0.6674 | Time: 64.33s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:43:27] [Round 025] FedSophia | Acc: 77.28% | Loss: 0.6447 | Time: 61.30s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:44:17] [Round 026] FedSophia | Acc: 78.52% | Loss: 0.6102 | Time: 50.02s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:44:59] [Round 027] FedSophia | Acc: 79.44% | Loss: 0.5831 | Time: 42.47s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:46:04] [Round 028] FedSophia | Acc: 79.83% | Loss: 0.5685 | Time: 64.51s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:47:12] [Round 029] FedSophia | Acc: 80.01% | Loss: 0.5605 | Time: 68.42s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:48:23] [Round 030] FedSophia | Acc: 79.27% | Loss: 0.5741 | Time: 70.36s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:49:35] [Round 031] FedSophia | Acc: 78.18% | Loss: 0.6041 | Time: 71.99s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:50:36] [Round 032] FedSophia | Acc: 78.25% | Loss: 0.6059 | Time: 61.14s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:51:20] [Round 033] FedSophia | Acc: 78.31% | Loss: 0.6062 | Time: 44.41s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:52:18] [Round 034] FedSophia | Acc: 78.21% | Loss: 0.6253 | Time: 57.99s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:53:10] [Round 035] FedSophia | Acc: 77.88% | Loss: 0.6370 | Time: 51.80s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:54:06] [Round 036] FedSophia | Acc: 77.98% | Loss: 0.6374 | Time: 56.31s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:54:56] [Round 037] FedSophia | Acc: 78.31% | Loss: 0.6253 | Time: 49.95s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:55:44] [Round 038] FedSophia | Acc: 78.72% | Loss: 0.6111 | Time: 47.34s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:56:26] [Round 039] FedSophia | Acc: 79.27% | Loss: 0.6009 | Time: 42.29s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:56:58] [Round 040] FedSophia | Acc: 79.83% | Loss: 0.5863 | Time: 32.25s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:57:54] [Round 041] FedSophia | Acc: 80.37% | Loss: 0.5710 | Time: 56.06s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:59:02] [Round 042] FedSophia | Acc: 80.46% | Loss: 0.5720 | Time: 67.48s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:59:32] [Round 043] FedSophia | Acc: 80.68% | Loss: 0.5749 | Time: 29.75s | Max GPU Mem: 1482.45 MB
[2025-11-27 13:00:13] [Round 044] FedSophia | Acc: 80.23% | Loss: 0.5876 | Time: 41.96s | Max GPU Mem: 1482.45 MB
[2025-11-27 13:01:22] [Round 045] FedSophia | Acc: 80.28% | Loss: 0.5851 | Time: 68.96s | Max GPU Mem: 1482.45 MB
[2025-11-27 13:02:33] [Round 046] FedSophia | Acc: 81.12% | Loss: 0.5555 | Time: 70.87s | Max GPU Mem: 1482.45 MB
[2025-11-27 13:03:02] [Round 047] FedSophia | Acc: 81.51% | Loss: 0.5291 | Time: 28.45s | Max GPU Mem: 1482.45 MB
[2025-11-27 13:03:24] [Round 048] FedSophia | Acc: 81.55% | Loss: 0.5269 | Time: 22.55s | Max GPU Mem: 1482.45 MB
[2025-11-27 13:03:53] [Round 049] FedSophia | Acc: 79.36% | Loss: 0.5831 | Time: 28.43s | Max GPU Mem: 1482.45 MB
[2025-11-27 13:04:09] [Round 050] FedSophia | Acc: 76.97% | Loss: 0.6784 | Time: 16.33s | Max GPU Mem: 1482.45 MB
[2025-11-27 13:04:09] Saved to runs/run_20251127_103732_resnet18_head/cifar10/logs/FedSophia_head_cifar10_resnet18_s2.npz
