[2025-11-27 10:03:17] Namespace(method='FedSophia', training_mode='head', dataset='cifar10', model_name='resnet18', seed=1, rounds=50, num_clients=10, fraction=0.5, local_epochs=1, batch_size=64, lr=0.01, newton_lr=0.1, sophia_lr=0.05, rho=0.04, betas='0.9,0.99', mu=0.01, log_dir='runs/run_20251127_001608_resnet18_head/cifar10/logs', optimizer='sgd', hessian_batches=32, damping=0.01, alpha=0.5)
[2025-11-27 10:03:17] Start: FedSophia | Mode: head | Dataset: cifar10 | Device: cuda
[2025-11-27 10:05:39] [Round 001] FedSophia | Acc: 34.76% | Loss: 2.1352 | Time: 28.75s | Max GPU Mem: 1482.35 MB
[2025-11-27 10:06:04] [Round 002] FedSophia | Acc: 44.44% | Loss: 1.8683 | Time: 25.35s | Max GPU Mem: 1482.39 MB
[2025-11-27 10:06:31] [Round 003] FedSophia | Acc: 50.16% | Loss: 1.6104 | Time: 26.51s | Max GPU Mem: 1482.39 MB
[2025-11-27 10:06:56] [Round 004] FedSophia | Acc: 54.95% | Loss: 1.3990 | Time: 24.98s | Max GPU Mem: 1482.41 MB
[2025-11-27 10:07:26] [Round 005] FedSophia | Acc: 60.19% | Loss: 1.2149 | Time: 30.57s | Max GPU Mem: 1482.45 MB
[2025-11-27 10:08:29] [Round 006] FedSophia | Acc: 65.57% | Loss: 1.0513 | Time: 62.51s | Max GPU Mem: 1482.45 MB
[2025-11-27 10:09:02] [Round 007] FedSophia | Acc: 70.78% | Loss: 0.8975 | Time: 33.27s | Max GPU Mem: 1482.45 MB
[2025-11-27 10:10:00] [Round 008] FedSophia | Acc: 74.20% | Loss: 0.7802 | Time: 58.12s | Max GPU Mem: 1482.45 MB
[2025-11-27 10:10:52] [Round 009] FedSophia | Acc: 76.58% | Loss: 0.6929 | Time: 51.69s | Max GPU Mem: 1482.45 MB
[2025-11-27 10:11:44] [Round 010] FedSophia | Acc: 77.96% | Loss: 0.6461 | Time: 51.53s | Max GPU Mem: 1482.45 MB
[2025-11-27 10:12:55] [Round 011] FedSophia | Acc: 78.59% | Loss: 0.6240 | Time: 71.70s | Max GPU Mem: 1482.45 MB
[2025-11-27 10:13:56] [Round 012] FedSophia | Acc: 78.97% | Loss: 0.6065 | Time: 60.88s | Max GPU Mem: 1482.45 MB
[2025-11-27 10:14:56] [Round 013] FedSophia | Acc: 79.36% | Loss: 0.5895 | Time: 60.12s | Max GPU Mem: 1482.45 MB
[2025-11-27 10:15:58] [Round 014] FedSophia | Acc: 79.65% | Loss: 0.5808 | Time: 61.40s | Max GPU Mem: 1482.45 MB
[2025-11-27 10:16:52] [Round 015] FedSophia | Acc: 79.78% | Loss: 0.5757 | Time: 54.11s | Max GPU Mem: 1482.45 MB
[2025-11-27 10:17:42] [Round 016] FedSophia | Acc: 80.27% | Loss: 0.5686 | Time: 49.99s | Max GPU Mem: 1482.45 MB
[2025-11-27 10:18:32] [Round 017] FedSophia | Acc: 80.62% | Loss: 0.5603 | Time: 50.31s | Max GPU Mem: 1482.45 MB
[2025-11-27 10:19:11] [Round 018] FedSophia | Acc: 81.00% | Loss: 0.5550 | Time: 38.67s | Max GPU Mem: 1482.45 MB
[2025-11-27 10:20:04] [Round 019] FedSophia | Acc: 81.18% | Loss: 0.5512 | Time: 53.69s | Max GPU Mem: 1482.45 MB
[2025-11-27 10:21:00] [Round 020] FedSophia | Acc: 81.28% | Loss: 0.5549 | Time: 55.31s | Max GPU Mem: 1482.45 MB
[2025-11-27 10:21:54] [Round 021] FedSophia | Acc: 81.02% | Loss: 0.5622 | Time: 54.02s | Max GPU Mem: 1482.45 MB
[2025-11-27 10:22:43] [Round 022] FedSophia | Acc: 80.50% | Loss: 0.5776 | Time: 49.08s | Max GPU Mem: 1482.45 MB
[2025-11-27 10:23:35] [Round 023] FedSophia | Acc: 80.25% | Loss: 0.5888 | Time: 52.20s | Max GPU Mem: 1482.45 MB
[2025-11-27 10:24:52] [Round 024] FedSophia | Acc: 79.61% | Loss: 0.6073 | Time: 77.14s | Max GPU Mem: 1482.45 MB
[2025-11-27 10:25:56] [Round 025] FedSophia | Acc: 78.76% | Loss: 0.6293 | Time: 64.32s | Max GPU Mem: 1482.45 MB
[2025-11-27 10:26:49] [Round 026] FedSophia | Acc: 78.19% | Loss: 0.6515 | Time: 52.73s | Max GPU Mem: 1482.45 MB
[2025-11-27 10:27:38] [Round 027] FedSophia | Acc: 78.20% | Loss: 0.6510 | Time: 48.93s | Max GPU Mem: 1482.45 MB
[2025-11-27 10:28:23] [Round 028] FedSophia | Acc: 78.27% | Loss: 0.6417 | Time: 44.70s | Max GPU Mem: 1482.45 MB
[2025-11-27 10:29:16] [Round 029] FedSophia | Acc: 79.33% | Loss: 0.6085 | Time: 53.69s | Max GPU Mem: 1482.45 MB
[2025-11-27 10:30:04] [Round 030] FedSophia | Acc: 80.23% | Loss: 0.5791 | Time: 47.08s | Max GPU Mem: 1482.45 MB
[2025-11-27 10:31:25] [Round 031] FedSophia | Acc: 81.10% | Loss: 0.5501 | Time: 81.75s | Max GPU Mem: 1482.45 MB
[2025-11-27 10:32:29] [Round 032] FedSophia | Acc: 81.84% | Loss: 0.5319 | Time: 64.06s | Max GPU Mem: 1482.45 MB
[2025-11-27 10:33:24] [Round 033] FedSophia | Acc: 82.23% | Loss: 0.5172 | Time: 54.72s | Max GPU Mem: 1482.45 MB
[2025-11-27 10:34:08] [Round 034] FedSophia | Acc: 82.86% | Loss: 0.5018 | Time: 43.39s | Max GPU Mem: 1482.45 MB
[2025-11-27 10:35:02] [Round 035] FedSophia | Acc: 82.88% | Loss: 0.4978 | Time: 54.80s | Max GPU Mem: 1482.45 MB
[2025-11-27 10:35:49] [Round 036] FedSophia | Acc: 83.07% | Loss: 0.4948 | Time: 47.13s | Max GPU Mem: 1482.45 MB
[2025-11-27 10:36:58] [Round 037] FedSophia | Acc: 83.11% | Loss: 0.4940 | Time: 68.87s | Max GPU Mem: 1482.45 MB
[2025-11-27 10:37:40] [Round 038] FedSophia | Acc: 83.15% | Loss: 0.4929 | Time: 41.87s | Max GPU Mem: 1482.45 MB
[2025-11-27 10:38:38] [Round 039] FedSophia | Acc: 83.21% | Loss: 0.4937 | Time: 57.43s | Max GPU Mem: 1482.45 MB
[2025-11-27 10:39:25] [Round 040] FedSophia | Acc: 83.06% | Loss: 0.4964 | Time: 46.94s | Max GPU Mem: 1482.45 MB
[2025-11-27 10:40:16] [Round 041] FedSophia | Acc: 83.11% | Loss: 0.4971 | Time: 50.96s | Max GPU Mem: 1482.45 MB
[2025-11-27 10:41:02] [Round 042] FedSophia | Acc: 83.21% | Loss: 0.4931 | Time: 46.80s | Max GPU Mem: 1482.45 MB
[2025-11-27 10:42:12] [Round 043] FedSophia | Acc: 83.07% | Loss: 0.4953 | Time: 70.05s | Max GPU Mem: 1482.45 MB
[2025-11-27 10:43:41] [Round 044] FedSophia | Acc: 82.93% | Loss: 0.4977 | Time: 88.85s | Max GPU Mem: 1482.45 MB
[2025-11-27 10:44:45] [Round 045] FedSophia | Acc: 83.01% | Loss: 0.4979 | Time: 64.07s | Max GPU Mem: 1482.45 MB
[2025-11-27 10:46:03] [Round 046] FedSophia | Acc: 82.96% | Loss: 0.4991 | Time: 78.11s | Max GPU Mem: 1482.45 MB
[2025-11-27 10:46:30] [Round 047] FedSophia | Acc: 83.04% | Loss: 0.4935 | Time: 26.53s | Max GPU Mem: 1482.45 MB
[2025-11-27 10:46:51] [Round 048] FedSophia | Acc: 83.15% | Loss: 0.4897 | Time: 21.05s | Max GPU Mem: 1482.45 MB
[2025-11-27 10:47:15] [Round 049] FedSophia | Acc: 83.21% | Loss: 0.4862 | Time: 24.31s | Max GPU Mem: 1482.45 MB
[2025-11-27 10:47:39] [Round 050] FedSophia | Acc: 83.73% | Loss: 0.4708 | Time: 23.56s | Max GPU Mem: 1482.45 MB
[2025-11-27 10:47:39] Saved to runs/run_20251127_001608_resnet18_head/cifar10/logs/FedSophia_head_cifar10_resnet18_s1.npz
