[2025-11-27 12:16:04] Namespace(method='FedSophia', training_mode='head', dataset='cifar10', model_name='resnet18', seed=0, rounds=50, num_clients=10, fraction=0.5, local_epochs=1, batch_size=64, lr=0.01, newton_lr=0.1, sophia_lr=0.05, rho=0.04, betas='0.9,0.99', mu=0.01, log_dir='runs/run_20251127_103732_resnet18_head/cifar10/logs', optimizer='sgd', hessian_batches=32, damping=0.01, alpha=0.1, max_norm=1.0)
[2025-11-27 12:16:04] Start: FedSophia | Mode: head | Dataset: cifar10 | Device: cuda
[2025-11-27 12:18:22] [Round 001] FedSophia | Acc: 16.62% | Loss: 2.1890 | Time: 24.94s | Max GPU Mem: 1482.35 MB
[2025-11-27 12:18:39] [Round 002] FedSophia | Acc: 44.71% | Loss: 1.9893 | Time: 16.80s | Max GPU Mem: 1482.41 MB
[2025-11-27 12:19:07] [Round 003] FedSophia | Acc: 56.14% | Loss: 1.8356 | Time: 28.06s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:19:35] [Round 004] FedSophia | Acc: 57.97% | Loss: 1.7108 | Time: 28.40s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:20:05] [Round 005] FedSophia | Acc: 57.95% | Loss: 1.6607 | Time: 29.82s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:21:31] [Round 006] FedSophia | Acc: 57.91% | Loss: 1.6222 | Time: 85.84s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:23:04] [Round 007] FedSophia | Acc: 58.04% | Loss: 1.5669 | Time: 93.12s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:24:21] [Round 008] FedSophia | Acc: 58.53% | Loss: 1.4861 | Time: 77.05s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:25:22] [Round 009] FedSophia | Acc: 59.81% | Loss: 1.4107 | Time: 60.61s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:26:32] [Round 010] FedSophia | Acc: 61.34% | Loss: 1.3473 | Time: 70.43s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:27:15] [Round 011] FedSophia | Acc: 64.09% | Loss: 1.1851 | Time: 42.62s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:28:17] [Round 012] FedSophia | Acc: 67.28% | Loss: 1.0337 | Time: 62.78s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:29:27] [Round 013] FedSophia | Acc: 69.94% | Loss: 0.9138 | Time: 69.97s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:31:00] [Round 014] FedSophia | Acc: 72.03% | Loss: 0.8115 | Time: 92.55s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:32:23] [Round 015] FedSophia | Acc: 73.88% | Loss: 0.7291 | Time: 83.27s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:33:40] [Round 016] FedSophia | Acc: 75.42% | Loss: 0.6760 | Time: 76.52s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:34:49] [Round 017] FedSophia | Acc: 76.44% | Loss: 0.6546 | Time: 69.50s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:35:29] [Round 018] FedSophia | Acc: 77.56% | Loss: 0.6274 | Time: 39.64s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:36:33] [Round 019] FedSophia | Acc: 77.51% | Loss: 0.6364 | Time: 63.97s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:37:09] [Round 020] FedSophia | Acc: 77.50% | Loss: 0.6382 | Time: 36.63s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:37:50] [Round 021] FedSophia | Acc: 77.33% | Loss: 0.6434 | Time: 40.60s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:38:27] [Round 022] FedSophia | Acc: 77.69% | Loss: 0.6422 | Time: 37.16s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:39:20] [Round 023] FedSophia | Acc: 78.37% | Loss: 0.6294 | Time: 52.28s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:40:24] [Round 024] FedSophia | Acc: 78.73% | Loss: 0.6311 | Time: 64.00s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:41:21] [Round 025] FedSophia | Acc: 79.33% | Loss: 0.6276 | Time: 57.52s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:42:27] [Round 026] FedSophia | Acc: 79.59% | Loss: 0.6284 | Time: 65.99s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:43:59] [Round 027] FedSophia | Acc: 80.16% | Loss: 0.6078 | Time: 92.32s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:44:28] [Round 028] FedSophia | Acc: 80.77% | Loss: 0.5863 | Time: 28.70s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:46:07] [Round 029] FedSophia | Acc: 81.32% | Loss: 0.5555 | Time: 99.40s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:47:36] [Round 030] FedSophia | Acc: 80.76% | Loss: 0.5525 | Time: 88.35s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:48:30] [Round 031] FedSophia | Acc: 80.11% | Loss: 0.5727 | Time: 54.11s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:49:31] [Round 032] FedSophia | Acc: 79.50% | Loss: 0.5975 | Time: 61.04s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:50:43] [Round 033] FedSophia | Acc: 78.76% | Loss: 0.6255 | Time: 71.86s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:51:37] [Round 034] FedSophia | Acc: 77.38% | Loss: 0.6884 | Time: 54.22s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:52:12] [Round 035] FedSophia | Acc: 77.14% | Loss: 0.7204 | Time: 35.37s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:53:05] [Round 036] FedSophia | Acc: 78.18% | Loss: 0.6990 | Time: 52.83s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:54:04] [Round 037] FedSophia | Acc: 78.61% | Loss: 0.6999 | Time: 58.50s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:55:18] [Round 038] FedSophia | Acc: 78.90% | Loss: 0.6835 | Time: 74.27s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:56:00] [Round 039] FedSophia | Acc: 79.95% | Loss: 0.6328 | Time: 42.43s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:56:55] [Round 040] FedSophia | Acc: 81.55% | Loss: 0.5588 | Time: 54.06s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:57:46] [Round 041] FedSophia | Acc: 83.02% | Loss: 0.5041 | Time: 51.33s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:59:04] [Round 042] FedSophia | Acc: 83.73% | Loss: 0.4847 | Time: 78.15s | Max GPU Mem: 1482.45 MB
[2025-11-27 12:59:34] [Round 043] FedSophia | Acc: 83.54% | Loss: 0.4925 | Time: 29.94s | Max GPU Mem: 1482.45 MB
[2025-11-27 13:01:06] [Round 044] FedSophia | Acc: 83.45% | Loss: 0.4922 | Time: 91.58s | Max GPU Mem: 1482.45 MB
[2025-11-27 13:02:03] [Round 045] FedSophia | Acc: 84.03% | Loss: 0.4737 | Time: 57.31s | Max GPU Mem: 1482.45 MB
[2025-11-27 13:02:38] [Round 046] FedSophia | Acc: 84.35% | Loss: 0.4622 | Time: 34.71s | Max GPU Mem: 1482.45 MB
[2025-11-27 13:03:01] [Round 047] FedSophia | Acc: 84.55% | Loss: 0.4583 | Time: 23.34s | Max GPU Mem: 1482.45 MB
[2025-11-27 13:03:18] [Round 048] FedSophia | Acc: 84.21% | Loss: 0.4618 | Time: 17.34s | Max GPU Mem: 1482.45 MB
[2025-11-27 13:03:39] [Round 049] FedSophia | Acc: 82.72% | Loss: 0.4889 | Time: 20.66s | Max GPU Mem: 1482.45 MB
[2025-11-27 13:03:57] [Round 050] FedSophia | Acc: 81.58% | Loss: 0.5240 | Time: 18.30s | Max GPU Mem: 1482.45 MB
[2025-11-27 13:03:57] Saved to runs/run_20251127_103732_resnet18_head/cifar10/logs/FedSophia_head_cifar10_resnet18_s0.npz
