[2025-11-27 06:14:05] Namespace(method='FedSophia', training_mode='head', dataset='fashionmnist', model_name='resnet18', seed=2, rounds=50, num_clients=10, fraction=0.5, local_epochs=1, batch_size=64, lr=0.01, newton_lr=0.1, sophia_lr=0.05, rho=0.04, betas='0.9,0.99', mu=0.01, log_dir='runs/run_20251127_001740_resnet18_head/fashionmnist/logs', optimizer='sgd', hessian_batches=32, damping=0.01, alpha=10.0)
[2025-11-27 06:14:05] Start: FedSophia | Mode: head | Dataset: fashionmnist | Device: cuda
[2025-11-27 06:17:07] [Round 001] FedSophia | Acc: 46.32% | Loss: 2.0462 | Time: 69.54s | Max GPU Mem: 1507.98 MB
[2025-11-27 06:18:18] [Round 002] FedSophia | Acc: 74.06% | Loss: 1.6312 | Time: 70.63s | Max GPU Mem: 1507.54 MB
[2025-11-27 06:19:21] [Round 003] FedSophia | Acc: 78.22% | Loss: 1.2188 | Time: 63.33s | Max GPU Mem: 1507.56 MB
[2025-11-27 06:20:25] [Round 004] FedSophia | Acc: 78.94% | Loss: 0.9201 | Time: 64.28s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:21:43] [Round 005] FedSophia | Acc: 79.11% | Loss: 0.7422 | Time: 77.88s | Max GPU Mem: 1508.08 MB
[2025-11-27 06:22:59] [Round 006] FedSophia | Acc: 79.27% | Loss: 0.6471 | Time: 76.37s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:24:12] [Round 007] FedSophia | Acc: 79.47% | Loss: 0.5975 | Time: 72.85s | Max GPU Mem: 1508.08 MB
[2025-11-27 06:25:27] [Round 008] FedSophia | Acc: 79.93% | Loss: 0.5707 | Time: 74.72s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:26:43] [Round 009] FedSophia | Acc: 80.49% | Loss: 0.5549 | Time: 75.85s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:27:44] [Round 010] FedSophia | Acc: 81.08% | Loss: 0.5436 | Time: 61.11s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:28:44] [Round 011] FedSophia | Acc: 81.34% | Loss: 0.5360 | Time: 59.61s | Max GPU Mem: 1507.45 MB
[2025-11-27 06:29:51] [Round 012] FedSophia | Acc: 81.67% | Loss: 0.5301 | Time: 67.49s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:30:51] [Round 013] FedSophia | Acc: 82.12% | Loss: 0.5253 | Time: 59.91s | Max GPU Mem: 1507.58 MB
[2025-11-27 06:31:57] [Round 014] FedSophia | Acc: 82.18% | Loss: 0.5208 | Time: 66.26s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:32:57] [Round 015] FedSophia | Acc: 82.27% | Loss: 0.5158 | Time: 60.22s | Max GPU Mem: 1507.58 MB
[2025-11-27 06:33:55] [Round 016] FedSophia | Acc: 82.35% | Loss: 0.5101 | Time: 57.14s | Max GPU Mem: 1507.58 MB
[2025-11-27 06:34:42] [Round 017] FedSophia | Acc: 82.65% | Loss: 0.5036 | Time: 47.26s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:35:37] [Round 018] FedSophia | Acc: 82.98% | Loss: 0.4968 | Time: 54.90s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:36:34] [Round 019] FedSophia | Acc: 83.24% | Loss: 0.4899 | Time: 57.60s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:37:33] [Round 020] FedSophia | Acc: 83.56% | Loss: 0.4833 | Time: 58.35s | Max GPU Mem: 1507.45 MB
[2025-11-27 06:38:21] [Round 021] FedSophia | Acc: 83.76% | Loss: 0.4769 | Time: 47.98s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:39:17] [Round 022] FedSophia | Acc: 84.03% | Loss: 0.4706 | Time: 56.20s | Max GPU Mem: 1507.45 MB
[2025-11-27 06:40:10] [Round 023] FedSophia | Acc: 84.24% | Loss: 0.4645 | Time: 53.36s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:41:04] [Round 024] FedSophia | Acc: 84.36% | Loss: 0.4592 | Time: 53.85s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:41:48] [Round 025] FedSophia | Acc: 84.41% | Loss: 0.4545 | Time: 44.11s | Max GPU Mem: 1507.45 MB
[2025-11-27 06:42:41] [Round 026] FedSophia | Acc: 84.54% | Loss: 0.4500 | Time: 53.06s | Max GPU Mem: 1508.08 MB
[2025-11-27 06:43:33] [Round 027] FedSophia | Acc: 84.60% | Loss: 0.4460 | Time: 51.71s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:44:38] [Round 028] FedSophia | Acc: 84.67% | Loss: 0.4419 | Time: 64.78s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:45:29] [Round 029] FedSophia | Acc: 84.73% | Loss: 0.4376 | Time: 50.84s | Max GPU Mem: 1508.08 MB
[2025-11-27 06:46:36] [Round 030] FedSophia | Acc: 84.85% | Loss: 0.4332 | Time: 67.38s | Max GPU Mem: 1507.58 MB
[2025-11-27 06:47:39] [Round 031] FedSophia | Acc: 84.99% | Loss: 0.4291 | Time: 63.12s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:48:42] [Round 032] FedSophia | Acc: 85.04% | Loss: 0.4255 | Time: 62.92s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:49:47] [Round 033] FedSophia | Acc: 85.12% | Loss: 0.4224 | Time: 64.98s | Max GPU Mem: 1508.08 MB
[2025-11-27 06:50:53] [Round 034] FedSophia | Acc: 85.16% | Loss: 0.4195 | Time: 66.39s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:52:13] [Round 035] FedSophia | Acc: 85.34% | Loss: 0.4169 | Time: 80.03s | Max GPU Mem: 1508.08 MB
[2025-11-27 06:53:18] [Round 036] FedSophia | Acc: 85.41% | Loss: 0.4142 | Time: 64.45s | Max GPU Mem: 1507.45 MB
[2025-11-27 06:54:33] [Round 037] FedSophia | Acc: 85.55% | Loss: 0.4114 | Time: 75.25s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:54:54] [Round 038] FedSophia | Acc: 85.69% | Loss: 0.4083 | Time: 20.58s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:55:15] [Round 039] FedSophia | Acc: 85.89% | Loss: 0.4054 | Time: 21.21s | Max GPU Mem: 1507.58 MB
[2025-11-27 06:55:35] [Round 040] FedSophia | Acc: 85.96% | Loss: 0.4030 | Time: 20.21s | Max GPU Mem: 1507.58 MB
[2025-11-27 06:55:56] [Round 041] FedSophia | Acc: 86.02% | Loss: 0.4008 | Time: 21.34s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:56:17] [Round 042] FedSophia | Acc: 86.03% | Loss: 0.3985 | Time: 20.54s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:56:48] [Round 043] FedSophia | Acc: 86.12% | Loss: 0.3960 | Time: 30.69s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:57:09] [Round 044] FedSophia | Acc: 86.15% | Loss: 0.3938 | Time: 21.44s | Max GPU Mem: 1507.58 MB
[2025-11-27 06:57:33] [Round 045] FedSophia | Acc: 86.22% | Loss: 0.3914 | Time: 23.68s | Max GPU Mem: 1507.58 MB
[2025-11-27 06:57:56] [Round 046] FedSophia | Acc: 86.30% | Loss: 0.3892 | Time: 23.53s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:58:19] [Round 047] FedSophia | Acc: 86.33% | Loss: 0.3873 | Time: 22.28s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:58:41] [Round 048] FedSophia | Acc: 86.39% | Loss: 0.3856 | Time: 22.50s | Max GPU Mem: 1506.95 MB
[2025-11-27 06:59:49] [Round 049] FedSophia | Acc: 86.52% | Loss: 0.3840 | Time: 67.50s | Max GPU Mem: 1506.95 MB
[2025-11-27 07:00:42] [Round 050] FedSophia | Acc: 86.57% | Loss: 0.3827 | Time: 53.56s | Max GPU Mem: 1507.58 MB
[2025-11-27 07:00:42] Saved to runs/run_20251127_001740_resnet18_head/fashionmnist/logs/FedSophia_head_fashionmnist_resnet18_s2.npz
