[2025-12-03 04:59:25] Namespace(method='FedNewton', training_mode='head', dataset='cifar10', model_name='resnet18', seed=0, rounds=50, num_clients=10, fraction=0.5, local_epochs=1, batch_size=64, lr=0.01, newton_lr=0.1, sophia_lr=0.05, rho=0.04, betas='0.9,0.99', mu=0.01, log_dir='runs/compare_solvers_20251203_001839_resnet18_head/cifar10/logs/lbfgs', optimizer='sgd', hessian_batches=64, damping=0.0001, alpha=0.5, max_norm=0, newton_solver='lbfgs', newton_cg_max_iter=10, lbfgs_m=5)
[2025-12-03 04:59:25] Start: FedNewton | Mode: head | Dataset: cifar10 | Solver: lbfgs
[2025-12-03 05:02:25] [Round 001] FedNewton (Solver: lbfgs) | Acc: 10.00% | Loss: 3.5690 | Time: 66.89s | Max GPU Mem: 1438.87 MB
[2025-12-03 05:03:42] [Round 002] FedNewton (Solver: lbfgs) | Acc: 11.65% | Loss: 3.2974 | Time: 77.17s | Max GPU Mem: 1438.99 MB
[2025-12-03 05:05:03] [Round 003] FedNewton (Solver: lbfgs) | Acc: 19.19% | Loss: 2.7508 | Time: 80.91s | Max GPU Mem: 1439.03 MB
[2025-12-03 05:06:18] [Round 004] FedNewton (Solver: lbfgs) | Acc: 26.98% | Loss: 2.3514 | Time: 74.50s | Max GPU Mem: 1439.09 MB
[2025-12-03 05:07:47] [Round 005] FedNewton (Solver: lbfgs) | Acc: 48.96% | Loss: 2.0711 | Time: 88.89s | Max GPU Mem: 1439.15 MB
[2025-12-03 05:08:14] [Round 006] FedNewton (Solver: lbfgs) | Acc: 48.57% | Loss: 2.0136 | Time: 27.63s | Max GPU Mem: 1439.19 MB
[2025-12-03 05:08:43] [Round 007] FedNewton (Solver: lbfgs) | Acc: 52.02% | Loss: 1.8745 | Time: 29.04s | Max GPU Mem: 1439.19 MB
[2025-12-03 05:09:12] [Round 008] FedNewton (Solver: lbfgs) | Acc: 38.42% | Loss: 1.8265 | Time: 28.53s | Max GPU Mem: 1439.19 MB
[2025-12-03 05:09:41] [Round 009] FedNewton (Solver: lbfgs) | Acc: 44.72% | Loss: 1.6870 | Time: 29.69s | Max GPU Mem: 1439.19 MB
[2025-12-03 05:10:45] [Round 010] FedNewton (Solver: lbfgs) | Acc: 69.54% | Loss: 1.0034 | Time: 63.97s | Max GPU Mem: 1439.19 MB
[2025-12-03 05:11:59] [Round 011] FedNewton (Solver: lbfgs) | Acc: 71.70% | Loss: 0.9387 | Time: 73.41s | Max GPU Mem: 1439.19 MB
[2025-12-03 05:13:07] [Round 012] FedNewton (Solver: lbfgs) | Acc: 67.20% | Loss: 0.9279 | Time: 68.08s | Max GPU Mem: 1439.19 MB
[2025-12-03 05:14:07] [Round 013] FedNewton (Solver: lbfgs) | Acc: 67.93% | Loss: 0.9101 | Time: 59.82s | Max GPU Mem: 1439.19 MB
[2025-12-03 05:15:16] [Round 014] FedNewton (Solver: lbfgs) | Acc: 69.11% | Loss: 0.8943 | Time: 68.98s | Max GPU Mem: 1439.19 MB
[2025-12-03 05:15:59] [Round 015] FedNewton (Solver: lbfgs) | Acc: 69.46% | Loss: 0.8723 | Time: 42.85s | Max GPU Mem: 1439.19 MB
[2025-12-03 05:16:37] [Round 016] FedNewton (Solver: lbfgs) | Acc: 66.14% | Loss: 0.9930 | Time: 37.97s | Max GPU Mem: 1439.19 MB
[2025-12-03 05:17:31] [Round 017] FedNewton (Solver: lbfgs) | Acc: 68.58% | Loss: 0.9325 | Time: 54.62s | Max GPU Mem: 1439.19 MB
[2025-12-03 05:18:17] [Round 018] FedNewton (Solver: lbfgs) | Acc: 69.43% | Loss: 0.9051 | Time: 46.01s | Max GPU Mem: 1439.19 MB
[2025-12-03 05:18:42] [Round 019] FedNewton (Solver: lbfgs) | Acc: 66.68% | Loss: 0.9685 | Time: 24.66s | Max GPU Mem: 1439.19 MB
[2025-12-03 05:19:09] [Round 020] FedNewton (Solver: lbfgs) | Acc: 67.91% | Loss: 0.9178 | Time: 26.79s | Max GPU Mem: 1439.19 MB
[2025-12-03 05:19:34] [Round 021] FedNewton (Solver: lbfgs) | Acc: 55.83% | Loss: 1.3033 | Time: 25.74s | Max GPU Mem: 1439.19 MB
[2025-12-03 05:20:03] [Round 022] FedNewton (Solver: lbfgs) | Acc: 58.90% | Loss: 1.1696 | Time: 28.52s | Max GPU Mem: 1439.19 MB
[2025-12-03 05:21:14] [Round 023] FedNewton (Solver: lbfgs) | Acc: 66.65% | Loss: 0.9128 | Time: 71.38s | Max GPU Mem: 1439.19 MB
[2025-12-03 05:22:23] [Round 024] FedNewton (Solver: lbfgs) | Acc: 68.27% | Loss: 0.8672 | Time: 68.49s | Max GPU Mem: 1439.19 MB
[2025-12-03 05:22:50] [Round 025] FedNewton (Solver: lbfgs) | Acc: 70.36% | Loss: 0.8216 | Time: 27.54s | Max GPU Mem: 1439.19 MB
[2025-12-03 05:23:13] [Round 026] FedNewton (Solver: lbfgs) | Acc: 74.71% | Loss: 0.7232 | Time: 22.59s | Max GPU Mem: 1439.19 MB
[2025-12-03 05:23:45] [Round 027] FedNewton (Solver: lbfgs) | Acc: 75.49% | Loss: 0.7025 | Time: 31.79s | Max GPU Mem: 1439.19 MB
[2025-12-03 05:24:10] [Round 028] FedNewton (Solver: lbfgs) | Acc: 72.90% | Loss: 0.7649 | Time: 25.10s | Max GPU Mem: 1439.19 MB
[2025-12-03 05:25:28] [Round 029] FedNewton (Solver: lbfgs) | Acc: 73.49% | Loss: 0.7472 | Time: 78.26s | Max GPU Mem: 1439.19 MB
[2025-12-03 05:26:40] [Round 030] FedNewton (Solver: lbfgs) | Acc: 74.10% | Loss: 0.7255 | Time: 72.41s | Max GPU Mem: 1439.23 MB
[2025-12-03 05:27:50] [Round 031] FedNewton (Solver: lbfgs) | Acc: 75.18% | Loss: 0.7013 | Time: 69.72s | Max GPU Mem: 1439.19 MB
[2025-12-03 05:28:51] [Round 032] FedNewton (Solver: lbfgs) | Acc: 76.87% | Loss: 0.6725 | Time: 61.36s | Max GPU Mem: 1439.19 MB
[2025-12-03 05:30:18] [Round 033] FedNewton (Solver: lbfgs) | Acc: 77.33% | Loss: 0.6651 | Time: 87.00s | Max GPU Mem: 1439.19 MB
[2025-12-03 05:31:18] [Round 034] FedNewton (Solver: lbfgs) | Acc: 77.44% | Loss: 0.6592 | Time: 59.52s | Max GPU Mem: 1439.19 MB
[2025-12-03 05:32:32] [Round 035] FedNewton (Solver: lbfgs) | Acc: 65.64% | Loss: 1.0186 | Time: 73.96s | Max GPU Mem: 1439.19 MB
[2025-12-03 05:33:52] [Round 036] FedNewton (Solver: lbfgs) | Acc: 67.52% | Loss: 0.9479 | Time: 80.34s | Max GPU Mem: 1439.19 MB
[2025-12-03 05:35:01] [Round 037] FedNewton (Solver: lbfgs) | Acc: 10.00% | Loss: 8046.1569 | Time: 68.87s | Max GPU Mem: 1439.19 MB
[2025-12-03 05:35:01] Early stopping as test loss is very high.
[2025-12-03 05:35:01] Saved to runs/compare_solvers_20251203_001839_resnet18_head/cifar10/logs/lbfgs/FedNewton_head_cifar10_resnet18_lbfgs_s0.npz
