[2025-12-03 05:07:47] Namespace(method='FedNewton', training_mode='head', dataset='cifar10', model_name='resnet18', seed=2, rounds=50, num_clients=10, fraction=0.5, local_epochs=1, batch_size=64, lr=0.01, newton_lr=0.1, sophia_lr=0.05, rho=0.04, betas='0.9,0.99', mu=0.01, log_dir='runs/compare_solvers_20251203_001839_resnet18_head/cifar10/logs/lbfgs', optimizer='sgd', hessian_batches=64, damping=0.0001, alpha=0.5, max_norm=0, newton_solver='lbfgs', newton_cg_max_iter=10, lbfgs_m=5)
[2025-12-03 05:07:47] Start: FedNewton | Mode: head | Dataset: cifar10 | Solver: lbfgs
[2025-12-03 05:10:45] [Round 001] FedNewton (Solver: lbfgs) | Acc: 19.62% | Loss: 4.4606 | Time: 63.13s | Max GPU Mem: 1438.87 MB
[2025-12-03 05:11:47] [Round 002] FedNewton (Solver: lbfgs) | Acc: 19.61% | Loss: 4.1622 | Time: 62.01s | Max GPU Mem: 1438.97 MB
[2025-12-03 05:13:02] [Round 003] FedNewton (Solver: lbfgs) | Acc: 19.30% | Loss: 3.7746 | Time: 74.75s | Max GPU Mem: 1439.07 MB
[2025-12-03 05:14:04] [Round 004] FedNewton (Solver: lbfgs) | Acc: 10.03% | Loss: 3.8577 | Time: 62.78s | Max GPU Mem: 1439.07 MB
[2025-12-03 05:15:20] [Round 005] FedNewton (Solver: lbfgs) | Acc: 10.39% | Loss: 3.2673 | Time: 75.93s | Max GPU Mem: 1439.11 MB
[2025-12-03 05:16:07] [Round 006] FedNewton (Solver: lbfgs) | Acc: 25.46% | Loss: 2.4102 | Time: 46.29s | Max GPU Mem: 1439.15 MB
[2025-12-03 05:17:15] [Round 007] FedNewton (Solver: lbfgs) | Acc: 31.72% | Loss: 2.2342 | Time: 68.45s | Max GPU Mem: 1439.19 MB
[2025-12-03 05:18:13] [Round 008] FedNewton (Solver: lbfgs) | Acc: 43.41% | Loss: 2.0224 | Time: 57.59s | Max GPU Mem: 1439.19 MB
[2025-12-03 05:18:39] [Round 009] FedNewton (Solver: lbfgs) | Acc: 44.35% | Loss: 1.8793 | Time: 26.06s | Max GPU Mem: 1439.19 MB
[2025-12-03 05:19:08] [Round 010] FedNewton (Solver: lbfgs) | Acc: 48.46% | Loss: 1.6178 | Time: 28.93s | Max GPU Mem: 1439.19 MB
[2025-12-03 05:19:40] [Round 011] FedNewton (Solver: lbfgs) | Acc: 53.11% | Loss: 1.5401 | Time: 32.66s | Max GPU Mem: 1439.19 MB
[2025-12-03 05:20:06] [Round 012] FedNewton (Solver: lbfgs) | Acc: 56.80% | Loss: 1.4597 | Time: 25.14s | Max GPU Mem: 1439.23 MB
[2025-12-03 05:21:18] [Round 013] FedNewton (Solver: lbfgs) | Acc: 60.99% | Loss: 1.4110 | Time: 72.20s | Max GPU Mem: 1439.19 MB
[2025-12-03 05:22:19] [Round 014] FedNewton (Solver: lbfgs) | Acc: 19.12% | Loss: 93.4987 | Time: 61.11s | Max GPU Mem: 1439.19 MB
[2025-12-03 05:22:19] Early stopping as test loss is very high.
[2025-12-03 05:22:19] Saved to runs/compare_solvers_20251203_001839_resnet18_head/cifar10/logs/lbfgs/FedNewton_head_cifar10_resnet18_lbfgs_s2.npz
