[2025-12-03 04:59:29] Namespace(method='FedNewton', training_mode='head', dataset='cifar10', model_name='resnet18', seed=1, rounds=50, num_clients=10, fraction=0.5, local_epochs=1, batch_size=64, lr=0.01, newton_lr=0.1, sophia_lr=0.05, rho=0.04, betas='0.9,0.99', mu=0.01, log_dir='runs/compare_solvers_20251203_001839_resnet18_head/cifar10/logs/lbfgs', optimizer='sgd', hessian_batches=64, damping=0.0001, alpha=0.5, max_norm=0, newton_solver='lbfgs', newton_cg_max_iter=10, lbfgs_m=5)
[2025-12-03 04:59:29] Start: FedNewton | Mode: head | Dataset: cifar10 | Solver: lbfgs
[2025-12-03 05:02:31] [Round 001] FedNewton (Solver: lbfgs) | Acc: 10.00% | Loss: 2.5057 | Time: 69.52s | Max GPU Mem: 1438.87 MB
[2025-12-03 05:03:53] [Round 002] FedNewton (Solver: lbfgs) | Acc: 11.46% | Loss: 2.3872 | Time: 82.37s | Max GPU Mem: 1438.97 MB
[2025-12-03 05:05:10] [Round 003] FedNewton (Solver: lbfgs) | Acc: 26.30% | Loss: 2.0835 | Time: 76.31s | Max GPU Mem: 1439.01 MB
[2025-12-03 05:06:21] [Round 004] FedNewton (Solver: lbfgs) | Acc: 55.61% | Loss: 1.6518 | Time: 71.70s | Max GPU Mem: 1439.07 MB
[2025-12-03 05:07:49] [Round 005] FedNewton (Solver: lbfgs) | Acc: 57.15% | Loss: 1.5141 | Time: 88.10s | Max GPU Mem: 1439.15 MB
[2025-12-03 05:08:17] [Round 006] FedNewton (Solver: lbfgs) | Acc: 66.30% | Loss: 1.2922 | Time: 27.74s | Max GPU Mem: 1439.19 MB
[2025-12-03 05:08:42] [Round 007] FedNewton (Solver: lbfgs) | Acc: 68.58% | Loss: 1.2081 | Time: 24.47s | Max GPU Mem: 1439.19 MB
[2025-12-03 05:09:11] [Round 008] FedNewton (Solver: lbfgs) | Acc: 69.43% | Loss: 1.0780 | Time: 29.51s | Max GPU Mem: 1439.19 MB
[2025-12-03 05:09:36] [Round 009] FedNewton (Solver: lbfgs) | Acc: 72.21% | Loss: 0.9792 | Time: 24.88s | Max GPU Mem: 1439.19 MB
[2025-12-03 05:10:29] [Round 010] FedNewton (Solver: lbfgs) | Acc: 74.14% | Loss: 0.8681 | Time: 53.14s | Max GPU Mem: 1439.19 MB
[2025-12-03 05:11:48] [Round 011] FedNewton (Solver: lbfgs) | Acc: 74.23% | Loss: 0.8342 | Time: 78.91s | Max GPU Mem: 1439.19 MB
[2025-12-03 05:12:57] [Round 012] FedNewton (Solver: lbfgs) | Acc: 75.01% | Loss: 0.7891 | Time: 68.96s | Max GPU Mem: 1439.19 MB
[2025-12-03 05:13:51] [Round 013] FedNewton (Solver: lbfgs) | Acc: 75.05% | Loss: 0.7697 | Time: 54.05s | Max GPU Mem: 1439.19 MB
[2025-12-03 05:14:54] [Round 014] FedNewton (Solver: lbfgs) | Acc: 75.30% | Loss: 0.7495 | Time: 63.10s | Max GPU Mem: 1439.19 MB
[2025-12-03 05:15:40] [Round 015] FedNewton (Solver: lbfgs) | Acc: 75.81% | Loss: 0.7296 | Time: 45.82s | Max GPU Mem: 1439.19 MB
[2025-12-03 05:16:26] [Round 016] FedNewton (Solver: lbfgs) | Acc: 68.51% | Loss: 1.0880 | Time: 45.57s | Max GPU Mem: 1439.19 MB
[2025-12-03 05:17:18] [Round 017] FedNewton (Solver: lbfgs) | Acc: 69.62% | Loss: 1.0287 | Time: 52.48s | Max GPU Mem: 1439.19 MB
[2025-12-03 05:18:12] [Round 018] FedNewton (Solver: lbfgs) | Acc: 10.00% | Loss: 21.6544 | Time: 53.63s | Max GPU Mem: 1439.19 MB
[2025-12-03 05:18:12] Early stopping as test loss is very high.
[2025-12-03 05:18:12] Saved to runs/compare_solvers_20251203_001839_resnet18_head/cifar10/logs/lbfgs/FedNewton_head_cifar10_resnet18_lbfgs_s1.npz
