StyleGAN2: Optimized CUDA op FusedLeakyReLU not available, using native PyTorch fallback.
StyleGAN2: Optimized CUDA op UpFirDn2d not available, using native PyTorch fallback.
(512, 36) (512, 36)
StyleGAN2 8
['1', '2', '3', '4', '5', '6', '7', '8']
Loading ../models/checkpoints/stylegan2/stylegan2_ffhq_1024.pt
dict_keys(['1', '2', '3', '4', '5', '6', '7', '8'])
dict_keys([0.0005, 0.001, 0.005, 0.01])
[37, 39, 37, 37, 36, 36, 33, 36, 40, 36]
StyleGAN2
Layer name : 8

  0%|          | 0/1000 [00:00<?, ?it/s]
  0%|          | 1/1000 [00:00<04:58,  3.34it/s]
  0%|          | 3/1000 [00:00<02:06,  7.89it/s]
  0%|          | 5/1000 [00:00<01:30, 10.98it/s]
  1%|          | 7/1000 [00:00<01:15, 13.23it/s]
  1%|          | 9/1000 [00:00<01:06, 14.90it/s]
  1%|          | 11/1000 [00:00<01:01, 16.00it/s]
  1%|▏         | 13/1000 [00:00<01:01, 16.15it/s]
  2%|▏         | 15/1000 [00:01<00:59, 16.66it/s]
  2%|▏         | 17/1000 [00:01<00:59, 16.62it/s]
  2%|▏         | 19/1000 [00:01<00:57, 17.08it/s]
  2%|▏         | 21/1000 [00:01<00:56, 17.42it/s]
  2%|▏         | 23/1000 [00:01<00:55, 17.52it/s]
  2%|▎         | 25/1000 [00:01<00:54, 17.85it/s]
  3%|▎         | 27/1000 [00:01<00:53, 18.16it/s]
  3%|▎         | 29/1000 [00:01<00:53, 18.15it/s]
  3%|▎         | 31/1000 [00:01<00:54, 17.92it/s]
  3%|▎         | 33/1000 [00:02<00:54, 17.78it/s]
  4%|▎         | 35/1000 [00:02<00:53, 18.03it/s]
  4%|▎         | 37/1000 [00:02<00:54, 17.82it/s]
  4%|▍         | 39/1000 [00:02<00:53, 18.04it/s]
  4%|▍         | 41/1000 [00:02<00:53, 18.02it/s]
  4%|▍         | 43/1000 [00:02<00:52, 18.15it/s]
  4%|▍         | 45/1000 [00:02<00:52, 18.29it/s]
  5%|▍         | 47/1000 [00:02<00:52, 18.05it/s]
  5%|▍         | 49/1000 [00:03<00:54, 17.51it/s]
  5%|▌         | 51/1000 [00:03<00:54, 17.57it/s]
  5%|▌         | 53/1000 [00:03<00:53, 17.79it/s]
  6%|▌         | 55/1000 [00:03<00:52, 17.94it/s]
  6%|▌         | 57/1000 [00:03<00:51, 18.33it/s]
  6%|▌         | 59/1000 [00:03<00:51, 18.44it/s]
  6%|▌         | 61/1000 [00:03<00:50, 18.55it/s]
  6%|▋         | 63/1000 [00:03<00:50, 18.57it/s]
  6%|▋         | 65/1000 [00:03<00:51, 18.27it/s]
  7%|▋         | 67/1000 [00:03<00:51, 18.22it/s]
  7%|▋         | 69/1000 [00:04<00:51, 18.18it/s]
  7%|▋         | 71/1000 [00:04<00:50, 18.32it/s]
  7%|▋         | 73/1000 [00:04<00:51, 17.92it/s]
  8%|▊         | 75/1000 [00:04<00:52, 17.73it/s]
  8%|▊         | 77/1000 [00:04<00:52, 17.51it/s]
  8%|▊         | 79/1000 [00:04<00:53, 17.25it/s]
  8%|▊         | 81/1000 [00:04<00:53, 17.12it/s]
  8%|▊         | 83/1000 [00:04<00:53, 17.21it/s]
  8%|▊         | 85/1000 [00:05<00:52, 17.47it/s]
  9%|▊         | 87/1000 [00:05<00:52, 17.42it/s]
  9%|▉         | 89/1000 [00:05<00:52, 17.47it/s]
  9%|▉         | 91/1000 [00:05<00:52, 17.36it/s]
  9%|▉         | 93/1000 [00:05<00:52, 17.14it/s]
 10%|▉         | 95/1000 [00:05<00:52, 17.30it/s]
 10%|▉         | 97/1000 [00:05<00:51, 17.65it/s]
 10%|▉         | 99/1000 [00:05<00:50, 17.80it/s]
 10%|█         | 101/1000 [00:05<00:49, 18.07it/s]
 10%|█         | 103/1000 [00:06<00:49, 18.30it/s]
 10%|█         | 105/1000 [00:06<00:48, 18.34it/s]
 11%|█         | 107/1000 [00:06<00:48, 18.53it/s]
 11%|█         | 109/1000 [00:06<00:47, 18.59it/s]
 11%|█         | 111/1000 [00:06<00:47, 18.69it/s]
 11%|█▏        | 113/1000 [00:06<00:47, 18.75it/s]
 12%|█▏        | 115/1000 [00:06<00:48, 18.40it/s]
 12%|█▏        | 117/1000 [00:06<00:48, 18.08it/s]
 12%|█▏        | 119/1000 [00:06<00:49, 17.83it/s]
 12%|█▏        | 121/1000 [00:07<00:50, 17.47it/s]
 12%|█▏        | 123/1000 [00:07<00:51, 17.09it/s]
 12%|█▎        | 125/1000 [00:07<00:51, 17.08it/s]
 13%|█▎        | 127/1000 [00:07<00:50, 17.14it/s]
 13%|█▎        | 129/1000 [00:07<00:50, 17.32it/s]
 13%|█▎        | 131/1000 [00:07<00:49, 17.40it/s]
 13%|█▎        | 133/1000 [00:07<00:49, 17.60it/s]
 14%|█▎        | 135/1000 [00:07<00:48, 17.69it/s]
 14%|█▎        | 137/1000 [00:07<00:48, 17.84it/s]
 14%|█▍        | 139/1000 [00:08<00:47, 18.07it/s]
 14%|█▍        | 141/1000 [00:08<00:46, 18.45it/s]
 14%|█▍        | 143/1000 [00:08<00:46, 18.53it/s]
 14%|█▍        | 145/1000 [00:08<00:45, 18.79it/s]
 15%|█▍        | 147/1000 [00:08<00:44, 18.97it/s]
 15%|█▍        | 149/1000 [00:08<00:45, 18.61it/s]
 15%|█▌        | 151/1000 [00:08<00:45, 18.57it/s]
 15%|█▌        | 153/1000 [00:08<00:45, 18.61it/s]
 16%|█▌        | 155/1000 [00:08<00:45, 18.56it/s]
 16%|█▌        | 157/1000 [00:09<00:45, 18.64it/s]
 16%|█▌        | 159/1000 [00:09<00:45, 18.63it/s]
 16%|█▌        | 161/1000 [00:09<00:44, 18.72it/s]
 16%|█▋        | 163/1000 [00:09<00:45, 18.60it/s]
 16%|█▋        | 165/1000 [00:09<00:44, 18.61it/s]
 17%|█▋        | 167/1000 [00:09<00:45, 18.48it/s]
 17%|█▋        | 169/1000 [00:09<00:44, 18.53it/s]
 17%|█▋        | 171/1000 [00:09<00:44, 18.53it/s]
 17%|█▋        | 173/1000 [00:09<00:44, 18.53it/s]
 18%|█▊        | 175/1000 [00:09<00:44, 18.43it/s]
 18%|█▊        | 177/1000 [00:10<00:44, 18.33it/s]
 18%|█▊        | 179/1000 [00:10<00:44, 18.36it/s]
 18%|█▊        | 181/1000 [00:10<00:44, 18.37it/s]
 18%|█▊        | 183/1000 [00:10<00:44, 18.33it/s]
 18%|█▊        | 185/1000 [00:10<00:44, 18.47it/s]
 19%|█▊        | 187/1000 [00:10<00:43, 18.69it/s]
 19%|█▉        | 189/1000 [00:10<00:43, 18.66it/s]
 19%|█▉        | 191/1000 [00:10<00:44, 18.36it/s]
 19%|█▉        | 193/1000 [00:10<00:44, 18.25it/s]
 20%|█▉        | 195/1000 [00:11<00:44, 18.19it/s]
 20%|█▉        | 197/1000 [00:11<00:44, 18.22it/s]
 20%|█▉        | 199/1000 [00:11<00:43, 18.47it/s]
 20%|██        | 201/1000 [00:11<00:42, 18.73it/s]
 20%|██        | 203/1000 [00:11<00:42, 18.93it/s]
 20%|██        | 205/1000 [00:11<00:42, 18.82it/s]
 21%|██        | 207/1000 [00:11<00:42, 18.79it/s]
 21%|██        | 209/1000 [00:11<00:42, 18.76it/s]
 21%|██        | 211/1000 [00:11<00:41, 18.81it/s]
 21%|██▏       | 213/1000 [00:12<00:41, 18.80it/s]
 22%|██▏       | 215/1000 [00:12<00:41, 18.79it/s]
 22%|██▏       | 217/1000 [00:12<00:41, 18.94it/s]
 22%|██▏       | 220/1000 [00:12<00:39, 19.57it/s]
 22%|██▏       | 223/1000 [00:12<00:39, 19.70it/s]
 22%|██▎       | 225/1000 [00:12<00:39, 19.62it/s]
 23%|██▎       | 227/1000 [00:12<00:39, 19.58it/s]
 23%|██▎       | 229/1000 [00:12<00:39, 19.60it/s]
 23%|██▎       | 231/1000 [00:12<00:39, 19.63it/s]
 23%|██▎       | 233/1000 [00:13<00:39, 19.62it/s]
 24%|██▎       | 235/1000 [00:13<00:39, 19.59it/s]
 24%|██▎       | 237/1000 [00:13<00:39, 19.11it/s]
 24%|██▍       | 239/1000 [00:13<00:39, 19.22it/s]
 24%|██▍       | 241/1000 [00:13<00:39, 19.30it/s]
 24%|██▍       | 243/1000 [00:13<00:39, 19.38it/s]
 24%|██▍       | 245/1000 [00:13<00:38, 19.40it/s]
 25%|██▍       | 247/1000 [00:13<00:39, 19.29it/s]
 25%|██▍       | 249/1000 [00:13<00:38, 19.45it/s]
 25%|██▌       | 251/1000 [00:13<00:38, 19.50it/s]
 25%|██▌       | 253/1000 [00:14<00:38, 19.59it/s]
 26%|██▌       | 255/1000 [00:14<00:38, 19.55it/s]
 26%|██▌       | 257/1000 [00:14<00:38, 19.15it/s]
 26%|██▌       | 260/1000 [00:14<00:37, 19.69it/s]
 26%|██▋       | 263/1000 [00:14<00:36, 19.94it/s]
 27%|██▋       | 266/1000 [00:14<00:36, 20.13it/s]
 27%|██▋       | 269/1000 [00:14<00:36, 20.03it/s]
 27%|██▋       | 271/1000 [00:15<00:41, 17.55it/s]
 27%|██▋       | 273/1000 [00:15<00:40, 17.88it/s]
 28%|██▊       | 275/1000 [00:15<00:39, 18.27it/s]
 28%|██▊       | 277/1000 [00:15<00:38, 18.62it/s]
 28%|██▊       | 279/1000 [00:15<00:37, 18.98it/s]
 28%|██▊       | 281/1000 [00:15<00:37, 19.17it/s]
 28%|██▊       | 283/1000 [00:15<00:37, 19.33it/s]
 28%|██▊       | 285/1000 [00:15<00:36, 19.47it/s]
 29%|██▊       | 287/1000 [00:15<00:36, 19.46it/s]
 29%|██▉       | 289/1000 [00:15<00:36, 19.58it/s]
 29%|██▉       | 292/1000 [00:16<00:35, 19.76it/s]
 29%|██▉       | 294/1000 [00:16<00:35, 19.81it/s]
 30%|██▉       | 296/1000 [00:16<00:35, 19.74it/s]
 30%|██▉       | 299/1000 [00:16<00:35, 19.91it/s]
 30%|███       | 302/1000 [00:16<00:35, 19.91it/s]
 30%|███       | 304/1000 [00:16<00:35, 19.81it/s]
 31%|███       | 306/1000 [00:16<00:35, 19.78it/s]
 31%|███       | 308/1000 [00:16<00:35, 19.70it/s]
 31%|███       | 310/1000 [00:17<00:36, 19.09it/s]
 31%|███▏      | 313/1000 [00:17<00:35, 19.54it/s]
 32%|███▏      | 315/1000 [00:17<00:34, 19.65it/s]
 32%|███▏      | 318/1000 [00:17<00:34, 19.76it/s]
 32%|███▏      | 320/1000 [00:17<00:34, 19.82it/s]
 32%|███▏      | 322/1000 [00:17<00:34, 19.73it/s]
 32%|███▏      | 324/1000 [00:17<00:34, 19.60it/s]
 33%|███▎      | 326/1000 [00:17<00:37, 17.82it/s]
 33%|███▎      | 328/1000 [00:17<00:36, 18.26it/s]
 33%|███▎      | 330/1000 [00:18<00:35, 18.64it/s]
 33%|███▎      | 332/1000 [00:18<00:35, 18.84it/s]
 34%|███▎      | 335/1000 [00:18<00:34, 19.25it/s]
 34%|███▎      | 337/1000 [00:18<00:34, 19.37it/s]
 34%|███▍      | 339/1000 [00:18<00:34, 19.39it/s]
 34%|███▍      | 341/1000 [00:18<00:34, 19.35it/s]
 34%|███▍      | 343/1000 [00:18<00:34, 19.11it/s]
 34%|███▍      | 345/1000 [00:18<00:34, 19.15it/s]
 35%|███▍      | 347/1000 [00:19<00:40, 16.32it/s]
 35%|███▍      | 349/1000 [00:19<00:37, 17.17it/s]
 35%|███▌      | 351/1000 [00:19<00:36, 17.84it/s]
 35%|███▌      | 353/1000 [00:19<00:35, 18.19it/s]
 36%|███▌      | 355/1000 [00:19<00:34, 18.56it/s]
 36%|███▌      | 357/1000 [00:19<00:33, 18.96it/s]
 36%|███▌      | 360/1000 [00:19<00:32, 19.42it/s]
 36%|███▌      | 362/1000 [00:19<00:33, 19.31it/s]
 36%|███▋      | 364/1000 [00:19<00:32, 19.47it/s]
 37%|███▋      | 366/1000 [00:20<00:35, 17.71it/s]
 37%|███▋      | 368/1000 [00:20<00:34, 18.13it/s]
 37%|███▋      | 370/1000 [00:20<00:34, 18.37it/s]
 37%|███▋      | 372/1000 [00:20<00:33, 18.58it/s]
 37%|███▋      | 374/1000 [00:20<00:33, 18.78it/s]
 38%|███▊      | 376/1000 [00:20<00:33, 18.69it/s]
 38%|███▊      | 378/1000 [00:20<00:32, 18.89it/s]
 38%|███▊      | 380/1000 [00:20<00:32, 18.98it/s]
 38%|███▊      | 382/1000 [00:20<00:32, 19.16it/s]
 38%|███▊      | 384/1000 [00:20<00:32, 19.24it/s]
 39%|███▊      | 386/1000 [00:21<00:32, 18.94it/s]
 39%|███▉      | 388/1000 [00:21<00:33, 18.38it/s]
 39%|███▉      | 390/1000 [00:21<00:34, 17.67it/s]
 39%|███▉      | 392/1000 [00:21<00:33, 18.29it/s]
 39%|███▉      | 394/1000 [00:21<00:33, 18.35it/s]
 40%|███▉      | 396/1000 [00:21<00:32, 18.61it/s]
 40%|███▉      | 398/1000 [00:21<00:32, 18.47it/s]
 40%|████      | 400/1000 [00:21<00:32, 18.72it/s]
 40%|████      | 402/1000 [00:21<00:31, 19.00it/s]
 40%|████      | 404/1000 [00:22<00:30, 19.24it/s]
 41%|████      | 406/1000 [00:22<00:30, 19.41it/s]
 41%|████      | 408/1000 [00:22<00:31, 19.07it/s]
 41%|████      | 410/1000 [00:22<00:30, 19.08it/s]
 41%|████      | 412/1000 [00:22<00:30, 19.05it/s]
 41%|████▏     | 414/1000 [00:22<00:30, 19.19it/s]
 42%|████▏     | 416/1000 [00:22<00:30, 19.28it/s]
 42%|████▏     | 418/1000 [00:22<00:30, 19.38it/s]
 42%|████▏     | 420/1000 [00:22<00:29, 19.46it/s]
 42%|████▏     | 422/1000 [00:22<00:29, 19.56it/s]
 42%|████▏     | 424/1000 [00:23<00:29, 19.56it/s]
 43%|████▎     | 426/1000 [00:23<00:29, 19.57it/s]
 43%|████▎     | 428/1000 [00:23<00:29, 19.56it/s]
 43%|████▎     | 430/1000 [00:23<00:29, 19.45it/s]
 43%|████▎     | 432/1000 [00:23<00:29, 19.44it/s]
 43%|████▎     | 434/1000 [00:23<00:29, 19.19it/s]
 44%|████▎     | 436/1000 [00:23<00:29, 19.10it/s]
 44%|████▍     | 438/1000 [00:23<00:29, 19.17it/s]
 44%|████▍     | 440/1000 [00:23<00:29, 19.26it/s]
 44%|████▍     | 442/1000 [00:23<00:28, 19.46it/s]
 44%|████▍     | 444/1000 [00:24<00:28, 19.57it/s]
 45%|████▍     | 447/1000 [00:24<00:28, 19.70it/s]
 45%|████▍     | 449/1000 [00:24<00:27, 19.72it/s]
 45%|████▌     | 451/1000 [00:24<00:28, 19.35it/s]
 45%|████▌     | 453/1000 [00:24<00:28, 19.22it/s]
 46%|████▌     | 455/1000 [00:24<00:28, 19.30it/s]
 46%|████▌     | 457/1000 [00:24<00:28, 19.30it/s]
 46%|████▌     | 459/1000 [00:24<00:27, 19.37it/s]
 46%|████▌     | 461/1000 [00:24<00:28, 19.24it/s]
 46%|████▋     | 463/1000 [00:25<00:27, 19.30it/s]
 46%|████▋     | 465/1000 [00:25<00:27, 19.23it/s]
 47%|████▋     | 468/1000 [00:25<00:27, 19.58it/s]
 47%|████▋     | 470/1000 [00:25<00:27, 19.57it/s]
 47%|████▋     | 472/1000 [00:25<00:27, 19.32it/s]
 47%|████▋     | 474/1000 [00:25<00:27, 19.43it/s]
 48%|████▊     | 476/1000 [00:25<00:26, 19.54it/s]
 48%|████▊     | 478/1000 [00:25<00:26, 19.62it/s]
 48%|████▊     | 480/1000 [00:25<00:26, 19.50it/s]
 48%|████▊     | 482/1000 [00:26<00:26, 19.45it/s]
 48%|████▊     | 484/1000 [00:26<00:28, 18.24it/s]
 49%|████▊     | 486/1000 [00:26<00:27, 18.50it/s]
 49%|████▉     | 488/1000 [00:26<00:27, 18.86it/s]
 49%|████▉     | 490/1000 [00:26<00:26, 19.06it/s]
 49%|████▉     | 492/1000 [00:26<00:26, 19.18it/s]
 49%|████▉     | 494/1000 [00:26<00:26, 19.22it/s]
 50%|████▉     | 496/1000 [00:26<00:26, 19.05it/s]
 50%|████▉     | 498/1000 [00:26<00:26, 18.85it/s]
 50%|█████     | 500/1000 [00:27<00:26, 18.87it/s]
 50%|█████     | 502/1000 [00:27<00:26, 18.95it/s]
 50%|█████     | 504/1000 [00:27<00:29, 17.08it/s]
 51%|█████     | 506/1000 [00:27<00:28, 17.37it/s]
 51%|█████     | 508/1000 [00:27<00:27, 18.03it/s]
 51%|█████     | 510/1000 [00:27<00:26, 18.54it/s]
 51%|█████     | 512/1000 [00:27<00:25, 18.85it/s]
 51%|█████▏    | 514/1000 [00:27<00:25, 19.09it/s]
 52%|█████▏    | 516/1000 [00:27<00:25, 19.11it/s]
 52%|█████▏    | 518/1000 [00:27<00:25, 18.97it/s]
 52%|█████▏    | 520/1000 [00:28<00:25, 19.01it/s]
 52%|█████▏    | 522/1000 [00:28<00:25, 19.02it/s]
 52%|█████▏    | 524/1000 [00:28<00:25, 19.03it/s]
 53%|█████▎    | 526/1000 [00:28<00:24, 19.03it/s]
 53%|█████▎    | 528/1000 [00:28<00:24, 19.13it/s]
 53%|█████▎    | 530/1000 [00:28<00:24, 19.23it/s]
 53%|█████▎    | 532/1000 [00:28<00:24, 19.29it/s]
 53%|█████▎    | 534/1000 [00:28<00:24, 19.28it/s]
 54%|█████▎    | 536/1000 [00:28<00:24, 19.18it/s]
 54%|█████▍    | 538/1000 [00:29<00:24, 19.12it/s]
 54%|█████▍    | 540/1000 [00:29<00:24, 19.09it/s]
 54%|█████▍    | 542/1000 [00:29<00:24, 18.88it/s]
 54%|█████▍    | 544/1000 [00:29<00:24, 18.72it/s]
 55%|█████▍    | 546/1000 [00:29<00:24, 18.66it/s]
 55%|█████▍    | 548/1000 [00:29<00:24, 18.64it/s]
 55%|█████▌    | 550/1000 [00:29<00:24, 18.64it/s]
 55%|█████▌    | 552/1000 [00:29<00:24, 18.45it/s]
 55%|█████▌    | 554/1000 [00:29<00:24, 18.44it/s]
 56%|█████▌    | 556/1000 [00:30<00:23, 18.56it/s]
 56%|█████▌    | 558/1000 [00:30<00:23, 18.42it/s]
 56%|█████▌    | 560/1000 [00:30<00:24, 18.05it/s]
 56%|█████▌    | 562/1000 [00:30<00:24, 18.14it/s]
 56%|█████▋    | 564/1000 [00:30<00:23, 18.33it/s]
 57%|█████▋    | 566/1000 [00:30<00:23, 18.41it/s]
 57%|█████▋    | 568/1000 [00:30<00:23, 18.50it/s]
 57%|█████▋    | 570/1000 [00:30<00:23, 18.49it/s]
 57%|█████▋    | 572/1000 [00:30<00:23, 18.55it/s]
 57%|█████▋    | 574/1000 [00:30<00:22, 18.64it/s]
 58%|█████▊    | 576/1000 [00:31<00:22, 18.58it/s]
 58%|█████▊    | 578/1000 [00:31<00:23, 17.86it/s]
 58%|█████▊    | 580/1000 [00:31<00:23, 18.05it/s]
 58%|█████▊    | 582/1000 [00:31<00:22, 18.35it/s]
 58%|█████▊    | 584/1000 [00:31<00:22, 18.59it/s]
 59%|█████▊    | 586/1000 [00:31<00:22, 18.70it/s]
 59%|█████▉    | 588/1000 [00:31<00:22, 18.69it/s]
 59%|█████▉    | 590/1000 [00:31<00:22, 18.58it/s]
 59%|█████▉    | 592/1000 [00:31<00:22, 18.45it/s]
 59%|█████▉    | 594/1000 [00:32<00:22, 18.41it/s]
 60%|█████▉    | 596/1000 [00:32<00:21, 18.45it/s]
 60%|█████▉    | 598/1000 [00:32<00:21, 18.40it/s]
 60%|██████    | 600/1000 [00:32<00:21, 18.40it/s]
 60%|██████    | 602/1000 [00:32<00:21, 18.45it/s]
 60%|██████    | 604/1000 [00:32<00:21, 18.49it/s]
 61%|██████    | 606/1000 [00:32<00:21, 18.64it/s]
 61%|██████    | 608/1000 [00:32<00:20, 18.68it/s]
 61%|██████    | 610/1000 [00:32<00:20, 18.62it/s]
 61%|██████    | 612/1000 [00:33<00:21, 18.37it/s]
 61%|██████▏   | 614/1000 [00:33<00:21, 18.14it/s]
 62%|██████▏   | 616/1000 [00:33<00:21, 18.16it/s]
 62%|██████▏   | 618/1000 [00:33<00:21, 18.15it/s]
 62%|██████▏   | 620/1000 [00:33<00:20, 18.12it/s]
 62%|██████▏   | 622/1000 [00:33<00:20, 18.14it/s]
 62%|██████▏   | 624/1000 [00:33<00:20, 18.09it/s]
 63%|██████▎   | 626/1000 [00:33<00:20, 18.00it/s]
 63%|██████▎   | 628/1000 [00:33<00:20, 17.89it/s]
 63%|██████▎   | 630/1000 [00:34<00:20, 17.96it/s]
 63%|██████▎   | 632/1000 [00:34<00:20, 18.09it/s]
 63%|██████▎   | 634/1000 [00:34<00:20, 18.10it/s]
 64%|██████▎   | 636/1000 [00:34<00:19, 18.28it/s]
 64%|██████▍   | 638/1000 [00:34<00:19, 18.19it/s]
 64%|██████▍   | 640/1000 [00:34<00:19, 18.11it/s]
 64%|██████▍   | 642/1000 [00:34<00:19, 18.06it/s]
 64%|██████▍   | 644/1000 [00:34<00:19, 17.87it/s]
 65%|██████▍   | 646/1000 [00:34<00:19, 17.92it/s]
 65%|██████▍   | 648/1000 [00:35<00:19, 17.95it/s]
 65%|██████▌   | 650/1000 [00:35<00:19, 17.79it/s]
 65%|██████▌   | 652/1000 [00:35<00:19, 17.94it/s]
 65%|██████▌   | 654/1000 [00:35<00:19, 18.19it/s]
 66%|██████▌   | 656/1000 [00:35<00:18, 18.24it/s]
 66%|██████▌   | 658/1000 [00:35<00:18, 18.22it/s]
 66%|██████▌   | 660/1000 [00:35<00:18, 18.24it/s]
 66%|██████▌   | 662/1000 [00:35<00:18, 18.37it/s]
 66%|██████▋   | 664/1000 [00:35<00:18, 18.29it/s]
 67%|██████▋   | 666/1000 [00:36<00:18, 18.33it/s]
 67%|██████▋   | 668/1000 [00:36<00:18, 18.24it/s]
 67%|██████▋   | 670/1000 [00:36<00:18, 18.26it/s]
 67%|██████▋   | 672/1000 [00:36<00:18, 17.85it/s]
 67%|██████▋   | 674/1000 [00:36<00:18, 17.20it/s]
 68%|██████▊   | 676/1000 [00:36<00:18, 17.42it/s]
 68%|██████▊   | 678/1000 [00:36<00:18, 17.40it/s]
 68%|██████▊   | 680/1000 [00:36<00:18, 17.61it/s]
 68%|██████▊   | 682/1000 [00:36<00:17, 17.75it/s]
 68%|██████▊   | 684/1000 [00:37<00:17, 17.95it/s]
 69%|██████▊   | 686/1000 [00:37<00:17, 17.82it/s]
 69%|██████▉   | 688/1000 [00:37<00:17, 17.84it/s]
 69%|██████▉   | 690/1000 [00:37<00:17, 17.84it/s]
 69%|██████▉   | 692/1000 [00:37<00:17, 17.96it/s]
 69%|██████▉   | 694/1000 [00:37<00:17, 17.84it/s]
 70%|██████▉   | 696/1000 [00:37<00:16, 17.94it/s]
 70%|██████▉   | 698/1000 [00:37<00:16, 18.05it/s]
 70%|███████   | 700/1000 [00:37<00:16, 18.16it/s]
 70%|███████   | 702/1000 [00:38<00:16, 18.11it/s]
 70%|███████   | 704/1000 [00:38<00:16, 18.27it/s]
 71%|███████   | 706/1000 [00:38<00:16, 18.31it/s]
 71%|███████   | 708/1000 [00:38<00:16, 17.87it/s]
 71%|███████   | 710/1000 [00:38<00:16, 17.61it/s]
 71%|███████   | 712/1000 [00:38<00:18, 15.86it/s]
 71%|███████▏  | 714/1000 [00:38<00:19, 14.67it/s]
 72%|███████▏  | 716/1000 [00:38<00:18, 15.41it/s]
 72%|███████▏  | 718/1000 [00:39<00:17, 16.03it/s]
 72%|███████▏  | 720/1000 [00:39<00:16, 16.59it/s]
 72%|███████▏  | 722/1000 [00:39<00:16, 17.02it/s]
 72%|███████▏  | 724/1000 [00:39<00:16, 17.18it/s]
 73%|███████▎  | 726/1000 [00:39<00:15, 17.25it/s]
 73%|███████▎  | 728/1000 [00:39<00:15, 17.50it/s]
 73%|███████▎  | 730/1000 [00:39<00:15, 17.24it/s]
 73%|███████▎  | 732/1000 [00:39<00:15, 17.37it/s]
 73%|███████▎  | 734/1000 [00:39<00:15, 17.70it/s]
 74%|███████▎  | 736/1000 [00:40<00:14, 17.80it/s]
 74%|███████▍  | 738/1000 [00:40<00:14, 18.09it/s]
 74%|███████▍  | 740/1000 [00:40<00:14, 18.25it/s]
 74%|███████▍  | 742/1000 [00:40<00:14, 18.30it/s]
 74%|███████▍  | 744/1000 [00:40<00:13, 18.35it/s]
 75%|███████▍  | 746/1000 [00:40<00:13, 18.32it/s]
 75%|███████▍  | 748/1000 [00:40<00:13, 18.34it/s]
 75%|███████▌  | 750/1000 [00:40<00:13, 18.26it/s]
 75%|███████▌  | 752/1000 [00:40<00:13, 18.37it/s]
 75%|███████▌  | 754/1000 [00:41<00:13, 18.59it/s]
 76%|███████▌  | 756/1000 [00:41<00:12, 18.78it/s]
 76%|███████▌  | 758/1000 [00:41<00:12, 18.77it/s]
 76%|███████▌  | 760/1000 [00:41<00:12, 18.71it/s]
 76%|███████▌  | 762/1000 [00:41<00:12, 18.64it/s]
 76%|███████▋  | 764/1000 [00:41<00:12, 18.62it/s]
 77%|███████▋  | 766/1000 [00:41<00:12, 18.58it/s]
 77%|███████▋  | 768/1000 [00:41<00:12, 18.58it/s]
 77%|███████▋  | 770/1000 [00:41<00:12, 18.52it/s]
 77%|███████▋  | 772/1000 [00:41<00:12, 18.47it/s]
 77%|███████▋  | 774/1000 [00:42<00:12, 18.38it/s]
 78%|███████▊  | 776/1000 [00:42<00:12, 18.25it/s]
 78%|███████▊  | 778/1000 [00:42<00:12, 18.09it/s]
 78%|███████▊  | 780/1000 [00:42<00:12, 17.91it/s]
 78%|███████▊  | 782/1000 [00:42<00:12, 17.83it/s]
 78%|███████▊  | 784/1000 [00:42<00:12, 17.84it/s]
 79%|███████▊  | 786/1000 [00:42<00:11, 18.09it/s]
 79%|███████▉  | 788/1000 [00:42<00:11, 18.17it/s]
 79%|███████▉  | 790/1000 [00:42<00:11, 18.23it/s]
 79%|███████▉  | 792/1000 [00:43<00:11, 18.25it/s]
 79%|███████▉  | 794/1000 [00:43<00:11, 18.23it/s]
 80%|███████▉  | 796/1000 [00:43<00:11, 18.25it/s]
 80%|███████▉  | 798/1000 [00:43<00:10, 18.40it/s]
 80%|████████  | 800/1000 [00:43<00:10, 18.36it/s]
 80%|████████  | 802/1000 [00:43<00:10, 18.52it/s]
 80%|████████  | 804/1000 [00:43<00:10, 18.62it/s]
 81%|████████  | 806/1000 [00:43<00:10, 18.55it/s]
 81%|████████  | 808/1000 [00:43<00:10, 18.32it/s]
 81%|████████  | 810/1000 [00:44<00:10, 18.24it/s]
 81%|████████  | 812/1000 [00:44<00:10, 18.04it/s]
 81%|████████▏ | 814/1000 [00:44<00:10, 18.06it/s]
 82%|████████▏ | 816/1000 [00:44<00:10, 18.12it/s]
 82%|████████▏ | 818/1000 [00:44<00:09, 18.28it/s]
 82%|████████▏ | 820/1000 [00:44<00:09, 18.35it/s]
 82%|████████▏ | 822/1000 [00:44<00:09, 18.31it/s]
 82%|████████▏ | 824/1000 [00:44<00:09, 18.11it/s]
 83%|████████▎ | 826/1000 [00:44<00:09, 18.12it/s]
 83%|████████▎ | 828/1000 [00:45<00:09, 18.10it/s]
 83%|████████▎ | 830/1000 [00:45<00:09, 18.02it/s]
 83%|████████▎ | 832/1000 [00:45<00:09, 17.99it/s]
 83%|████████▎ | 834/1000 [00:45<00:09, 17.96it/s]
 84%|████████▎ | 836/1000 [00:45<00:09, 18.12it/s]
 84%|████████▍ | 838/1000 [00:45<00:08, 18.26it/s]
 84%|████████▍ | 840/1000 [00:45<00:08, 18.40it/s]
 84%|████████▍ | 842/1000 [00:45<00:08, 18.40it/s]
 84%|████████▍ | 844/1000 [00:45<00:08, 18.41it/s]
 85%|████████▍ | 846/1000 [00:46<00:08, 18.27it/s]
 85%|████████▍ | 848/1000 [00:46<00:08, 18.29it/s]
 85%|████████▌ | 850/1000 [00:46<00:08, 18.31it/s]
 85%|████████▌ | 852/1000 [00:46<00:08, 18.40it/s]
 85%|████████▌ | 854/1000 [00:46<00:07, 18.41it/s]
 86%|████████▌ | 856/1000 [00:46<00:07, 18.41it/s]
 86%|████████▌ | 858/1000 [00:46<00:07, 18.43it/s]
 86%|████████▌ | 860/1000 [00:46<00:07, 18.32it/s]
 86%|████████▌ | 862/1000 [00:46<00:07, 18.15it/s]
 86%|████████▋ | 864/1000 [00:47<00:07, 18.17it/s]
 87%|████████▋ | 866/1000 [00:47<00:07, 18.08it/s]
 87%|████████▋ | 868/1000 [00:47<00:07, 18.08it/s]
 87%|████████▋ | 870/1000 [00:47<00:07, 18.12it/s]
 87%|████████▋ | 872/1000 [00:47<00:07, 18.09it/s]
 87%|████████▋ | 874/1000 [00:47<00:06, 18.15it/s]
 88%|████████▊ | 876/1000 [00:47<00:06, 18.13it/s]
 88%|████████▊ | 878/1000 [00:47<00:06, 18.02it/s]
 88%|████████▊ | 880/1000 [00:47<00:06, 18.04it/s]
 88%|████████▊ | 882/1000 [00:48<00:06, 17.97it/s]
 88%|████████▊ | 884/1000 [00:48<00:06, 17.86it/s]
 89%|████████▊ | 886/1000 [00:48<00:06, 17.80it/s]
 89%|████████▉ | 888/1000 [00:48<00:06, 17.81it/s]
 89%|████████▉ | 890/1000 [00:48<00:06, 17.95it/s]
 89%|████████▉ | 892/1000 [00:48<00:05, 18.09it/s]
 89%|████████▉ | 894/1000 [00:48<00:05, 18.05it/s]
 90%|████████▉ | 896/1000 [00:48<00:05, 18.02it/s]
 90%|████████▉ | 898/1000 [00:48<00:05, 18.06it/s]
 90%|█████████ | 900/1000 [00:49<00:05, 17.79it/s]
 90%|█████████ | 902/1000 [00:49<00:05, 17.85it/s]
 90%|█████████ | 904/1000 [00:49<00:05, 17.80it/s]
 91%|█████████ | 906/1000 [00:49<00:05, 17.88it/s]
 91%|█████████ | 908/1000 [00:49<00:05, 17.69it/s]
 91%|█████████ | 910/1000 [00:49<00:05, 17.72it/s]
 91%|█████████ | 912/1000 [00:49<00:04, 17.76it/s]
 91%|█████████▏| 914/1000 [00:49<00:04, 17.83it/s]
 92%|█████████▏| 916/1000 [00:49<00:04, 17.99it/s]
 92%|█████████▏| 918/1000 [00:50<00:04, 18.10it/s]
 92%|█████████▏| 920/1000 [00:50<00:04, 17.99it/s]
 92%|█████████▏| 922/1000 [00:50<00:04, 17.76it/s]
 92%|█████████▏| 924/1000 [00:50<00:04, 17.62it/s]
 93%|█████████▎| 926/1000 [00:50<00:04, 17.59it/s]
 93%|█████████▎| 928/1000 [00:50<00:04, 17.62it/s]
 93%|█████████▎| 930/1000 [00:50<00:03, 17.69it/s]
 93%|█████████▎| 932/1000 [00:50<00:03, 17.86it/s]
 93%|█████████▎| 934/1000 [00:50<00:03, 18.11it/s]
 94%|█████████▎| 936/1000 [00:51<00:03, 18.16it/s]
 94%|█████████▍| 938/1000 [00:51<00:03, 18.15it/s]
 94%|█████████▍| 940/1000 [00:51<00:03, 18.03it/s]
 94%|█████████▍| 942/1000 [00:51<00:03, 18.05it/s]
 94%|█████████▍| 944/1000 [00:51<00:03, 17.90it/s]
 95%|█████████▍| 946/1000 [00:51<00:03, 17.89it/s]
 95%|█████████▍| 948/1000 [00:51<00:02, 17.99it/s]
 95%|█████████▌| 950/1000 [00:51<00:02, 17.98it/s]
 95%|█████████▌| 952/1000 [00:51<00:02, 18.02it/s]
 95%|█████████▌| 954/1000 [00:52<00:02, 17.96it/s]
 96%|█████████▌| 956/1000 [00:52<00:02, 18.01it/s]
 96%|█████████▌| 958/1000 [00:52<00:02, 18.09it/s]
 96%|█████████▌| 960/1000 [00:52<00:02, 18.12it/s]
 96%|█████████▌| 962/1000 [00:52<00:02, 18.22it/s]
 96%|█████████▋| 964/1000 [00:52<00:01, 18.27it/s]
 97%|█████████▋| 966/1000 [00:52<00:01, 18.18it/s]
 97%|█████████▋| 968/1000 [00:52<00:01, 18.06it/s]
 97%|█████████▋| 970/1000 [00:52<00:01, 18.00it/s]
 97%|█████████▋| 972/1000 [00:53<00:01, 17.97it/s]
 97%|█████████▋| 974/1000 [00:53<00:01, 18.11it/s]
 98%|█████████▊| 976/1000 [00:53<00:01, 18.14it/s]
 98%|█████████▊| 978/1000 [00:53<00:01, 18.02it/s]
 98%|█████████▊| 980/1000 [00:53<00:01, 17.96it/s]
 98%|█████████▊| 982/1000 [00:53<00:01, 17.87it/s]
 98%|█████████▊| 984/1000 [00:53<00:00, 17.89it/s]
 99%|█████████▊| 986/1000 [00:53<00:00, 17.97it/s]
 99%|█████████▉| 988/1000 [00:53<00:00, 17.84it/s]
 99%|█████████▉| 990/1000 [00:54<00:00, 17.92it/s]
 99%|█████████▉| 992/1000 [00:54<00:00, 18.01it/s]
 99%|█████████▉| 994/1000 [00:54<00:00, 18.19it/s]
100%|█████████▉| 996/1000 [00:54<00:00, 18.34it/s]
100%|█████████▉| 998/1000 [00:54<00:00, 18.50it/s]
100%|██████████| 1000/1000 [00:54<00:00, 18.44it/s]
100%|██████████| 1000/1000 [01:20<00:00, 12.44it/s]
3000
Optimizing...
Iteration    Cost                       Gradient norm     
---------    -----------------------    --------------    
  1          +5.9565947948260378e+04    1.55683613e+03    
  2          +5.8051722579405803e+04    1.51245178e+03    
  3          +5.3753654823932455e+04    1.14733950e+03    
  4          +5.1458280732987769e+04    1.14933003e+03    
  5          +4.9635418885980915e+04    8.13463216e+02    
  6          +4.8989930007514093e+04    6.18791541e+02    
  7          +4.8535182179521777e+04    3.00740790e+02    
  8          +4.8469531872426945e+04    3.58187036e+02    
  9          +4.8324883646718044e+04    1.42983966e+02    
 10          +4.8257726190164445e+04    1.71685504e+02    
 11          +4.8228701778574352e+04    1.85159107e+02    
 12          +4.8199408093898070e+04    1.47405960e+02    
 13          +4.8178068266133290e+04    8.58902962e+01    
 14          +4.8169007860027763e+04    6.77647616e+01    
 15          +4.8162544031089448e+04    7.45193600e+01    
 16          +4.8161729561512446e+04    1.11892991e+02    
 17          +4.8158687735272979e+04    9.87618536e+01    
 18          +4.8150178680120393e+04    5.13947789e+01    
 19          +4.8147286425283608e+04    8.25538716e+01    
 20          +4.8140161470748659e+04    3.32700763e+01    
 21          +4.8138336182858649e+04    3.88765076e+01    
 22          +4.8136703939528998e+04    4.08203623e+01    
 23          +4.8134642284530171e+04    3.08550230e+01    
 24          +4.8134060032548012e+04    3.38809190e+01    
 25          +4.8132844414921703e+04    1.72824620e+01    
 26          +4.8132828110975453e+04    4.26180789e+01    
 27          +4.8132763368002175e+04    4.20002273e+01    
 28          +4.8132512044790950e+04    3.95274701e+01    
 29          +4.8131634836021178e+04    2.96755793e+01    
 30          +4.8130480772750234e+04    2.47076568e+01    
 31          +4.8130067758533129e+04    2.46125697e+01    
 32          +4.8129587202634335e+04    1.44298002e+01    
 33          +4.8129398286147865e+04    1.15591325e+01    
 34          +4.8129279728514528e+04    2.35624075e+01    
 35          +4.8128889075277089e+04    1.55969538e+01    
 36          +4.8128526295184907e+04    1.49066917e+01    
 37          +4.8128224121133964e+04    1.71952273e+01    
 38          +4.8127838853515277e+04    1.74342758e+01    
 39          +4.8127766754277451e+04    2.49386929e+01    
 40          +4.8127511475694831e+04    1.92739363e+01    
 41          +4.8127129612597571e+04    1.33414108e+01    
 42          +4.8127059308707998e+04    1.98931099e+01    
 43          +4.8126822383184663e+04    1.63282053e+01    
 44          +4.8126489559101276e+04    1.64964039e+01    
 45          +4.8126485006979296e+04    2.44065437e+01    
 46          +4.8126466939836551e+04    2.40273742e+01    
 47          +4.8126396962783008e+04    2.25061703e+01    
 48          +4.8126155793503378e+04    1.63794013e+01    
 49          +4.8125975536027428e+04    2.10184466e+01    
 50          +4.8125517586529932e+04    1.22823150e+01    
 51          +4.8125340775578617e+04    1.96990371e+01    
 52          +4.8124847670714094e+04    8.31836159e+00    
 53          +4.8124832671460652e+04    1.25519673e+01    
 54          +4.8124776587855609e+04    1.09213953e+01    
 55          +4.8124623471929808e+04    4.28032743e+00    
 56          +4.8124584745802124e+04    9.08397950e+00    
 57          +4.8124474062605819e+04    4.16328503e+00    
 58          +4.8124442621622984e+04    9.23715371e+00    
 59          +4.8124347066349699e+04    4.90846415e+00    
 60          +4.8124306565104998e+04    8.99179016e+00    
 61          +4.8124195615915094e+04    3.67479730e+00    
 62          +4.8124168077587354e+04    1.15440257e+00    
 63          +4.8124165818403992e+04    8.24849166e-01    
 64          +4.8124164942925483e+04    3.37322788e-01    
 65          +4.8124164841095080e+04    2.82900656e-01    
 66          +4.8124164765432855e+04    1.23999528e-01    
 67          +4.8124164748810610e+04    6.26602985e-02    
 68          +4.8124164744166774e+04    6.71284175e-02    
 69          +4.8124164739880071e+04    2.13097568e-02    
 70          +4.8124164739069754e+04    2.24789868e-02    
 71          +4.8124164738803680e+04    1.88680250e-02    
 72          +4.8124164738611689e+04    1.38990674e-02    
 73          +4.8124164738439918e+04    3.39465222e-03    
 74          +4.8124164738421816e+04    2.99944414e-03    
 75          +4.8124164738419953e+04    3.65609765e-03    
 76          +4.8124164738413710e+04    2.50989941e-03    
Terminated - max time reached after 76 iterations.

Aligned frechet basis path : ./geodesic_interp_basis/interpBasis_Frechet2GANSpace_StyleGAN2_layer_8_thres_0.01_n_step_7_ovsht_idx_0_basisiter_100.npy
(Interpolation Subspace = Frechet Mean Basis) at Idx 1
3000
Optimizing...
Iteration    Cost                       Gradient norm     
---------    -----------------------    --------------    
  1          +6.0052093078305064e+04    1.53825591e+03    
  2          +5.8548701903125810e+04    1.51955945e+03    
  3          +5.4216110553901337e+04    1.20544933e+03    
  4          +5.1516188728973815e+04    1.08478987e+03    
  5          +5.0328583564574248e+04    1.00426719e+03    
  6          +4.8871536213843530e+04    5.68308163e+02    
  7          +4.8450998624517175e+04    4.25359950e+02    
  8          +4.8315635954370991e+04    3.80781853e+02    
  9          +4.8207987467285770e+04    2.73108136e+02    
 10          +4.8141889871586172e+04    1.34238993e+02    
 11          +4.8132554556787167e+04    1.21994763e+02    
 12          +4.8118810355850357e+04    5.51279405e+01    
 13          +4.8117861306392806e+04    7.20570238e+01    
 14          +4.8114771068000584e+04    4.57356933e+01    
 15          +4.8112875316486301e+04    2.78374307e+01    
 16          +4.8112117503362657e+04    1.44998551e+01    
 17          +4.8111868964623405e+04    1.96455726e+01    
 18          +4.8111290187070743e+04    1.23723411e+01    
 19          +4.8111000005668859e+04    1.09206918e+01    
 20          +4.8110899424391006e+04    1.38670944e+01    
 21          +4.8110681846904859e+04    3.88748986e+00    
 22          +4.8110659130337117e+04    2.14708947e+00    
 23          +4.8110654712596544e+04    9.75401408e-01    
 24          +4.8110653627029089e+04    4.70568032e-01    
 25          +4.8110653313062496e+04    5.41305615e-01    
 26          +4.8110653054631912e+04    1.73144857e-01    
 27          +4.8110653034845265e+04    2.11639233e-01    
 28          +4.8110652994647469e+04    4.60617886e-02    
 29          +4.8110652987978101e+04    5.15757659e-02    
 30          +4.8110652986361725e+04    2.71592747e-02    
 31          +4.8110652985813074e+04    9.30363939e-03    
 32          +4.8110652985792076e+04    8.53526322e-03    
 33          +4.8110652985737128e+04    2.74356191e-03    
 34          +4.8110652985736153e+04    3.12888028e-03    
 35          +4.8110652985732726e+04    2.39510320e-03    
 36          +4.8110652985728448e+04    1.14211740e-03    
 37          +4.8110652985728004e+04    1.09500204e-03    
 38          +4.8110652985726905e+04    2.32013094e-04    
Terminated - min step_size reached after 38 iterations, 1776.74 seconds.

Aligned frechet basis path : ./geodesic_interp_basis/interpBasis_Frechet2GANSpace_StyleGAN2_layer_8_thres_0.01_n_step_7_ovsht_idx_2_basisiter_100.npy
3000
Optimizing...
Iteration    Cost                       Gradient norm     
---------    -----------------------    --------------    
  1          +5.9328325378090522e+04    1.52207525e+03    
  2          +5.7845424967153194e+04    1.49467240e+03    
  3          +5.3545241680035288e+04    1.17766364e+03    
  4          +5.1334188346166135e+04    1.12826900e+03    
  5          +4.9733018406037932e+04    7.79168371e+02    
  6          +4.9057132970643594e+04    5.41652104e+02    
  7          +4.8806838196690551e+04    4.33562349e+02    
  8          +4.8746651396661560e+04    4.90769684e+02    
  9          +4.8560749340360278e+04    2.93169062e+02    
 10          +4.8452005467648698e+04    2.90186406e+02    
 11          +4.8402740724436597e+04    3.74919642e+02    
 12          +4.8269927110032251e+04    1.70993689e+02    
 13          +4.8215301816778032e+04    1.68202700e+02    
 14          +4.8185421588845435e+04    1.59362055e+02    
 15          +4.8156823857105810e+04    7.78876504e+01    
 16          +4.8147206911869798e+04    8.65251887e+01    
 17          +4.8139446682553214e+04    5.13903469e+01    
 18          +4.8136170350122404e+04    3.86019620e+01    
 19          +4.8135264906987242e+04    5.57137878e+01    
 20          +4.8132649803910106e+04    2.70366264e+01    
 21          +4.8131552795631993e+04    2.20608173e+01    
 22          +4.8131473101431278e+04    3.15709490e+01    
 23          +4.8131180087538974e+04    2.65034033e+01    
 24          +4.8130486377216519e+04    8.40582170e+00    
 25          +4.8130360930069524e+04    2.67121984e+01    
 26          +4.8129902780837125e+04    2.33773274e+01    
 27          +4.8128842931237392e+04    2.76250829e+01    
 28          +4.8127733546663461e+04    3.41577837e+01    
 29          +4.8126219103683521e+04    1.86716650e+01    
 30          +4.8125985211627049e+04    2.03021294e+01    
 31          +4.8125470540271221e+04    1.02279241e+01    
 32          +4.8125303625996537e+04    1.71093448e+01    
 33          +4.8124896575372630e+04    5.44061638e+00    
 34          +4.8124819355501677e+04    1.62436781e+01    
 35          +4.8124552799933765e+04    1.67303489e+01    
 36          +4.8124131127335306e+04    6.65189624e+00    
 37          +4.8124119188773162e+04    6.87306540e+00    
 38          +4.8124082910127159e+04    3.62580723e+00    
 39          +4.8124068812641475e+04    1.22361254e+00    
 40          +4.8124067413632132e+04    4.84211847e-01    
 41          +4.8124067190088550e+04    3.63206895e-01    
 42          +4.8124067125894653e+04    3.54765083e-01    
 43          +4.8124067019310773e+04    1.09657355e-01    
 44          +4.8124067013707485e+04    1.45413547e-01    
 45          +4.8124066998264294e+04    5.73102737e-02    
 46          +4.8124066995032248e+04    2.94685648e-02    
 47          +4.8124066994143439e+04    2.97418433e-02    
 48          +4.8124066993342756e+04    1.02658869e-02    
 49          +4.8124066993175657e+04    9.38318333e-03    
 50          +4.8124066993163025e+04    1.12206616e-02    
 51          +4.8124066993118431e+04    8.57551587e-03    
 52          +4.8124066993065273e+04    4.28272017e-03    
 53          +4.8124066993054279e+04    3.23475980e-03    
 54          +4.8124066993045257e+04    1.14740892e-03    
 55          +4.8124066993043845e+04    1.04781290e-03    
 56          +4.8124066993042994e+04    6.20587183e-04    
 57          +4.8124066993042557e+04    2.89430719e-04    
 58          +4.8124066993042499e+04    4.23977207e-04    
 59          +4.8124066993042346e+04    1.09788657e-04    
 60          +4.8124066993042266e+04    9.17393241e-05    
Terminated - min step_size reached after 60 iterations, 2612.05 seconds.

Aligned frechet basis path : ./geodesic_interp_basis/interpBasis_Frechet2GANSpace_StyleGAN2_layer_8_thres_0.01_n_step_7_ovsht_idx_3_basisiter_100.npy
3000
Optimizing...
Iteration    Cost                       Gradient norm     
---------    -----------------------    --------------    
  1          +6.0051916366480815e+04    1.55299234e+03    
  2          +5.8544468194031928e+04    1.51410767e+03    
  3          +5.4196375038063372e+04    1.19069419e+03    
  4          +5.1529931770967545e+04    1.15479691e+03    
  5          +4.9702497487643872e+04    9.20854861e+02    
  6          +4.9418355843544887e+04    9.28584347e+02    
  7          +4.8580484758898368e+04    5.13295631e+02    
  8          +4.8219692994741803e+04    1.82527021e+02    
  9          +4.8177523147567983e+04    7.77408906e+01    
 10          +4.8169966654235192e+04    5.67872680e+01    
 11          +4.8166422117536160e+04    3.01765557e+01    
 12          +4.8165059368391099e+04    2.72355236e+01    
 13          +4.8164370401858185e+04    3.20790095e+01    
 14          +4.8163112183111138e+04    2.41636378e+01    
 15          +4.8162545798374034e+04    2.58312111e+01    
 16          +4.8162248891356714e+04    2.29416826e+01    
 17          +4.8161859271370209e+04    8.46260234e+00    
 18          +4.8161821179285376e+04    5.54653831e+00    
 19          +4.8161801316447316e+04    2.85582932e+00    
 20          +4.8161795771992118e+04    1.41628813e+00    
 21          +4.8161794670205309e+04    9.68850687e-01    
 22          +4.8161793986704797e+04    4.36523041e-01    
 23          +4.8161793816531106e+04    1.15345413e-01    
 24          +4.8161793785540212e+04    1.17708498e-01    
 25          +4.8161793775536520e+04    4.41706483e-02    
 26          +4.8161793774316800e+04    2.53165944e-02    
 27          +4.8161793773774094e+04    6.13858669e-03    
 28          +4.8161793773721838e+04    5.42781380e-03    
 29          +4.8161793773713238e+04    5.84212851e-03    
 30          +4.8161793773689140e+04    2.45012590e-03    
 31          +4.8161793773683319e+04    9.59303770e-04    
 32          +4.8161793773682206e+04    1.44013667e-03    
 33          +4.8161793773680663e+04    4.62760213e-04    
 34          +4.8161793773680503e+04    9.55731143e-05    
 35          +4.8161793773680496e+04    2.00737398e-04    
 36          +4.8161793773680496e+04    1.12237185e-04    
Terminated - min step_size reached after 36 iterations, 1535.88 seconds.

Aligned frechet basis path : ./geodesic_interp_basis/interpBasis_Frechet2GANSpace_StyleGAN2_layer_8_thres_0.01_n_step_7_ovsht_idx_4_basisiter_100.npy
3000
Optimizing...
Iteration    Cost                       Gradient norm     
---------    -----------------------    --------------    
  1          +5.9563031562196593e+04    1.50243186e+03    
  2          +5.8098058071717154e+04    1.48465108e+03    
  3          +5.3911386000097271e+04    1.16989754e+03    
  4          +5.1381819834839327e+04    1.09833912e+03    
  5          +5.0035478150942639e+04    8.92221963e+02    
  6          +4.9459110886940114e+04    7.53348543e+02    
  7          +4.8854562832914686e+04    4.01357697e+02    
  8          +4.8714770467059912e+04    2.64776475e+02    
  9          +4.8682756345910413e+04    2.38785831e+02    
 10          +4.8623904311693179e+04    6.98168475e+01    
 11          +4.8614703862282411e+04    1.06413877e+02    
 12          +4.8600637627168238e+04    9.00406616e+01    
 13          +4.8587318553146426e+04    8.06125201e+01    
 14          +4.8574724188282969e+04    9.90424753e+01    
 15          +4.8558858829133387e+04    1.45062743e+02    
 16          +4.8529964503973002e+04    1.20411991e+02    
 17          +4.8520319585440549e+04    2.79878279e+02    
 18          +4.8485976394281381e+04    2.22789690e+02    
 19          +4.8421775735595867e+04    1.56881739e+02    
 20          +4.8375167018898625e+04    2.17195321e+02    
 21          +4.8336661474630608e+04    2.33046473e+02    
 22          +4.8284940868282989e+04    1.45114767e+02    
 23          +4.8284300582037562e+04    2.17728816e+02    
 24          +4.8281778543283792e+04    2.11225824e+02    
 25          +4.8272330577702873e+04    1.85387698e+02    
 26          +4.8245890784108189e+04    8.52631411e+01    
 27          +4.8237947149819825e+04    8.43334030e+01    
 28          +4.8230295230895717e+04    4.20979573e+01    
 29          +4.8226814571465555e+04    5.91215699e+01    
 30          +4.8223784272629899e+04    5.96301842e+01    
 31          +4.8222371650036424e+04    5.91194096e+01    
 32          +4.8219250221925780e+04    1.70409018e+01    
 33          +4.8218505242130945e+04    2.68954984e+01    
 34          +4.8217310590641551e+04    2.05922974e+01    
 35          +4.8217198877671421e+04    2.68253423e+01    
 36          +4.8216810980740993e+04    1.98404327e+01    
 37          +4.8216492455179512e+04    1.46417329e+01    
 38          +4.8216333659524294e+04    8.30432158e+00    
 39          +4.8216276317114105e+04    2.70597039e+00    
 40          +4.8216269751069092e+04    7.01045408e-01    
 41          +4.8216269713203743e+04    1.27045641e+00    
 42          +4.8216269565990769e+04    1.19918917e+00    
 43          +4.8216269049164555e+04    9.06081774e-01    
 44          +4.8216268530331770e+04    4.69591454e-01    
 45          +4.8216268373170453e+04    2.01881573e-01    
 46          +4.8216268338168382e+04    5.07035114e-02    
 47          +4.8216268334286717e+04    4.18776626e-02    
 48          +4.8216268332405096e+04    2.06068512e-02    
 49          +4.8216268331738480e+04    2.21148013e-02    
 50          +4.8216268331402141e+04    1.46278232e-02    
 51          +4.8216268331307416e+04    1.29135908e-02    
 52          +4.8216268331177271e+04    5.35305887e-03    
 53          +4.8216268331150095e+04    2.52286765e-03    
 54          +4.8216268331145038e+04    3.06861124e-03    
 55          +4.8216268331137289e+04    1.10585258e-03    
 56          +4.8216268331136009e+04    9.33810872e-04    
 57          +4.8216268331135521e+04    7.16871924e-04    
 58          +4.8216268331135077e+04    2.20610221e-04    
 59          +4.8216268331134954e+04    2.06678864e-04    
 60          +4.8216268331134954e+04    1.54219580e-04    
Terminated - min step_size reached after 60 iterations, 2519.07 seconds.

Aligned frechet basis path : ./geodesic_interp_basis/interpBasis_Frechet2GANSpace_StyleGAN2_layer_8_thres_0.01_n_step_7_ovsht_idx_5_basisiter_100.npy
3000
Optimizing...
Iteration    Cost                       Gradient norm     
---------    -----------------------    --------------    
  1          +5.9559378952130086e+04    1.52817384e+03    
  2          +5.8076911950768597e+04    1.48941673e+03    
  3          +5.3800451332950273e+04    1.18368854e+03    
  4          +5.1163894077555793e+04    1.12199933e+03    
  5          +4.9658188839262686e+04    8.94075893e+02    
  6          +4.9296812107365586e+04    8.42651198e+02    
  7          +4.8455324508781996e+04    2.95949468e+02    
  8          +4.8351175635921812e+04    2.23687906e+02    
  9          +4.8312696843516547e+04    1.77275175e+02    
 10          +4.8277657514315586e+04    5.77629325e+01    
 11          +4.8275270426797491e+04    9.11592974e+01    
 12          +4.8268368984161214e+04    4.46981208e+01    
 13          +4.8265195976739138e+04    3.61744535e+01    
 14          +4.8264681964820185e+04    5.47009384e+01    
 15          +4.8262984071632927e+04    3.75330222e+01    
 16          +4.8261336309969309e+04    2.55830939e+01    
 17          +4.8260418814012148e+04    3.68853839e+01    
 18          +4.8258815504915226e+04    2.01595857e+01    
 19          +4.8258515245255949e+04    2.81820204e+01    
 20          +4.8257707729566609e+04    1.52270407e+01    
 21          +4.8257614487169041e+04    2.02147335e+01    
 22          +4.8257306964952382e+04    1.32614507e+01    
 23          +4.8257071596221816e+04    1.00479503e+01    
 24          +4.8257025427197783e+04    9.53391939e+00    
 25          +4.8256931409740173e+04    1.98204521e+00    
 26          +4.8256927432648197e+04    1.15653315e+00    
 27          +4.8256926567031202e+04    8.84234280e-01    
 28          +4.8256925892067513e+04    3.57579212e-01    
 29          +4.8256925742237072e+04    2.29177312e-01    
 30          +4.8256925673994658e+04    1.62386993e-01    
 31          +4.8256925640829897e+04    1.02917465e-01    
 32          +4.8256925625386757e+04    7.99925325e-02    
 33          +4.8256925617747162e+04    4.64361516e-02    
 34          +4.8256925614260879e+04    4.01188237e-02    
 35          +4.8256925614200525e+04    5.58157261e-02    
 36          +4.8256925613964471e+04    5.32848244e-02    
 37          +4.8256925613112020e+04    4.29770719e-02    
 38          +4.8256925611509629e+04    1.00422585e-02    
 39          +4.8256925611447237e+04    1.90363569e-02    
 40          +4.8256925611249790e+04    1.11103220e-02    
 41          +4.8256925611235529e+04    1.04295469e-02    
 42          +4.8256925611187457e+04    7.12387654e-03    
 43          +4.8256925611146296e+04    1.16405201e-03    
 44          +4.8256925611146296e+04    1.40969309e-03    
Terminated - min step_size reached after 44 iterations, 1963.91 seconds.

Aligned frechet basis path : ./geodesic_interp_basis/interpBasis_Frechet2GANSpace_StyleGAN2_layer_8_thres_0.01_n_step_7_ovsht_idx_6_basisiter_100.npy
3000
Optimizing...
Iteration    Cost                       Gradient norm     
---------    -----------------------    --------------    
  1          +5.9660026919190241e+04    1.52195857e+03    
  2          +5.8183652880122907e+04    1.47893332e+03    
  3          +5.4031104649151544e+04    1.13389782e+03    
  4          +5.1862035637522116e+04    1.12365756e+03    
  5          +5.0094908001605952e+04    7.79835191e+02    
  6          +4.9419603915616244e+04    6.07916568e+02    
  7          +4.8951034534954859e+04    3.36213827e+02    
  8          +4.8803471390884282e+04    2.90586191e+02    
  9          +4.8698614636873674e+04    2.28811466e+02    
 10          +4.8635618922944588e+04    2.23102100e+02    
 11          +4.8626651696814282e+04    3.32019360e+02    
 12          +4.8593764794233655e+04    2.82145707e+02    
 13          +4.8513215396889340e+04    1.25744649e+02    
 14          +4.8457620194071744e+04    2.23281151e+02    
 15          +4.8412158021575939e+04    2.30721046e+02    
 16          +4.8364012507737876e+04    1.69132806e+02    
 17          +4.8344984764409935e+04    1.51292617e+02    
 18          +4.8329601614963758e+04    1.27927334e+02    
 19          +4.8326668486583454e+04    1.47486884e+02    
 20          +4.8316744070183398e+04    1.04603369e+02    
 21          +4.8313181033995730e+04    1.11537841e+02    
 22          +4.8303328526469806e+04    4.97926422e+01    
 23          +4.8300356271993689e+04    6.16638453e+01    
 24          +4.8296032961563782e+04    4.82418039e+01    
 25          +4.8294383526505000e+04    5.40054873e+01    
 26          +4.8291470782953191e+04    2.69989934e+01    
 27          +4.8290604207770746e+04    2.57481624e+01    
 28          +4.8290037911619998e+04    1.89064726e+01    
 29          +4.8289628048443650e+04    1.78704914e+01    
 30          +4.8289615467356576e+04    3.29096446e+01    
 31          +4.8289565689331241e+04    3.21935223e+01    
 32          +4.8289375474105887e+04    2.93233767e+01    
 33          +4.8288767954475290e+04    1.79611875e+01    
 34          +4.8288422488524673e+04    1.63136042e+01    
 35          +4.8288162792334711e+04    1.17469217e+01    
 36          +4.8288037675363521e+04    1.31560266e+01    
 37          +4.8287850002846695e+04    7.00225545e+00    
 38          +4.8287804094386280e+04    2.07336039e+00    
 39          +4.8287794992886789e+04    9.16434637e+00    
 40          +4.8287761139011047e+04    7.89130831e+00    
 41          +4.8287668317187890e+04    9.46911574e+00    
 42          +4.8287521265818861e+04    1.28566994e+01    
 43          +4.8287234190038558e+04    1.34959218e+01    
 44          +4.8287162694151702e+04    2.18098697e+01    
 45          +4.8286908557018753e+04    1.69953656e+01    
 46          +4.8286530092920111e+04    1.16287961e+01    
 47          +4.8286339150889529e+04    9.85265628e+00    
 48          +4.8286215411642814e+04    5.67430018e+00    
 49          +4.8286201442216028e+04    1.03293218e+01    
 50          +4.8286150854252628e+04    8.40482543e+00    
 51          +4.8286043004998639e+04    9.47973691e+00    
 52          +4.8285957667919691e+04    1.13674984e+01    
 53          +4.8285782288658083e+04    3.21987719e+00    
 54          +4.8285776526972193e+04    3.49422040e+00    
 55          +4.8285766162259504e+04    6.06700741e-01    
 56          +4.8285765829281947e+04    5.51382045e-01    
 57          +4.8285765564246758e+04    2.12146594e-01    
 58          +4.8285765514479011e+04    1.53125180e-01    
 59          +4.8285765489631151e+04    6.94835973e-02    
 60          +4.8285765481433082e+04    8.05602706e-02    
 61          +4.8285765476863584e+04    4.35746209e-02    
 62          +4.8285765475311957e+04    2.14268610e-02    
 63          +4.8285765475037879e+04    2.04721533e-02    
 64          +4.8285765474742147e+04    1.21455490e-02    
 65          +4.8285765474606909e+04    4.12308089e-03    
 66          +4.8285765474577274e+04    3.82986907e-03    
 67          +4.8285765474562533e+04    1.56707013e-03    
 68          +4.8285765474557869e+04    2.02004268e-03    
 69          +4.8285765474554770e+04    8.18113087e-04    
 70          +4.8285765474554137e+04    3.80714698e-04    
 71          +4.8285765474554071e+04    1.98968767e-04    
 72          +4.8285765474554020e+04    2.94539446e-04    
 73          +4.8285765474553940e+04    1.26567668e-04    
 74          +4.8285765474553860e+04    8.18019784e-05    
 75          +4.8285765474553846e+04    7.35953034e-05    
 76          +4.8285765474553846e+04    4.68801640e-05    
Terminated - min step_size reached after 76 iterations, 2938.38 seconds.

Aligned frechet basis path : ./geodesic_interp_basis/interpBasis_Frechet2GANSpace_StyleGAN2_layer_8_thres_0.01_n_step_7_ovsht_idx_7_basisiter_100.npy
3000
Optimizing...
Iteration    Cost                       Gradient norm     
---------    -----------------------    --------------    
  1          +5.9719014203877814e+04    1.49156597e+03    
  2          +5.8261571008033548e+04    1.46955233e+03    
  3          +5.4147399556744458e+04    1.15004353e+03    
  4          +5.1652489377497615e+04    1.09928797e+03    
  5          +5.0093888294945915e+04    9.23541975e+02    
  6          +4.9412481186710706e+04    8.21660777e+02    
  7          +4.8620505616931834e+04    4.32818006e+02    
  8          +4.8479249105420866e+04    3.50867908e+02    
  9          +4.8357425644282819e+04    1.14165242e+02    
 10          +4.8351691471431797e+04    1.40619759e+02    
 11          +4.8335801255309896e+04    5.98190026e+01    
 12          +4.8334099846453515e+04    7.53646236e+01    
 13          +4.8329421631606994e+04    3.26243739e+01    
 14          +4.8328357792586241e+04    4.46348364e+01    
 15          +4.8326031902550974e+04    1.91321352e+01    
 16          +4.8325644567870186e+04    3.12816745e+01    
 17          +4.8324638276777499e+04    1.94939003e+01    
 18          +4.8324160873937224e+04    2.34028469e+01    
 19          +4.8323328854820240e+04    1.22958380e+01    
 20          +4.8323270175106605e+04    2.11092421e+01    
 21          +4.8323059528950063e+04    1.68409182e+01    
 22          +4.8322654671175980e+04    1.43455060e+01    
 23          +4.8322342426098643e+04    1.83236606e+01    
 24          +4.8321775302229747e+04    1.85370763e+01    
 25          +4.8321223802924134e+04    1.56161854e+01    
 26          +4.8320990967808902e+04    1.37082463e+01    
 27          +4.8320832398674669e+04    5.84206806e+00    
 28          +4.8320805313488752e+04    2.41116700e+00    
 29          +4.8320800072044578e+04    1.10240322e+00    
 30          +4.8320799764754316e+04    1.44133751e+00    
 31          +4.8320798748152272e+04    9.45861874e-01    
 32          +4.8320798025769560e+04    3.81274119e-01    
 33          +4.8320797887385364e+04    2.06779099e-01    
 34          +4.8320797847059555e+04    1.73693581e-01    
 35          +4.8320797822909655e+04    1.07441008e-01    
 36          +4.8320797811763201e+04    4.22394075e-02    
 37          +4.8320797811025121e+04    7.03371714e-02    
 38          +4.8320797808599949e+04    4.52604906e-02    
 39          +4.8320797807158538e+04    1.96566530e-02    
 40          +4.8320797806827024e+04    4.13110362e-03    
 41          +4.8320797806801340e+04    4.78577520e-03    
 42          +4.8320797806782546e+04    1.88081026e-03    
 43          +4.8320797806779236e+04    1.16675475e-03    
 44          +4.8320797806777708e+04    6.38917111e-04    
 45          +4.8320797806777293e+04    6.20237867e-04    
 46          +4.8320797806776915e+04    2.47391367e-04    
 47          +4.8320797806776776e+04    1.85009441e-04    
 48          +4.8320797806776754e+04    1.80019376e-04    
Terminated - min step_size reached after 48 iterations, 2125.67 seconds.

Aligned frechet basis path : ./geodesic_interp_basis/interpBasis_Frechet2GANSpace_StyleGAN2_layer_8_thres_0.01_n_step_7_ovsht_idx_8_basisiter_100.npy
