Logging to experiments/gym_fwalker2d/nov7/Wa01w350e3_seed2231
Print configuration .....
{'env_name': 'gym_fwalker2d', 'random_seeds': [3214, 2431, 2531, 2231], 'save_variables': False, 'model_save_dir': '/tmp/gym_fwalker2d_models/', 'restore_variables': False, 'start_onpol_iter': 0, 'onpol_iters': 33, 'num_path_random': 6, 'num_path_onpol': 6, 'env_horizon': 1000, 'max_train_data': 200000, 'max_val_data': 100000, 'discard_ratio': 0.0, 'dynamics': {'pre_training': {'mode': 'intrinsic_reward', 'itr': 0, 'policy_itr': 20}, 'model': 'nn', 'ensemble': True, 'ensemble_model_count': 2, 'enable_particle_ensemble': True, 'particles': 2, 'obs_var': 1.0, 'intrinsic_reward_coeff': 1.0, 'ita': 1.0, 'mode': 'random', 'val': True, 'n_layers': 4, 'hidden_size': 1000, 'activation': 'relu', 'batch_size': 1000, 'learning_rate': 0.001, 'reg_coeff': 0.0, 'epochs': 200, 'kfac_params': {'learning_rate': 0.1, 'damping': 0.001, 'momentum': 0.9, 'kl_clip': 0.0001, 'cov_ema_decay': 0.99}}, 'policy': {'network_shape': [64, 64], 'init_logstd': 0.0, 'activation': 'tanh', 'reinitialize_every_itr': False}, 'trpo': {'horizon': 1000, 'gamma': 0.99, 'step_size': 0.01, 'iterations': 20, 'batch_size': 50000, 'gae': 0.95, 'visualization': False, 'visualize_iterations': [0]}, 'algo': 'trpo'}
Generating random rollouts.
Path 0 | total_timesteps 0.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 1 | total_timesteps 23.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 2 | total_timesteps 38.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 3 | total_timesteps 58.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 4 | total_timesteps 81.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 5 | total_timesteps 97.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 6 | total_timesteps 112.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 7 | total_timesteps 125.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 8 | total_timesteps 139.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 9 | total_timesteps 156.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 10 | total_timesteps 176.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 11 | total_timesteps 189.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 12 | total_timesteps 204.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 13 | total_timesteps 228.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 14 | total_timesteps 254.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 15 | total_timesteps 280.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 16 | total_timesteps 305.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 17 | total_timesteps 323.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 18 | total_timesteps 343.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 19 | total_timesteps 381.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 20 | total_timesteps 406.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 21 | total_timesteps 417.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 22 | total_timesteps 438.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 23 | total_timesteps 470.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 24 | total_timesteps 483.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 25 | total_timesteps 511.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 26 | total_timesteps 554.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 27 | total_timesteps 576.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 28 | total_timesteps 595.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 29 | total_timesteps 609.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 30 | total_timesteps 622.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 31 | total_timesteps 655.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 32 | total_timesteps 691.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 33 | total_timesteps 712.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 34 | total_timesteps 735.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 35 | total_timesteps 768.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 36 | total_timesteps 789.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 37 | total_timesteps 810.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 38 | total_timesteps 823.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 39 | total_timesteps 839.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 40 | total_timesteps 847.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 41 | total_timesteps 865.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 42 | total_timesteps 882.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 43 | total_timesteps 910.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 44 | total_timesteps 924.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 45 | total_timesteps 941.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 46 | total_timesteps 973.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 47 | total_timesteps 996.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 48 | total_timesteps 1014.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 49 | total_timesteps 1031.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 50 | total_timesteps 1055.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 51 | total_timesteps 1070.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 52 | total_timesteps 1081.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 53 | total_timesteps 1111.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 54 | total_timesteps 1124.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 55 | total_timesteps 1166.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 56 | total_timesteps 1204.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 57 | total_timesteps 1236.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 58 | total_timesteps 1249.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 59 | total_timesteps 1282.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 60 | total_timesteps 1298.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 61 | total_timesteps 1313.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 62 | total_timesteps 1336.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 63 | total_timesteps 1371.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 64 | total_timesteps 1389.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 65 | total_timesteps 1401.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 66 | total_timesteps 1416.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 67 | total_timesteps 1446.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 68 | total_timesteps 1481.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 69 | total_timesteps 1508.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 70 | total_timesteps 1533.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 71 | total_timesteps 1553.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 72 | total_timesteps 1603.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 73 | total_timesteps 1611.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 74 | total_timesteps 1631.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 75 | total_timesteps 1655.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 76 | total_timesteps 1670.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 77 | total_timesteps 1684.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 78 | total_timesteps 1707.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 79 | total_timesteps 1721.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 80 | total_timesteps 1766.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 81 | total_timesteps 1781.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 82 | total_timesteps 1808.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 83 | total_timesteps 1831.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 84 | total_timesteps 1846.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 85 | total_timesteps 1856.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 86 | total_timesteps 1872.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 87 | total_timesteps 1907.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 88 | total_timesteps 1918.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 89 | total_timesteps 1938.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 90 | total_timesteps 1958.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 91 | total_timesteps 1983.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 92 | total_timesteps 2014.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 93 | total_timesteps 2039.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 94 | total_timesteps 2063.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 95 | total_timesteps 2080.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 96 | total_timesteps 2107.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 97 | total_timesteps 2116.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 98 | total_timesteps 2133.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 99 | total_timesteps 2144.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 100 | total_timesteps 2154.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 101 | total_timesteps 2172.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 102 | total_timesteps 2196.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 103 | total_timesteps 2207.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 104 | total_timesteps 2227.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 105 | total_timesteps 2243.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 106 | total_timesteps 2260.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 107 | total_timesteps 2298.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 108 | total_timesteps 2325.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 109 | total_timesteps 2345.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 110 | total_timesteps 2382.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 111 | total_timesteps 2403.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 112 | total_timesteps 2441.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 113 | total_timesteps 2458.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 114 | total_timesteps 2476.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 115 | total_timesteps 2491.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 116 | total_timesteps 2511.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 117 | total_timesteps 2535.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 118 | total_timesteps 2553.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 119 | total_timesteps 2571.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 120 | total_timesteps 2604.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 121 | total_timesteps 2619.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 122 | total_timesteps 2632.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 123 | total_timesteps 2653.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 124 | total_timesteps 2669.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 125 | total_timesteps 2680.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 126 | total_timesteps 2703.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 127 | total_timesteps 2730.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 128 | total_timesteps 2753.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 129 | total_timesteps 2770.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 130 | total_timesteps 2781.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 131 | total_timesteps 2803.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 132 | total_timesteps 2813.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 133 | total_timesteps 2828.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 134 | total_timesteps 2838.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 135 | total_timesteps 2852.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 136 | total_timesteps 2886.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 137 | total_timesteps 2911.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 138 | total_timesteps 2946.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 139 | total_timesteps 2972.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 140 | total_timesteps 2985.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 141 | total_timesteps 3003.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 142 | total_timesteps 3012.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 143 | total_timesteps 3022.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 144 | total_timesteps 3045.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 145 | total_timesteps 3075.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 146 | total_timesteps 3110.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 147 | total_timesteps 3131.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 148 | total_timesteps 3148.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 149 | total_timesteps 3173.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 150 | total_timesteps 3190.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 151 | total_timesteps 3203.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 152 | total_timesteps 3233.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 153 | total_timesteps 3245.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 154 | total_timesteps 3271.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 155 | total_timesteps 3290.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 156 | total_timesteps 3307.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 157 | total_timesteps 3327.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 158 | total_timesteps 3338.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 159 | total_timesteps 3375.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 160 | total_timesteps 3411.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 161 | total_timesteps 3434.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 162 | total_timesteps 3457.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 163 | total_timesteps 3473.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 164 | total_timesteps 3488.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 165 | total_timesteps 3499.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 166 | total_timesteps 3514.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 167 | total_timesteps 3538.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 168 | total_timesteps 3554.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 169 | total_timesteps 3574.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 170 | total_timesteps 3600.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 171 | total_timesteps 3619.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 172 | total_timesteps 3645.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 173 | total_timesteps 3658.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 174 | total_timesteps 3687.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 175 | total_timesteps 3712.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 176 | total_timesteps 3727.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 177 | total_timesteps 3754.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 178 | total_timesteps 3781.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 179 | total_timesteps 3810.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 180 | total_timesteps 3826.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 181 | total_timesteps 3835.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 182 | total_timesteps 3866.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 183 | total_timesteps 3880.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 184 | total_timesteps 3900.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 185 | total_timesteps 3915.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 186 | total_timesteps 3943.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 187 | total_timesteps 3960.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 188 | total_timesteps 3972.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 189 | total_timesteps 4002.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 190 | total_timesteps 4037.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 191 | total_timesteps 4050.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 192 | total_timesteps 4072.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 193 | total_timesteps 4093.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 194 | total_timesteps 4103.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 195 | total_timesteps 4119.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 196 | total_timesteps 4142.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 197 | total_timesteps 4166.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 198 | total_timesteps 4180.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 199 | total_timesteps 4202.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 200 | total_timesteps 4224.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 201 | total_timesteps 4244.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 202 | total_timesteps 4269.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 203 | total_timesteps 4301.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 204 | total_timesteps 4317.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 205 | total_timesteps 4339.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 206 | total_timesteps 4368.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 207 | total_timesteps 4378.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 208 | total_timesteps 4394.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 209 | total_timesteps 4405.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 210 | total_timesteps 4436.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 211 | total_timesteps 4450.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 212 | total_timesteps 4472.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 213 | total_timesteps 4499.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 214 | total_timesteps 4521.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 215 | total_timesteps 4538.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 216 | total_timesteps 4557.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 217 | total_timesteps 4583.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 218 | total_timesteps 4610.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 219 | total_timesteps 4621.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 220 | total_timesteps 4641.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 221 | total_timesteps 4654.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 222 | total_timesteps 4666.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 223 | total_timesteps 4688.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 224 | total_timesteps 4714.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 225 | total_timesteps 4749.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 226 | total_timesteps 4770.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 227 | total_timesteps 4807.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 228 | total_timesteps 4827.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 229 | total_timesteps 4850.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 230 | total_timesteps 4868.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 231 | total_timesteps 4891.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 232 | total_timesteps 4906.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 233 | total_timesteps 4928.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 234 | total_timesteps 4955.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 235 | total_timesteps 4974.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 236 | total_timesteps 5004.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 237 | total_timesteps 5023.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 238 | total_timesteps 5039.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 239 | total_timesteps 5070.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 240 | total_timesteps 5087.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 241 | total_timesteps 5114.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 242 | total_timesteps 5134.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 243 | total_timesteps 5166.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 244 | total_timesteps 5185.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 245 | total_timesteps 5199.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 246 | total_timesteps 5219.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 247 | total_timesteps 5254.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 248 | total_timesteps 5275.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 249 | total_timesteps 5305.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 250 | total_timesteps 5337.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 251 | total_timesteps 5349.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 252 | total_timesteps 5360.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 253 | total_timesteps 5380.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 254 | total_timesteps 5409.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 255 | total_timesteps 5423.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 256 | total_timesteps 5436.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 257 | total_timesteps 5484.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 258 | total_timesteps 5499.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 259 | total_timesteps 5529.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 260 | total_timesteps 5546.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 261 | total_timesteps 5566.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 262 | total_timesteps 5585.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 263 | total_timesteps 5621.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 264 | total_timesteps 5631.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 265 | total_timesteps 5650.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 266 | total_timesteps 5670.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 267 | total_timesteps 5701.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 268 | total_timesteps 5708.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 269 | total_timesteps 5727.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 270 | total_timesteps 5768.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 271 | total_timesteps 5782.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 272 | total_timesteps 5796.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 273 | total_timesteps 5817.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 274 | total_timesteps 5835.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 275 | total_timesteps 5850.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 276 | total_timesteps 5879.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 277 | total_timesteps 5889.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 278 | total_timesteps 5902.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 279 | total_timesteps 5920.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 280 | total_timesteps 5941.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 281 | total_timesteps 5954.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 282 | total_timesteps 5966.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Path 283 | total_timesteps 5976.
number of affinization with epsilon = 3 is 0
average number of affinization = 0.0
Done generating random rollouts.
Creating normalization for training data.
Done creating normalization for training data.
Particle ensemble enabled? True
An ensemble of 2 dynamics model <class 'model.dynamics.NNDynamicsModel'> initialized
Train dynamics model with intrinsic reward only? False
Pre-training enabled. Using only intrinsic reward.
Pre-training dynamics model for 0 iterations...
Done pre-training dynamics model.
Using external reward only.
itr #0 | 
Fitting dynamics.
Fitting model 0 (0-based) in the ensemble of 2 models
Validation loss = 0.3667718470096588
Validation loss = 0.1164451315999031
Validation loss = 0.08797409385442734
Validation loss = 0.075174480676651
Validation loss = 0.07792405784130096
Validation loss = 0.06676110625267029
Validation loss = 0.07587417960166931
Validation loss = 0.05848544463515282
Validation loss = 0.0552092120051384
Validation loss = 0.05512760579586029
Validation loss = 0.05866602808237076
Validation loss = 0.05086616054177284
Validation loss = 0.048620566725730896
Validation loss = 0.05034608393907547
Validation loss = 0.06420588493347168
Validation loss = 0.046724412590265274
Validation loss = 0.05373411625623703
Validation loss = 0.048958875238895416
Validation loss = 0.04748765751719475
Validation loss = 0.04703662171959877
Fitting model 1 (0-based) in the ensemble of 2 models
Validation loss = 0.3865044414997101
Validation loss = 0.13194113969802856
Validation loss = 0.09305686503648758
Validation loss = 0.0777287632226944
Validation loss = 0.07095006108283997
Validation loss = 0.0692833885550499
Validation loss = 0.06252455711364746
Validation loss = 0.06251685321331024
Validation loss = 0.055011920630931854
Validation loss = 0.05486810952425003
Validation loss = 0.05298899859189987
Validation loss = 0.050267916172742844
Validation loss = 0.055446725338697433
Validation loss = 0.057604461908340454
Validation loss = 0.04840794578194618
Validation loss = 0.0506221279501915
Validation loss = 0.049558475613594055
Validation loss = 0.04974835366010666
Validation loss = 0.049202386289834976
Done fitting dynamics.
Updating randomness.
Done updating randomness.
Training policy using TRPO.
Re-initialize init_std.
Obtaining samples for iteration 0...
Obtaining samples for iteration 1...
Obtaining samples for iteration 2...
Obtaining samples for iteration 3...
Obtaining samples for iteration 4...
Obtaining samples for iteration 5...
Obtaining samples for iteration 6...
Obtaining samples for iteration 7...
Obtaining samples for iteration 8...
Obtaining samples for iteration 9...
Obtaining samples for iteration 10...
Obtaining samples for iteration 11...
Obtaining samples for iteration 12...
Obtaining samples for iteration 13...
Obtaining samples for iteration 14...
Obtaining samples for iteration 15...
Obtaining samples for iteration 16...
Obtaining samples for iteration 17...
Obtaining samples for iteration 18...
Obtaining samples for iteration 19...
Done training policy.
Generating on-policy rollouts.
Path 0 | total_timesteps 0.
number of affinization with epsilon = 3 is 28
average number of affinization = 0.09824561403508772
Path 1 | total_timesteps 33.
number of affinization with epsilon = 3 is 22
average number of affinization = 0.17482517482517482
Path 2 | total_timesteps 64.
number of affinization with epsilon = 3 is 20
average number of affinization = 0.24390243902439024
Path 3 | total_timesteps 86.
number of affinization with epsilon = 3 is 22
average number of affinization = 0.3194444444444444
Path 4 | total_timesteps 116.
number of affinization with epsilon = 3 is 11
average number of affinization = 0.356401384083045
Path 5 | total_timesteps 129.
number of affinization with epsilon = 3 is 18
average number of affinization = 0.41724137931034483
Path 6 | total_timesteps 153.
number of affinization with epsilon = 3 is 8
average number of affinization = 0.44329896907216493
Path 7 | total_timesteps 165.
number of affinization with epsilon = 3 is 11
average number of affinization = 0.4794520547945205
Path 8 | total_timesteps 180.
number of affinization with epsilon = 3 is 18
average number of affinization = 0.5392491467576792
Path 9 | total_timesteps 199.
number of affinization with epsilon = 3 is 13
average number of affinization = 0.5816326530612245
Path 10 | total_timesteps 215.
number of affinization with epsilon = 3 is 15
average number of affinization = 0.6305084745762712
Path 11 | total_timesteps 236.
number of affinization with epsilon = 3 is 12
average number of affinization = 0.668918918918919
Path 12 | total_timesteps 252.
number of affinization with epsilon = 3 is 27
average number of affinization = 0.7575757575757576
Path 13 | total_timesteps 282.
number of affinization with epsilon = 3 is 11
average number of affinization = 0.7919463087248322
Path 14 | total_timesteps 298.
number of affinization with epsilon = 3 is 17
average number of affinization = 0.8461538461538461
Path 15 | total_timesteps 320.
number of affinization with epsilon = 3 is 18
average number of affinization = 0.9033333333333333
Path 16 | total_timesteps 342.
number of affinization with epsilon = 3 is 19
average number of affinization = 0.9634551495016611
Path 17 | total_timesteps 363.
number of affinization with epsilon = 3 is 49
average number of affinization = 1.1225165562913908
Path 18 | total_timesteps 418.
number of affinization with epsilon = 3 is 14
average number of affinization = 1.165016501650165
Path 19 | total_timesteps 434.
number of affinization with epsilon = 3 is 13
average number of affinization = 1.2039473684210527
Path 20 | total_timesteps 450.
number of affinization with epsilon = 3 is 13
average number of affinization = 1.2426229508196722
Path 21 | total_timesteps 468.
number of affinization with epsilon = 3 is 23
average number of affinization = 1.3137254901960784
Path 22 | total_timesteps 496.
number of affinization with epsilon = 3 is 10
average number of affinization = 1.3420195439739413
Path 23 | total_timesteps 508.
number of affinization with epsilon = 3 is 16
average number of affinization = 1.3896103896103895
Path 24 | total_timesteps 529.
number of affinization with epsilon = 3 is 24
average number of affinization = 1.4627831715210355
Path 25 | total_timesteps 563.
number of affinization with epsilon = 3 is 20
average number of affinization = 1.5225806451612902
Path 26 | total_timesteps 590.
number of affinization with epsilon = 3 is 13
average number of affinization = 1.5594855305466238
Path 27 | total_timesteps 607.
number of affinization with epsilon = 3 is 11
average number of affinization = 1.5897435897435896
Path 28 | total_timesteps 621.
number of affinization with epsilon = 3 is 6
average number of affinization = 1.6038338658146964
Path 29 | total_timesteps 630.
number of affinization with epsilon = 3 is 15
average number of affinization = 1.6464968152866242
Path 30 | total_timesteps 648.
number of affinization with epsilon = 3 is 19
average number of affinization = 1.7015873015873015
Path 31 | total_timesteps 670.
number of affinization with epsilon = 3 is 14
average number of affinization = 1.740506329113924
Path 32 | total_timesteps 688.
number of affinization with epsilon = 3 is 20
average number of affinization = 1.7981072555205047
Path 33 | total_timesteps 712.
number of affinization with epsilon = 3 is 13
average number of affinization = 1.8333333333333333
Path 34 | total_timesteps 729.
number of affinization with epsilon = 3 is 21
average number of affinization = 1.8934169278996866
Path 35 | total_timesteps 754.
number of affinization with epsilon = 3 is 24
average number of affinization = 1.9625
Path 36 | total_timesteps 784.
number of affinization with epsilon = 3 is 11
average number of affinization = 1.9906542056074767
Path 37 | total_timesteps 802.
number of affinization with epsilon = 3 is 17
average number of affinization = 2.0372670807453415
Path 38 | total_timesteps 822.
number of affinization with epsilon = 3 is 11
average number of affinization = 2.065015479876161
Path 39 | total_timesteps 834.
number of affinization with epsilon = 3 is 9
average number of affinization = 2.0864197530864197
Path 40 | total_timesteps 847.
number of affinization with epsilon = 3 is 13
average number of affinization = 2.12
Path 41 | total_timesteps 863.
number of affinization with epsilon = 3 is 16
average number of affinization = 2.1625766871165646
Path 42 | total_timesteps 883.
number of affinization with epsilon = 3 is 18
average number of affinization = 2.2110091743119265
Path 43 | total_timesteps 907.
number of affinization with epsilon = 3 is 12
average number of affinization = 2.2408536585365852
Path 44 | total_timesteps 922.
number of affinization with epsilon = 3 is 18
average number of affinization = 2.288753799392097
Path 45 | total_timesteps 941.
number of affinization with epsilon = 3 is 26
average number of affinization = 2.360606060606061
Path 46 | total_timesteps 974.
number of affinization with epsilon = 3 is 25
average number of affinization = 2.4290030211480365
Path 47 | total_timesteps 1010.
number of affinization with epsilon = 3 is 20
average number of affinization = 2.4819277108433737
Path 48 | total_timesteps 1035.
number of affinization with epsilon = 3 is 21
average number of affinization = 2.5375375375375375
Path 49 | total_timesteps 1060.
number of affinization with epsilon = 3 is 26
average number of affinization = 2.6077844311377247
Path 50 | total_timesteps 1095.
number of affinization with epsilon = 3 is 14
average number of affinization = 2.6417910447761193
Path 51 | total_timesteps 1113.
number of affinization with epsilon = 3 is 14
average number of affinization = 2.675595238095238
Path 52 | total_timesteps 1132.
number of affinization with epsilon = 3 is 15
average number of affinization = 2.712166172106825
Path 53 | total_timesteps 1153.
number of affinization with epsilon = 3 is 14
average number of affinization = 2.7455621301775146
Path 54 | total_timesteps 1170.
number of affinization with epsilon = 3 is 14
average number of affinization = 2.7787610619469025
Path 55 | total_timesteps 1189.
number of affinization with epsilon = 3 is 21
average number of affinization = 2.8323529411764707
Path 56 | total_timesteps 1216.
number of affinization with epsilon = 3 is 18
average number of affinization = 2.87683284457478
Path 57 | total_timesteps 1241.
number of affinization with epsilon = 3 is 23
average number of affinization = 2.935672514619883
Path 58 | total_timesteps 1268.
number of affinization with epsilon = 3 is 18
average number of affinization = 2.979591836734694
Path 59 | total_timesteps 1290.
number of affinization with epsilon = 3 is 19
average number of affinization = 3.0261627906976742
Path 60 | total_timesteps 1314.
number of affinization with epsilon = 3 is 12
average number of affinization = 3.0521739130434784
Path 61 | total_timesteps 1329.
number of affinization with epsilon = 3 is 24
average number of affinization = 3.11271676300578
Path 62 | total_timesteps 1362.
number of affinization with epsilon = 3 is 28
average number of affinization = 3.1844380403458215
Path 63 | total_timesteps 1395.
number of affinization with epsilon = 3 is 16
average number of affinization = 3.221264367816092
Path 64 | total_timesteps 1413.
number of affinization with epsilon = 3 is 21
average number of affinization = 3.2722063037249285
Path 65 | total_timesteps 1443.
number of affinization with epsilon = 3 is 34
average number of affinization = 3.36
Path 66 | total_timesteps 1484.
number of affinization with epsilon = 3 is 23
average number of affinization = 3.415954415954416
Path 67 | total_timesteps 1510.
number of affinization with epsilon = 3 is 15
average number of affinization = 3.4488636363636362
Path 68 | total_timesteps 1530.
number of affinization with epsilon = 3 is 39
average number of affinization = 3.54957507082153
Path 69 | total_timesteps 1574.
number of affinization with epsilon = 3 is 10
average number of affinization = 3.5677966101694913
Path 70 | total_timesteps 1588.
number of affinization with epsilon = 3 is 7
average number of affinization = 3.5774647887323945
Path 71 | total_timesteps 1599.
number of affinization with epsilon = 3 is 15
average number of affinization = 3.609550561797753
Path 72 | total_timesteps 1619.
number of affinization with epsilon = 3 is 22
average number of affinization = 3.661064425770308
Path 73 | total_timesteps 1643.
number of affinization with epsilon = 3 is 18
average number of affinization = 3.701117318435754
Path 74 | total_timesteps 1664.
number of affinization with epsilon = 3 is 27
average number of affinization = 3.766016713091922
Path 75 | total_timesteps 1697.
number of affinization with epsilon = 3 is 17
average number of affinization = 3.8027777777777776
Path 76 | total_timesteps 1722.
number of affinization with epsilon = 3 is 20
average number of affinization = 3.847645429362881
Path 77 | total_timesteps 1746.
number of affinization with epsilon = 3 is 12
average number of affinization = 3.8701657458563536
Path 78 | total_timesteps 1761.
number of affinization with epsilon = 3 is 8
average number of affinization = 3.881542699724518
Path 79 | total_timesteps 1774.
number of affinization with epsilon = 3 is 10
average number of affinization = 3.8983516483516483
Path 80 | total_timesteps 1787.
number of affinization with epsilon = 3 is 12
average number of affinization = 3.9205479452054797
Path 81 | total_timesteps 1801.
number of affinization with epsilon = 3 is 11
average number of affinization = 3.939890710382514
Path 82 | total_timesteps 1813.
number of affinization with epsilon = 3 is 14
average number of affinization = 3.9673024523160763
Path 83 | total_timesteps 1833.
number of affinization with epsilon = 3 is 10
average number of affinization = 3.983695652173913
Path 84 | total_timesteps 1851.
number of affinization with epsilon = 3 is 11
average number of affinization = 4.002710027100271
Path 85 | total_timesteps 1866.
number of affinization with epsilon = 3 is 20
average number of affinization = 4.045945945945946
Path 86 | total_timesteps 1890.
number of affinization with epsilon = 3 is 26
average number of affinization = 4.105121293800539
Path 87 | total_timesteps 1919.
number of affinization with epsilon = 3 is 13
average number of affinization = 4.129032258064516
Path 88 | total_timesteps 1940.
number of affinization with epsilon = 3 is 8
average number of affinization = 4.13941018766756
Path 89 | total_timesteps 1951.
number of affinization with epsilon = 3 is 14
average number of affinization = 4.165775401069519
Path 90 | total_timesteps 1971.
number of affinization with epsilon = 3 is 7
average number of affinization = 4.173333333333333
Path 91 | total_timesteps 1981.
number of affinization with epsilon = 3 is 11
average number of affinization = 4.191489361702128
Path 92 | total_timesteps 1996.
number of affinization with epsilon = 3 is 13
average number of affinization = 4.2148541114058355
Path 93 | total_timesteps 2012.
number of affinization with epsilon = 3 is 12
average number of affinization = 4.235449735449736
Path 94 | total_timesteps 2026.
number of affinization with epsilon = 3 is 51
average number of affinization = 4.358839050131926
Path 95 | total_timesteps 2086.
number of affinization with epsilon = 3 is 22
average number of affinization = 4.405263157894737
Path 96 | total_timesteps 2114.
number of affinization with epsilon = 3 is 15
average number of affinization = 4.433070866141732
Path 97 | total_timesteps 2133.
number of affinization with epsilon = 3 is 18
average number of affinization = 4.468586387434555
Path 98 | total_timesteps 2153.
number of affinization with epsilon = 3 is 10
average number of affinization = 4.483028720626632
Path 99 | total_timesteps 2166.
number of affinization with epsilon = 3 is 7
average number of affinization = 4.489583333333333
Path 100 | total_timesteps 2174.
number of affinization with epsilon = 3 is 19
average number of affinization = 4.527272727272727
Path 101 | total_timesteps 2200.
number of affinization with epsilon = 3 is 11
average number of affinization = 4.544041450777202
Path 102 | total_timesteps 2213.
number of affinization with epsilon = 3 is 21
average number of affinization = 4.58656330749354
Path 103 | total_timesteps 2239.
number of affinization with epsilon = 3 is 11
average number of affinization = 4.603092783505154
Path 104 | total_timesteps 2252.
number of affinization with epsilon = 3 is 15
average number of affinization = 4.629820051413882
Path 105 | total_timesteps 2270.
number of affinization with epsilon = 3 is 20
average number of affinization = 4.6692307692307695
Path 106 | total_timesteps 2299.
number of affinization with epsilon = 3 is 20
average number of affinization = 4.708439897698209
Path 107 | total_timesteps 2323.
number of affinization with epsilon = 3 is 5
average number of affinization = 4.709183673469388
Path 108 | total_timesteps 2332.
number of affinization with epsilon = 3 is 17
average number of affinization = 4.740458015267175
Path 109 | total_timesteps 2352.
number of affinization with epsilon = 3 is 16
average number of affinization = 4.769035532994923
Path 110 | total_timesteps 2373.
number of affinization with epsilon = 3 is 11
average number of affinization = 4.784810126582278
Path 111 | total_timesteps 2390.
number of affinization with epsilon = 3 is 32
average number of affinization = 4.853535353535354
Path 112 | total_timesteps 2427.
number of affinization with epsilon = 3 is 12
average number of affinization = 4.871536523929471
Path 113 | total_timesteps 2442.
number of affinization with epsilon = 3 is 24
average number of affinization = 4.919597989949748
Path 114 | total_timesteps 2471.
number of affinization with epsilon = 3 is 18
average number of affinization = 4.9523809523809526
Path 115 | total_timesteps 2492.
number of affinization with epsilon = 3 is 14
average number of affinization = 4.975
Path 116 | total_timesteps 2508.
number of affinization with epsilon = 3 is 23
average number of affinization = 5.019950124688279
Path 117 | total_timesteps 2536.
number of affinization with epsilon = 3 is 9
average number of affinization = 5.029850746268656
Path 118 | total_timesteps 2549.
number of affinization with epsilon = 3 is 10
average number of affinization = 5.042183622828784
Path 119 | total_timesteps 2561.
number of affinization with epsilon = 3 is 12
average number of affinization = 5.0594059405940595
Path 120 | total_timesteps 2574.
number of affinization with epsilon = 3 is 16
average number of affinization = 5.08641975308642
Path 121 | total_timesteps 2594.
number of affinization with epsilon = 3 is 20
average number of affinization = 5.123152709359606
Path 122 | total_timesteps 2618.
number of affinization with epsilon = 3 is 11
average number of affinization = 5.137592137592137
Path 123 | total_timesteps 2633.
number of affinization with epsilon = 3 is 16
average number of affinization = 5.16421568627451
Path 124 | total_timesteps 2651.
number of affinization with epsilon = 3 is 33
average number of affinization = 5.232273838630807
Path 125 | total_timesteps 2693.
number of affinization with epsilon = 3 is 18
average number of affinization = 5.263414634146342
Path 126 | total_timesteps 2716.
number of affinization with epsilon = 3 is 20
average number of affinization = 5.299270072992701
Path 127 | total_timesteps 2742.
number of affinization with epsilon = 3 is 22
average number of affinization = 5.339805825242719
Path 128 | total_timesteps 2770.
number of affinization with epsilon = 3 is 31
average number of affinization = 5.401937046004843
Path 129 | total_timesteps 2806.
number of affinization with epsilon = 3 is 9
average number of affinization = 5.4106280193236715
Path 130 | total_timesteps 2818.
number of affinization with epsilon = 3 is 24
average number of affinization = 5.455421686746988
Path 131 | total_timesteps 2848.
number of affinization with epsilon = 3 is 14
average number of affinization = 5.475961538461538
Path 132 | total_timesteps 2866.
number of affinization with epsilon = 3 is 24
average number of affinization = 5.520383693045564
Path 133 | total_timesteps 2895.
number of affinization with epsilon = 3 is 34
average number of affinization = 5.588516746411483
Path 134 | total_timesteps 2938.
number of affinization with epsilon = 3 is 22
average number of affinization = 5.627684964200477
Path 135 | total_timesteps 2963.
number of affinization with epsilon = 3 is 22
average number of affinization = 5.666666666666667
Path 136 | total_timesteps 2990.
number of affinization with epsilon = 3 is 16
average number of affinization = 5.6912114014251785
Path 137 | total_timesteps 3008.
number of affinization with epsilon = 3 is 14
average number of affinization = 5.710900473933649
Path 138 | total_timesteps 3027.
number of affinization with epsilon = 3 is 9
average number of affinization = 5.718676122931442
Path 139 | total_timesteps 3041.
number of affinization with epsilon = 3 is 27
average number of affinization = 5.768867924528302
Path 140 | total_timesteps 3076.
number of affinization with epsilon = 3 is 15
average number of affinization = 5.790588235294118
Path 141 | total_timesteps 3097.
number of affinization with epsilon = 3 is 10
average number of affinization = 5.800469483568075
Path 142 | total_timesteps 3109.
number of affinization with epsilon = 3 is 13
average number of affinization = 5.817330210772834
Path 143 | total_timesteps 3125.
number of affinization with epsilon = 3 is 23
average number of affinization = 5.857476635514018
Path 144 | total_timesteps 3150.
number of affinization with epsilon = 3 is 6
average number of affinization = 5.857808857808858
Path 145 | total_timesteps 3158.
number of affinization with epsilon = 3 is 14
average number of affinization = 5.876744186046512
Path 146 | total_timesteps 3173.
number of affinization with epsilon = 3 is 9
average number of affinization = 5.8839907192575405
Path 147 | total_timesteps 3186.
number of affinization with epsilon = 3 is 20
average number of affinization = 5.916666666666667
Path 148 | total_timesteps 3216.
number of affinization with epsilon = 3 is 21
average number of affinization = 5.951501154734411
Path 149 | total_timesteps 3241.
number of affinization with epsilon = 3 is 13
average number of affinization = 5.967741935483871
Path 150 | total_timesteps 3257.
number of affinization with epsilon = 3 is 17
average number of affinization = 5.993103448275862
Path 151 | total_timesteps 3277.
number of affinization with epsilon = 3 is 20
average number of affinization = 6.025229357798165
Path 152 | total_timesteps 3303.
number of affinization with epsilon = 3 is 7
average number of affinization = 6.02745995423341
Path 153 | total_timesteps 3311.
number of affinization with epsilon = 3 is 14
average number of affinization = 6.045662100456621
Path 154 | total_timesteps 3327.
number of affinization with epsilon = 3 is 17
average number of affinization = 6.070615034168565
Path 155 | total_timesteps 3349.
number of affinization with epsilon = 3 is 12
average number of affinization = 6.084090909090909
Path 156 | total_timesteps 3364.
number of affinization with epsilon = 3 is 7
average number of affinization = 6.086167800453515
Path 157 | total_timesteps 3374.
number of affinization with epsilon = 3 is 13
average number of affinization = 6.101809954751131
Path 158 | total_timesteps 3391.
number of affinization with epsilon = 3 is 21
average number of affinization = 6.135440180586907
Path 159 | total_timesteps 3415.
number of affinization with epsilon = 3 is 30
average number of affinization = 6.1891891891891895
Path 160 | total_timesteps 3450.
number of affinization with epsilon = 3 is 23
average number of affinization = 6.226966292134832
Path 161 | total_timesteps 3477.
number of affinization with epsilon = 3 is 29
average number of affinization = 6.278026905829597
Path 162 | total_timesteps 3514.
number of affinization with epsilon = 3 is 25
average number of affinization = 6.319910514541387
Path 163 | total_timesteps 3545.
number of affinization with epsilon = 3 is 13
average number of affinization = 6.334821428571429
Path 164 | total_timesteps 3561.
number of affinization with epsilon = 3 is 12
average number of affinization = 6.347438752783964
Path 165 | total_timesteps 3574.
number of affinization with epsilon = 3 is 45
average number of affinization = 6.433333333333334
Path 166 | total_timesteps 3624.
number of affinization with epsilon = 3 is 12
average number of affinization = 6.445676274944567
Path 167 | total_timesteps 3638.
number of affinization with epsilon = 3 is 12
average number of affinization = 6.457964601769912
Path 168 | total_timesteps 3652.
number of affinization with epsilon = 3 is 14
average number of affinization = 6.474613686534217
Path 169 | total_timesteps 3669.
number of affinization with epsilon = 3 is 12
average number of affinization = 6.486784140969163
Path 170 | total_timesteps 3684.
number of affinization with epsilon = 3 is 27
average number of affinization = 6.531868131868132
Path 171 | total_timesteps 3719.
number of affinization with epsilon = 3 is 14
average number of affinization = 6.548245614035087
Path 172 | total_timesteps 3738.
number of affinization with epsilon = 3 is 18
average number of affinization = 6.573304157549234
Path 173 | total_timesteps 3761.
number of affinization with epsilon = 3 is 14
average number of affinization = 6.5895196506550215
Path 174 | total_timesteps 3777.
number of affinization with epsilon = 3 is 33
average number of affinization = 6.647058823529412
Path 175 | total_timesteps 3812.
number of affinization with epsilon = 3 is 17
average number of affinization = 6.6695652173913045
Path 176 | total_timesteps 3833.
number of affinization with epsilon = 3 is 12
average number of affinization = 6.681127982646421
Path 177 | total_timesteps 3848.
number of affinization with epsilon = 3 is 11
average number of affinization = 6.690476190476191
Path 178 | total_timesteps 3860.
number of affinization with epsilon = 3 is 16
average number of affinization = 6.7105831533477325
Path 179 | total_timesteps 3884.
number of affinization with epsilon = 3 is 10
average number of affinization = 6.717672413793103
Path 180 | total_timesteps 3897.
number of affinization with epsilon = 3 is 37
average number of affinization = 6.7827956989247316
Path 181 | total_timesteps 3943.
number of affinization with epsilon = 3 is 11
average number of affinization = 6.791845493562231
Path 182 | total_timesteps 3956.
number of affinization with epsilon = 3 is 23
average number of affinization = 6.826552462526767
Path 183 | total_timesteps 3982.
number of affinization with epsilon = 3 is 41
average number of affinization = 6.89957264957265
Path 184 | total_timesteps 4033.
number of affinization with epsilon = 3 is 21
average number of affinization = 6.929637526652452
Path 185 | total_timesteps 4071.
number of affinization with epsilon = 3 is 16
average number of affinization = 6.948936170212766
Path 186 | total_timesteps 4095.
number of affinization with epsilon = 3 is 9
average number of affinization = 6.953290870488322
Path 187 | total_timesteps 4108.
number of affinization with epsilon = 3 is 12
average number of affinization = 6.963983050847458
Path 188 | total_timesteps 4122.
number of affinization with epsilon = 3 is 14
average number of affinization = 6.978858350951374
Path 189 | total_timesteps 4140.
number of affinization with epsilon = 3 is 35
average number of affinization = 7.037974683544304
Path 190 | total_timesteps 4184.
number of affinization with epsilon = 3 is 14
average number of affinization = 7.052631578947368
Path 191 | total_timesteps 4201.
number of affinization with epsilon = 3 is 11
average number of affinization = 7.060924369747899
Path 192 | total_timesteps 4215.
number of affinization with epsilon = 3 is 29
average number of affinization = 7.1069182389937104
Path 193 | total_timesteps 4254.
number of affinization with epsilon = 3 is 5
average number of affinization = 7.102510460251046
Path 194 | total_timesteps 4264.
number of affinization with epsilon = 3 is 38
average number of affinization = 7.167014613778706
Path 195 | total_timesteps 4315.
number of affinization with epsilon = 3 is 24
average number of affinization = 7.202083333333333
Path 196 | total_timesteps 4343.
number of affinization with epsilon = 3 is 17
average number of affinization = 7.222453222453223
Path 197 | total_timesteps 4363.
number of affinization with epsilon = 3 is 13
average number of affinization = 7.234439834024896
Path 198 | total_timesteps 4378.
number of affinization with epsilon = 3 is 14
average number of affinization = 7.248447204968944
Path 199 | total_timesteps 4396.
number of affinization with epsilon = 3 is 10
average number of affinization = 7.2541322314049586
Path 200 | total_timesteps 4409.
number of affinization with epsilon = 3 is 7
average number of affinization = 7.25360824742268
Path 201 | total_timesteps 4421.
number of affinization with epsilon = 3 is 22
average number of affinization = 7.283950617283951
Path 202 | total_timesteps 4452.
number of affinization with epsilon = 3 is 8
average number of affinization = 7.285420944558521
Path 203 | total_timesteps 4462.
number of affinization with epsilon = 3 is 19
average number of affinization = 7.309426229508197
Path 204 | total_timesteps 4483.
number of affinization with epsilon = 3 is 20
average number of affinization = 7.335378323108385
Path 205 | total_timesteps 4506.
number of affinization with epsilon = 3 is 17
average number of affinization = 7.355102040816327
Path 206 | total_timesteps 4528.
number of affinization with epsilon = 3 is 16
average number of affinization = 7.372708757637475
Path 207 | total_timesteps 4546.
number of affinization with epsilon = 3 is 17
average number of affinization = 7.392276422764228
Path 208 | total_timesteps 4568.
number of affinization with epsilon = 3 is 12
average number of affinization = 7.401622718052739
Path 209 | total_timesteps 4582.
number of affinization with epsilon = 3 is 25
average number of affinization = 7.437246963562753
Path 210 | total_timesteps 4615.
number of affinization with epsilon = 3 is 20
average number of affinization = 7.462626262626262
Path 211 | total_timesteps 4637.
number of affinization with epsilon = 3 is 8
average number of affinization = 7.463709677419355
Path 212 | total_timesteps 4648.
number of affinization with epsilon = 3 is 10
average number of affinization = 7.468812877263582
Path 213 | total_timesteps 4661.
number of affinization with epsilon = 3 is 14
average number of affinization = 7.481927710843373
Path 214 | total_timesteps 4676.
number of affinization with epsilon = 3 is 11
average number of affinization = 7.488977955911824
Path 215 | total_timesteps 4690.
number of affinization with epsilon = 3 is 10
average number of affinization = 7.494
Path 216 | total_timesteps 4701.
number of affinization with epsilon = 3 is 13
average number of affinization = 7.50499001996008
Path 217 | total_timesteps 4718.
number of affinization with epsilon = 3 is 10
average number of affinization = 7.50996015936255
Path 218 | total_timesteps 4731.
number of affinization with epsilon = 3 is 21
average number of affinization = 7.536779324055666
Path 219 | total_timesteps 4757.
number of affinization with epsilon = 3 is 14
average number of affinization = 7.549603174603175
Path 220 | total_timesteps 4773.
number of affinization with epsilon = 3 is 15
average number of affinization = 7.564356435643564
Path 221 | total_timesteps 4792.
number of affinization with epsilon = 3 is 10
average number of affinization = 7.569169960474309
Path 222 | total_timesteps 4804.
number of affinization with epsilon = 3 is 16
average number of affinization = 7.585798816568047
Path 223 | total_timesteps 4823.
number of affinization with epsilon = 3 is 22
average number of affinization = 7.6141732283464565
Path 224 | total_timesteps 4849.
number of affinization with epsilon = 3 is 26
average number of affinization = 7.650294695481336
Path 225 | total_timesteps 4880.
number of affinization with epsilon = 3 is 14
average number of affinization = 7.662745098039216
Path 226 | total_timesteps 4895.
number of affinization with epsilon = 3 is 14
average number of affinization = 7.675146771037182
Path 227 | total_timesteps 4913.
number of affinization with epsilon = 3 is 21
average number of affinization = 7.701171875
Path 228 | total_timesteps 4942.
number of affinization with epsilon = 3 is 7
average number of affinization = 7.699805068226121
Path 229 | total_timesteps 4952.
number of affinization with epsilon = 3 is 11
average number of affinization = 7.706225680933852
Path 230 | total_timesteps 4966.
number of affinization with epsilon = 3 is 10
average number of affinization = 7.710679611650486
Path 231 | total_timesteps 4981.
number of affinization with epsilon = 3 is 10
average number of affinization = 7.715116279069767
Path 232 | total_timesteps 4992.
number of affinization with epsilon = 3 is 8
average number of affinization = 7.715667311411992
Path 233 | total_timesteps 5002.
number of affinization with epsilon = 3 is 21
average number of affinization = 7.741312741312742
Path 234 | total_timesteps 5034.
number of affinization with epsilon = 3 is 22
average number of affinization = 7.76878612716763
Path 235 | total_timesteps 5061.
number of affinization with epsilon = 3 is 12
average number of affinization = 7.776923076923077
Path 236 | total_timesteps 5081.
number of affinization with epsilon = 3 is 11
average number of affinization = 7.7831094049904035
Path 237 | total_timesteps 5103.
number of affinization with epsilon = 3 is 6
average number of affinization = 7.7796934865900385
Path 238 | total_timesteps 5112.
number of affinization with epsilon = 3 is 29
average number of affinization = 7.820267686424474
Path 239 | total_timesteps 5147.
number of affinization with epsilon = 3 is 12
average number of affinization = 7.82824427480916
Path 240 | total_timesteps 5162.
number of affinization with epsilon = 3 is 13
average number of affinization = 7.838095238095238
Path 241 | total_timesteps 5180.
number of affinization with epsilon = 3 is 9
average number of affinization = 7.840304182509506
Path 242 | total_timesteps 5198.
number of affinization with epsilon = 3 is 22
average number of affinization = 7.867172675521822
Path 243 | total_timesteps 5228.
number of affinization with epsilon = 3 is 8
average number of affinization = 7.867424242424242
Path 244 | total_timesteps 5239.
number of affinization with epsilon = 3 is 5
average number of affinization = 7.862003780718337
Path 245 | total_timesteps 5248.
number of affinization with epsilon = 3 is 11
average number of affinization = 7.867924528301887
Path 246 | total_timesteps 5262.
number of affinization with epsilon = 3 is 17
average number of affinization = 7.885122410546139
Path 247 | total_timesteps 5284.
number of affinization with epsilon = 3 is 20
average number of affinization = 7.907894736842105
Path 248 | total_timesteps 5309.
number of affinization with epsilon = 3 is 13
average number of affinization = 7.917448405253284
Path 249 | total_timesteps 5324.
number of affinization with epsilon = 3 is 25
average number of affinization = 7.949438202247191
Path 250 | total_timesteps 5352.
number of affinization with epsilon = 3 is 12
average number of affinization = 7.9570093457943925
Path 251 | total_timesteps 5365.
number of affinization with epsilon = 3 is 11
average number of affinization = 7.962686567164179
Path 252 | total_timesteps 5379.
number of affinization with epsilon = 3 is 12
average number of affinization = 7.970204841713222
Path 253 | total_timesteps 5393.
number of affinization with epsilon = 3 is 7
average number of affinization = 7.9684014869888475
Path 254 | total_timesteps 5401.
number of affinization with epsilon = 3 is 16
average number of affinization = 7.98330241187384
Path 255 | total_timesteps 5423.
number of affinization with epsilon = 3 is 13
average number of affinization = 7.992592592592593
Path 256 | total_timesteps 5437.
number of affinization with epsilon = 3 is 23
average number of affinization = 8.020332717190389
Path 257 | total_timesteps 5464.
number of affinization with epsilon = 3 is 12
average number of affinization = 8.027675276752767
Path 258 | total_timesteps 5477.
number of affinization with epsilon = 3 is 8
average number of affinization = 8.027624309392266
Path 259 | total_timesteps 5487.
number of affinization with epsilon = 3 is 14
average number of affinization = 8.038602941176471
Path 260 | total_timesteps 5508.
number of affinization with epsilon = 3 is 13
average number of affinization = 8.047706422018349
Path 261 | total_timesteps 5522.
number of affinization with epsilon = 3 is 8
average number of affinization = 8.047619047619047
Path 262 | total_timesteps 5531.
number of affinization with epsilon = 3 is 19
average number of affinization = 8.06764168190128
Path 263 | total_timesteps 5554.
number of affinization with epsilon = 3 is 12
average number of affinization = 8.074817518248175
Path 264 | total_timesteps 5568.
number of affinization with epsilon = 3 is 9
average number of affinization = 8.076502732240437
Path 265 | total_timesteps 5579.
number of affinization with epsilon = 3 is 21
average number of affinization = 8.1
Path 266 | total_timesteps 5605.
number of affinization with epsilon = 3 is 27
average number of affinization = 8.134301270417422
Path 267 | total_timesteps 5643.
number of affinization with epsilon = 3 is 10
average number of affinization = 8.13768115942029
Path 268 | total_timesteps 5656.
number of affinization with epsilon = 3 is 12
average number of affinization = 8.144665461121157
Path 269 | total_timesteps 5671.
number of affinization with epsilon = 3 is 13
average number of affinization = 8.153429602888087
Path 270 | total_timesteps 5687.
number of affinization with epsilon = 3 is 18
average number of affinization = 8.17117117117117
Path 271 | total_timesteps 5713.
number of affinization with epsilon = 3 is 7
average number of affinization = 8.16906474820144
Path 272 | total_timesteps 5723.
number of affinization with epsilon = 3 is 14
average number of affinization = 8.179533213644524
Path 273 | total_timesteps 5740.
number of affinization with epsilon = 3 is 19
average number of affinization = 8.198924731182796
Path 274 | total_timesteps 5772.
number of affinization with epsilon = 3 is 25
average number of affinization = 8.228980322003578
Path 275 | total_timesteps 5802.
number of affinization with epsilon = 3 is 16
average number of affinization = 8.242857142857142
Path 276 | total_timesteps 5825.
number of affinization with epsilon = 3 is 8
average number of affinization = 8.242424242424242
Path 277 | total_timesteps 5835.
number of affinization with epsilon = 3 is 23
average number of affinization = 8.268683274021353
Path 278 | total_timesteps 5865.
number of affinization with epsilon = 3 is 19
average number of affinization = 8.287744227353464
Path 279 | total_timesteps 5888.
number of affinization with epsilon = 3 is 11
average number of affinization = 8.292553191489361
Path 280 | total_timesteps 5903.
number of affinization with epsilon = 3 is 14
average number of affinization = 8.302654867256637
Path 281 | total_timesteps 5919.
number of affinization with epsilon = 3 is 12
average number of affinization = 8.309187279151944
Path 282 | total_timesteps 5935.
number of affinization with epsilon = 3 is 22
average number of affinization = 8.333333333333334
Path 283 | total_timesteps 5958.
number of affinization with epsilon = 3 is 7
average number of affinization = 8.330985915492958
Path 284 | total_timesteps 5967.
number of affinization with epsilon = 3 is 29
average number of affinization = 8.36731107205624
Done generating on-policy rollouts.
Updating normalization.
Done updating normalization.
----------------------------
| AverageReturn | -7.48    |
| Iteration     | 0        |
| MaximumReturn | 21.4     |
| MinimumReturn | -23.8    |
| TotalSamples  | 8016     |
----------------------------
itr #1 | 
Fitting dynamics.
Fitting model 0 (0-based) in the ensemble of 2 models
Validation loss = 0.04936937615275383
Validation loss = 0.04914809390902519
Validation loss = 0.042596422135829926
Validation loss = 0.039233386516571045
Validation loss = 0.043344348669052124
Validation loss = 0.03706338256597519
Validation loss = 0.03786253556609154
Validation loss = 0.03579983860254288
Validation loss = 0.038371749222278595
Validation loss = 0.03826477378606796
Validation loss = 0.03780871257185936
Validation loss = 0.04166534170508385
Fitting model 1 (0-based) in the ensemble of 2 models
Validation loss = 0.0568634569644928
Validation loss = 0.045516036450862885
Validation loss = 0.04459668695926666
Validation loss = 0.045229457318782806
Validation loss = 0.039431553333997726
Validation loss = 0.03921410068869591
Validation loss = 0.04400459676980972
Validation loss = 0.041934795677661896
Validation loss = 0.036560796201229095
Validation loss = 0.03671431541442871
Validation loss = 0.03578898310661316
Validation loss = 0.036421652883291245
Validation loss = 0.035826534032821655
Validation loss = 0.036166734993457794
Validation loss = 0.035663239657878876
Validation loss = 0.03825049474835396
Validation loss = 0.03476007655262947
Validation loss = 0.03456142172217369
Validation loss = 0.033765628933906555
Validation loss = 0.03572794422507286
Validation loss = 0.035055503249168396
Validation loss = 0.035093434154987335
Validation loss = 0.033050309866666794
Validation loss = 0.035476330667734146
Validation loss = 0.03322872146964073
Validation loss = 0.03544092923402786
Validation loss = 0.04068634659051895
Done fitting dynamics.
Updating randomness.
Done updating randomness.
Training policy using TRPO.
Re-initialize init_std.
Obtaining samples for iteration 0...
Obtaining samples for iteration 1...
Obtaining samples for iteration 2...
Obtaining samples for iteration 3...
Obtaining samples for iteration 4...
Obtaining samples for iteration 5...
Obtaining samples for iteration 6...
Obtaining samples for iteration 7...
Obtaining samples for iteration 8...
Obtaining samples for iteration 9...
Obtaining samples for iteration 10...
Obtaining samples for iteration 11...
Obtaining samples for iteration 12...
Obtaining samples for iteration 13...
Obtaining samples for iteration 14...
Obtaining samples for iteration 15...
Obtaining samples for iteration 16...
Obtaining samples for iteration 17...
Obtaining samples for iteration 18...
Obtaining samples for iteration 19...
Done training policy.
Generating on-policy rollouts.
Path 0 | total_timesteps 0.
number of affinization with epsilon = 3 is 18
average number of affinization = 8.384210526315789
Path 1 | total_timesteps 25.
number of affinization with epsilon = 3 is 26
average number of affinization = 8.415061295971979
Path 2 | total_timesteps 60.
number of affinization with epsilon = 3 is 15
average number of affinization = 8.426573426573427
Path 3 | total_timesteps 79.
number of affinization with epsilon = 3 is 25
average number of affinization = 8.455497382198953
Path 4 | total_timesteps 115.
number of affinization with epsilon = 3 is 33
average number of affinization = 8.498257839721255
Path 5 | total_timesteps 157.
number of affinization with epsilon = 3 is 36
average number of affinization = 8.546086956521739
Path 6 | total_timesteps 197.
number of affinization with epsilon = 3 is 9
average number of affinization = 8.546875
Path 7 | total_timesteps 207.
number of affinization with epsilon = 3 is 28
average number of affinization = 8.580589254766032
Path 8 | total_timesteps 242.
number of affinization with epsilon = 3 is 23
average number of affinization = 8.60553633217993
Path 9 | total_timesteps 269.
number of affinization with epsilon = 3 is 24
average number of affinization = 8.632124352331607
Path 10 | total_timesteps 298.
number of affinization with epsilon = 3 is 15
average number of affinization = 8.643103448275863
Path 11 | total_timesteps 315.
number of affinization with epsilon = 3 is 8
average number of affinization = 8.641996557659208
Path 12 | total_timesteps 329.
number of affinization with epsilon = 3 is 13
average number of affinization = 8.649484536082474
Path 13 | total_timesteps 348.
number of affinization with epsilon = 3 is 14
average number of affinization = 8.658662092624358
Path 14 | total_timesteps 367.
number of affinization with epsilon = 3 is 12
average number of affinization = 8.664383561643836
Path 15 | total_timesteps 383.
number of affinization with epsilon = 3 is 27
average number of affinization = 8.695726495726495
Path 16 | total_timesteps 425.
number of affinization with epsilon = 3 is 42
average number of affinization = 8.752559726962458
Path 17 | total_timesteps 479.
number of affinization with epsilon = 3 is 30
average number of affinization = 8.788756388415672
Path 18 | total_timesteps 518.
number of affinization with epsilon = 3 is 16
average number of affinization = 8.801020408163266
Path 19 | total_timesteps 540.
number of affinization with epsilon = 3 is 9
average number of affinization = 8.801358234295416
Path 20 | total_timesteps 556.
number of affinization with epsilon = 3 is 11
average number of affinization = 8.805084745762711
Path 21 | total_timesteps 574.
number of affinization with epsilon = 3 is 16
average number of affinization = 8.817258883248732
Path 22 | total_timesteps 592.
number of affinization with epsilon = 3 is 15
average number of affinization = 8.827702702702704
Path 23 | total_timesteps 610.
number of affinization with epsilon = 3 is 26
average number of affinization = 8.856661045531197
Path 24 | total_timesteps 638.
number of affinization with epsilon = 3 is 43
average number of affinization = 8.914141414141413
Path 25 | total_timesteps 690.
number of affinization with epsilon = 3 is 24
average number of affinization = 8.939495798319328
Path 26 | total_timesteps 722.
number of affinization with epsilon = 3 is 20
average number of affinization = 8.958053691275168
Path 27 | total_timesteps 748.
number of affinization with epsilon = 3 is 21
average number of affinization = 8.97822445561139
Path 28 | total_timesteps 771.
number of affinization with epsilon = 3 is 17
average number of affinization = 8.991638795986622
Path 29 | total_timesteps 792.
number of affinization with epsilon = 3 is 22
average number of affinization = 9.013355592654424
Path 30 | total_timesteps 818.
number of affinization with epsilon = 3 is 47
average number of affinization = 9.076666666666666
Path 31 | total_timesteps 880.
number of affinization with epsilon = 3 is 28
average number of affinization = 9.108153078202996
Path 32 | total_timesteps 915.
number of affinization with epsilon = 3 is 13
average number of affinization = 9.114617940199336
Path 33 | total_timesteps 931.
number of affinization with epsilon = 3 is 22
average number of affinization = 9.135986733001658
Path 34 | total_timesteps 957.
number of affinization with epsilon = 3 is 18
average number of affinization = 9.150662251655628
Path 35 | total_timesteps 980.
number of affinization with epsilon = 3 is 24
average number of affinization = 9.175206611570248
Path 36 | total_timesteps 1013.
number of affinization with epsilon = 3 is 22
average number of affinization = 9.196369636963697
Path 37 | total_timesteps 1042.
number of affinization with epsilon = 3 is 49
average number of affinization = 9.261943986820429
Path 38 | total_timesteps 1102.
number of affinization with epsilon = 3 is 20
average number of affinization = 9.279605263157896
Path 39 | total_timesteps 1125.
number of affinization with epsilon = 3 is 35
average number of affinization = 9.32183908045977
Path 40 | total_timesteps 1165.
number of affinization with epsilon = 3 is 14
average number of affinization = 9.329508196721312
Path 41 | total_timesteps 1182.
number of affinization with epsilon = 3 is 17
average number of affinization = 9.342062193126022
Path 42 | total_timesteps 1201.
number of affinization with epsilon = 3 is 16
average number of affinization = 9.352941176470589
Path 43 | total_timesteps 1219.
number of affinization with epsilon = 3 is 30
average number of affinization = 9.386623164763458
Path 44 | total_timesteps 1255.
number of affinization with epsilon = 3 is 22
average number of affinization = 9.407166123778502
Path 45 | total_timesteps 1283.
number of affinization with epsilon = 3 is 17
average number of affinization = 9.419512195121952
Path 46 | total_timesteps 1306.
number of affinization with epsilon = 3 is 32
average number of affinization = 9.456168831168831
Path 47 | total_timesteps 1343.
number of affinization with epsilon = 3 is 8
average number of affinization = 9.453808752025932
Path 48 | total_timesteps 1352.
number of affinization with epsilon = 3 is 20
average number of affinization = 9.470873786407767
Path 49 | total_timesteps 1374.
number of affinization with epsilon = 3 is 33
average number of affinization = 9.508885298869144
Path 50 | total_timesteps 1410.
number of affinization with epsilon = 3 is 10
average number of affinization = 9.509677419354839
Path 51 | total_timesteps 1422.
number of affinization with epsilon = 3 is 9
average number of affinization = 9.508856682769727
Path 52 | total_timesteps 1434.
number of affinization with epsilon = 3 is 50
average number of affinization = 9.57395498392283
Path 53 | total_timesteps 1490.
number of affinization with epsilon = 3 is 16
average number of affinization = 9.584269662921349
Path 54 | total_timesteps 1508.
number of affinization with epsilon = 3 is 13
average number of affinization = 9.58974358974359
Path 55 | total_timesteps 1523.
number of affinization with epsilon = 3 is 29
average number of affinization = 9.6208
Path 56 | total_timesteps 1559.
number of affinization with epsilon = 3 is 17
average number of affinization = 9.63258785942492
Path 57 | total_timesteps 1581.
number of affinization with epsilon = 3 is 17
average number of affinization = 9.644338118022329
Path 58 | total_timesteps 1608.
number of affinization with epsilon = 3 is 22
average number of affinization = 9.664012738853502
Path 59 | total_timesteps 1633.
number of affinization with epsilon = 3 is 14
average number of affinization = 9.670906200317965
Path 60 | total_timesteps 1649.
number of affinization with epsilon = 3 is 24
average number of affinization = 9.693650793650793
Path 61 | total_timesteps 1680.
number of affinization with epsilon = 3 is 35
average number of affinization = 9.733755942947703
Path 62 | total_timesteps 1721.
number of affinization with epsilon = 3 is 21
average number of affinization = 9.751582278481013
Path 63 | total_timesteps 1745.
number of affinization with epsilon = 3 is 21
average number of affinization = 9.769352290679304
Path 64 | total_timesteps 1770.
number of affinization with epsilon = 3 is 14
average number of affinization = 9.77602523659306
Path 65 | total_timesteps 1793.
number of affinization with epsilon = 3 is 12
average number of affinization = 9.779527559055119
Path 66 | total_timesteps 1808.
number of affinization with epsilon = 3 is 36
average number of affinization = 9.820754716981131
Path 67 | total_timesteps 1848.
number of affinization with epsilon = 3 is 17
average number of affinization = 9.832025117739404
Path 68 | total_timesteps 1868.
number of affinization with epsilon = 3 is 15
average number of affinization = 9.84012539184953
Path 69 | total_timesteps 1888.
number of affinization with epsilon = 3 is 17
average number of affinization = 9.85133020344288
Path 70 | total_timesteps 1910.
number of affinization with epsilon = 3 is 38
average number of affinization = 9.8953125
Path 71 | total_timesteps 1956.
number of affinization with epsilon = 3 is 20
average number of affinization = 9.911076443057722
Path 72 | total_timesteps 1985.
number of affinization with epsilon = 3 is 16
average number of affinization = 9.92056074766355
Path 73 | total_timesteps 2002.
number of affinization with epsilon = 3 is 18
average number of affinization = 9.933125972006222
Path 74 | total_timesteps 2024.
number of affinization with epsilon = 3 is 22
average number of affinization = 9.951863354037267
Path 75 | total_timesteps 2052.
number of affinization with epsilon = 3 is 33
average number of affinization = 9.987596899224807
Path 76 | total_timesteps 2093.
number of affinization with epsilon = 3 is 12
average number of affinization = 9.990712074303406
Path 77 | total_timesteps 2112.
number of affinization with epsilon = 3 is 20
average number of affinization = 10.006182380216384
Path 78 | total_timesteps 2140.
number of affinization with epsilon = 3 is 11
average number of affinization = 10.007716049382717
Path 79 | total_timesteps 2155.
number of affinization with epsilon = 3 is 14
average number of affinization = 10.01386748844376
Path 80 | total_timesteps 2177.
number of affinization with epsilon = 3 is 25
average number of affinization = 10.036923076923078
Path 81 | total_timesteps 2206.
number of affinization with epsilon = 3 is 29
average number of affinization = 10.06605222734255
Path 82 | total_timesteps 2243.
number of affinization with epsilon = 3 is 19
average number of affinization = 10.079754601226995
Path 83 | total_timesteps 2265.
number of affinization with epsilon = 3 is 11
average number of affinization = 10.081163859111792
Path 84 | total_timesteps 2277.
number of affinization with epsilon = 3 is 38
average number of affinization = 10.123853211009175
Path 85 | total_timesteps 2320.
number of affinization with epsilon = 3 is 12
average number of affinization = 10.126717557251908
Path 86 | total_timesteps 2334.
number of affinization with epsilon = 3 is 33
average number of affinization = 10.161585365853659
Path 87 | total_timesteps 2379.
number of affinization with epsilon = 3 is 22
average number of affinization = 10.179604261796042
Path 88 | total_timesteps 2404.
number of affinization with epsilon = 3 is 12
average number of affinization = 10.182370820668693
Path 89 | total_timesteps 2419.
number of affinization with epsilon = 3 is 16
average number of affinization = 10.191198786039454
Path 90 | total_timesteps 2440.
number of affinization with epsilon = 3 is 12
average number of affinization = 10.193939393939393
Path 91 | total_timesteps 2462.
number of affinization with epsilon = 3 is 16
average number of affinization = 10.202723146747353
Path 92 | total_timesteps 2481.
number of affinization with epsilon = 3 is 26
average number of affinization = 10.226586102719033
Path 93 | total_timesteps 2517.
number of affinization with epsilon = 3 is 15
average number of affinization = 10.233785822021115
Path 94 | total_timesteps 2534.
number of affinization with epsilon = 3 is 20
average number of affinization = 10.248493975903614
Path 95 | total_timesteps 2557.
number of affinization with epsilon = 3 is 36
average number of affinization = 10.287218045112782
Path 96 | total_timesteps 2601.
number of affinization with epsilon = 3 is 24
average number of affinization = 10.307807807807809
Path 97 | total_timesteps 2637.
number of affinization with epsilon = 3 is 27
average number of affinization = 10.332833583208396
Path 98 | total_timesteps 2671.
number of affinization with epsilon = 3 is 15
average number of affinization = 10.339820359281438
Path 99 | total_timesteps 2689.
number of affinization with epsilon = 3 is 18
average number of affinization = 10.351270553064275
Path 100 | total_timesteps 2712.
number of affinization with epsilon = 3 is 33
average number of affinization = 10.385074626865672
Path 101 | total_timesteps 2754.
number of affinization with epsilon = 3 is 16
average number of affinization = 10.39344262295082
Path 102 | total_timesteps 2773.
number of affinization with epsilon = 3 is 23
average number of affinization = 10.412202380952381
Path 103 | total_timesteps 2798.
number of affinization with epsilon = 3 is 61
average number of affinization = 10.487369985141159
Path 104 | total_timesteps 2870.
number of affinization with epsilon = 3 is 22
average number of affinization = 10.504451038575668
Path 105 | total_timesteps 2898.
number of affinization with epsilon = 3 is 22
average number of affinization = 10.521481481481482
Path 106 | total_timesteps 2923.
number of affinization with epsilon = 3 is 19
average number of affinization = 10.534023668639053
Path 107 | total_timesteps 2947.
number of affinization with epsilon = 3 is 8
average number of affinization = 10.530280649926144
Path 108 | total_timesteps 2959.
number of affinization with epsilon = 3 is 39
average number of affinization = 10.572271386430678
Path 109 | total_timesteps 3004.
number of affinization with epsilon = 3 is 20
average number of affinization = 10.586156111929307
Path 110 | total_timesteps 3030.
number of affinization with epsilon = 3 is 23
average number of affinization = 10.604411764705882
Path 111 | total_timesteps 3060.
number of affinization with epsilon = 3 is 22
average number of affinization = 10.62114537444934
Path 112 | total_timesteps 3085.
number of affinization with epsilon = 3 is 27
average number of affinization = 10.64516129032258
Path 113 | total_timesteps 3118.
number of affinization with epsilon = 3 is 16
average number of affinization = 10.653001464128844
Path 114 | total_timesteps 3138.
number of affinization with epsilon = 3 is 39
average number of affinization = 10.694444444444445
Path 115 | total_timesteps 3184.
number of affinization with epsilon = 3 is 23
average number of affinization = 10.712408759124088
Path 116 | total_timesteps 3210.
number of affinization with epsilon = 3 is 19
average number of affinization = 10.724489795918368
Path 117 | total_timesteps 3232.
number of affinization with epsilon = 3 is 15
average number of affinization = 10.730713245997089
Path 118 | total_timesteps 3252.
number of affinization with epsilon = 3 is 29
average number of affinization = 10.757267441860465
Path 119 | total_timesteps 3285.
number of affinization with epsilon = 3 is 20
average number of affinization = 10.770682148040638
Path 120 | total_timesteps 3310.
number of affinization with epsilon = 3 is 31
average number of affinization = 10.8
Path 121 | total_timesteps 3344.
number of affinization with epsilon = 3 is 22
average number of affinization = 10.816208393632417
Path 122 | total_timesteps 3371.
number of affinization with epsilon = 3 is 14
average number of affinization = 10.820809248554914
Path 123 | total_timesteps 3389.
number of affinization with epsilon = 3 is 18
average number of affinization = 10.831168831168831
Path 124 | total_timesteps 3409.
number of affinization with epsilon = 3 is 20
average number of affinization = 10.844380403458214
Path 125 | total_timesteps 3433.
number of affinization with epsilon = 3 is 25
average number of affinization = 10.864748201438848
Path 126 | total_timesteps 3466.
number of affinization with epsilon = 3 is 16
average number of affinization = 10.87212643678161
Path 127 | total_timesteps 3486.
number of affinization with epsilon = 3 is 14
average number of affinization = 10.87661406025825
Path 128 | total_timesteps 3507.
number of affinization with epsilon = 3 is 20
average number of affinization = 10.88968481375358
Path 129 | total_timesteps 3529.
number of affinization with epsilon = 3 is 15
average number of affinization = 10.895565092989985
Path 130 | total_timesteps 3548.
number of affinization with epsilon = 3 is 35
average number of affinization = 10.93
Path 131 | total_timesteps 3588.
number of affinization with epsilon = 3 is 21
average number of affinization = 10.944365192582026
Path 132 | total_timesteps 3612.
number of affinization with epsilon = 3 is 28
average number of affinization = 10.968660968660968
Path 133 | total_timesteps 3646.
number of affinization with epsilon = 3 is 16
average number of affinization = 10.975817923186344
Path 134 | total_timesteps 3665.
number of affinization with epsilon = 3 is 16
average number of affinization = 10.982954545454545
Path 135 | total_timesteps 3684.
number of affinization with epsilon = 3 is 18
average number of affinization = 10.99290780141844
Path 136 | total_timesteps 3708.
number of affinization with epsilon = 3 is 18
average number of affinization = 11.002832861189802
Path 137 | total_timesteps 3731.
number of affinization with epsilon = 3 is 21
average number of affinization = 11.016973125884016
Path 138 | total_timesteps 3763.
number of affinization with epsilon = 3 is 28
average number of affinization = 11.040960451977401
Path 139 | total_timesteps 3797.
number of affinization with epsilon = 3 is 27
average number of affinization = 11.063469675599436
Path 140 | total_timesteps 3831.
number of affinization with epsilon = 3 is 9
average number of affinization = 11.06056338028169
Path 141 | total_timesteps 3842.
number of affinization with epsilon = 3 is 18
average number of affinization = 11.070323488045007
Path 142 | total_timesteps 3865.
number of affinization with epsilon = 3 is 22
average number of affinization = 11.085674157303371
Path 143 | total_timesteps 3895.
number of affinization with epsilon = 3 is 20
average number of affinization = 11.098176718092567
Path 144 | total_timesteps 3922.
number of affinization with epsilon = 3 is 22
average number of affinization = 11.11344537815126
Path 145 | total_timesteps 3948.
number of affinization with epsilon = 3 is 28
average number of affinization = 11.137062937062938
Path 146 | total_timesteps 3982.
number of affinization with epsilon = 3 is 11
average number of affinization = 11.136871508379889
Path 147 | total_timesteps 3997.
number of affinization with epsilon = 3 is 12
average number of affinization = 11.138075313807532
Path 148 | total_timesteps 4010.
number of affinization with epsilon = 3 is 30
average number of affinization = 11.164345403899722
Path 149 | total_timesteps 4051.
number of affinization with epsilon = 3 is 22
average number of affinization = 11.179415855354659
Path 150 | total_timesteps 4077.
number of affinization with epsilon = 3 is 20
average number of affinization = 11.191666666666666
Path 151 | total_timesteps 4099.
number of affinization with epsilon = 3 is 27
average number of affinization = 11.21359223300971
Path 152 | total_timesteps 4133.
number of affinization with epsilon = 3 is 17
average number of affinization = 11.221606648199446
Path 153 | total_timesteps 4156.
number of affinization with epsilon = 3 is 14
average number of affinization = 11.225449515905947
Path 154 | total_timesteps 4178.
number of affinization with epsilon = 3 is 13
average number of affinization = 11.227900552486188
Path 155 | total_timesteps 4197.
number of affinization with epsilon = 3 is 19
average number of affinization = 11.238620689655173
Path 156 | total_timesteps 4218.
number of affinization with epsilon = 3 is 24
average number of affinization = 11.256198347107437
Path 157 | total_timesteps 4248.
number of affinization with epsilon = 3 is 26
average number of affinization = 11.276478679504814
Path 158 | total_timesteps 4277.
number of affinization with epsilon = 3 is 26
average number of affinization = 11.296703296703297
Path 159 | total_timesteps 4308.
number of affinization with epsilon = 3 is 31
average number of affinization = 11.323731138545954
Path 160 | total_timesteps 4345.
number of affinization with epsilon = 3 is 25
average number of affinization = 11.342465753424657
Path 161 | total_timesteps 4374.
number of affinization with epsilon = 3 is 26
average number of affinization = 11.3625170998632
Path 162 | total_timesteps 4407.
number of affinization with epsilon = 3 is 16
average number of affinization = 11.368852459016393
Path 163 | total_timesteps 4430.
number of affinization with epsilon = 3 is 27
average number of affinization = 11.390177353342429
Path 164 | total_timesteps 4464.
number of affinization with epsilon = 3 is 16
average number of affinization = 11.396457765667575
Path 165 | total_timesteps 4482.
number of affinization with epsilon = 3 is 15
average number of affinization = 11.401360544217686
Path 166 | total_timesteps 4501.
number of affinization with epsilon = 3 is 15
average number of affinization = 11.40625
Path 167 | total_timesteps 4518.
number of affinization with epsilon = 3 is 17
average number of affinization = 11.41383989145183
Path 168 | total_timesteps 4539.
number of affinization with epsilon = 3 is 10
average number of affinization = 11.411924119241192
Path 169 | total_timesteps 4552.
number of affinization with epsilon = 3 is 13
average number of affinization = 11.414073071718539
Path 170 | total_timesteps 4572.
number of affinization with epsilon = 3 is 45
average number of affinization = 11.45945945945946
Path 171 | total_timesteps 4623.
number of affinization with epsilon = 3 is 9
average number of affinization = 11.456140350877194
Path 172 | total_timesteps 4634.
number of affinization with epsilon = 3 is 13
average number of affinization = 11.45822102425876
Path 173 | total_timesteps 4651.
number of affinization with epsilon = 3 is 11
average number of affinization = 11.457604306864065
Path 174 | total_timesteps 4663.
number of affinization with epsilon = 3 is 18
average number of affinization = 11.466397849462366
Path 175 | total_timesteps 4688.
number of affinization with epsilon = 3 is 12
average number of affinization = 11.467114093959731
Path 176 | total_timesteps 4706.
number of affinization with epsilon = 3 is 21
average number of affinization = 11.479892761394101
Path 177 | total_timesteps 4730.
number of affinization with epsilon = 3 is 18
average number of affinization = 11.488621151271754
Path 178 | total_timesteps 4751.
number of affinization with epsilon = 3 is 15
average number of affinization = 11.493315508021391
Path 179 | total_timesteps 4777.
number of affinization with epsilon = 3 is 8
average number of affinization = 11.488651535380507
Path 180 | total_timesteps 4791.
number of affinization with epsilon = 3 is 8
average number of affinization = 11.484
Path 181 | total_timesteps 4800.
number of affinization with epsilon = 3 is 24
average number of affinization = 11.500665778961384
Path 182 | total_timesteps 4829.
number of affinization with epsilon = 3 is 82
average number of affinization = 11.59441489361702
Path 183 | total_timesteps 4930.
number of affinization with epsilon = 3 is 15
average number of affinization = 11.598937583001328
Path 184 | total_timesteps 4949.
number of affinization with epsilon = 3 is 34
average number of affinization = 11.628647214854112
Path 185 | total_timesteps 4985.
number of affinization with epsilon = 3 is 19
average number of affinization = 11.63841059602649
Path 186 | total_timesteps 5008.
number of affinization with epsilon = 3 is 29
average number of affinization = 11.661375661375661
Path 187 | total_timesteps 5045.
number of affinization with epsilon = 3 is 37
average number of affinization = 11.694848084544253
Path 188 | total_timesteps 5088.
number of affinization with epsilon = 3 is 22
average number of affinization = 11.70844327176781
Path 189 | total_timesteps 5122.
number of affinization with epsilon = 3 is 26
average number of affinization = 11.727272727272727
Path 190 | total_timesteps 5152.
number of affinization with epsilon = 3 is 15
average number of affinization = 11.73157894736842
Path 191 | total_timesteps 5174.
number of affinization with epsilon = 3 is 19
average number of affinization = 11.741130091984232
Path 192 | total_timesteps 5199.
number of affinization with epsilon = 3 is 23
average number of affinization = 11.755905511811024
Path 193 | total_timesteps 5227.
number of affinization with epsilon = 3 is 24
average number of affinization = 11.771952817824378
Path 194 | total_timesteps 5259.
number of affinization with epsilon = 3 is 7
average number of affinization = 11.765706806282722
Path 195 | total_timesteps 5269.
number of affinization with epsilon = 3 is 14
average number of affinization = 11.768627450980393
Path 196 | total_timesteps 5287.
number of affinization with epsilon = 3 is 18
average number of affinization = 11.776762402088773
Path 197 | total_timesteps 5307.
number of affinization with epsilon = 3 is 21
average number of affinization = 11.788787483702738
Path 198 | total_timesteps 5333.
number of affinization with epsilon = 3 is 12
average number of affinization = 11.7890625
Path 199 | total_timesteps 5347.
number of affinization with epsilon = 3 is 8
average number of affinization = 11.784135240572171
Path 200 | total_timesteps 5358.
number of affinization with epsilon = 3 is 31
average number of affinization = 11.809090909090909
Path 201 | total_timesteps 5398.
number of affinization with epsilon = 3 is 37
average number of affinization = 11.841763942931259
Path 202 | total_timesteps 5443.
number of affinization with epsilon = 3 is 7
average number of affinization = 11.835492227979275
Path 203 | total_timesteps 5454.
number of affinization with epsilon = 3 is 22
average number of affinization = 11.848641655886158
Path 204 | total_timesteps 5483.
number of affinization with epsilon = 3 is 18
average number of affinization = 11.856589147286822
Path 205 | total_timesteps 5507.
number of affinization with epsilon = 3 is 24
average number of affinization = 11.87225806451613
Path 206 | total_timesteps 5536.
number of affinization with epsilon = 3 is 20
average number of affinization = 11.882731958762887
Path 207 | total_timesteps 5566.
number of affinization with epsilon = 3 is 23
average number of affinization = 11.897039897039898
Path 208 | total_timesteps 5592.
number of affinization with epsilon = 3 is 28
average number of affinization = 11.917737789203084
Path 209 | total_timesteps 5622.
number of affinization with epsilon = 3 is 19
average number of affinization = 11.926829268292684
Path 210 | total_timesteps 5645.
number of affinization with epsilon = 3 is 11
average number of affinization = 11.925641025641026
Path 211 | total_timesteps 5664.
number of affinization with epsilon = 3 is 31
average number of affinization = 11.950064020486556
Path 212 | total_timesteps 5701.
number of affinization with epsilon = 3 is 33
average number of affinization = 11.976982097186701
Path 213 | total_timesteps 5739.
number of affinization with epsilon = 3 is 44
average number of affinization = 12.017879948914432
Path 214 | total_timesteps 5797.
number of affinization with epsilon = 3 is 20
average number of affinization = 12.028061224489797
Path 215 | total_timesteps 5824.
number of affinization with epsilon = 3 is 26
average number of affinization = 12.045859872611466
Path 216 | total_timesteps 5853.
number of affinization with epsilon = 3 is 23
average number of affinization = 12.059796437659033
Path 217 | total_timesteps 5887.
number of affinization with epsilon = 3 is 15
average number of affinization = 12.063532401524778
Path 218 | total_timesteps 5907.
number of affinization with epsilon = 3 is 22
average number of affinization = 12.076142131979696
Path 219 | total_timesteps 5932.
number of affinization with epsilon = 3 is 29
average number of affinization = 12.097591888466413
Path 220 | total_timesteps 5964.
number of affinization with epsilon = 3 is 34
average number of affinization = 12.125316455696202
Done generating on-policy rollouts.
Updating normalization.
Done updating normalization.
----------------------------
| AverageReturn | -6.47    |
| Iteration     | 1        |
| MaximumReturn | 38.8     |
| MinimumReturn | -31.1    |
| TotalSamples  | 12019    |
----------------------------
itr #2 | 
Fitting dynamics.
Fitting model 0 (0-based) in the ensemble of 2 models
Validation loss = 0.043772753328084946
Validation loss = 0.03590262308716774
Validation loss = 0.03429633378982544
Validation loss = 0.03437794744968414
Validation loss = 0.0321718193590641
Validation loss = 0.034918464720249176
Validation loss = 0.031774554401636124
Validation loss = 0.03340122476220131
Validation loss = 0.0349665991961956
Validation loss = 0.03223318234086037
Validation loss = 0.03221496194601059
Fitting model 1 (0-based) in the ensemble of 2 models
Validation loss = 0.04861266911029816
Validation loss = 0.03360813483595848
Validation loss = 0.03287488594651222
Validation loss = 0.03415890783071518
Validation loss = 0.031253088265657425
Validation loss = 0.030090196058154106
Validation loss = 0.031154662370681763
Validation loss = 0.031445447355508804
Validation loss = 0.03134896978735924
Validation loss = 0.03218626603484154
Done fitting dynamics.
Updating randomness.
Done updating randomness.
Training policy using TRPO.
Re-initialize init_std.
Obtaining samples for iteration 0...
Obtaining samples for iteration 1...
Obtaining samples for iteration 2...
Obtaining samples for iteration 3...
Obtaining samples for iteration 4...
Obtaining samples for iteration 5...
Obtaining samples for iteration 6...
Obtaining samples for iteration 7...
Obtaining samples for iteration 8...
Obtaining samples for iteration 9...
Obtaining samples for iteration 10...
Obtaining samples for iteration 11...
Obtaining samples for iteration 12...
Obtaining samples for iteration 13...
Obtaining samples for iteration 14...
Obtaining samples for iteration 15...
Obtaining samples for iteration 16...
Obtaining samples for iteration 17...
Obtaining samples for iteration 18...
Obtaining samples for iteration 19...
Done training policy.
Generating on-policy rollouts.
Path 0 | total_timesteps 0.
number of affinization with epsilon = 3 is 25
average number of affinization = 12.141592920353983
Path 1 | total_timesteps 32.
number of affinization with epsilon = 3 is 19
average number of affinization = 12.150252525252526
Path 2 | total_timesteps 54.
number of affinization with epsilon = 3 is 34
average number of affinization = 12.177805800756621
Path 3 | total_timesteps 102.
number of affinization with epsilon = 3 is 16
average number of affinization = 12.182619647355164
Path 4 | total_timesteps 119.
number of affinization with epsilon = 3 is 21
average number of affinization = 12.193710691823899
Path 5 | total_timesteps 144.
number of affinization with epsilon = 3 is 22
average number of affinization = 12.206030150753769
Path 6 | total_timesteps 173.
number of affinization with epsilon = 3 is 12
average number of affinization = 12.20577164366374
Path 7 | total_timesteps 190.
number of affinization with epsilon = 3 is 41
average number of affinization = 12.241854636591478
Path 8 | total_timesteps 241.
number of affinization with epsilon = 3 is 31
average number of affinization = 12.265331664580726
Path 9 | total_timesteps 277.
number of affinization with epsilon = 3 is 24
average number of affinization = 12.28
Path 10 | total_timesteps 307.
number of affinization with epsilon = 3 is 18
average number of affinization = 12.287141073657928
Path 11 | total_timesteps 332.
number of affinization with epsilon = 3 is 24
average number of affinization = 12.301745635910224
Path 12 | total_timesteps 362.
number of affinization with epsilon = 3 is 16
average number of affinization = 12.306351183063512
Path 13 | total_timesteps 382.
number of affinization with epsilon = 3 is 11
average number of affinization = 12.304726368159203
Path 14 | total_timesteps 397.
number of affinization with epsilon = 3 is 24
average number of affinization = 12.319254658385093
Path 15 | total_timesteps 428.
number of affinization with epsilon = 3 is 27
average number of affinization = 12.337468982630273
Path 16 | total_timesteps 465.
number of affinization with epsilon = 3 is 18
average number of affinization = 12.344485749690211
Path 17 | total_timesteps 487.
number of affinization with epsilon = 3 is 9
average number of affinization = 12.340346534653465
Path 18 | total_timesteps 501.
number of affinization with epsilon = 3 is 81
average number of affinization = 12.42521631644005
Path 19 | total_timesteps 601.
number of affinization with epsilon = 3 is 21
average number of affinization = 12.435802469135803
Path 20 | total_timesteps 623.
number of affinization with epsilon = 3 is 20
average number of affinization = 12.445129469790382
Path 21 | total_timesteps 648.
number of affinization with epsilon = 3 is 16
average number of affinization = 12.449507389162562
Path 22 | total_timesteps 666.
number of affinization with epsilon = 3 is 28
average number of affinization = 12.468634686346864
Path 23 | total_timesteps 705.
number of affinization with epsilon = 3 is 21
average number of affinization = 12.47911547911548
Path 24 | total_timesteps 734.
number of affinization with epsilon = 3 is 11
average number of affinization = 12.477300613496933
Path 25 | total_timesteps 746.
number of affinization with epsilon = 3 is 15
average number of affinization = 12.480392156862745
Path 26 | total_timesteps 768.
number of affinization with epsilon = 3 is 10
average number of affinization = 12.477356181150551
Path 27 | total_timesteps 780.
number of affinization with epsilon = 3 is 18
average number of affinization = 12.484107579462103
Path 28 | total_timesteps 806.
number of affinization with epsilon = 3 is 29
average number of affinization = 12.504273504273504
Path 29 | total_timesteps 847.
number of affinization with epsilon = 3 is 9
average number of affinization = 12.5
Path 30 | total_timesteps 859.
number of affinization with epsilon = 3 is 15
average number of affinization = 12.503045066991474
Path 31 | total_timesteps 879.
number of affinization with epsilon = 3 is 14
average number of affinization = 12.504866180048662
Path 32 | total_timesteps 895.
number of affinization with epsilon = 3 is 26
average number of affinization = 12.521263669501822
Path 33 | total_timesteps 929.
number of affinization with epsilon = 3 is 18
average number of affinization = 12.527912621359222
Path 34 | total_timesteps 955.
number of affinization with epsilon = 3 is 8
average number of affinization = 12.522424242424242
Path 35 | total_timesteps 966.
number of affinization with epsilon = 3 is 28
average number of affinization = 12.541162227602905
Path 36 | total_timesteps 1000.
number of affinization with epsilon = 3 is 39
average number of affinization = 12.573155985489722
Path 37 | total_timesteps 1050.
number of affinization with epsilon = 3 is 33
average number of affinization = 12.597826086956522
Path 38 | total_timesteps 1088.
number of affinization with epsilon = 3 is 21
average number of affinization = 12.607961399276236
Path 39 | total_timesteps 1120.
number of affinization with epsilon = 3 is 22
average number of affinization = 12.619277108433735
Path 40 | total_timesteps 1146.
number of affinization with epsilon = 3 is 36
average number of affinization = 12.647412755716005
Path 41 | total_timesteps 1188.
number of affinization with epsilon = 3 is 9
average number of affinization = 12.643028846153847
Path 42 | total_timesteps 1200.
number of affinization with epsilon = 3 is 16
average number of affinization = 12.647058823529411
Path 43 | total_timesteps 1219.
number of affinization with epsilon = 3 is 22
average number of affinization = 12.658273381294965
Path 44 | total_timesteps 1244.
number of affinization with epsilon = 3 is 21
average number of affinization = 12.668263473053893
Path 45 | total_timesteps 1272.
number of affinization with epsilon = 3 is 22
average number of affinization = 12.679425837320574
Path 46 | total_timesteps 1300.
number of affinization with epsilon = 3 is 28
average number of affinization = 12.697729988052568
Path 47 | total_timesteps 1336.
number of affinization with epsilon = 3 is 18
average number of affinization = 12.704057279236277
Path 48 | total_timesteps 1357.
number of affinization with epsilon = 3 is 20
average number of affinization = 12.712753277711561
Path 49 | total_timesteps 1386.
number of affinization with epsilon = 3 is 25
average number of affinization = 12.727380952380953
Path 50 | total_timesteps 1416.
number of affinization with epsilon = 3 is 15
average number of affinization = 12.730083234244946
Path 51 | total_timesteps 1434.
number of affinization with epsilon = 3 is 31
average number of affinization = 12.751781472684085
Path 52 | total_timesteps 1471.
number of affinization with epsilon = 3 is 8
average number of affinization = 12.746144721233689
Path 53 | total_timesteps 1481.
number of affinization with epsilon = 3 is 20
average number of affinization = 12.754739336492891
Path 54 | total_timesteps 1504.
number of affinization with epsilon = 3 is 12
average number of affinization = 12.753846153846155
Path 55 | total_timesteps 1519.
number of affinization with epsilon = 3 is 17
average number of affinization = 12.75886524822695
Path 56 | total_timesteps 1538.
number of affinization with epsilon = 3 is 28
average number of affinization = 12.776859504132231
Path 57 | total_timesteps 1569.
number of affinization with epsilon = 3 is 23
average number of affinization = 12.788915094339623
Path 58 | total_timesteps 1597.
number of affinization with epsilon = 3 is 28
average number of affinization = 12.806831566548881
Path 59 | total_timesteps 1636.
number of affinization with epsilon = 3 is 43
average number of affinization = 12.84235294117647
Path 60 | total_timesteps 1698.
number of affinization with epsilon = 3 is 10
average number of affinization = 12.839012925969447
Path 61 | total_timesteps 1712.
number of affinization with epsilon = 3 is 24
average number of affinization = 12.852112676056338
Path 62 | total_timesteps 1741.
number of affinization with epsilon = 3 is 25
average number of affinization = 12.866354044548652
Path 63 | total_timesteps 1773.
number of affinization with epsilon = 3 is 16
average number of affinization = 12.870023419203747
Path 64 | total_timesteps 1794.
number of affinization with epsilon = 3 is 23
average number of affinization = 12.88187134502924
Path 65 | total_timesteps 1821.
number of affinization with epsilon = 3 is 16
average number of affinization = 12.88551401869159
Path 66 | total_timesteps 1839.
number of affinization with epsilon = 3 is 17
average number of affinization = 12.890315052508752
Path 67 | total_timesteps 1859.
number of affinization with epsilon = 3 is 30
average number of affinization = 12.91025641025641
Path 68 | total_timesteps 1895.
number of affinization with epsilon = 3 is 17
average number of affinization = 12.91501746216531
Path 69 | total_timesteps 1918.
number of affinization with epsilon = 3 is 22
average number of affinization = 12.925581395348837
Path 70 | total_timesteps 1944.
number of affinization with epsilon = 3 is 23
average number of affinization = 12.937282229965156
Path 71 | total_timesteps 1971.
number of affinization with epsilon = 3 is 44
average number of affinization = 12.973317865429234
Path 72 | total_timesteps 2022.
number of affinization with epsilon = 3 is 53
average number of affinization = 13.019698725376593
Path 73 | total_timesteps 2086.
number of affinization with epsilon = 3 is 35
average number of affinization = 13.04513888888889
Path 74 | total_timesteps 2128.
number of affinization with epsilon = 3 is 17
average number of affinization = 13.04971098265896
Path 75 | total_timesteps 2150.
number of affinization with epsilon = 3 is 20
average number of affinization = 13.057736720554272
Path 76 | total_timesteps 2178.
number of affinization with epsilon = 3 is 16
average number of affinization = 13.061130334486736
Path 77 | total_timesteps 2197.
number of affinization with epsilon = 3 is 19
average number of affinization = 13.067972350230415
Path 78 | total_timesteps 2224.
number of affinization with epsilon = 3 is 15
average number of affinization = 13.070195627157652
Path 79 | total_timesteps 2242.
number of affinization with epsilon = 3 is 34
average number of affinization = 13.094252873563219
Path 80 | total_timesteps 2283.
number of affinization with epsilon = 3 is 28
average number of affinization = 13.111366245694605
Path 81 | total_timesteps 2314.
number of affinization with epsilon = 3 is 28
average number of affinization = 13.128440366972477
Path 82 | total_timesteps 2351.
number of affinization with epsilon = 3 is 16
average number of affinization = 13.131729667812142
Path 83 | total_timesteps 2370.
number of affinization with epsilon = 3 is 17
average number of affinization = 13.136155606407323
Path 84 | total_timesteps 2391.
number of affinization with epsilon = 3 is 12
average number of affinization = 13.134857142857143
Path 85 | total_timesteps 2409.
number of affinization with epsilon = 3 is 25
average number of affinization = 13.148401826484019
Path 86 | total_timesteps 2437.
number of affinization with epsilon = 3 is 10
average number of affinization = 13.144811858608893
Path 87 | total_timesteps 2448.
number of affinization with epsilon = 3 is 20
average number of affinization = 13.15261958997722
Path 88 | total_timesteps 2470.
number of affinization with epsilon = 3 is 38
average number of affinization = 13.180887372013652
Path 89 | total_timesteps 2518.
number of affinization with epsilon = 3 is 21
average number of affinization = 13.189772727272727
Path 90 | total_timesteps 2546.
number of affinization with epsilon = 3 is 41
average number of affinization = 13.221339387060159
Path 91 | total_timesteps 2598.
number of affinization with epsilon = 3 is 28
average number of affinization = 13.238095238095237
Path 92 | total_timesteps 2631.
number of affinization with epsilon = 3 is 12
average number of affinization = 13.236693091732729
Path 93 | total_timesteps 2646.
number of affinization with epsilon = 3 is 16
average number of affinization = 13.239819004524886
Path 94 | total_timesteps 2664.
number of affinization with epsilon = 3 is 11
average number of affinization = 13.23728813559322
Path 95 | total_timesteps 2678.
number of affinization with epsilon = 3 is 16
average number of affinization = 13.24040632054176
Path 96 | total_timesteps 2696.
number of affinization with epsilon = 3 is 42
average number of affinization = 13.2728297632469
Path 97 | total_timesteps 2747.
number of affinization with epsilon = 3 is 10
average number of affinization = 13.269144144144144
Path 98 | total_timesteps 2761.
number of affinization with epsilon = 3 is 18
average number of affinization = 13.274465691788526
Path 99 | total_timesteps 2784.
number of affinization with epsilon = 3 is 25
average number of affinization = 13.287640449438202
Path 100 | total_timesteps 2820.
number of affinization with epsilon = 3 is 21
average number of affinization = 13.296296296296296
Path 101 | total_timesteps 2845.
number of affinization with epsilon = 3 is 26
average number of affinization = 13.310538116591928
Path 102 | total_timesteps 2878.
number of affinization with epsilon = 3 is 16
average number of affinization = 13.313549832026876
Path 103 | total_timesteps 2897.
number of affinization with epsilon = 3 is 36
average number of affinization = 13.338926174496644
Path 104 | total_timesteps 2940.
number of affinization with epsilon = 3 is 20
average number of affinization = 13.346368715083798
Path 105 | total_timesteps 2965.
number of affinization with epsilon = 3 is 11
average number of affinization = 13.34375
Path 106 | total_timesteps 2980.
number of affinization with epsilon = 3 is 9
average number of affinization = 13.338907469342251
Path 107 | total_timesteps 2993.
number of affinization with epsilon = 3 is 18
average number of affinization = 13.344097995545656
Path 108 | total_timesteps 3016.
number of affinization with epsilon = 3 is 11
average number of affinization = 13.341490545050055
Path 109 | total_timesteps 3030.
number of affinization with epsilon = 3 is 24
average number of affinization = 13.353333333333333
Path 110 | total_timesteps 3058.
number of affinization with epsilon = 3 is 13
average number of affinization = 13.352941176470589
Path 111 | total_timesteps 3076.
number of affinization with epsilon = 3 is 27
average number of affinization = 13.368070953436806
Path 112 | total_timesteps 3110.
number of affinization with epsilon = 3 is 19
average number of affinization = 13.374307862679956
Path 113 | total_timesteps 3132.
number of affinization with epsilon = 3 is 18
average number of affinization = 13.379424778761061
Path 114 | total_timesteps 3156.
number of affinization with epsilon = 3 is 19
average number of affinization = 13.385635359116023
Path 115 | total_timesteps 3182.
number of affinization with epsilon = 3 is 12
average number of affinization = 13.3841059602649
Path 116 | total_timesteps 3202.
number of affinization with epsilon = 3 is 12
average number of affinization = 13.38257993384785
Path 117 | total_timesteps 3217.
number of affinization with epsilon = 3 is 13
average number of affinization = 13.38215859030837
Path 118 | total_timesteps 3231.
number of affinization with epsilon = 3 is 13
average number of affinization = 13.381738173817382
Path 119 | total_timesteps 3247.
number of affinization with epsilon = 3 is 26
average number of affinization = 13.395604395604396
Path 120 | total_timesteps 3281.
number of affinization with epsilon = 3 is 16
average number of affinization = 13.398463227222832
Path 121 | total_timesteps 3300.
number of affinization with epsilon = 3 is 11
average number of affinization = 13.395833333333334
Path 122 | total_timesteps 3317.
number of affinization with epsilon = 3 is 16
average number of affinization = 13.3986856516977
Path 123 | total_timesteps 3336.
number of affinization with epsilon = 3 is 8
average number of affinization = 13.39277899343545
Path 124 | total_timesteps 3346.
number of affinization with epsilon = 3 is 31
average number of affinization = 13.412021857923497
Path 125 | total_timesteps 3381.
number of affinization with epsilon = 3 is 14
average number of affinization = 13.412663755458516
Path 126 | total_timesteps 3404.
number of affinization with epsilon = 3 is 10
average number of affinization = 13.408942202835332
Path 127 | total_timesteps 3419.
number of affinization with epsilon = 3 is 17
average number of affinization = 13.412854030501089
Path 128 | total_timesteps 3440.
number of affinization with epsilon = 3 is 18
average number of affinization = 13.41784548422198
Path 129 | total_timesteps 3464.
number of affinization with epsilon = 3 is 43
average number of affinization = 13.45
Path 130 | total_timesteps 3512.
number of affinization with epsilon = 3 is 13
average number of affinization = 13.449511400651465
Path 131 | total_timesteps 3527.
number of affinization with epsilon = 3 is 22
average number of affinization = 13.458785249457701
Path 132 | total_timesteps 3551.
number of affinization with epsilon = 3 is 15
average number of affinization = 13.460455037919827
Path 133 | total_timesteps 3574.
number of affinization with epsilon = 3 is 17
average number of affinization = 13.464285714285714
Path 134 | total_timesteps 3596.
number of affinization with epsilon = 3 is 21
average number of affinization = 13.472432432432432
Path 135 | total_timesteps 3619.
number of affinization with epsilon = 3 is 14
average number of affinization = 13.473002159827214
Path 136 | total_timesteps 3637.
number of affinization with epsilon = 3 is 12
average number of affinization = 13.47141316073355
Path 137 | total_timesteps 3652.
number of affinization with epsilon = 3 is 22
average number of affinization = 13.480603448275861
Path 138 | total_timesteps 3680.
number of affinization with epsilon = 3 is 17
average number of affinization = 13.484391819160388
Path 139 | total_timesteps 3700.
number of affinization with epsilon = 3 is 26
average number of affinization = 13.497849462365592
Path 140 | total_timesteps 3733.
number of affinization with epsilon = 3 is 10
average number of affinization = 13.494092373791622
Path 141 | total_timesteps 3744.
number of affinization with epsilon = 3 is 14
average number of affinization = 13.494635193133048
Path 142 | total_timesteps 3763.
number of affinization with epsilon = 3 is 29
average number of affinization = 13.511254019292604
Path 143 | total_timesteps 3803.
number of affinization with epsilon = 3 is 37
average number of affinization = 13.536402569593148
Path 144 | total_timesteps 3852.
number of affinization with epsilon = 3 is 18
average number of affinization = 13.541176470588235
Path 145 | total_timesteps 3885.
number of affinization with epsilon = 3 is 26
average number of affinization = 13.554487179487179
Path 146 | total_timesteps 3914.
number of affinization with epsilon = 3 is 19
average number of affinization = 13.560298826040555
Path 147 | total_timesteps 3938.
number of affinization with epsilon = 3 is 22
average number of affinization = 13.569296375266525
Path 148 | total_timesteps 3967.
number of affinization with epsilon = 3 is 19
average number of affinization = 13.575079872204473
Path 149 | total_timesteps 3992.
number of affinization with epsilon = 3 is 21
average number of affinization = 13.582978723404254
Path 150 | total_timesteps 4016.
number of affinization with epsilon = 3 is 29
average number of affinization = 13.599362380446333
Path 151 | total_timesteps 4054.
number of affinization with epsilon = 3 is 43
average number of affinization = 13.630573248407643
Path 152 | total_timesteps 4104.
number of affinization with epsilon = 3 is 26
average number of affinization = 13.643690349946977
Path 153 | total_timesteps 4136.
number of affinization with epsilon = 3 is 18
average number of affinization = 13.648305084745763
Path 154 | total_timesteps 4159.
number of affinization with epsilon = 3 is 11
average number of affinization = 13.645502645502646
Path 155 | total_timesteps 4173.
number of affinization with epsilon = 3 is 25
average number of affinization = 13.657505285412261
Path 156 | total_timesteps 4203.
number of affinization with epsilon = 3 is 22
average number of affinization = 13.666314677930306
Path 157 | total_timesteps 4233.
number of affinization with epsilon = 3 is 20
average number of affinization = 13.672995780590718
Path 158 | total_timesteps 4258.
number of affinization with epsilon = 3 is 11
average number of affinization = 13.67017913593256
Path 159 | total_timesteps 4271.
number of affinization with epsilon = 3 is 10
average number of affinization = 13.666315789473684
Path 160 | total_timesteps 4284.
number of affinization with epsilon = 3 is 17
average number of affinization = 13.669821240799159
Path 161 | total_timesteps 4305.
number of affinization with epsilon = 3 is 16
average number of affinization = 13.672268907563025
Path 162 | total_timesteps 4327.
number of affinization with epsilon = 3 is 10
average number of affinization = 13.66841552990556
Path 163 | total_timesteps 4343.
number of affinization with epsilon = 3 is 31
average number of affinization = 13.68658280922432
Path 164 | total_timesteps 4382.
number of affinization with epsilon = 3 is 31
average number of affinization = 13.704712041884816
Path 165 | total_timesteps 4417.
number of affinization with epsilon = 3 is 26
average number of affinization = 13.717573221757322
Path 166 | total_timesteps 4447.
number of affinization with epsilon = 3 is 15
average number of affinization = 13.718913270637408
Path 167 | total_timesteps 4471.
number of affinization with epsilon = 3 is 10
average number of affinization = 13.715031315240083
Path 168 | total_timesteps 4484.
number of affinization with epsilon = 3 is 11
average number of affinization = 13.712200208550573
Path 169 | total_timesteps 4500.
number of affinization with epsilon = 3 is 27
average number of affinization = 13.726041666666667
Path 170 | total_timesteps 4530.
number of affinization with epsilon = 3 is 27
average number of affinization = 13.739854318418315
Path 171 | total_timesteps 4560.
number of affinization with epsilon = 3 is 18
average number of affinization = 13.744282744282744
Path 172 | total_timesteps 4584.
number of affinization with epsilon = 3 is 13
average number of affinization = 13.743509865005192
Path 173 | total_timesteps 4602.
number of affinization with epsilon = 3 is 26
average number of affinization = 13.756224066390041
Path 174 | total_timesteps 4635.
number of affinization with epsilon = 3 is 17
average number of affinization = 13.759585492227979
Path 175 | total_timesteps 4655.
number of affinization with epsilon = 3 is 10
average number of affinization = 13.755693581780537
Path 176 | total_timesteps 4666.
number of affinization with epsilon = 3 is 27
average number of affinization = 13.769389865563598
Path 177 | total_timesteps 4699.
number of affinization with epsilon = 3 is 15
average number of affinization = 13.770661157024794
Path 178 | total_timesteps 4723.
number of affinization with epsilon = 3 is 32
average number of affinization = 13.789473684210526
Path 179 | total_timesteps 4765.
number of affinization with epsilon = 3 is 24
average number of affinization = 13.8
Path 180 | total_timesteps 4792.
number of affinization with epsilon = 3 is 18
average number of affinization = 13.8043254376931
Path 181 | total_timesteps 4814.
number of affinization with epsilon = 3 is 23
average number of affinization = 13.813786008230453
Path 182 | total_timesteps 4842.
number of affinization with epsilon = 3 is 31
average number of affinization = 13.831449126413155
Path 183 | total_timesteps 4879.
number of affinization with epsilon = 3 is 6
average number of affinization = 13.82340862422998
Path 184 | total_timesteps 4888.
number of affinization with epsilon = 3 is 23
average number of affinization = 13.832820512820513
Path 185 | total_timesteps 4913.
number of affinization with epsilon = 3 is 20
average number of affinization = 13.839139344262295
Path 186 | total_timesteps 4938.
number of affinization with epsilon = 3 is 31
average number of affinization = 13.856704196519958
Path 187 | total_timesteps 4975.
number of affinization with epsilon = 3 is 30
average number of affinization = 13.87321063394683
Path 188 | total_timesteps 5010.
number of affinization with epsilon = 3 is 25
average number of affinization = 13.884576098059243
Path 189 | total_timesteps 5040.
number of affinization with epsilon = 3 is 18
average number of affinization = 13.888775510204082
Path 190 | total_timesteps 5066.
number of affinization with epsilon = 3 is 29
average number of affinization = 13.904179408766565
Path 191 | total_timesteps 5103.
number of affinization with epsilon = 3 is 8
average number of affinization = 13.89816700610998
Path 192 | total_timesteps 5117.
number of affinization with epsilon = 3 is 36
average number of affinization = 13.920651068158698
Path 193 | total_timesteps 5158.
number of affinization with epsilon = 3 is 38
average number of affinization = 13.945121951219512
Path 194 | total_timesteps 5203.
number of affinization with epsilon = 3 is 24
average number of affinization = 13.955329949238578
Path 195 | total_timesteps 5231.
number of affinization with epsilon = 3 is 24
average number of affinization = 13.96551724137931
Path 196 | total_timesteps 5259.
number of affinization with epsilon = 3 is 25
average number of affinization = 13.976697061803446
Path 197 | total_timesteps 5290.
number of affinization with epsilon = 3 is 15
average number of affinization = 13.977732793522268
Path 198 | total_timesteps 5311.
number of affinization with epsilon = 3 is 36
average number of affinization = 14.0
Path 199 | total_timesteps 5357.
number of affinization with epsilon = 3 is 22
average number of affinization = 14.008080808080807
Path 200 | total_timesteps 5384.
number of affinization with epsilon = 3 is 30
average number of affinization = 14.024217961654895
Path 201 | total_timesteps 5421.
number of affinization with epsilon = 3 is 13
average number of affinization = 14.023185483870968
Path 202 | total_timesteps 5438.
number of affinization with epsilon = 3 is 11
average number of affinization = 14.020140986908359
Path 203 | total_timesteps 5451.
number of affinization with epsilon = 3 is 11
average number of affinization = 14.017102615694165
Path 204 | total_timesteps 5465.
number of affinization with epsilon = 3 is 42
average number of affinization = 14.045226130653266
Path 205 | total_timesteps 5512.
number of affinization with epsilon = 3 is 6
average number of affinization = 14.03714859437751
Path 206 | total_timesteps 5522.
number of affinization with epsilon = 3 is 16
average number of affinization = 14.039117352056168
Path 207 | total_timesteps 5551.
number of affinization with epsilon = 3 is 29
average number of affinization = 14.054108216432866
Path 208 | total_timesteps 5586.
number of affinization with epsilon = 3 is 11
average number of affinization = 14.05105105105105
Path 209 | total_timesteps 5603.
number of affinization with epsilon = 3 is 28
average number of affinization = 14.065
Path 210 | total_timesteps 5636.
number of affinization with epsilon = 3 is 17
average number of affinization = 14.067932067932068
Path 211 | total_timesteps 5657.
number of affinization with epsilon = 3 is 27
average number of affinization = 14.080838323353293
Path 212 | total_timesteps 5691.
number of affinization with epsilon = 3 is 16
average number of affinization = 14.082751744765703
Path 213 | total_timesteps 5712.
number of affinization with epsilon = 3 is 25
average number of affinization = 14.093625498007968
Path 214 | total_timesteps 5741.
number of affinization with epsilon = 3 is 31
average number of affinization = 14.11044776119403
Path 215 | total_timesteps 5778.
number of affinization with epsilon = 3 is 27
average number of affinization = 14.123260437375745
Path 216 | total_timesteps 5809.
number of affinization with epsilon = 3 is 12
average number of affinization = 14.121151936444885
Path 217 | total_timesteps 5824.
number of affinization with epsilon = 3 is 16
average number of affinization = 14.123015873015873
Path 218 | total_timesteps 5842.
number of affinization with epsilon = 3 is 15
average number of affinization = 14.12388503468781
Path 219 | total_timesteps 5861.
number of affinization with epsilon = 3 is 18
average number of affinization = 14.127722772277227
Path 220 | total_timesteps 5885.
number of affinization with epsilon = 3 is 26
average number of affinization = 14.13946587537092
Path 221 | total_timesteps 5913.
number of affinization with epsilon = 3 is 21
average number of affinization = 14.146245059288537
Path 222 | total_timesteps 5940.
number of affinization with epsilon = 3 is 23
average number of affinization = 14.154985192497533
Path 223 | total_timesteps 5966.
number of affinization with epsilon = 3 is 11
average number of affinization = 14.151873767258383
Path 224 | total_timesteps 5981.
number of affinization with epsilon = 3 is 16
average number of affinization = 14.153694581280789
Path 225 | total_timesteps 5998.
number of affinization with epsilon = 3 is 29
average number of affinization = 14.168307086614174
Done generating on-policy rollouts.
Updating normalization.
Done updating normalization.
----------------------------
| AverageReturn | -6.65    |
| Iteration     | 2        |
| MaximumReturn | 23       |
| MinimumReturn | -23.4    |
| TotalSamples  | 16041    |
----------------------------
itr #3 | 
Fitting dynamics.
Fitting model 0 (0-based) in the ensemble of 2 models
Validation loss = 0.03437582403421402
Validation loss = 0.032686956226825714
Validation loss = 0.030450016260147095
Validation loss = 0.0294635072350502
Validation loss = 0.030580293387174606
Validation loss = 0.02948998659849167
Validation loss = 0.030087187886238098
Validation loss = 0.029027536511421204
Validation loss = 0.028120556846261024
Validation loss = 0.029323115944862366
Validation loss = 0.028665699064731598
Validation loss = 0.02818765491247177
Validation loss = 0.04135511815547943
Fitting model 1 (0-based) in the ensemble of 2 models
Validation loss = 0.03253085911273956
Validation loss = 0.030708760023117065
Validation loss = 0.02956143580377102
Validation loss = 0.029593976214528084
Validation loss = 0.027744626626372337
Validation loss = 0.02819192036986351
Validation loss = 0.03111071139574051
Validation loss = 0.028226029127836227
Validation loss = 0.02659520134329796
Validation loss = 0.027027800679206848
Validation loss = 0.029319489374756813
Validation loss = 0.029924001544713974
Validation loss = 0.028573904186487198
Done fitting dynamics.
Updating randomness.
Done updating randomness.
Training policy using TRPO.
Re-initialize init_std.
Obtaining samples for iteration 0...
Obtaining samples for iteration 1...
Obtaining samples for iteration 2...
Obtaining samples for iteration 3...
Obtaining samples for iteration 4...
Obtaining samples for iteration 5...
Obtaining samples for iteration 6...
Obtaining samples for iteration 7...
Obtaining samples for iteration 8...
Obtaining samples for iteration 9...
Obtaining samples for iteration 10...
Obtaining samples for iteration 11...
Obtaining samples for iteration 12...
Obtaining samples for iteration 13...
Obtaining samples for iteration 14...
Obtaining samples for iteration 15...
Obtaining samples for iteration 16...
Obtaining samples for iteration 17...
Obtaining samples for iteration 18...
Obtaining samples for iteration 19...
Done training policy.
Generating on-policy rollouts.
Path 0 | total_timesteps 0.
number of affinization with epsilon = 3 is 18
average number of affinization = 14.172074729596854
Path 1 | total_timesteps 28.
number of affinization with epsilon = 3 is 15
average number of affinization = 14.172888015717092
Path 2 | total_timesteps 49.
number of affinization with epsilon = 3 is 20
average number of affinization = 14.178606476938175
Path 3 | total_timesteps 74.
number of affinization with epsilon = 3 is 41
average number of affinization = 14.204901960784314
Path 4 | total_timesteps 124.
number of affinization with epsilon = 3 is 11
average number of affinization = 14.201762977473066
Path 5 | total_timesteps 139.
number of affinization with epsilon = 3 is 29
average number of affinization = 14.21624266144814
Path 6 | total_timesteps 178.
number of affinization with epsilon = 3 is 21
average number of affinization = 14.222873900293255
Path 7 | total_timesteps 205.
number of affinization with epsilon = 3 is 9
average number of affinization = 14.2177734375
Path 8 | total_timesteps 215.
number of affinization with epsilon = 3 is 28
average number of affinization = 14.231219512195121
Path 9 | total_timesteps 248.
number of affinization with epsilon = 3 is 9
average number of affinization = 14.226120857699804
Path 10 | total_timesteps 260.
number of affinization with epsilon = 3 is 24
average number of affinization = 14.235637779941577
Path 11 | total_timesteps 289.
number of affinization with epsilon = 3 is 17
average number of affinization = 14.238326848249027
Path 12 | total_timesteps 310.
number of affinization with epsilon = 3 is 42
average number of affinization = 14.26530612244898
Path 13 | total_timesteps 366.
number of affinization with epsilon = 3 is 12
average number of affinization = 14.263106796116505
Path 14 | total_timesteps 383.
number of affinization with epsilon = 3 is 22
average number of affinization = 14.270611057225993
Path 15 | total_timesteps 414.
number of affinization with epsilon = 3 is 15
average number of affinization = 14.271317829457365
Path 16 | total_timesteps 433.
number of affinization with epsilon = 3 is 23
average number of affinization = 14.27976766698935
Path 17 | total_timesteps 460.
number of affinization with epsilon = 3 is 5
average number of affinization = 14.270793036750483
Path 18 | total_timesteps 469.
number of affinization with epsilon = 3 is 14
average number of affinization = 14.270531400966183
Path 19 | total_timesteps 489.
number of affinization with epsilon = 3 is 9
average number of affinization = 14.265444015444016
Path 20 | total_timesteps 499.
number of affinization with epsilon = 3 is 17
average number of affinization = 14.268081002892961
Path 21 | total_timesteps 519.
number of affinization with epsilon = 3 is 17
average number of affinization = 14.270712909441233
Path 22 | total_timesteps 540.
number of affinization with epsilon = 3 is 32
average number of affinization = 14.287776708373435
Path 23 | total_timesteps 576.
number of affinization with epsilon = 3 is 20
average number of affinization = 14.29326923076923
Path 24 | total_timesteps 600.
number of affinization with epsilon = 3 is 33
average number of affinization = 14.311239193083573
Path 25 | total_timesteps 641.
number of affinization with epsilon = 3 is 23
average number of affinization = 14.31957773512476
Path 26 | total_timesteps 671.
number of affinization with epsilon = 3 is 18
average number of affinization = 14.323106423777565
Path 27 | total_timesteps 692.
number of affinization with epsilon = 3 is 28
average number of affinization = 14.336206896551724
Path 28 | total_timesteps 724.
number of affinization with epsilon = 3 is 38
average number of affinization = 14.358851674641148
Path 29 | total_timesteps 767.
number of affinization with epsilon = 3 is 19
average number of affinization = 14.363288718929255
Path 30 | total_timesteps 790.
number of affinization with epsilon = 3 is 18
average number of affinization = 14.366762177650429
Path 31 | total_timesteps 813.
number of affinization with epsilon = 3 is 19
average number of affinization = 14.37118320610687
Path 32 | total_timesteps 837.
number of affinization with epsilon = 3 is 12
average number of affinization = 14.368922783603432
Path 33 | total_timesteps 857.
number of affinization with epsilon = 3 is 21
average number of affinization = 14.375238095238096
Path 34 | total_timesteps 889.
number of affinization with epsilon = 3 is 34
average number of affinization = 14.393910561370124
Path 35 | total_timesteps 937.
number of affinization with epsilon = 3 is 13
average number of affinization = 14.392585551330798
Path 36 | total_timesteps 955.
number of affinization with epsilon = 3 is 12
average number of affinization = 14.39031339031339
Path 37 | total_timesteps 971.
number of affinization with epsilon = 3 is 36
average number of affinization = 14.410815939278937
Path 38 | total_timesteps 1017.
number of affinization with epsilon = 3 is 22
average number of affinization = 14.418009478672985
Path 39 | total_timesteps 1043.
number of affinization with epsilon = 3 is 18
average number of affinization = 14.421401515151516
Path 40 | total_timesteps 1067.
number of affinization with epsilon = 3 is 39
average number of affinization = 14.444654683065279
Path 41 | total_timesteps 1113.
number of affinization with epsilon = 3 is 20
average number of affinization = 14.449905482041588
Path 42 | total_timesteps 1138.
number of affinization with epsilon = 3 is 13
average number of affinization = 14.448536355051935
Path 43 | total_timesteps 1154.
number of affinization with epsilon = 3 is 24
average number of affinization = 14.45754716981132
Path 44 | total_timesteps 1186.
number of affinization with epsilon = 3 is 15
average number of affinization = 14.458058435438266
Path 45 | total_timesteps 1205.
number of affinization with epsilon = 3 is 21
average number of affinization = 14.464218455743879
Path 46 | total_timesteps 1233.
number of affinization with epsilon = 3 is 22
average number of affinization = 14.471307619943556
Path 47 | total_timesteps 1259.
number of affinization with epsilon = 3 is 22
average number of affinization = 14.478383458646617
Path 48 | total_timesteps 1285.
number of affinization with epsilon = 3 is 25
average number of affinization = 14.488262910798122
Path 49 | total_timesteps 1316.
number of affinization with epsilon = 3 is 22
average number of affinization = 14.4953095684803
Path 50 | total_timesteps 1342.
number of affinization with epsilon = 3 is 20
average number of affinization = 14.500468603561387
Path 51 | total_timesteps 1369.
number of affinization with epsilon = 3 is 12
average number of affinization = 14.49812734082397
Path 52 | total_timesteps 1384.
number of affinization with epsilon = 3 is 22
average number of affinization = 14.505144995322732
Path 53 | total_timesteps 1408.
number of affinization with epsilon = 3 is 29
average number of affinization = 14.518691588785046
Path 54 | total_timesteps 1444.
number of affinization with epsilon = 3 is 28
average number of affinization = 14.531279178338002
Path 55 | total_timesteps 1481.
number of affinization with epsilon = 3 is 11
average number of affinization = 14.527985074626866
Path 56 | total_timesteps 1496.
number of affinization with epsilon = 3 is 34
average number of affinization = 14.546132339235788
Path 57 | total_timesteps 1539.
number of affinization with epsilon = 3 is 18
average number of affinization = 14.549348230912477
Path 58 | total_timesteps 1562.
number of affinization with epsilon = 3 is 62
average number of affinization = 14.593488372093024
Path 59 | total_timesteps 1636.
number of affinization with epsilon = 3 is 18
average number of affinization = 14.596654275092936
Path 60 | total_timesteps 1655.
number of affinization with epsilon = 3 is 27
average number of affinization = 14.608170844939647
Path 61 | total_timesteps 1686.
number of affinization with epsilon = 3 is 17
average number of affinization = 14.61038961038961
Path 62 | total_timesteps 1707.
number of affinization with epsilon = 3 is 12
average number of affinization = 14.607970342910102
Path 63 | total_timesteps 1723.
number of affinization with epsilon = 3 is 36
average number of affinization = 14.627777777777778
Path 64 | total_timesteps 1767.
number of affinization with epsilon = 3 is 22
average number of affinization = 14.634597594819612
Path 65 | total_timesteps 1799.
number of affinization with epsilon = 3 is 18
average number of affinization = 14.637707948243992
Path 66 | total_timesteps 1821.
number of affinization with epsilon = 3 is 27
average number of affinization = 14.649122807017545
Path 67 | total_timesteps 1854.
number of affinization with epsilon = 3 is 20
average number of affinization = 14.654059040590406
Path 68 | total_timesteps 1883.
number of affinization with epsilon = 3 is 17
average number of affinization = 14.656221198156683
Path 69 | total_timesteps 1906.
number of affinization with epsilon = 3 is 13
average number of affinization = 14.654696132596685
Path 70 | total_timesteps 1925.
number of affinization with epsilon = 3 is 21
average number of affinization = 14.660533578656853
Path 71 | total_timesteps 1950.
number of affinization with epsilon = 3 is 10
average number of affinization = 14.65625
Path 72 | total_timesteps 1965.
number of affinization with epsilon = 3 is 34
average number of affinization = 14.674012855831037
Path 73 | total_timesteps 2006.
number of affinization with epsilon = 3 is 17
average number of affinization = 14.676146788990826
Path 74 | total_timesteps 2027.
number of affinization with epsilon = 3 is 14
average number of affinization = 14.675527039413382
Path 75 | total_timesteps 2046.
number of affinization with epsilon = 3 is 14
average number of affinization = 14.674908424908425
Path 76 | total_timesteps 2064.
number of affinization with epsilon = 3 is 27
average number of affinization = 14.686184812442818
Path 77 | total_timesteps 2097.
number of affinization with epsilon = 3 is 17
average number of affinization = 14.688299817184644
Path 78 | total_timesteps 2115.
number of affinization with epsilon = 3 is 23
average number of affinization = 14.695890410958905
Path 79 | total_timesteps 2149.
number of affinization with epsilon = 3 is 11
average number of affinization = 14.692518248175183
Path 80 | total_timesteps 2165.
number of affinization with epsilon = 3 is 9
average number of affinization = 14.6873290793072
Path 81 | total_timesteps 2181.
number of affinization with epsilon = 3 is 30
average number of affinization = 14.70127504553734
Path 82 | total_timesteps 2216.
number of affinization with epsilon = 3 is 20
average number of affinization = 14.70609645131938
Path 83 | total_timesteps 2238.
number of affinization with epsilon = 3 is 26
average number of affinization = 14.716363636363637
Path 84 | total_timesteps 2272.
number of affinization with epsilon = 3 is 44
average number of affinization = 14.742960944595822
Path 85 | total_timesteps 2325.
number of affinization with epsilon = 3 is 12
average number of affinization = 14.740471869328493
Path 86 | total_timesteps 2340.
number of affinization with epsilon = 3 is 20
average number of affinization = 14.745240253853128
Path 87 | total_timesteps 2365.
number of affinization with epsilon = 3 is 18
average number of affinization = 14.748188405797102
Path 88 | total_timesteps 2387.
number of affinization with epsilon = 3 is 20
average number of affinization = 14.75294117647059
Path 89 | total_timesteps 2410.
number of affinization with epsilon = 3 is 10
average number of affinization = 14.74864376130199
Path 90 | total_timesteps 2424.
number of affinization with epsilon = 3 is 11
average number of affinization = 14.745257452574526
Path 91 | total_timesteps 2438.
number of affinization with epsilon = 3 is 31
average number of affinization = 14.759927797833935
Path 92 | total_timesteps 2477.
number of affinization with epsilon = 3 is 14
average number of affinization = 14.759242560865644
Path 93 | total_timesteps 2494.
number of affinization with epsilon = 3 is 20
average number of affinization = 14.763963963963963
Path 94 | total_timesteps 2521.
number of affinization with epsilon = 3 is 36
average number of affinization = 14.783078307830783
Path 95 | total_timesteps 2564.
number of affinization with epsilon = 3 is 52
average number of affinization = 14.816546762589928
Path 96 | total_timesteps 2629.
number of affinization with epsilon = 3 is 16
average number of affinization = 14.817610062893081
Path 97 | total_timesteps 2653.
number of affinization with epsilon = 3 is 16
average number of affinization = 14.81867145421903
Path 98 | total_timesteps 2671.
number of affinization with epsilon = 3 is 39
average number of affinization = 14.840358744394619
Path 99 | total_timesteps 2717.
number of affinization with epsilon = 3 is 16
average number of affinization = 14.841397849462366
Path 100 | total_timesteps 2735.
number of affinization with epsilon = 3 is 17
average number of affinization = 14.843330349149507
Path 101 | total_timesteps 2757.
number of affinization with epsilon = 3 is 18
average number of affinization = 14.846153846153847
Path 102 | total_timesteps 2783.
number of affinization with epsilon = 3 is 16
average number of affinization = 14.847184986595174
Path 103 | total_timesteps 2801.
number of affinization with epsilon = 3 is 21
average number of affinization = 14.852678571428571
Path 104 | total_timesteps 2827.
number of affinization with epsilon = 3 is 15
average number of affinization = 14.852809991079393
Path 105 | total_timesteps 2845.
number of affinization with epsilon = 3 is 22
average number of affinization = 14.859180035650624
Path 106 | total_timesteps 2871.
number of affinization with epsilon = 3 is 16
average number of affinization = 14.860195903829029
Path 107 | total_timesteps 2893.
number of affinization with epsilon = 3 is 35
average number of affinization = 14.878113879003559
Path 108 | total_timesteps 2936.
number of affinization with epsilon = 3 is 22
average number of affinization = 14.884444444444444
Path 109 | total_timesteps 2963.
number of affinization with epsilon = 3 is 30
average number of affinization = 14.897868561278862
Path 110 | total_timesteps 3000.
number of affinization with epsilon = 3 is 22
average number of affinization = 14.904170363797693
Path 111 | total_timesteps 3027.
number of affinization with epsilon = 3 is 17
average number of affinization = 14.906028368794326
Path 112 | total_timesteps 3050.
number of affinization with epsilon = 3 is 24
average number of affinization = 14.9140832595217
Path 113 | total_timesteps 3079.
number of affinization with epsilon = 3 is 8
average number of affinization = 14.907964601769912
Path 114 | total_timesteps 3093.
number of affinization with epsilon = 3 is 35
average number of affinization = 14.925729442970823
Path 115 | total_timesteps 3137.
number of affinization with epsilon = 3 is 17
average number of affinization = 14.92756183745583
Path 116 | total_timesteps 3159.
number of affinization with epsilon = 3 is 25
average number of affinization = 14.936451897616946
Path 117 | total_timesteps 3192.
number of affinization with epsilon = 3 is 21
average number of affinization = 14.941798941798941
Path 118 | total_timesteps 3216.
number of affinization with epsilon = 3 is 22
average number of affinization = 14.948017621145375
Path 119 | total_timesteps 3245.
number of affinization with epsilon = 3 is 6
average number of affinization = 14.940140845070422
Path 120 | total_timesteps 3255.
number of affinization with epsilon = 3 is 11
average number of affinization = 14.936675461741425
Path 121 | total_timesteps 3271.
number of affinization with epsilon = 3 is 23
average number of affinization = 14.943760984182777
Path 122 | total_timesteps 3298.
number of affinization with epsilon = 3 is 34
average number of affinization = 14.960491659350307
Path 123 | total_timesteps 3338.
number of affinization with epsilon = 3 is 10
average number of affinization = 14.956140350877194
Path 124 | total_timesteps 3354.
number of affinization with epsilon = 3 is 20
average number of affinization = 14.960560911481156
Path 125 | total_timesteps 3379.
number of affinization with epsilon = 3 is 17
average number of affinization = 14.962346760070053
Path 126 | total_timesteps 3402.
number of affinization with epsilon = 3 is 21
average number of affinization = 14.967629046369204
Path 127 | total_timesteps 3427.
number of affinization with epsilon = 3 is 19
average number of affinization = 14.971153846153847
Path 128 | total_timesteps 3452.
number of affinization with epsilon = 3 is 13
average number of affinization = 14.969432314410481
Path 129 | total_timesteps 3475.
number of affinization with epsilon = 3 is 21
average number of affinization = 14.974694589877837
Path 130 | total_timesteps 3502.
number of affinization with epsilon = 3 is 15
average number of affinization = 14.974716652136006
Path 131 | total_timesteps 3521.
number of affinization with epsilon = 3 is 27
average number of affinization = 14.985191637630662
Path 132 | total_timesteps 3551.
number of affinization with epsilon = 3 is 18
average number of affinization = 14.98781549173194
Path 133 | total_timesteps 3573.
number of affinization with epsilon = 3 is 15
average number of affinization = 14.987826086956522
Path 134 | total_timesteps 3590.
number of affinization with epsilon = 3 is 13
average number of affinization = 14.986099044309297
Path 135 | total_timesteps 3605.
number of affinization with epsilon = 3 is 18
average number of affinization = 14.988715277777779
Path 136 | total_timesteps 3629.
number of affinization with epsilon = 3 is 19
average number of affinization = 14.992194275802255
Path 137 | total_timesteps 3653.
number of affinization with epsilon = 3 is 29
average number of affinization = 15.004332755632582
Path 138 | total_timesteps 3688.
number of affinization with epsilon = 3 is 7
average number of affinization = 14.997402597402598
Path 139 | total_timesteps 3697.
number of affinization with epsilon = 3 is 29
average number of affinization = 15.009515570934257
Path 140 | total_timesteps 3729.
number of affinization with epsilon = 3 is 6
average number of affinization = 15.00172860847018
Path 141 | total_timesteps 3741.
number of affinization with epsilon = 3 is 30
average number of affinization = 15.0146804835924
Path 142 | total_timesteps 3778.
number of affinization with epsilon = 3 is 7
average number of affinization = 15.007765314926662
Path 143 | total_timesteps 3792.
number of affinization with epsilon = 3 is 7
average number of affinization = 15.000862068965517
Path 144 | total_timesteps 3801.
number of affinization with epsilon = 3 is 26
average number of affinization = 15.010335917312661
Path 145 | total_timesteps 3832.
number of affinization with epsilon = 3 is 12
average number of affinization = 15.007745266781411
Path 146 | total_timesteps 3846.
number of affinization with epsilon = 3 is 22
average number of affinization = 15.013757523645744
Path 147 | total_timesteps 3874.
number of affinization with epsilon = 3 is 37
average number of affinization = 15.032646048109966
Path 148 | total_timesteps 3916.
number of affinization with epsilon = 3 is 23
average number of affinization = 15.039484978540772
Path 149 | total_timesteps 3943.
number of affinization with epsilon = 3 is 26
average number of affinization = 15.048885077186965
Path 150 | total_timesteps 3971.
number of affinization with epsilon = 3 is 16
average number of affinization = 15.049700085689803
Path 151 | total_timesteps 3990.
number of affinization with epsilon = 3 is 10
average number of affinization = 15.045376712328768
Path 152 | total_timesteps 4003.
number of affinization with epsilon = 3 is 12
average number of affinization = 15.042771599657828
Path 153 | total_timesteps 4018.
number of affinization with epsilon = 3 is 30
average number of affinization = 15.055555555555555
Path 154 | total_timesteps 4052.
number of affinization with epsilon = 3 is 8
average number of affinization = 15.049530315969257
Path 155 | total_timesteps 4063.
number of affinization with epsilon = 3 is 43
average number of affinization = 15.073378839590443
Path 156 | total_timesteps 4110.
number of affinization with epsilon = 3 is 12
average number of affinization = 15.07075873827792
Path 157 | total_timesteps 4126.
number of affinization with epsilon = 3 is 19
average number of affinization = 15.074105621805792
Path 158 | total_timesteps 4151.
number of affinization with epsilon = 3 is 15
average number of affinization = 15.07404255319149
Path 159 | total_timesteps 4169.
number of affinization with epsilon = 3 is 16
average number of affinization = 15.07482993197279
Path 160 | total_timesteps 4190.
number of affinization with epsilon = 3 is 20
average number of affinization = 15.079014443500425
Path 161 | total_timesteps 4212.
number of affinization with epsilon = 3 is 14
average number of affinization = 15.078098471986417
Path 162 | total_timesteps 4229.
number of affinization with epsilon = 3 is 23
average number of affinization = 15.08481764206955
Path 163 | total_timesteps 4261.
number of affinization with epsilon = 3 is 13
average number of affinization = 15.083050847457628
Path 164 | total_timesteps 4277.
number of affinization with epsilon = 3 is 46
average number of affinization = 15.109229466553767
Path 165 | total_timesteps 4333.
number of affinization with epsilon = 3 is 21
average number of affinization = 15.114213197969542
Path 166 | total_timesteps 4358.
number of affinization with epsilon = 3 is 62
average number of affinization = 15.153846153846153
Path 167 | total_timesteps 4438.
number of affinization with epsilon = 3 is 61
average number of affinization = 15.192567567567568
Path 168 | total_timesteps 4503.
number of affinization with epsilon = 3 is 35
average number of affinization = 15.20928270042194
Path 169 | total_timesteps 4546.
number of affinization with epsilon = 3 is 21
average number of affinization = 15.2141652613828
Path 170 | total_timesteps 4571.
number of affinization with epsilon = 3 is 15
average number of affinization = 15.213984835720304
Path 171 | total_timesteps 4590.
number of affinization with epsilon = 3 is 14
average number of affinization = 15.212962962962964
Path 172 | total_timesteps 4606.
number of affinization with epsilon = 3 is 27
average number of affinization = 15.2228763666947
Path 173 | total_timesteps 4639.
number of affinization with epsilon = 3 is 8
average number of affinization = 15.216806722689075
Path 174 | total_timesteps 4652.
number of affinization with epsilon = 3 is 41
average number of affinization = 15.238455079764904
Path 175 | total_timesteps 4702.
number of affinization with epsilon = 3 is 6
average number of affinization = 15.230704697986576
Path 176 | total_timesteps 4710.
number of affinization with epsilon = 3 is 27
average number of affinization = 15.24056999161777
Path 177 | total_timesteps 4748.
number of affinization with epsilon = 3 is 20
average number of affinization = 15.244556113902847
Path 178 | total_timesteps 4770.
number of affinization with epsilon = 3 is 34
average number of affinization = 15.260251046025104
Path 179 | total_timesteps 4813.
number of affinization with epsilon = 3 is 21
average number of affinization = 15.26505016722408
Path 180 | total_timesteps 4838.
number of affinization with epsilon = 3 is 11
average number of affinization = 15.261487050960735
Path 181 | total_timesteps 4852.
number of affinization with epsilon = 3 is 17
average number of affinization = 15.262938230383973
Path 182 | total_timesteps 4876.
number of affinization with epsilon = 3 is 19
average number of affinization = 15.26605504587156
Path 183 | total_timesteps 4901.
number of affinization with epsilon = 3 is 25
average number of affinization = 15.274166666666666
Path 184 | total_timesteps 4932.
number of affinization with epsilon = 3 is 9
average number of affinization = 15.268942547876769
Path 185 | total_timesteps 4946.
number of affinization with epsilon = 3 is 30
average number of affinization = 15.281198003327788
Path 186 | total_timesteps 4980.
number of affinization with epsilon = 3 is 16
average number of affinization = 15.281795511221945
Path 187 | total_timesteps 5000.
number of affinization with epsilon = 3 is 7
average number of affinization = 15.274916943521594
Path 188 | total_timesteps 5008.
number of affinization with epsilon = 3 is 28
average number of affinization = 15.285477178423237
Path 189 | total_timesteps 5044.
number of affinization with epsilon = 3 is 8
average number of affinization = 15.279436152570481
Path 190 | total_timesteps 5053.
number of affinization with epsilon = 3 is 8
average number of affinization = 15.273405136702568
Path 191 | total_timesteps 5069.
number of affinization with epsilon = 3 is 20
average number of affinization = 15.277317880794701
Path 192 | total_timesteps 5093.
number of affinization with epsilon = 3 is 19
average number of affinization = 15.280397022332506
Path 193 | total_timesteps 5114.
number of affinization with epsilon = 3 is 5
average number of affinization = 15.27190082644628
Path 194 | total_timesteps 5123.
number of affinization with epsilon = 3 is 20
average number of affinization = 15.275805119735756
Path 195 | total_timesteps 5147.
number of affinization with epsilon = 3 is 8
average number of affinization = 15.26980198019802
Path 196 | total_timesteps 5159.
number of affinization with epsilon = 3 is 17
average number of affinization = 15.271228359439407
Path 197 | total_timesteps 5179.
number of affinization with epsilon = 3 is 30
average number of affinization = 15.2833607907743
Path 198 | total_timesteps 5217.
number of affinization with epsilon = 3 is 32
average number of affinization = 15.297119341563786
Path 199 | total_timesteps 5255.
number of affinization with epsilon = 3 is 20
average number of affinization = 15.300986842105264
Path 200 | total_timesteps 5278.
number of affinization with epsilon = 3 is 18
average number of affinization = 15.303204601479047
Path 201 | total_timesteps 5300.
number of affinization with epsilon = 3 is 21
average number of affinization = 15.307881773399014
Path 202 | total_timesteps 5324.
number of affinization with epsilon = 3 is 14
average number of affinization = 15.306808859721082
Path 203 | total_timesteps 5340.
number of affinization with epsilon = 3 is 24
average number of affinization = 15.313934426229508
Path 204 | total_timesteps 5369.
number of affinization with epsilon = 3 is 33
average number of affinization = 15.32841932841933
Path 205 | total_timesteps 5409.
number of affinization with epsilon = 3 is 49
average number of affinization = 15.355973813420622
Path 206 | total_timesteps 5469.
number of affinization with epsilon = 3 is 27
average number of affinization = 15.365494685200327
Path 207 | total_timesteps 5501.
number of affinization with epsilon = 3 is 18
average number of affinization = 15.367647058823529
Path 208 | total_timesteps 5524.
number of affinization with epsilon = 3 is 27
average number of affinization = 15.377142857142857
Path 209 | total_timesteps 5560.
number of affinization with epsilon = 3 is 28
average number of affinization = 15.387438825448614
Path 210 | total_timesteps 5591.
number of affinization with epsilon = 3 is 20
average number of affinization = 15.39119804400978
Path 211 | total_timesteps 5620.
number of affinization with epsilon = 3 is 30
average number of affinization = 15.403094462540716
Path 212 | total_timesteps 5655.
number of affinization with epsilon = 3 is 19
average number of affinization = 15.406021155410903
Path 213 | total_timesteps 5680.
number of affinization with epsilon = 3 is 6
average number of affinization = 15.398373983739837
Path 214 | total_timesteps 5693.
number of affinization with epsilon = 3 is 31
average number of affinization = 15.411047928513403
Path 215 | total_timesteps 5733.
number of affinization with epsilon = 3 is 43
average number of affinization = 15.433441558441558
Path 216 | total_timesteps 5785.
number of affinization with epsilon = 3 is 28
average number of affinization = 15.443633414436334
Path 217 | total_timesteps 5817.
number of affinization with epsilon = 3 is 63
average number of affinization = 15.482171799027553
Path 218 | total_timesteps 5888.
number of affinization with epsilon = 3 is 24
average number of affinization = 15.48906882591093
Path 219 | total_timesteps 5914.
number of affinization with epsilon = 3 is 15
average number of affinization = 15.488673139158577
Path 220 | total_timesteps 5932.
number of affinization with epsilon = 3 is 13
average number of affinization = 15.486661277283751
Path 221 | total_timesteps 5950.
number of affinization with epsilon = 3 is 39
average number of affinization = 15.505654281098545
Path 222 | total_timesteps 5994.
number of affinization with epsilon = 3 is 21
average number of affinization = 15.510088781275222
Done generating on-policy rollouts.
Updating normalization.
Done updating normalization.
----------------------------
| AverageReturn | -6.21    |
| Iteration     | 3        |
| MaximumReturn | 49       |
| MinimumReturn | -19.5    |
| TotalSamples  | 20054    |
----------------------------
itr #4 | 
Fitting dynamics.
Fitting model 0 (0-based) in the ensemble of 2 models
Validation loss = 0.0315123125910759
Validation loss = 0.028299838304519653
Validation loss = 0.028566237539052963
Validation loss = 0.028653115034103394
Validation loss = 0.02704417146742344
Validation loss = 0.028121357783675194
Validation loss = 0.02812727726995945
Validation loss = 0.026944393292069435
Validation loss = 0.02720271423459053
Validation loss = 0.02803432010114193
Validation loss = 0.027743035927414894
Validation loss = 0.026586050167679787
Validation loss = 0.026561062783002853
Validation loss = 0.025367271155118942
Validation loss = 0.028824547305703163
Validation loss = 0.025509381666779518
Validation loss = 0.027907419949769974
Validation loss = 0.03472721204161644
Fitting model 1 (0-based) in the ensemble of 2 models
Validation loss = 0.03124905563890934
Validation loss = 0.030461108312010765
Validation loss = 0.029188241809606552
Validation loss = 0.027626505121588707
Validation loss = 0.027447635307908058
Validation loss = 0.025913959369063377
Validation loss = 0.035949625074863434
Validation loss = 0.02644297108054161
Validation loss = 0.025945816189050674
Validation loss = 0.028075719252228737
Done fitting dynamics.
Updating randomness.
Done updating randomness.
Training policy using TRPO.
Re-initialize init_std.
Obtaining samples for iteration 0...
Obtaining samples for iteration 1...
Obtaining samples for iteration 2...
Obtaining samples for iteration 3...
Obtaining samples for iteration 4...
Obtaining samples for iteration 5...
Obtaining samples for iteration 6...
Obtaining samples for iteration 7...
Obtaining samples for iteration 8...
Obtaining samples for iteration 9...
Obtaining samples for iteration 10...
Obtaining samples for iteration 11...
Obtaining samples for iteration 12...
Obtaining samples for iteration 13...
Obtaining samples for iteration 14...
Obtaining samples for iteration 15...
Obtaining samples for iteration 16...
Obtaining samples for iteration 17...
Obtaining samples for iteration 18...
Obtaining samples for iteration 19...
Done training policy.
Generating on-policy rollouts.
Path 0 | total_timesteps 0.
number of affinization with epsilon = 3 is 57
average number of affinization = 15.543548387096774
Path 1 | total_timesteps 66.
number of affinization with epsilon = 3 is 13
average number of affinization = 15.541498791297341
Path 2 | total_timesteps 83.
number of affinization with epsilon = 3 is 16
average number of affinization = 15.541867954911433
Path 3 | total_timesteps 102.
number of affinization with epsilon = 3 is 21
average number of affinization = 15.54625905068383
Path 4 | total_timesteps 131.
number of affinization with epsilon = 3 is 37
average number of affinization = 15.563504823151126
Path 5 | total_timesteps 176.
number of affinization with epsilon = 3 is 34
average number of affinization = 15.578313253012048
Path 6 | total_timesteps 215.
number of affinization with epsilon = 3 is 23
average number of affinization = 15.584269662921349
Path 7 | total_timesteps 242.
number of affinization with epsilon = 3 is 15
average number of affinization = 15.583801122694467
Path 8 | total_timesteps 258.
number of affinization with epsilon = 3 is 11
average number of affinization = 15.580128205128204
Path 9 | total_timesteps 275.
number of affinization with epsilon = 3 is 23
average number of affinization = 15.586068855084067
Path 10 | total_timesteps 303.
number of affinization with epsilon = 3 is 47
average number of affinization = 15.6112
Path 11 | total_timesteps 354.
number of affinization with epsilon = 3 is 23
average number of affinization = 15.61710631494804
Path 12 | total_timesteps 382.
number of affinization with epsilon = 3 is 24
average number of affinization = 15.623801916932907
Path 13 | total_timesteps 409.
number of affinization with epsilon = 3 is 19
average number of affinization = 15.626496408619314
Path 14 | total_timesteps 431.
number of affinization with epsilon = 3 is 26
average number of affinization = 15.634768740031898
Path 15 | total_timesteps 468.
number of affinization with epsilon = 3 is 7
average number of affinization = 15.62788844621514
Path 16 | total_timesteps 478.
number of affinization with epsilon = 3 is 13
average number of affinization = 15.625796178343949
Path 17 | total_timesteps 497.
number of affinization with epsilon = 3 is 22
average number of affinization = 15.630867143993635
Path 18 | total_timesteps 526.
number of affinization with epsilon = 3 is 26
average number of affinization = 15.639109697933227
Path 19 | total_timesteps 556.
number of affinization with epsilon = 3 is 13
average number of affinization = 15.637013502779984
Path 20 | total_timesteps 574.
number of affinization with epsilon = 3 is 24
average number of affinization = 15.643650793650794
Path 21 | total_timesteps 602.
number of affinization with epsilon = 3 is 32
average number of affinization = 15.656621728786677
Path 22 | total_timesteps 636.
number of affinization with epsilon = 3 is 14
average number of affinization = 15.655309033280506
Path 23 | total_timesteps 653.
number of affinization with epsilon = 3 is 21
average number of affinization = 15.659540775930324
Path 24 | total_timesteps 679.
number of affinization with epsilon = 3 is 25
average number of affinization = 15.666930379746836
Path 25 | total_timesteps 707.
number of affinization with epsilon = 3 is 54
average number of affinization = 15.697233201581028
Path 26 | total_timesteps 775.
number of affinization with epsilon = 3 is 17
average number of affinization = 15.69826224328594
Path 27 | total_timesteps 799.
number of affinization with epsilon = 3 is 27
average number of affinization = 15.707182320441989
Path 28 | total_timesteps 833.
number of affinization with epsilon = 3 is 55
average number of affinization = 15.738170347003155
Path 29 | total_timesteps 902.
number of affinization with epsilon = 3 is 65
average number of affinization = 15.77698975571316
Path 30 | total_timesteps 989.
number of affinization with epsilon = 3 is 28
average number of affinization = 15.786614173228346
Path 31 | total_timesteps 1023.
number of affinization with epsilon = 3 is 49
average number of affinization = 15.812745869394178
Path 32 | total_timesteps 1084.
number of affinization with epsilon = 3 is 36
average number of affinization = 15.828616352201259
Path 33 | total_timesteps 1130.
number of affinization with epsilon = 3 is 34
average number of affinization = 15.842890809112333
Path 34 | total_timesteps 1171.
number of affinization with epsilon = 3 is 29
average number of affinization = 15.853218210361067
Path 35 | total_timesteps 1203.
number of affinization with epsilon = 3 is 29
average number of affinization = 15.863529411764706
Path 36 | total_timesteps 1242.
number of affinization with epsilon = 3 is 31
average number of affinization = 15.87539184952978
Path 37 | total_timesteps 1283.
number of affinization with epsilon = 3 is 25
average number of affinization = 15.882537196554425
Path 38 | total_timesteps 1315.
number of affinization with epsilon = 3 is 13
average number of affinization = 15.880281690140846
Path 39 | total_timesteps 1334.
number of affinization with epsilon = 3 is 30
average number of affinization = 15.891321344800625
Path 40 | total_timesteps 1371.
number of affinization with epsilon = 3 is 28
average number of affinization = 15.90078125
Path 41 | total_timesteps 1411.
number of affinization with epsilon = 3 is 26
average number of affinization = 15.908665105386417
Path 42 | total_timesteps 1442.
number of affinization with epsilon = 3 is 11
average number of affinization = 15.904836193447737
Path 43 | total_timesteps 1458.
number of affinization with epsilon = 3 is 32
average number of affinization = 15.91738113795791
Path 44 | total_timesteps 1498.
number of affinization with epsilon = 3 is 15
average number of affinization = 15.916666666666666
Path 45 | total_timesteps 1520.
number of affinization with epsilon = 3 is 15
average number of affinization = 15.915953307392996
Path 46 | total_timesteps 1537.
number of affinization with epsilon = 3 is 18
average number of affinization = 15.917573872472785
Path 47 | total_timesteps 1557.
number of affinization with epsilon = 3 is 11
average number of affinization = 15.913752913752914
Path 48 | total_timesteps 1570.
number of affinization with epsilon = 3 is 24
average number of affinization = 15.92003105590062
Path 49 | total_timesteps 1599.
number of affinization with epsilon = 3 is 13
average number of affinization = 15.917765709852599
Path 50 | total_timesteps 1615.
number of affinization with epsilon = 3 is 18
average number of affinization = 15.91937984496124
Path 51 | total_timesteps 1638.
number of affinization with epsilon = 3 is 17
average number of affinization = 15.92021688613478
Path 52 | total_timesteps 1662.
number of affinization with epsilon = 3 is 10
average number of affinization = 15.9156346749226
Path 53 | total_timesteps 1676.
number of affinization with epsilon = 3 is 15
average number of affinization = 15.91492652745553
Path 54 | total_timesteps 1696.
number of affinization with epsilon = 3 is 32
average number of affinization = 15.927357032457497
Path 55 | total_timesteps 1734.
number of affinization with epsilon = 3 is 31
average number of affinization = 15.938996138996139
Path 56 | total_timesteps 1773.
number of affinization with epsilon = 3 is 19
average number of affinization = 15.941358024691358
Path 57 | total_timesteps 1801.
number of affinization with epsilon = 3 is 13
average number of affinization = 15.939090208172706
Path 58 | total_timesteps 1819.
number of affinization with epsilon = 3 is 8
average number of affinization = 15.932973805855163
Path 59 | total_timesteps 1831.
number of affinization with epsilon = 3 is 16
average number of affinization = 15.933025404157044
Path 60 | total_timesteps 1855.
number of affinization with epsilon = 3 is 17
average number of affinization = 15.933846153846154
Path 61 | total_timesteps 1881.
number of affinization with epsilon = 3 is 46
average number of affinization = 15.95695618754804
Path 62 | total_timesteps 1933.
number of affinization with epsilon = 3 is 28
average number of affinization = 15.966205837173579
Path 63 | total_timesteps 1966.
number of affinization with epsilon = 3 is 28
average number of affinization = 15.97544128933231
Path 64 | total_timesteps 1997.
number of affinization with epsilon = 3 is 15
average number of affinization = 15.974693251533742
Path 65 | total_timesteps 2015.
number of affinization with epsilon = 3 is 28
average number of affinization = 15.983908045977012
Path 66 | total_timesteps 2050.
number of affinization with epsilon = 3 is 18
average number of affinization = 15.985451761102603
Path 67 | total_timesteps 2076.
number of affinization with epsilon = 3 is 19
average number of affinization = 15.987758224942617
Path 68 | total_timesteps 2100.
number of affinization with epsilon = 3 is 29
average number of affinization = 15.997706422018348
Path 69 | total_timesteps 2135.
number of affinization with epsilon = 3 is 21
average number of affinization = 16.001527883880826
Path 70 | total_timesteps 2158.
number of affinization with epsilon = 3 is 45
average number of affinization = 16.023664122137404
Path 71 | total_timesteps 2210.
number of affinization with epsilon = 3 is 26
average number of affinization = 16.031273836765827
Path 72 | total_timesteps 2238.
number of affinization with epsilon = 3 is 15
average number of affinization = 16.03048780487805
Path 73 | total_timesteps 2259.
number of affinization with epsilon = 3 is 38
average number of affinization = 16.047220106626046
Path 74 | total_timesteps 2307.
number of affinization with epsilon = 3 is 35
average number of affinization = 16.061643835616437
Path 75 | total_timesteps 2348.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.05703422053232
Path 76 | total_timesteps 2362.
number of affinization with epsilon = 3 is 24
average number of affinization = 16.06306990881459
Path 77 | total_timesteps 2393.
number of affinization with epsilon = 3 is 43
average number of affinization = 16.083523158694003
Path 78 | total_timesteps 2442.
number of affinization with epsilon = 3 is 33
average number of affinization = 16.096358118361152
Path 79 | total_timesteps 2489.
number of affinization with epsilon = 3 is 29
average number of affinization = 16.106141015921153
Path 80 | total_timesteps 2520.
number of affinization with epsilon = 3 is 20
average number of affinization = 16.10909090909091
Path 81 | total_timesteps 2545.
number of affinization with epsilon = 3 is 36
average number of affinization = 16.124148372445116
Path 82 | total_timesteps 2586.
number of affinization with epsilon = 3 is 38
average number of affinization = 16.140695915279878
Path 83 | total_timesteps 2633.
number of affinization with epsilon = 3 is 29
average number of affinization = 16.150415721844293
Path 84 | total_timesteps 2670.
number of affinization with epsilon = 3 is 25
average number of affinization = 16.157099697885197
Path 85 | total_timesteps 2701.
number of affinization with epsilon = 3 is 40
average number of affinization = 16.175094339622643
Path 86 | total_timesteps 2749.
number of affinization with epsilon = 3 is 12
average number of affinization = 16.171945701357465
Path 87 | total_timesteps 2766.
number of affinization with epsilon = 3 is 21
average number of affinization = 16.175584024114546
Path 88 | total_timesteps 2794.
number of affinization with epsilon = 3 is 37
average number of affinization = 16.191265060240966
Path 89 | total_timesteps 2835.
number of affinization with epsilon = 3 is 33
average number of affinization = 16.203912716328066
Path 90 | total_timesteps 2874.
number of affinization with epsilon = 3 is 15
average number of affinization = 16.203007518796994
Path 91 | total_timesteps 2893.
number of affinization with epsilon = 3 is 14
average number of affinization = 16.201352366641622
Path 92 | total_timesteps 2913.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.195945945945947
Path 93 | total_timesteps 2925.
number of affinization with epsilon = 3 is 38
average number of affinization = 16.212303075768943
Path 94 | total_timesteps 2970.
number of affinization with epsilon = 3 is 12
average number of affinization = 16.209145427286355
Path 95 | total_timesteps 2984.
number of affinization with epsilon = 3 is 27
average number of affinization = 16.217228464419474
Path 96 | total_timesteps 3017.
number of affinization with epsilon = 3 is 23
average number of affinization = 16.222305389221557
Path 97 | total_timesteps 3044.
number of affinization with epsilon = 3 is 33
average number of affinization = 16.234854151084516
Path 98 | total_timesteps 3082.
number of affinization with epsilon = 3 is 32
average number of affinization = 16.246636771300448
Path 99 | total_timesteps 3118.
number of affinization with epsilon = 3 is 13
average number of affinization = 16.24421209858103
Path 100 | total_timesteps 3134.
number of affinization with epsilon = 3 is 16
average number of affinization = 16.24402985074627
Path 101 | total_timesteps 3156.
number of affinization with epsilon = 3 is 38
average number of affinization = 16.260253542132737
Path 102 | total_timesteps 3200.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.25558867362146
Path 103 | total_timesteps 3212.
number of affinization with epsilon = 3 is 22
average number of affinization = 16.25986597170514
Path 104 | total_timesteps 3243.
number of affinization with epsilon = 3 is 26
average number of affinization = 16.267113095238095
Path 105 | total_timesteps 3274.
number of affinization with epsilon = 3 is 17
average number of affinization = 16.267657992565056
Path 106 | total_timesteps 3293.
number of affinization with epsilon = 3 is 16
average number of affinization = 16.26745913818722
Path 107 | total_timesteps 3314.
number of affinization with epsilon = 3 is 53
average number of affinization = 16.29472902746845
Path 108 | total_timesteps 3378.
number of affinization with epsilon = 3 is 16
average number of affinization = 16.294510385756677
Path 109 | total_timesteps 3398.
number of affinization with epsilon = 3 is 17
average number of affinization = 16.295033358042996
Path 110 | total_timesteps 3416.
number of affinization with epsilon = 3 is 21
average number of affinization = 16.29851851851852
Path 111 | total_timesteps 3442.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.293856402664694
Path 112 | total_timesteps 3455.
number of affinization with epsilon = 3 is 39
average number of affinization = 16.310650887573964
Path 113 | total_timesteps 3501.
number of affinization with epsilon = 3 is 19
average number of affinization = 16.312638580931264
Path 114 | total_timesteps 3525.
number of affinization with epsilon = 3 is 13
average number of affinization = 16.31019202363368
Path 115 | total_timesteps 3542.
number of affinization with epsilon = 3 is 50
average number of affinization = 16.335055350553507
Path 116 | total_timesteps 3600.
number of affinization with epsilon = 3 is 27
average number of affinization = 16.3429203539823
Path 117 | total_timesteps 3631.
number of affinization with epsilon = 3 is 13
average number of affinization = 16.34045689019897
Path 118 | total_timesteps 3651.
number of affinization with epsilon = 3 is 43
average number of affinization = 16.360088365243005
Path 119 | total_timesteps 3710.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.353200883002206
Path 120 | total_timesteps 3721.
number of affinization with epsilon = 3 is 27
average number of affinization = 16.361029411764704
Path 121 | total_timesteps 3755.
number of affinization with epsilon = 3 is 13
average number of affinization = 16.358559882439383
Path 122 | total_timesteps 3772.
number of affinization with epsilon = 3 is 21
average number of affinization = 16.361967694566815
Path 123 | total_timesteps 3798.
number of affinization with epsilon = 3 is 27
average number of affinization = 16.369772560528247
Path 124 | total_timesteps 3831.
number of affinization with epsilon = 3 is 20
average number of affinization = 16.372434017595307
Path 125 | total_timesteps 3856.
number of affinization with epsilon = 3 is 42
average number of affinization = 16.39120879120879
Path 126 | total_timesteps 3914.
number of affinization with epsilon = 3 is 13
average number of affinization = 16.388726207906295
Path 127 | total_timesteps 3929.
number of affinization with epsilon = 3 is 17
average number of affinization = 16.389173372348207
Path 128 | total_timesteps 3950.
number of affinization with epsilon = 3 is 16
average number of affinization = 16.38888888888889
Path 129 | total_timesteps 3969.
number of affinization with epsilon = 3 is 26
average number of affinization = 16.39590942293645
Path 130 | total_timesteps 4001.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.39051094890511
Path 131 | total_timesteps 4013.
number of affinization with epsilon = 3 is 31
average number of affinization = 16.40116703136397
Path 132 | total_timesteps 4047.
number of affinization with epsilon = 3 is 16
average number of affinization = 16.400874635568513
Path 133 | total_timesteps 4066.
number of affinization with epsilon = 3 is 28
average number of affinization = 16.409322651128914
Path 134 | total_timesteps 4097.
number of affinization with epsilon = 3 is 40
average number of affinization = 16.426491994177585
Path 135 | total_timesteps 4155.
number of affinization with epsilon = 3 is 23
average number of affinization = 16.431272727272727
Path 136 | total_timesteps 4183.
number of affinization with epsilon = 3 is 22
average number of affinization = 16.43531976744186
Path 137 | total_timesteps 4209.
number of affinization with epsilon = 3 is 26
average number of affinization = 16.44226579520697
Path 138 | total_timesteps 4246.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.43831640058055
Path 139 | total_timesteps 4258.
number of affinization with epsilon = 3 is 24
average number of affinization = 16.443799854967367
Path 140 | total_timesteps 4286.
number of affinization with epsilon = 3 is 19
average number of affinization = 16.445652173913043
Path 141 | total_timesteps 4309.
number of affinization with epsilon = 3 is 26
average number of affinization = 16.452570601013758
Path 142 | total_timesteps 4339.
number of affinization with epsilon = 3 is 44
average number of affinization = 16.47250361794501
Path 143 | total_timesteps 4388.
number of affinization with epsilon = 3 is 18
average number of affinization = 16.47360809833695
Path 144 | total_timesteps 4412.
number of affinization with epsilon = 3 is 27
average number of affinization = 16.48121387283237
Path 145 | total_timesteps 4448.
number of affinization with epsilon = 3 is 14
average number of affinization = 16.47942238267148
Path 146 | total_timesteps 4469.
number of affinization with epsilon = 3 is 15
average number of affinization = 16.47835497835498
Path 147 | total_timesteps 4491.
number of affinization with epsilon = 3 is 25
average number of affinization = 16.4844989185292
Path 148 | total_timesteps 4523.
number of affinization with epsilon = 3 is 36
average number of affinization = 16.498559077809798
Path 149 | total_timesteps 4568.
number of affinization with epsilon = 3 is 21
average number of affinization = 16.50179985601152
Path 150 | total_timesteps 4592.
number of affinization with epsilon = 3 is 27
average number of affinization = 16.50935251798561
Path 151 | total_timesteps 4623.
number of affinization with epsilon = 3 is 36
average number of affinization = 16.523364485981308
Path 152 | total_timesteps 4664.
number of affinization with epsilon = 3 is 24
average number of affinization = 16.528735632183906
Path 153 | total_timesteps 4696.
number of affinization with epsilon = 3 is 13
average number of affinization = 16.526202440775304
Path 154 | total_timesteps 4713.
number of affinization with epsilon = 3 is 48
average number of affinization = 16.548780487804876
Path 155 | total_timesteps 4771.
number of affinization with epsilon = 3 is 47
average number of affinization = 16.570609318996414
Path 156 | total_timesteps 4833.
number of affinization with epsilon = 3 is 42
average number of affinization = 16.588825214899714
Path 157 | total_timesteps 4883.
number of affinization with epsilon = 3 is 21
average number of affinization = 16.591982820329278
Path 158 | total_timesteps 4912.
number of affinization with epsilon = 3 is 20
average number of affinization = 16.59442060085837
Path 159 | total_timesteps 4937.
number of affinization with epsilon = 3 is 35
average number of affinization = 16.60757684060043
Path 160 | total_timesteps 4982.
number of affinization with epsilon = 3 is 22
average number of affinization = 16.611428571428572
Path 161 | total_timesteps 5010.
number of affinization with epsilon = 3 is 69
average number of affinization = 16.64882226980728
Path 162 | total_timesteps 5084.
number of affinization with epsilon = 3 is 34
average number of affinization = 16.66119828815977
Path 163 | total_timesteps 5137.
number of affinization with epsilon = 3 is 37
average number of affinization = 16.67569493941554
Path 164 | total_timesteps 5177.
number of affinization with epsilon = 3 is 22
average number of affinization = 16.67948717948718
Path 165 | total_timesteps 5203.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.67544483985765
Path 166 | total_timesteps 5215.
number of affinization with epsilon = 3 is 24
average number of affinization = 16.680654338549076
Path 167 | total_timesteps 5249.
number of affinization with epsilon = 3 is 39
average number of affinization = 16.696517412935325
Path 168 | total_timesteps 5298.
number of affinization with epsilon = 3 is 13
average number of affinization = 16.693892045454547
Path 169 | total_timesteps 5316.
number of affinization with epsilon = 3 is 25
average number of affinization = 16.699787083037616
Path 170 | total_timesteps 5346.
number of affinization with epsilon = 3 is 20
average number of affinization = 16.70212765957447
Path 171 | total_timesteps 5374.
number of affinization with epsilon = 3 is 21
average number of affinization = 16.705173635719348
Path 172 | total_timesteps 5400.
number of affinization with epsilon = 3 is 31
average number of affinization = 16.71529745042493
Path 173 | total_timesteps 5436.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.709129511677283
Path 174 | total_timesteps 5448.
number of affinization with epsilon = 3 is 25
average number of affinization = 16.714992927864216
Path 175 | total_timesteps 5478.
number of affinization with epsilon = 3 is 28
average number of affinization = 16.722968197879858
Path 176 | total_timesteps 5511.
number of affinization with epsilon = 3 is 27
average number of affinization = 16.730225988700564
Path 177 | total_timesteps 5543.
number of affinization with epsilon = 3 is 14
average number of affinization = 16.728299223712067
Path 178 | total_timesteps 5564.
number of affinization with epsilon = 3 is 14
average number of affinization = 16.726375176304654
Path 179 | total_timesteps 5580.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.721634954193092
Path 180 | total_timesteps 5591.
number of affinization with epsilon = 3 is 45
average number of affinization = 16.741549295774647
Path 181 | total_timesteps 5640.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.735397607318788
Path 182 | total_timesteps 5652.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.72855133614627
Path 183 | total_timesteps 5663.
number of affinization with epsilon = 3 is 24
average number of affinization = 16.733661278988052
Path 184 | total_timesteps 5694.
number of affinization with epsilon = 3 is 15
average number of affinization = 16.73244382022472
Path 185 | total_timesteps 5711.
number of affinization with epsilon = 3 is 13
average number of affinization = 16.729824561403507
Path 186 | total_timesteps 5732.
number of affinization with epsilon = 3 is 14
average number of affinization = 16.72791023842917
Path 187 | total_timesteps 5750.
number of affinization with epsilon = 3 is 27
average number of affinization = 16.73510861948143
Path 188 | total_timesteps 5778.
number of affinization with epsilon = 3 is 17
average number of affinization = 16.735294117647058
Path 189 | total_timesteps 5797.
number of affinization with epsilon = 3 is 24
average number of affinization = 16.74037788663401
Path 190 | total_timesteps 5825.
number of affinization with epsilon = 3 is 24
average number of affinization = 16.745454545454546
Path 191 | total_timesteps 5853.
number of affinization with epsilon = 3 is 28
average number of affinization = 16.75331935709294
Path 192 | total_timesteps 5889.
number of affinization with epsilon = 3 is 19
average number of affinization = 16.754888268156424
Path 193 | total_timesteps 5912.
number of affinization with epsilon = 3 is 20
average number of affinization = 16.75715282623866
Path 194 | total_timesteps 5937.
number of affinization with epsilon = 3 is 17
average number of affinization = 16.757322175732217
Path 195 | total_timesteps 5956.
number of affinization with epsilon = 3 is 26
average number of affinization = 16.763763066202092
Path 196 | total_timesteps 5990.
number of affinization with epsilon = 3 is 32
average number of affinization = 16.774373259052926
Done generating on-policy rollouts.
Updating normalization.
Done updating normalization.
----------------------------
| AverageReturn | -6.04    |
| Iteration     | 4        |
| MaximumReturn | 24.2     |
| MinimumReturn | -37.7    |
| TotalSamples  | 24074    |
----------------------------
itr #5 | 
Fitting dynamics.
Fitting model 0 (0-based) in the ensemble of 2 models
Validation loss = 0.030567800626158714
Validation loss = 0.025775328278541565
Validation loss = 0.030573761090636253
Validation loss = 0.026753908023238182
Validation loss = 0.026772229000926018
Validation loss = 0.027081169188022614
Fitting model 1 (0-based) in the ensemble of 2 models
Validation loss = 0.0281637292355299
Validation loss = 0.027715159580111504
Validation loss = 0.027240648865699768
Validation loss = 0.02584059350192547
Validation loss = 0.02719014883041382
Validation loss = 0.026214100420475006
Validation loss = 0.027598029002547264
Validation loss = 0.025615990161895752
Validation loss = 0.030462048947811127
Validation loss = 0.026609009131789207
Validation loss = 0.026375306770205498
Validation loss = 0.027182212099432945
Done fitting dynamics.
Updating randomness.
Done updating randomness.
Training policy using TRPO.
Re-initialize init_std.
Obtaining samples for iteration 0...
Obtaining samples for iteration 1...
Obtaining samples for iteration 2...
Obtaining samples for iteration 3...
Obtaining samples for iteration 4...
Obtaining samples for iteration 5...
Obtaining samples for iteration 6...
Obtaining samples for iteration 7...
Obtaining samples for iteration 8...
Obtaining samples for iteration 9...
Obtaining samples for iteration 10...
Obtaining samples for iteration 11...
Obtaining samples for iteration 12...
Obtaining samples for iteration 13...
Obtaining samples for iteration 14...
Obtaining samples for iteration 15...
Obtaining samples for iteration 16...
Obtaining samples for iteration 17...
Obtaining samples for iteration 18...
Obtaining samples for iteration 19...
Done training policy.
Generating on-policy rollouts.
Path 0 | total_timesteps 0.
number of affinization with epsilon = 3 is 25
average number of affinization = 16.78009742519137
Path 1 | total_timesteps 30.
number of affinization with epsilon = 3 is 23
average number of affinization = 16.78442280945758
Path 2 | total_timesteps 63.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.77970813064628
Path 3 | total_timesteps 79.
number of affinization with epsilon = 3 is 19
average number of affinization = 16.78125
Path 4 | total_timesteps 99.
number of affinization with epsilon = 3 is 39
average number of affinization = 16.796668979875086
Path 5 | total_timesteps 146.
number of affinization with epsilon = 3 is 15
average number of affinization = 16.795423023578362
Path 6 | total_timesteps 165.
number of affinization with epsilon = 3 is 35
average number of affinization = 16.80803880803881
Path 7 | total_timesteps 208.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.80263157894737
Path 8 | total_timesteps 219.
number of affinization with epsilon = 3 is 48
average number of affinization = 16.824221453287198
Path 9 | total_timesteps 277.
number of affinization with epsilon = 3 is 30
average number of affinization = 16.833333333333332
Path 10 | total_timesteps 313.
number of affinization with epsilon = 3 is 22
average number of affinization = 16.83690393918452
Path 11 | total_timesteps 338.
number of affinization with epsilon = 3 is 21
average number of affinization = 16.83977900552486
Path 12 | total_timesteps 364.
number of affinization with epsilon = 3 is 15
average number of affinization = 16.838509316770185
Path 13 | total_timesteps 382.
number of affinization with epsilon = 3 is 31
average number of affinization = 16.848275862068967
Path 14 | total_timesteps 418.
number of affinization with epsilon = 3 is 32
average number of affinization = 16.858718125430737
Path 15 | total_timesteps 460.
number of affinization with epsilon = 3 is 19
average number of affinization = 16.860192837465565
Path 16 | total_timesteps 485.
number of affinization with epsilon = 3 is 30
average number of affinization = 16.869236063317274
Path 17 | total_timesteps 520.
number of affinization with epsilon = 3 is 15
average number of affinization = 16.867950481430537
Path 18 | total_timesteps 536.
number of affinization with epsilon = 3 is 15
average number of affinization = 16.866666666666667
Path 19 | total_timesteps 553.
number of affinization with epsilon = 3 is 21
average number of affinization = 16.869505494505493
Path 20 | total_timesteps 580.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.86547700754976
Path 21 | total_timesteps 595.
number of affinization with epsilon = 3 is 28
average number of affinization = 16.873113854595335
Path 22 | total_timesteps 626.
number of affinization with epsilon = 3 is 19
average number of affinization = 16.874571624400275
Path 23 | total_timesteps 649.
number of affinization with epsilon = 3 is 27
average number of affinization = 16.88150684931507
Path 24 | total_timesteps 682.
number of affinization with epsilon = 3 is 29
average number of affinization = 16.889801505817932
Path 25 | total_timesteps 717.
number of affinization with epsilon = 3 is 15
average number of affinization = 16.888508891928865
Path 26 | total_timesteps 735.
number of affinization with epsilon = 3 is 23
average number of affinization = 16.892686261107315
Path 27 | total_timesteps 760.
number of affinization with epsilon = 3 is 22
average number of affinization = 16.896174863387976
Path 28 | total_timesteps 789.
number of affinization with epsilon = 3 is 18
average number of affinization = 16.89692832764505
Path 29 | total_timesteps 812.
number of affinization with epsilon = 3 is 55
average number of affinization = 16.92291950886767
Path 30 | total_timesteps 879.
number of affinization with epsilon = 3 is 17
average number of affinization = 16.922972051806408
Path 31 | total_timesteps 904.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.917574931880107
Path 32 | total_timesteps 920.
number of affinization with epsilon = 3 is 17
average number of affinization = 16.917631041524846
Path 33 | total_timesteps 950.
number of affinization with epsilon = 3 is 14
average number of affinization = 16.9156462585034
Path 34 | total_timesteps 967.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.91162474507138
Path 35 | total_timesteps 982.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.904891304347824
Path 36 | total_timesteps 991.
number of affinization with epsilon = 3 is 15
average number of affinization = 16.90359809911745
Path 37 | total_timesteps 1009.
number of affinization with epsilon = 3 is 21
average number of affinization = 16.906377204884667
Path 38 | total_timesteps 1033.
number of affinization with epsilon = 3 is 15
average number of affinization = 16.90508474576271
Path 39 | total_timesteps 1055.
number of affinization with epsilon = 3 is 23
average number of affinization = 16.90921409214092
Path 40 | total_timesteps 1084.
number of affinization with epsilon = 3 is 18
average number of affinization = 16.90995260663507
Path 41 | total_timesteps 1105.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.904600811907983
Path 42 | total_timesteps 1120.
number of affinization with epsilon = 3 is 17
average number of affinization = 16.904665314401623
Path 43 | total_timesteps 1141.
number of affinization with epsilon = 3 is 18
average number of affinization = 16.905405405405407
Path 44 | total_timesteps 1166.
number of affinization with epsilon = 3 is 27
average number of affinization = 16.91222147197839
Path 45 | total_timesteps 1200.
number of affinization with epsilon = 3 is 21
average number of affinization = 16.91497975708502
Path 46 | total_timesteps 1222.
number of affinization with epsilon = 3 is 30
average number of affinization = 16.923803101820635
Path 47 | total_timesteps 1260.
number of affinization with epsilon = 3 is 25
average number of affinization = 16.92924528301887
Path 48 | total_timesteps 1289.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.924579124579125
Path 49 | total_timesteps 1302.
number of affinization with epsilon = 3 is 19
average number of affinization = 16.925975773889636
Path 50 | total_timesteps 1329.
number of affinization with epsilon = 3 is 12
average number of affinization = 16.9226630800269
Path 51 | total_timesteps 1345.
number of affinization with epsilon = 3 is 20
average number of affinization = 16.9247311827957
Path 52 | total_timesteps 1369.
number of affinization with epsilon = 3 is 29
average number of affinization = 16.932840832773675
Path 53 | total_timesteps 1402.
number of affinization with epsilon = 3 is 23
average number of affinization = 16.936912751677852
Path 54 | total_timesteps 1430.
number of affinization with epsilon = 3 is 22
average number of affinization = 16.940308517773307
Path 55 | total_timesteps 1456.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.935656836461128
Path 56 | total_timesteps 1477.
number of affinization with epsilon = 3 is 28
average number of affinization = 16.9430676490288
Path 57 | total_timesteps 1513.
number of affinization with epsilon = 3 is 16
average number of affinization = 16.94243641231593
Path 58 | total_timesteps 1532.
number of affinization with epsilon = 3 is 24
average number of affinization = 16.94715719063545
Path 59 | total_timesteps 1565.
number of affinization with epsilon = 3 is 16
average number of affinization = 16.946524064171122
Path 60 | total_timesteps 1586.
number of affinization with epsilon = 3 is 19
average number of affinization = 16.947895791583168
Path 61 | total_timesteps 1609.
number of affinization with epsilon = 3 is 35
average number of affinization = 16.959946595460615
Path 62 | total_timesteps 1648.
number of affinization with epsilon = 3 is 33
average number of affinization = 16.970647098065378
Path 63 | total_timesteps 1688.
number of affinization with epsilon = 3 is 19
average number of affinization = 16.972
Path 64 | total_timesteps 1708.
number of affinization with epsilon = 3 is 41
average number of affinization = 16.98800799467022
Path 65 | total_timesteps 1753.
number of affinization with epsilon = 3 is 31
average number of affinization = 16.99733688415446
Path 66 | total_timesteps 1789.
number of affinization with epsilon = 3 is 22
average number of affinization = 17.00066533599468
Path 67 | total_timesteps 1817.
number of affinization with epsilon = 3 is 27
average number of affinization = 17.007313829787233
Path 68 | total_timesteps 1849.
number of affinization with epsilon = 3 is 28
average number of affinization = 17.014617940199336
Path 69 | total_timesteps 1881.
number of affinization with epsilon = 3 is 27
average number of affinization = 17.02124833997344
Path 70 | total_timesteps 1911.
number of affinization with epsilon = 3 is 30
average number of affinization = 17.029860650298605
Path 71 | total_timesteps 1949.
number of affinization with epsilon = 3 is 18
average number of affinization = 17.03050397877984
Path 72 | total_timesteps 1971.
number of affinization with epsilon = 3 is 27
average number of affinization = 17.03711066931743
Path 73 | total_timesteps 2008.
number of affinization with epsilon = 3 is 21
average number of affinization = 17.039735099337747
Path 74 | total_timesteps 2038.
number of affinization with epsilon = 3 is 18
average number of affinization = 17.040370615486435
Path 75 | total_timesteps 2060.
number of affinization with epsilon = 3 is 17
average number of affinization = 17.040343915343914
Path 76 | total_timesteps 2080.
number of affinization with epsilon = 3 is 25
average number of affinization = 17.045604758757435
Path 77 | total_timesteps 2110.
number of affinization with epsilon = 3 is 22
average number of affinization = 17.04887714663144
Path 78 | total_timesteps 2137.
number of affinization with epsilon = 3 is 35
average number of affinization = 17.06072607260726
Path 79 | total_timesteps 2180.
number of affinization with epsilon = 3 is 26
average number of affinization = 17.066622691292874
Path 80 | total_timesteps 2211.
number of affinization with epsilon = 3 is 26
average number of affinization = 17.07251153592617
Path 81 | total_timesteps 2244.
number of affinization with epsilon = 3 is 10
average number of affinization = 17.067852437417656
Path 82 | total_timesteps 2260.
number of affinization with epsilon = 3 is 28
average number of affinization = 17.075049374588545
Path 83 | total_timesteps 2294.
number of affinization with epsilon = 3 is 32
average number of affinization = 17.084868421052633
Path 84 | total_timesteps 2331.
number of affinization with epsilon = 3 is 37
average number of affinization = 17.097961867192637
Path 85 | total_timesteps 2376.
number of affinization with epsilon = 3 is 36
average number of affinization = 17.110381077529567
Path 86 | total_timesteps 2417.
number of affinization with epsilon = 3 is 9
average number of affinization = 17.10505581089954
Path 87 | total_timesteps 2430.
number of affinization with epsilon = 3 is 16
average number of affinization = 17.10433070866142
Path 88 | total_timesteps 2450.
number of affinization with epsilon = 3 is 21
average number of affinization = 17.10688524590164
Path 89 | total_timesteps 2475.
number of affinization with epsilon = 3 is 17
average number of affinization = 17.10681520314548
Path 90 | total_timesteps 2498.
number of affinization with epsilon = 3 is 12
average number of affinization = 17.10347085789129
Path 91 | total_timesteps 2514.
number of affinization with epsilon = 3 is 13
average number of affinization = 17.100785340314136
Path 92 | total_timesteps 2532.
number of affinization with epsilon = 3 is 25
average number of affinization = 17.10595160235448
Path 93 | total_timesteps 2566.
number of affinization with epsilon = 3 is 14
average number of affinization = 17.103921568627452
Path 94 | total_timesteps 2586.
number of affinization with epsilon = 3 is 25
average number of affinization = 17.109079033311563
Path 95 | total_timesteps 2618.
number of affinization with epsilon = 3 is 58
average number of affinization = 17.135770234986946
Path 96 | total_timesteps 2684.
number of affinization with epsilon = 3 is 19
average number of affinization = 17.136986301369863
Path 97 | total_timesteps 2711.
number of affinization with epsilon = 3 is 20
average number of affinization = 17.13885267275098
Path 98 | total_timesteps 2738.
number of affinization with epsilon = 3 is 21
average number of affinization = 17.141368078175894
Path 99 | total_timesteps 2766.
number of affinization with epsilon = 3 is 25
average number of affinization = 17.146484375
Path 100 | total_timesteps 2801.
number of affinization with epsilon = 3 is 19
average number of affinization = 17.1476903057905
Path 101 | total_timesteps 2822.
number of affinization with epsilon = 3 is 22
average number of affinization = 17.150845253576072
Path 102 | total_timesteps 2847.
number of affinization with epsilon = 3 is 26
average number of affinization = 17.15659519168291
Path 103 | total_timesteps 2877.
number of affinization with epsilon = 3 is 20
average number of affinization = 17.15844155844156
Path 104 | total_timesteps 2900.
number of affinization with epsilon = 3 is 21
average number of affinization = 17.160934458144062
Path 105 | total_timesteps 2931.
number of affinization with epsilon = 3 is 13
average number of affinization = 17.15823605706874
Path 106 | total_timesteps 2947.
number of affinization with epsilon = 3 is 18
average number of affinization = 17.158781594296823
Path 107 | total_timesteps 2969.
number of affinization with epsilon = 3 is 37
average number of affinization = 17.17163212435233
Path 108 | total_timesteps 3015.
number of affinization with epsilon = 3 is 17
average number of affinization = 17.171521035598705
Path 109 | total_timesteps 3035.
number of affinization with epsilon = 3 is 25
average number of affinization = 17.176584734799484
Path 110 | total_timesteps 3062.
number of affinization with epsilon = 3 is 12
average number of affinization = 17.173238526179702
Path 111 | total_timesteps 3076.
number of affinization with epsilon = 3 is 18
average number of affinization = 17.17377260981912
Path 112 | total_timesteps 3098.
number of affinization with epsilon = 3 is 27
average number of affinization = 17.180116204002584
Path 113 | total_timesteps 3130.
number of affinization with epsilon = 3 is 26
average number of affinization = 17.185806451612905
Path 114 | total_timesteps 3169.
number of affinization with epsilon = 3 is 16
average number of affinization = 17.185041908446163
Path 115 | total_timesteps 3188.
number of affinization with epsilon = 3 is 6
average number of affinization = 17.177835051546392
Path 116 | total_timesteps 3197.
number of affinization with epsilon = 3 is 37
average number of affinization = 17.190598840952994
Path 117 | total_timesteps 3240.
number of affinization with epsilon = 3 is 16
average number of affinization = 17.18983268983269
Path 118 | total_timesteps 3265.
number of affinization with epsilon = 3 is 27
average number of affinization = 17.19614147909968
Path 119 | total_timesteps 3304.
number of affinization with epsilon = 3 is 28
average number of affinization = 17.203084832904885
Path 120 | total_timesteps 3342.
number of affinization with epsilon = 3 is 54
average number of affinization = 17.226718047527296
Path 121 | total_timesteps 3406.
number of affinization with epsilon = 3 is 26
average number of affinization = 17.23234916559692
Path 122 | total_timesteps 3438.
number of affinization with epsilon = 3 is 16
average number of affinization = 17.23155869146889
Path 123 | total_timesteps 3456.
number of affinization with epsilon = 3 is 29
average number of affinization = 17.239102564102563
Path 124 | total_timesteps 3495.
number of affinization with epsilon = 3 is 16
average number of affinization = 17.238308776425367
Path 125 | total_timesteps 3514.
number of affinization with epsilon = 3 is 42
average number of affinization = 17.254161331626122
Path 126 | total_timesteps 3562.
number of affinization with epsilon = 3 is 9
average number of affinization = 17.248880358285348
Path 127 | total_timesteps 3576.
number of affinization with epsilon = 3 is 44
average number of affinization = 17.265984654731458
Path 128 | total_timesteps 3631.
number of affinization with epsilon = 3 is 10
average number of affinization = 17.261341853035145
Path 129 | total_timesteps 3646.
number of affinization with epsilon = 3 is 25
average number of affinization = 17.266283524904214
Path 130 | total_timesteps 3678.
number of affinization with epsilon = 3 is 35
average number of affinization = 17.277600510529673
Path 131 | total_timesteps 3718.
number of affinization with epsilon = 3 is 21
average number of affinization = 17.27997448979592
Path 132 | total_timesteps 3745.
number of affinization with epsilon = 3 is 23
average number of affinization = 17.283620140216698
Path 133 | total_timesteps 3774.
number of affinization with epsilon = 3 is 25
average number of affinization = 17.288535031847132
Path 134 | total_timesteps 3807.
number of affinization with epsilon = 3 is 25
average number of affinization = 17.293443666454486
Path 135 | total_timesteps 3836.
number of affinization with epsilon = 3 is 46
average number of affinization = 17.3117048346056
Path 136 | total_timesteps 3894.
number of affinization with epsilon = 3 is 25
average number of affinization = 17.31659249841068
Path 137 | total_timesteps 3924.
number of affinization with epsilon = 3 is 24
average number of affinization = 17.320838627700127
Path 138 | total_timesteps 3953.
number of affinization with epsilon = 3 is 35
average number of affinization = 17.332063492063494
Path 139 | total_timesteps 3999.
number of affinization with epsilon = 3 is 24
average number of affinization = 17.336294416243653
Path 140 | total_timesteps 4030.
number of affinization with epsilon = 3 is 22
average number of affinization = 17.339251743817375
Path 141 | total_timesteps 4057.
number of affinization with epsilon = 3 is 22
average number of affinization = 17.342205323193916
Path 142 | total_timesteps 4082.
number of affinization with epsilon = 3 is 23
average number of affinization = 17.345788473717544
Path 143 | total_timesteps 4108.
number of affinization with epsilon = 3 is 13
average number of affinization = 17.343037974683543
Path 144 | total_timesteps 4123.
number of affinization with epsilon = 3 is 23
average number of affinization = 17.346616065781152
Path 145 | total_timesteps 4152.
number of affinization with epsilon = 3 is 20
average number of affinization = 17.34829329962073
Path 146 | total_timesteps 4175.
number of affinization with epsilon = 3 is 38
average number of affinization = 17.361339229311433
Path 147 | total_timesteps 4217.
number of affinization with epsilon = 3 is 19
average number of affinization = 17.362373737373737
Path 148 | total_timesteps 4242.
number of affinization with epsilon = 3 is 25
average number of affinization = 17.367192429022083
Path 149 | total_timesteps 4275.
number of affinization with epsilon = 3 is 32
average number of affinization = 17.37641866330391
Path 150 | total_timesteps 4311.
number of affinization with epsilon = 3 is 37
average number of affinization = 17.388783868935096
Path 151 | total_timesteps 4357.
number of affinization with epsilon = 3 is 24
average number of affinization = 17.392947103274558
Path 152 | total_timesteps 4385.
number of affinization with epsilon = 3 is 13
average number of affinization = 17.39018250471995
Path 153 | total_timesteps 4400.
number of affinization with epsilon = 3 is 17
average number of affinization = 17.38993710691824
Path 154 | total_timesteps 4421.
number of affinization with epsilon = 3 is 12
average number of affinization = 17.38654934003771
Path 155 | total_timesteps 4436.
number of affinization with epsilon = 3 is 37
average number of affinization = 17.39886934673367
Path 156 | total_timesteps 4478.
number of affinization with epsilon = 3 is 61
average number of affinization = 17.426239799121156
Path 157 | total_timesteps 4561.
number of affinization with epsilon = 3 is 29
average number of affinization = 17.433500627352572
Path 158 | total_timesteps 4603.
number of affinization with epsilon = 3 is 31
average number of affinization = 17.442006269592476
Path 159 | total_timesteps 4639.
number of affinization with epsilon = 3 is 14
average number of affinization = 17.43984962406015
Path 160 | total_timesteps 4655.
number of affinization with epsilon = 3 is 20
average number of affinization = 17.441452723857232
Path 161 | total_timesteps 4682.
number of affinization with epsilon = 3 is 29
average number of affinization = 17.448685857321653
Path 162 | total_timesteps 4716.
number of affinization with epsilon = 3 is 14
average number of affinization = 17.446529080675422
Path 163 | total_timesteps 4734.
number of affinization with epsilon = 3 is 11
average number of affinization = 17.4425
Path 164 | total_timesteps 4747.
number of affinization with epsilon = 3 is 23
average number of affinization = 17.44597126795753
Path 165 | total_timesteps 4781.
number of affinization with epsilon = 3 is 39
average number of affinization = 17.459425717852685
Path 166 | total_timesteps 4826.
number of affinization with epsilon = 3 is 10
average number of affinization = 17.454772301933875
Path 167 | total_timesteps 4839.
number of affinization with epsilon = 3 is 33
average number of affinization = 17.464463840399002
Path 168 | total_timesteps 4877.
number of affinization with epsilon = 3 is 7
average number of affinization = 17.457943925233646
Path 169 | total_timesteps 4888.
number of affinization with epsilon = 3 is 45
average number of affinization = 17.475093399750936
Path 170 | total_timesteps 4940.
number of affinization with epsilon = 3 is 13
average number of affinization = 17.472308649657748
Path 171 | total_timesteps 4960.
number of affinization with epsilon = 3 is 17
average number of affinization = 17.472014925373134
Path 172 | total_timesteps 4981.
number of affinization with epsilon = 3 is 12
average number of affinization = 17.4686140459913
Path 173 | total_timesteps 4998.
number of affinization with epsilon = 3 is 18
average number of affinization = 17.46894409937888
Path 174 | total_timesteps 5019.
number of affinization with epsilon = 3 is 33
average number of affinization = 17.478584729981378
Path 175 | total_timesteps 5061.
number of affinization with epsilon = 3 is 28
average number of affinization = 17.48511166253102
Path 176 | total_timesteps 5097.
number of affinization with epsilon = 3 is 30
average number of affinization = 17.492870427774335
Path 177 | total_timesteps 5133.
number of affinization with epsilon = 3 is 22
average number of affinization = 17.495662949194546
Path 178 | total_timesteps 5162.
number of affinization with epsilon = 3 is 11
average number of affinization = 17.491640866873066
Path 179 | total_timesteps 5179.
number of affinization with epsilon = 3 is 19
average number of affinization = 17.492574257425744
Path 180 | total_timesteps 5205.
number of affinization with epsilon = 3 is 13
average number of affinization = 17.489795918367346
Path 181 | total_timesteps 5223.
number of affinization with epsilon = 3 is 17
average number of affinization = 17.489493201483313
Path 182 | total_timesteps 5246.
number of affinization with epsilon = 3 is 15
average number of affinization = 17.487955528103768
Path 183 | total_timesteps 5263.
number of affinization with epsilon = 3 is 12
average number of affinization = 17.484567901234566
Path 184 | total_timesteps 5279.
number of affinization with epsilon = 3 is 45
average number of affinization = 17.501542257865516
Path 185 | total_timesteps 5332.
number of affinization with epsilon = 3 is 30
average number of affinization = 17.50924784217016
Path 186 | total_timesteps 5371.
number of affinization with epsilon = 3 is 27
average number of affinization = 17.515095502156502
Path 187 | total_timesteps 5403.
number of affinization with epsilon = 3 is 7
average number of affinization = 17.50862068965517
Path 188 | total_timesteps 5413.
number of affinization with epsilon = 3 is 23
average number of affinization = 17.512
Path 189 | total_timesteps 5445.
number of affinization with epsilon = 3 is 13
average number of affinization = 17.509225092250922
Path 190 | total_timesteps 5460.
number of affinization with epsilon = 3 is 18
average number of affinization = 17.509526736324524
Path 191 | total_timesteps 5481.
number of affinization with epsilon = 3 is 15
average number of affinization = 17.507985257985258
Path 192 | total_timesteps 5500.
number of affinization with epsilon = 3 is 12
average number of affinization = 17.504604051565376
Path 193 | total_timesteps 5516.
number of affinization with epsilon = 3 is 21
average number of affinization = 17.50674846625767
Path 194 | total_timesteps 5543.
number of affinization with epsilon = 3 is 43
average number of affinization = 17.522378908645003
Path 195 | total_timesteps 5592.
number of affinization with epsilon = 3 is 5
average number of affinization = 17.514705882352942
Path 196 | total_timesteps 5602.
number of affinization with epsilon = 3 is 31
average number of affinization = 17.522963870177588
Path 197 | total_timesteps 5636.
number of affinization with epsilon = 3 is 14
average number of affinization = 17.520807833537333
Path 198 | total_timesteps 5652.
number of affinization with epsilon = 3 is 24
average number of affinization = 17.524770642201833
Path 199 | total_timesteps 5684.
number of affinization with epsilon = 3 is 21
average number of affinization = 17.526894865525673
Path 200 | total_timesteps 5712.
number of affinization with epsilon = 3 is 26
average number of affinization = 17.532070861331704
Path 201 | total_timesteps 5743.
number of affinization with epsilon = 3 is 25
average number of affinization = 17.536630036630036
Path 202 | total_timesteps 5773.
number of affinization with epsilon = 3 is 14
average number of affinization = 17.534472239170224
Path 203 | total_timesteps 5793.
number of affinization with epsilon = 3 is 21
average number of affinization = 17.536585365853657
Path 204 | total_timesteps 5821.
number of affinization with epsilon = 3 is 12
average number of affinization = 17.533211456429008
Path 205 | total_timesteps 5835.
number of affinization with epsilon = 3 is 32
average number of affinization = 17.542021924482338
Path 206 | total_timesteps 5874.
number of affinization with epsilon = 3 is 18
average number of affinization = 17.542300669507
Path 207 | total_timesteps 5894.
number of affinization with epsilon = 3 is 19
average number of affinization = 17.543187347931873
Path 208 | total_timesteps 5916.
number of affinization with epsilon = 3 is 31
average number of affinization = 17.551367781155015
Path 209 | total_timesteps 5956.
number of affinization with epsilon = 3 is 27
average number of affinization = 17.55710814094775
Path 210 | total_timesteps 5989.
number of affinization with epsilon = 3 is 14
average number of affinization = 17.554948391013966
Done generating on-policy rollouts.
Updating normalization.
Done updating normalization.
----------------------------
| AverageReturn | -6.97    |
| Iteration     | 5        |
| MaximumReturn | 20.1     |
| MinimumReturn | -29.3    |
| TotalSamples  | 28077    |
----------------------------
itr #6 | 
Fitting dynamics.
Fitting model 0 (0-based) in the ensemble of 2 models
Validation loss = 0.026464521884918213
Validation loss = 0.025542953982949257
Validation loss = 0.025256741791963577
Validation loss = 0.025420039892196655
Validation loss = 0.02428392693400383
Validation loss = 0.025127658620476723
Validation loss = 0.02573767490684986
Validation loss = 0.02478734776377678
Validation loss = 0.025166628882288933
Fitting model 1 (0-based) in the ensemble of 2 models
Validation loss = 0.028765935450792313
Validation loss = 0.026391251012682915
Validation loss = 0.02479543909430504
Validation loss = 0.024504736065864563
Validation loss = 0.025127360597252846
Validation loss = 0.025191565975546837
Validation loss = 0.026536500081419945
Validation loss = 0.025454474613070488
Done fitting dynamics.
Updating randomness.
Done updating randomness.
Training policy using TRPO.
Re-initialize init_std.
Obtaining samples for iteration 0...
Obtaining samples for iteration 1...
Obtaining samples for iteration 2...
Obtaining samples for iteration 3...
Obtaining samples for iteration 4...
Obtaining samples for iteration 5...
Obtaining samples for iteration 6...
Obtaining samples for iteration 7...
Obtaining samples for iteration 8...
Obtaining samples for iteration 9...
Obtaining samples for iteration 10...
Obtaining samples for iteration 11...
Obtaining samples for iteration 12...
Obtaining samples for iteration 13...
Obtaining samples for iteration 14...
Obtaining samples for iteration 15...
Obtaining samples for iteration 16...
Obtaining samples for iteration 17...
Obtaining samples for iteration 18...
Obtaining samples for iteration 19...
Done training policy.
Generating on-policy rollouts.
Path 0 | total_timesteps 0.
number of affinization with epsilon = 3 is 44
average number of affinization = 17.570995145631066
Path 1 | total_timesteps 51.
number of affinization with epsilon = 3 is 8
average number of affinization = 17.565191024863555
Path 2 | total_timesteps 62.
number of affinization with epsilon = 3 is 21
average number of affinization = 17.567272727272726
Path 3 | total_timesteps 91.
number of affinization with epsilon = 3 is 29
average number of affinization = 17.57419745608722
Path 4 | total_timesteps 124.
number of affinization with epsilon = 3 is 18
average number of affinization = 17.574455205811137
Path 5 | total_timesteps 147.
number of affinization with epsilon = 3 is 20
average number of affinization = 17.575922565033274
Path 6 | total_timesteps 169.
number of affinization with epsilon = 3 is 18
average number of affinization = 17.576178960096737
Path 7 | total_timesteps 194.
number of affinization with epsilon = 3 is 11
average number of affinization = 17.572205438066465
Path 8 | total_timesteps 207.
number of affinization with epsilon = 3 is 51
average number of affinization = 17.592391304347824
Path 9 | total_timesteps 268.
number of affinization with epsilon = 3 is 53
average number of affinization = 17.613759806879905
Path 10 | total_timesteps 329.
number of affinization with epsilon = 3 is 17
average number of affinization = 17.61338962605549
Path 11 | total_timesteps 355.
number of affinization with epsilon = 3 is 18
average number of affinization = 17.613622664255576
Path 12 | total_timesteps 375.
number of affinization with epsilon = 3 is 20
average number of affinization = 17.615060240963857
Path 13 | total_timesteps 399.
number of affinization with epsilon = 3 is 30
average number of affinization = 17.62251655629139
Path 14 | total_timesteps 434.
number of affinization with epsilon = 3 is 13
average number of affinization = 17.61973525872443
Path 15 | total_timesteps 454.
number of affinization with epsilon = 3 is 46
average number of affinization = 17.636800962116656
Path 16 | total_timesteps 510.
number of affinization with epsilon = 3 is 25
average number of affinization = 17.64122596153846
Path 17 | total_timesteps 540.
number of affinization with epsilon = 3 is 21
average number of affinization = 17.643243243243244
Path 18 | total_timesteps 570.
number of affinization with epsilon = 3 is 15
average number of affinization = 17.641656662665067
Path 19 | total_timesteps 589.
number of affinization with epsilon = 3 is 58
average number of affinization = 17.665866826634673
Path 20 | total_timesteps 656.
number of affinization with epsilon = 3 is 29
average number of affinization = 17.672661870503596
Path 21 | total_timesteps 691.
number of affinization with epsilon = 3 is 14
average number of affinization = 17.670461354104255
Path 22 | total_timesteps 707.
number of affinization with epsilon = 3 is 24
average number of affinization = 17.674251497005987
Path 23 | total_timesteps 736.
number of affinization with epsilon = 3 is 16
average number of affinization = 17.673249551166965
Path 24 | total_timesteps 756.
number of affinization with epsilon = 3 is 23
average number of affinization = 17.676435406698566
Path 25 | total_timesteps 787.
number of affinization with epsilon = 3 is 52
average number of affinization = 17.696951583980873
Path 26 | total_timesteps 859.
number of affinization with epsilon = 3 is 21
average number of affinization = 17.698924731182796
Path 27 | total_timesteps 887.
number of affinization with epsilon = 3 is 24
average number of affinization = 17.70268656716418
Path 28 | total_timesteps 915.
number of affinization with epsilon = 3 is 46
average number of affinization = 17.719570405727925
Path 29 | total_timesteps 970.
number of affinization with epsilon = 3 is 32
average number of affinization = 17.728085867620752
Path 30 | total_timesteps 1009.
number of affinization with epsilon = 3 is 43
average number of affinization = 17.74314660309893
Path 31 | total_timesteps 1061.
number of affinization with epsilon = 3 is 16
average number of affinization = 17.742108397855866
Path 32 | total_timesteps 1083.
number of affinization with epsilon = 3 is 24
average number of affinization = 17.745833333333334
Path 33 | total_timesteps 1111.
number of affinization with epsilon = 3 is 30
average number of affinization = 17.75312314098751
Path 34 | total_timesteps 1146.
number of affinization with epsilon = 3 is 38
average number of affinization = 17.765160523186683
Path 35 | total_timesteps 1191.
number of affinization with epsilon = 3 is 18
average number of affinization = 17.765300059417708
Path 36 | total_timesteps 1216.
number of affinization with epsilon = 3 is 10
average number of affinization = 17.760688836104514
Path 37 | total_timesteps 1228.
number of affinization with epsilon = 3 is 22
average number of affinization = 17.76320474777448
Path 38 | total_timesteps 1255.
number of affinization with epsilon = 3 is 15
average number of affinization = 17.76156583629893
Path 39 | total_timesteps 1273.
number of affinization with epsilon = 3 is 14
average number of affinization = 17.759336099585063
Path 40 | total_timesteps 1290.
number of affinization with epsilon = 3 is 20
average number of affinization = 17.760663507109005
Path 41 | total_timesteps 1316.
number of affinization with epsilon = 3 is 14
average number of affinization = 17.758436944937834
Path 42 | total_timesteps 1332.
number of affinization with epsilon = 3 is 18
average number of affinization = 17.758579881656804
Path 43 | total_timesteps 1356.
number of affinization with epsilon = 3 is 24
average number of affinization = 17.76227084565346
Path 44 | total_timesteps 1388.
number of affinization with epsilon = 3 is 13
average number of affinization = 17.759456264775412
Path 45 | total_timesteps 1407.
number of affinization with epsilon = 3 is 30
average number of affinization = 17.766686355581808
Path 46 | total_timesteps 1443.
number of affinization with epsilon = 3 is 34
average number of affinization = 17.776269185360093
Path 47 | total_timesteps 1488.
number of affinization with epsilon = 3 is 32
average number of affinization = 17.78466076696165
Path 48 | total_timesteps 1524.
number of affinization with epsilon = 3 is 19
average number of affinization = 17.785377358490567
Path 49 | total_timesteps 1547.
number of affinization with epsilon = 3 is 22
average number of affinization = 17.7878609310548
Path 50 | total_timesteps 1574.
number of affinization with epsilon = 3 is 21
average number of affinization = 17.789752650176677
Path 51 | total_timesteps 1601.
number of affinization with epsilon = 3 is 32
average number of affinization = 17.798116539140672
Path 52 | total_timesteps 1638.
number of affinization with epsilon = 3 is 27
average number of affinization = 17.803529411764707
Path 53 | total_timesteps 1666.
number of affinization with epsilon = 3 is 22
average number of affinization = 17.80599647266314
Path 54 | total_timesteps 1689.
number of affinization with epsilon = 3 is 16
average number of affinization = 17.804935370152762
Path 55 | total_timesteps 1710.
number of affinization with epsilon = 3 is 22
average number of affinization = 17.80739870816207
Path 56 | total_timesteps 1735.
number of affinization with epsilon = 3 is 9
average number of affinization = 17.802230046948356
Path 57 | total_timesteps 1749.
number of affinization with epsilon = 3 is 23
average number of affinization = 17.805278592375366
Path 58 | total_timesteps 1775.
number of affinization with epsilon = 3 is 28
average number of affinization = 17.811254396248536
Path 59 | total_timesteps 1810.
number of affinization with epsilon = 3 is 17
average number of affinization = 17.8107791446983
Path 60 | total_timesteps 1828.
number of affinization with epsilon = 3 is 26
average number of affinization = 17.815573770491802
Path 61 | total_timesteps 1861.
number of affinization with epsilon = 3 is 19
average number of affinization = 17.816266822703334
Path 62 | total_timesteps 1887.
number of affinization with epsilon = 3 is 25
average number of affinization = 17.82046783625731
Path 63 | total_timesteps 1916.
number of affinization with epsilon = 3 is 12
average number of affinization = 17.81706604324956
Path 64 | total_timesteps 1932.
number of affinization with epsilon = 3 is 27
average number of affinization = 17.822429906542055
Path 65 | total_timesteps 1967.
number of affinization with epsilon = 3 is 7
average number of affinization = 17.816112084063047
Path 66 | total_timesteps 1978.
number of affinization with epsilon = 3 is 37
average number of affinization = 17.82730455075846
Path 67 | total_timesteps 2023.
number of affinization with epsilon = 3 is 20
average number of affinization = 17.82857142857143
Path 68 | total_timesteps 2049.
number of affinization with epsilon = 3 is 68
average number of affinization = 17.85780885780886
Path 69 | total_timesteps 2127.
number of affinization with epsilon = 3 is 6
average number of affinization = 17.850902737332557
Path 70 | total_timesteps 2138.
number of affinization with epsilon = 3 is 21
average number of affinization = 17.852735739231665
Path 71 | total_timesteps 2165.
number of affinization with epsilon = 3 is 20
average number of affinization = 17.853984874927285
Path 72 | total_timesteps 2188.
number of affinization with epsilon = 3 is 39
average number of affinization = 17.86627906976744
Path 73 | total_timesteps 2234.
number of affinization with epsilon = 3 is 27
average number of affinization = 17.87158628704242
Path 74 | total_timesteps 2265.
number of affinization with epsilon = 3 is 16
average number of affinization = 17.870499419279906
Path 75 | total_timesteps 2285.
number of affinization with epsilon = 3 is 22
average number of affinization = 17.872896111433548
Path 76 | total_timesteps 2312.
number of affinization with epsilon = 3 is 32
average number of affinization = 17.88109048723898
Path 77 | total_timesteps 2350.
number of affinization with epsilon = 3 is 59
average number of affinization = 17.904927536231884
Path 78 | total_timesteps 2426.
number of affinization with epsilon = 3 is 15
average number of affinization = 17.90324449594438
Path 79 | total_timesteps 2445.
number of affinization with epsilon = 3 is 14
average number of affinization = 17.900984365952517
Path 80 | total_timesteps 2463.
number of affinization with epsilon = 3 is 35
average number of affinization = 17.91087962962963
Path 81 | total_timesteps 2503.
number of affinization with epsilon = 3 is 18
average number of affinization = 17.910931174089068
Path 82 | total_timesteps 2525.
number of affinization with epsilon = 3 is 37
average number of affinization = 17.921965317919074
Path 83 | total_timesteps 2572.
number of affinization with epsilon = 3 is 36
average number of affinization = 17.932409012131714
Path 84 | total_timesteps 2619.
number of affinization with epsilon = 3 is 15
average number of affinization = 17.930715935334874
Path 85 | total_timesteps 2637.
number of affinization with epsilon = 3 is 24
average number of affinization = 17.934218118869012
Path 86 | total_timesteps 2667.
number of affinization with epsilon = 3 is 24
average number of affinization = 17.93771626297578
Path 87 | total_timesteps 2697.
number of affinization with epsilon = 3 is 8
average number of affinization = 17.93198847262248
Path 88 | total_timesteps 2710.
number of affinization with epsilon = 3 is 20
average number of affinization = 17.933179723502302
Path 89 | total_timesteps 2732.
number of affinization with epsilon = 3 is 22
average number of affinization = 17.93552101324122
Path 90 | total_timesteps 2760.
number of affinization with epsilon = 3 is 25
average number of affinization = 17.93958573072497
Path 91 | total_timesteps 2792.
number of affinization with epsilon = 3 is 5
average number of affinization = 17.932144910868317
Path 92 | total_timesteps 2804.
number of affinization with epsilon = 3 is 27
average number of affinization = 17.93735632183908
Path 93 | total_timesteps 2837.
number of affinization with epsilon = 3 is 26
average number of affinization = 17.941987363584147
Path 94 | total_timesteps 2871.
number of affinization with epsilon = 3 is 23
average number of affinization = 17.944890929965556
Path 95 | total_timesteps 2903.
number of affinization with epsilon = 3 is 28
average number of affinization = 17.950659781985085
Path 96 | total_timesteps 2938.
number of affinization with epsilon = 3 is 11
average number of affinization = 17.946674311926607
Path 97 | total_timesteps 2951.
number of affinization with epsilon = 3 is 20
average number of affinization = 17.94785100286533
Path 98 | total_timesteps 2976.
number of affinization with epsilon = 3 is 22
average number of affinization = 17.95017182130584
Path 99 | total_timesteps 3005.
number of affinization with epsilon = 3 is 43
average number of affinization = 17.96451058958214
Path 100 | total_timesteps 3052.
number of affinization with epsilon = 3 is 25
average number of affinization = 17.96853546910755
Path 101 | total_timesteps 3083.
number of affinization with epsilon = 3 is 15
average number of affinization = 17.966838193253288
Path 102 | total_timesteps 3104.
number of affinization with epsilon = 3 is 9
average number of affinization = 17.961714285714287
Path 103 | total_timesteps 3117.
number of affinization with epsilon = 3 is 19
average number of affinization = 17.962307252998286
Path 104 | total_timesteps 3139.
number of affinization with epsilon = 3 is 15
average number of affinization = 17.960616438356166
Path 105 | total_timesteps 3158.
number of affinization with epsilon = 3 is 23
average number of affinization = 17.963491158014833
Path 106 | total_timesteps 3186.
number of affinization with epsilon = 3 is 10
average number of affinization = 17.958950969213227
Path 107 | total_timesteps 3198.
number of affinization with epsilon = 3 is 21
average number of affinization = 17.96068376068376
Path 108 | total_timesteps 3223.
number of affinization with epsilon = 3 is 19
average number of affinization = 17.96127562642369
Path 109 | total_timesteps 3249.
number of affinization with epsilon = 3 is 11
average number of affinization = 17.95731360273193
Path 110 | total_timesteps 3267.
number of affinization with epsilon = 3 is 22
average number of affinization = 17.959613196814562
Path 111 | total_timesteps 3293.
number of affinization with epsilon = 3 is 20
average number of affinization = 17.960773166571915
Path 112 | total_timesteps 3315.
number of affinization with epsilon = 3 is 25
average number of affinization = 17.964772727272727
Path 113 | total_timesteps 3345.
number of affinization with epsilon = 3 is 32
average number of affinization = 17.972742759795572
Path 114 | total_timesteps 3384.
number of affinization with epsilon = 3 is 13
average number of affinization = 17.969920544835414
Path 115 | total_timesteps 3400.
number of affinization with epsilon = 3 is 28
average number of affinization = 17.975609756097562
Path 116 | total_timesteps 3433.
number of affinization with epsilon = 3 is 35
average number of affinization = 17.985260770975056
Path 117 | total_timesteps 3478.
number of affinization with epsilon = 3 is 24
average number of affinization = 17.988668555240793
Path 118 | total_timesteps 3505.
number of affinization with epsilon = 3 is 23
average number of affinization = 17.991506228765573
Path 119 | total_timesteps 3529.
number of affinization with epsilon = 3 is 36
average number of affinization = 18.00169779286927
Path 120 | total_timesteps 3572.
number of affinization with epsilon = 3 is 15
average number of affinization = 18.0
Path 121 | total_timesteps 3590.
number of affinization with epsilon = 3 is 18
average number of affinization = 18.0
Path 122 | total_timesteps 3610.
number of affinization with epsilon = 3 is 23
average number of affinization = 18.002824858757062
Path 123 | total_timesteps 3638.
number of affinization with epsilon = 3 is 12
average number of affinization = 17.999435347261436
Path 124 | total_timesteps 3662.
number of affinization with epsilon = 3 is 22
average number of affinization = 18.001693002257337
Path 125 | total_timesteps 3688.
number of affinization with epsilon = 3 is 28
average number of affinization = 18.007332205301747
Path 126 | total_timesteps 3725.
number of affinization with epsilon = 3 is 14
average number of affinization = 18.005073280721533
Path 127 | total_timesteps 3742.
number of affinization with epsilon = 3 is 11
average number of affinization = 18.00112676056338
Path 128 | total_timesteps 3758.
number of affinization with epsilon = 3 is 12
average number of affinization = 17.99774774774775
Path 129 | total_timesteps 3774.
number of affinization with epsilon = 3 is 26
average number of affinization = 18.00225098480585
Path 130 | total_timesteps 3805.
number of affinization with epsilon = 3 is 11
average number of affinization = 17.998312710911136
Path 131 | total_timesteps 3821.
number of affinization with epsilon = 3 is 53
average number of affinization = 18.017987633501967
Path 132 | total_timesteps 3888.
number of affinization with epsilon = 3 is 14
average number of affinization = 18.01573033707865
Path 133 | total_timesteps 3907.
number of affinization with epsilon = 3 is 24
average number of affinization = 18.01909039865244
Path 134 | total_timesteps 3935.
number of affinization with epsilon = 3 is 54
average number of affinization = 18.039281705948373
Path 135 | total_timesteps 4006.
number of affinization with epsilon = 3 is 7
average number of affinization = 18.03309029725182
Path 136 | total_timesteps 4019.
number of affinization with epsilon = 3 is 19
average number of affinization = 18.033632286995516
Path 137 | total_timesteps 4043.
number of affinization with epsilon = 3 is 30
average number of affinization = 18.04033613445378
Path 138 | total_timesteps 4085.
number of affinization with epsilon = 3 is 36
average number of affinization = 18.050391937290033
Path 139 | total_timesteps 4131.
number of affinization with epsilon = 3 is 26
average number of affinization = 18.054840514829323
Path 140 | total_timesteps 4159.
number of affinization with epsilon = 3 is 25
average number of affinization = 18.058724832214764
Path 141 | total_timesteps 4189.
number of affinization with epsilon = 3 is 47
average number of affinization = 18.074902179988822
Path 142 | total_timesteps 4242.
number of affinization with epsilon = 3 is 19
average number of affinization = 18.075418994413408
Path 143 | total_timesteps 4267.
number of affinization with epsilon = 3 is 11
average number of affinization = 18.071468453378
Path 144 | total_timesteps 4282.
number of affinization with epsilon = 3 is 57
average number of affinization = 18.093191964285715
Path 145 | total_timesteps 4351.
number of affinization with epsilon = 3 is 7
average number of affinization = 18.087005019520358
Path 146 | total_timesteps 4361.
number of affinization with epsilon = 3 is 7
average number of affinization = 18.08082497212932
Path 147 | total_timesteps 4371.
number of affinization with epsilon = 3 is 16
average number of affinization = 18.07966573816156
Path 148 | total_timesteps 4390.
number of affinization with epsilon = 3 is 19
average number of affinization = 18.080178173719375
Path 149 | total_timesteps 4410.
number of affinization with epsilon = 3 is 22
average number of affinization = 18.082359488035614
Path 150 | total_timesteps 4438.
number of affinization with epsilon = 3 is 25
average number of affinization = 18.086206896551722
Path 151 | total_timesteps 4467.
number of affinization with epsilon = 3 is 25
average number of affinization = 18.090050027793218
Path 152 | total_timesteps 4499.
number of affinization with epsilon = 3 is 51
average number of affinization = 18.108333333333334
Path 153 | total_timesteps 4554.
number of affinization with epsilon = 3 is 15
average number of affinization = 18.10660744031094
Path 154 | total_timesteps 4574.
number of affinization with epsilon = 3 is 17
average number of affinization = 18.10599334073252
Path 155 | total_timesteps 4594.
number of affinization with epsilon = 3 is 57
average number of affinization = 18.12756516916251
Path 156 | total_timesteps 4659.
number of affinization with epsilon = 3 is 26
average number of affinization = 18.131929046563194
Path 157 | total_timesteps 4688.
number of affinization with epsilon = 3 is 26
average number of affinization = 18.136288088642658
Path 158 | total_timesteps 4716.
number of affinization with epsilon = 3 is 16
average number of affinization = 18.135105204872648
Path 159 | total_timesteps 4734.
number of affinization with epsilon = 3 is 19
average number of affinization = 18.135583840619812
Path 160 | total_timesteps 4758.
number of affinization with epsilon = 3 is 22
average number of affinization = 18.137721238938052
Path 161 | total_timesteps 4785.
number of affinization with epsilon = 3 is 26
average number of affinization = 18.142067440574902
Path 162 | total_timesteps 4815.
number of affinization with epsilon = 3 is 26
average number of affinization = 18.146408839779006
Path 163 | total_timesteps 4845.
number of affinization with epsilon = 3 is 21
average number of affinization = 18.147984538928768
Path 164 | total_timesteps 4872.
number of affinization with epsilon = 3 is 18
average number of affinization = 18.147902869757175
Path 165 | total_timesteps 4891.
number of affinization with epsilon = 3 is 37
average number of affinization = 18.158301158301157
Path 166 | total_timesteps 4930.
number of affinization with epsilon = 3 is 21
average number of affinization = 18.15986769570011
Path 167 | total_timesteps 4956.
number of affinization with epsilon = 3 is 28
average number of affinization = 18.165289256198346
Path 168 | total_timesteps 5001.
number of affinization with epsilon = 3 is 17
average number of affinization = 18.16464757709251
Path 169 | total_timesteps 5022.
number of affinization with epsilon = 3 is 24
average number of affinization = 18.167859108420473
Path 170 | total_timesteps 5049.
number of affinization with epsilon = 3 is 20
average number of affinization = 18.16886688668867
Path 171 | total_timesteps 5080.
number of affinization with epsilon = 3 is 14
average number of affinization = 18.166575041231447
Path 172 | total_timesteps 5097.
number of affinization with epsilon = 3 is 20
average number of affinization = 18.167582417582416
Path 173 | total_timesteps 5122.
number of affinization with epsilon = 3 is 15
average number of affinization = 18.16584294343767
Path 174 | total_timesteps 5138.
number of affinization with epsilon = 3 is 54
average number of affinization = 18.185510428100987
Path 175 | total_timesteps 5202.
number of affinization with epsilon = 3 is 6
average number of affinization = 18.178826110806362
Path 176 | total_timesteps 5217.
number of affinization with epsilon = 3 is 22
average number of affinization = 18.18092105263158
Path 177 | total_timesteps 5242.
number of affinization with epsilon = 3 is 29
average number of affinization = 18.186849315068493
Path 178 | total_timesteps 5278.
number of affinization with epsilon = 3 is 19
average number of affinization = 18.187294633077766
Path 179 | total_timesteps 5304.
number of affinization with epsilon = 3 is 35
average number of affinization = 18.196496989600437
Path 180 | total_timesteps 5345.
number of affinization with epsilon = 3 is 19
average number of affinization = 18.196936542669583
Path 181 | total_timesteps 5371.
number of affinization with epsilon = 3 is 26
average number of affinization = 18.201202843083653
Path 182 | total_timesteps 5401.
number of affinization with epsilon = 3 is 35
average number of affinization = 18.2103825136612
Path 183 | total_timesteps 5439.
number of affinization with epsilon = 3 is 26
average number of affinization = 18.214636810486073
Path 184 | total_timesteps 5472.
number of affinization with epsilon = 3 is 20
average number of affinization = 18.21561135371179
Path 185 | total_timesteps 5500.
number of affinization with epsilon = 3 is 25
average number of affinization = 18.219312602291325
Path 186 | total_timesteps 5533.
number of affinization with epsilon = 3 is 23
average number of affinization = 18.221919302071974
Path 187 | total_timesteps 5559.
number of affinization with epsilon = 3 is 17
average number of affinization = 18.22125340599455
Path 188 | total_timesteps 5579.
number of affinization with epsilon = 3 is 27
average number of affinization = 18.2260348583878
Path 189 | total_timesteps 5615.
number of affinization with epsilon = 3 is 25
average number of affinization = 18.22972237343495
Path 190 | total_timesteps 5646.
number of affinization with epsilon = 3 is 25
average number of affinization = 18.233405875952123
Path 191 | total_timesteps 5675.
number of affinization with epsilon = 3 is 21
average number of affinization = 18.234910277324634
Path 192 | total_timesteps 5704.
number of affinization with epsilon = 3 is 31
average number of affinization = 18.241847826086957
Path 193 | total_timesteps 5739.
number of affinization with epsilon = 3 is 36
average number of affinization = 18.251493753394893
Path 194 | total_timesteps 5779.
number of affinization with epsilon = 3 is 18
average number of affinization = 18.251357220412594
Path 195 | total_timesteps 5804.
number of affinization with epsilon = 3 is 17
average number of affinization = 18.250678241996745
Path 196 | total_timesteps 5830.
number of affinization with epsilon = 3 is 18
average number of affinization = 18.25054229934924
Path 197 | total_timesteps 5856.
number of affinization with epsilon = 3 is 37
average number of affinization = 18.26070460704607
Path 198 | total_timesteps 5903.
number of affinization with epsilon = 3 is 13
average number of affinization = 18.257854821235103
Path 199 | total_timesteps 5919.
number of affinization with epsilon = 3 is 12
average number of affinization = 18.254466702761235
Path 200 | total_timesteps 5933.
number of affinization with epsilon = 3 is 32
average number of affinization = 18.261904761904763
Path 201 | total_timesteps 5975.
number of affinization with epsilon = 3 is 16
average number of affinization = 18.260681449432127
Path 202 | total_timesteps 5993.
number of affinization with epsilon = 3 is 70
average number of affinization = 18.28864864864865
Done generating on-policy rollouts.
Updating normalization.
Done updating normalization.
----------------------------
| AverageReturn | -6.01    |
| Iteration     | 6        |
| MaximumReturn | 34.7     |
| MinimumReturn | -27.6    |
| TotalSamples  | 32125    |
----------------------------
itr #7 | 
Fitting dynamics.
Fitting model 0 (0-based) in the ensemble of 2 models
Validation loss = 0.025341344997286797
Validation loss = 0.02494482696056366
Validation loss = 0.028721090406179428
Validation loss = 0.023086033761501312
Validation loss = 0.0232827328145504
Validation loss = 0.024815935641527176
Validation loss = 0.02455359697341919
Validation loss = 0.026306575164198875
Fitting model 1 (0-based) in the ensemble of 2 models
Validation loss = 0.026371784508228302
Validation loss = 0.023239020258188248
Validation loss = 0.02342432737350464
Validation loss = 0.023304667323827744
Validation loss = 0.02342899516224861
Validation loss = 0.02581159397959709
Done fitting dynamics.
Updating randomness.
Done updating randomness.
Training policy using TRPO.
Re-initialize init_std.
Obtaining samples for iteration 0...
Obtaining samples for iteration 1...
Obtaining samples for iteration 2...
Obtaining samples for iteration 3...
Obtaining samples for iteration 4...
Obtaining samples for iteration 5...
Obtaining samples for iteration 6...
Obtaining samples for iteration 7...
Obtaining samples for iteration 8...
Obtaining samples for iteration 9...
Obtaining samples for iteration 10...
Obtaining samples for iteration 11...
Obtaining samples for iteration 12...
Obtaining samples for iteration 13...
Obtaining samples for iteration 14...
Obtaining samples for iteration 15...
Obtaining samples for iteration 16...
Obtaining samples for iteration 17...
Obtaining samples for iteration 18...
Obtaining samples for iteration 19...
Done training policy.
Generating on-policy rollouts.
Path 0 | total_timesteps 0.
number of affinization with epsilon = 3 is 20
average number of affinization = 18.28957320367369
Path 1 | total_timesteps 24.
number of affinization with epsilon = 3 is 11
average number of affinization = 18.285637149028076
Path 2 | total_timesteps 39.
number of affinization with epsilon = 3 is 20
average number of affinization = 18.28656233135456
Path 3 | total_timesteps 62.
number of affinization with epsilon = 3 is 39
average number of affinization = 18.297734627831716
Path 4 | total_timesteps 110.
number of affinization with epsilon = 3 is 15
average number of affinization = 18.295956873315365
Path 5 | total_timesteps 129.
number of affinization with epsilon = 3 is 22
average number of affinization = 18.297952586206897
Path 6 | total_timesteps 158.
number of affinization with epsilon = 3 is 21
average number of affinization = 18.299407646742058
Path 7 | total_timesteps 185.
number of affinization with epsilon = 3 is 17
average number of affinization = 18.29870828848224
Path 8 | total_timesteps 207.
number of affinization with epsilon = 3 is 12
average number of affinization = 18.295320064550832
Path 9 | total_timesteps 222.
number of affinization with epsilon = 3 is 37
average number of affinization = 18.30537634408602
Path 10 | total_timesteps 264.
number of affinization with epsilon = 3 is 52
average number of affinization = 18.32348199892531
Path 11 | total_timesteps 323.
number of affinization with epsilon = 3 is 10
average number of affinization = 18.319011815252416
Path 12 | total_timesteps 335.
number of affinization with epsilon = 3 is 10
average number of affinization = 18.31454643048846
Path 13 | total_timesteps 347.
number of affinization with epsilon = 3 is 14
average number of affinization = 18.31223175965665
Path 14 | total_timesteps 364.
number of affinization with epsilon = 3 is 15
average number of affinization = 18.310455764075066
Path 15 | total_timesteps 386.
number of affinization with epsilon = 3 is 20
average number of affinization = 18.311361200428724
Path 16 | total_timesteps 412.
number of affinization with epsilon = 3 is 43
average number of affinization = 18.324584895554366
Path 17 | total_timesteps 470.
number of affinization with epsilon = 3 is 21
average number of affinization = 18.326017130620986
Path 18 | total_timesteps 498.
number of affinization with epsilon = 3 is 16
average number of affinization = 18.32477260567148
Path 19 | total_timesteps 522.
number of affinization with epsilon = 3 is 36
average number of affinization = 18.334224598930483
Path 20 | total_timesteps 564.
number of affinization with epsilon = 3 is 16
average number of affinization = 18.332977017637628
Path 21 | total_timesteps 583.
number of affinization with epsilon = 3 is 24
average number of affinization = 18.336004273504273
Path 22 | total_timesteps 612.
number of affinization with epsilon = 3 is 30
average number of affinization = 18.342231713828085
Path 23 | total_timesteps 646.
number of affinization with epsilon = 3 is 12
average number of affinization = 18.338847385272146
Path 24 | total_timesteps 661.
number of affinization with epsilon = 3 is 28
average number of affinization = 18.344
Path 25 | total_timesteps 697.
number of affinization with epsilon = 3 is 21
average number of affinization = 18.3454157782516
Path 26 | total_timesteps 726.
number of affinization with epsilon = 3 is 24
average number of affinization = 18.348428343100693
Path 27 | total_timesteps 757.
number of affinization with epsilon = 3 is 17
average number of affinization = 18.347710330138444
Path 28 | total_timesteps 776.
number of affinization with epsilon = 3 is 17
average number of affinization = 18.34699308142629
Path 29 | total_timesteps 802.
number of affinization with epsilon = 3 is 51
average number of affinization = 18.36436170212766
Path 30 | total_timesteps 867.
number of affinization with epsilon = 3 is 34
average number of affinization = 18.372674109516215
Path 31 | total_timesteps 906.
number of affinization with epsilon = 3 is 36
average number of affinization = 18.38204038257173
Path 32 | total_timesteps 950.
number of affinization with epsilon = 3 is 46
average number of affinization = 18.396707381837494
Path 33 | total_timesteps 1004.
number of affinization with epsilon = 3 is 24
average number of affinization = 18.39968152866242
Path 34 | total_timesteps 1035.
number of affinization with epsilon = 3 is 13
average number of affinization = 18.396816976127322
Path 35 | total_timesteps 1051.
number of affinization with epsilon = 3 is 11
average number of affinization = 18.39289501590668
Path 36 | total_timesteps 1064.
number of affinization with epsilon = 3 is 17
average number of affinization = 18.392156862745097
Path 37 | total_timesteps 1085.
number of affinization with epsilon = 3 is 22
average number of affinization = 18.39406779661017
Path 38 | total_timesteps 1110.
number of affinization with epsilon = 3 is 19
average number of affinization = 18.394388565378506
Path 39 | total_timesteps 1132.
number of affinization with epsilon = 3 is 14
average number of affinization = 18.392063492063492
Path 40 | total_timesteps 1152.
number of affinization with epsilon = 3 is 28
average number of affinization = 18.397144368059227
Path 41 | total_timesteps 1184.
number of affinization with epsilon = 3 is 31
average number of affinization = 18.403805496828753
Path 42 | total_timesteps 1224.
number of affinization with epsilon = 3 is 21
average number of affinization = 18.40517696777602
Path 43 | total_timesteps 1249.
number of affinization with epsilon = 3 is 15
average number of affinization = 18.40337909186906
Path 44 | total_timesteps 1268.
number of affinization with epsilon = 3 is 34
average number of affinization = 18.41160949868074
Path 45 | total_timesteps 1314.
number of affinization with epsilon = 3 is 37
average number of affinization = 18.421413502109704
Path 46 | total_timesteps 1359.
number of affinization with epsilon = 3 is 12
average number of affinization = 18.418028465998944
Path 47 | total_timesteps 1377.
number of affinization with epsilon = 3 is 18
average number of affinization = 18.41780821917808
Path 48 | total_timesteps 1399.
number of affinization with epsilon = 3 is 14
average number of affinization = 18.415481832543446
Path 49 | total_timesteps 1418.
number of affinization with epsilon = 3 is 17
average number of affinization = 18.414736842105263
Path 50 | total_timesteps 1441.
number of affinization with epsilon = 3 is 29
average number of affinization = 18.42030510257759
Path 51 | total_timesteps 1477.
number of affinization with epsilon = 3 is 18
average number of affinization = 18.420084121976867
Path 52 | total_timesteps 1501.
number of affinization with epsilon = 3 is 24
average number of affinization = 18.423016290068315
Path 53 | total_timesteps 1530.
number of affinization with epsilon = 3 is 9
average number of affinization = 18.418067226890756
Path 54 | total_timesteps 1541.
number of affinization with epsilon = 3 is 23
average number of affinization = 18.42047244094488
Path 55 | total_timesteps 1565.
number of affinization with epsilon = 3 is 11
average number of affinization = 18.416579223504723
Path 56 | total_timesteps 1578.
number of affinization with epsilon = 3 is 21
average number of affinization = 18.41793392763503
Path 57 | total_timesteps 1604.
number of affinization with epsilon = 3 is 21
average number of affinization = 18.41928721174004
Path 58 | total_timesteps 1631.
number of affinization with epsilon = 3 is 23
average number of affinization = 18.42168674698795
Path 59 | total_timesteps 1662.
number of affinization with epsilon = 3 is 27
average number of affinization = 18.426178010471205
Path 60 | total_timesteps 1696.
number of affinization with epsilon = 3 is 11
average number of affinization = 18.422291993720567
Path 61 | total_timesteps 1713.
number of affinization with epsilon = 3 is 29
average number of affinization = 18.427824267782427
Path 62 | total_timesteps 1750.
number of affinization with epsilon = 3 is 12
average number of affinization = 18.42446419236801
Path 63 | total_timesteps 1770.
number of affinization with epsilon = 3 is 26
average number of affinization = 18.428422152560085
Path 64 | total_timesteps 1801.
number of affinization with epsilon = 3 is 25
average number of affinization = 18.431853785900785
Path 65 | total_timesteps 1830.
number of affinization with epsilon = 3 is 48
average number of affinization = 18.447286012526096
Path 66 | total_timesteps 1890.
number of affinization with epsilon = 3 is 9
average number of affinization = 18.442357850808555
Path 67 | total_timesteps 1903.
number of affinization with epsilon = 3 is 13
average number of affinization = 18.439520333680917
Path 68 | total_timesteps 1917.
number of affinization with epsilon = 3 is 21
average number of affinization = 18.440854611776967
Path 69 | total_timesteps 1946.
number of affinization with epsilon = 3 is 25
average number of affinization = 18.444270833333334
Path 70 | total_timesteps 1975.
number of affinization with epsilon = 3 is 24
average number of affinization = 18.447162935970848
Path 71 | total_timesteps 2007.
number of affinization with epsilon = 3 is 23
average number of affinization = 18.449531737773153
Path 72 | total_timesteps 2035.
number of affinization with epsilon = 3 is 18
average number of affinization = 18.449297971918877
Path 73 | total_timesteps 2056.
number of affinization with epsilon = 3 is 16
average number of affinization = 18.448024948024948
Path 74 | total_timesteps 2076.
number of affinization with epsilon = 3 is 22
average number of affinization = 18.44987012987013
Path 75 | total_timesteps 2104.
number of affinization with epsilon = 3 is 20
average number of affinization = 18.45067497403946
Path 76 | total_timesteps 2126.
number of affinization with epsilon = 3 is 42
average number of affinization = 18.462895692786716
Path 77 | total_timesteps 2180.
number of affinization with epsilon = 3 is 17
average number of affinization = 18.46213692946058
Path 78 | total_timesteps 2209.
number of affinization with epsilon = 3 is 20
average number of affinization = 18.46293416277864
Path 79 | total_timesteps 2235.
number of affinization with epsilon = 3 is 10
average number of affinization = 18.458549222797927
Path 80 | total_timesteps 2249.
number of affinization with epsilon = 3 is 20
average number of affinization = 18.459347488348005
Path 81 | total_timesteps 2276.
number of affinization with epsilon = 3 is 24
average number of affinization = 18.462215320910975
Path 82 | total_timesteps 2303.
number of affinization with epsilon = 3 is 34
average number of affinization = 18.470253491981374
Path 83 | total_timesteps 2345.
number of affinization with epsilon = 3 is 41
average number of affinization = 18.48190279214064
Path 84 | total_timesteps 2398.
number of affinization with epsilon = 3 is 35
average number of affinization = 18.490439276485787
Path 85 | total_timesteps 2441.
number of affinization with epsilon = 3 is 7
average number of affinization = 18.484504132231404
Path 86 | total_timesteps 2455.
number of affinization with epsilon = 3 is 26
average number of affinization = 18.488384099122353
Path 87 | total_timesteps 2487.
number of affinization with epsilon = 3 is 17
average number of affinization = 18.487616099071207
Path 88 | total_timesteps 2512.
number of affinization with epsilon = 3 is 37
average number of affinization = 18.49716348633316
Path 89 | total_timesteps 2552.
number of affinization with epsilon = 3 is 5
average number of affinization = 18.49020618556701
Path 90 | total_timesteps 2560.
number of affinization with epsilon = 3 is 26
average number of affinization = 18.4940752189593
Path 91 | total_timesteps 2593.
number of affinization with epsilon = 3 is 17
average number of affinization = 18.49330587023687
Path 92 | total_timesteps 2613.
number of affinization with epsilon = 3 is 54
average number of affinization = 18.511580030880083
Path 93 | total_timesteps 2685.
number of affinization with epsilon = 3 is 13
average number of affinization = 18.508744855967077
Path 94 | total_timesteps 2703.
number of affinization with epsilon = 3 is 11
average number of affinization = 18.504884318766067
Path 95 | total_timesteps 2716.
number of affinization with epsilon = 3 is 25
average number of affinization = 18.508221993833505
Path 96 | total_timesteps 2746.
number of affinization with epsilon = 3 is 33
average number of affinization = 18.515665125834616
Path 97 | total_timesteps 2784.
number of affinization with epsilon = 3 is 20
average number of affinization = 18.516427104722794
Path 98 | total_timesteps 2810.
number of affinization with epsilon = 3 is 31
average number of affinization = 18.52283222165213
Path 99 | total_timesteps 2844.
number of affinization with epsilon = 3 is 13
average number of affinization = 18.52
Path 100 | total_timesteps 2862.
number of affinization with epsilon = 3 is 15
average number of affinization = 18.518195797027165
Path 101 | total_timesteps 2882.
number of affinization with epsilon = 3 is 11
average number of affinization = 18.514344262295083
Path 102 | total_timesteps 2898.
number of affinization with epsilon = 3 is 33
average number of affinization = 18.521761392729136
Path 103 | total_timesteps 2941.
number of affinization with epsilon = 3 is 32
average number of affinization = 18.52865916069601
Path 104 | total_timesteps 2979.
number of affinization with epsilon = 3 is 29
average number of affinization = 18.534015345268543
Path 105 | total_timesteps 3016.
number of affinization with epsilon = 3 is 13
average number of affinization = 18.53118609406953
Path 106 | total_timesteps 3032.
number of affinization with epsilon = 3 is 16
average number of affinization = 18.529892692897292
Path 107 | total_timesteps 3053.
number of affinization with epsilon = 3 is 10
average number of affinization = 18.525536261491318
Path 108 | total_timesteps 3068.
number of affinization with epsilon = 3 is 33
average number of affinization = 18.53292496171516
Path 109 | total_timesteps 3108.
number of affinization with epsilon = 3 is 46
average number of affinization = 18.546938775510203
Path 110 | total_timesteps 3164.
number of affinization with epsilon = 3 is 26
average number of affinization = 18.550739418663948
Path 111 | total_timesteps 3199.
number of affinization with epsilon = 3 is 15
average number of affinization = 18.54892966360856
Path 112 | total_timesteps 3222.
number of affinization with epsilon = 3 is 18
average number of affinization = 18.54865002547122
Path 113 | total_timesteps 3242.
number of affinization with epsilon = 3 is 19
average number of affinization = 18.54887983706721
Path 114 | total_timesteps 3267.
number of affinization with epsilon = 3 is 44
average number of affinization = 18.561832061068703
Path 115 | total_timesteps 3318.
number of affinization with epsilon = 3 is 50
average number of affinization = 18.577822990844354
Path 116 | total_timesteps 3381.
number of affinization with epsilon = 3 is 11
average number of affinization = 18.573970513472293
Path 117 | total_timesteps 3396.
number of affinization with epsilon = 3 is 15
average number of affinization = 18.572154471544714
Path 118 | total_timesteps 3415.
number of affinization with epsilon = 3 is 48
average number of affinization = 18.587100050787203
Path 119 | total_timesteps 3472.
number of affinization with epsilon = 3 is 42
average number of affinization = 18.598984771573605
Path 120 | total_timesteps 3534.
number of affinization with epsilon = 3 is 13
average number of affinization = 18.596144089294775
Path 121 | total_timesteps 3551.
number of affinization with epsilon = 3 is 15
average number of affinization = 18.594320486815416
Path 122 | total_timesteps 3568.
number of affinization with epsilon = 3 is 15
average number of affinization = 18.59249873289407
Path 123 | total_timesteps 3590.
number of affinization with epsilon = 3 is 27
average number of affinization = 18.596757852077
Path 124 | total_timesteps 3621.
number of affinization with epsilon = 3 is 37
average number of affinization = 18.60607594936709
Path 125 | total_timesteps 3664.
number of affinization with epsilon = 3 is 25
average number of affinization = 18.60931174089069
Path 126 | total_timesteps 3691.
number of affinization with epsilon = 3 is 33
average number of affinization = 18.616590794132524
Path 127 | total_timesteps 3729.
number of affinization with epsilon = 3 is 7
average number of affinization = 18.61071789686552
Path 128 | total_timesteps 3739.
number of affinization with epsilon = 3 is 15
average number of affinization = 18.6088933804952
Path 129 | total_timesteps 3762.
number of affinization with epsilon = 3 is 42
average number of affinization = 18.62070707070707
Path 130 | total_timesteps 3808.
number of affinization with epsilon = 3 is 32
average number of affinization = 18.62746087834427
Path 131 | total_timesteps 3850.
number of affinization with epsilon = 3 is 23
average number of affinization = 18.629667003027244
Path 132 | total_timesteps 3879.
number of affinization with epsilon = 3 is 22
average number of affinization = 18.631366616238022
Path 133 | total_timesteps 3903.
number of affinization with epsilon = 3 is 11
average number of affinization = 18.627520161290324
Path 134 | total_timesteps 3915.
number of affinization with epsilon = 3 is 15
average number of affinization = 18.625692695214106
Path 135 | total_timesteps 3933.
number of affinization with epsilon = 3 is 19
average number of affinization = 18.62588116817724
Path 136 | total_timesteps 3954.
number of affinization with epsilon = 3 is 13
average number of affinization = 18.62304982385506
Path 137 | total_timesteps 3972.
number of affinization with epsilon = 3 is 31
average number of affinization = 18.629275653923543
Path 138 | total_timesteps 4007.
number of affinization with epsilon = 3 is 16
average number of affinization = 18.627953745600806
Path 139 | total_timesteps 4027.
number of affinization with epsilon = 3 is 19
average number of affinization = 18.628140703517587
Path 140 | total_timesteps 4052.
number of affinization with epsilon = 3 is 18
average number of affinization = 18.62782521346057
Path 141 | total_timesteps 4075.
number of affinization with epsilon = 3 is 38
average number of affinization = 18.63755020080321
Path 142 | total_timesteps 4117.
number of affinization with epsilon = 3 is 45
average number of affinization = 18.650777722027094
Path 143 | total_timesteps 4170.
number of affinization with epsilon = 3 is 39
average number of affinization = 18.660982948846538
Path 144 | total_timesteps 4216.
number of affinization with epsilon = 3 is 56
average number of affinization = 18.6796992481203
Path 145 | total_timesteps 4278.
number of affinization with epsilon = 3 is 39
average number of affinization = 18.689879759519037
Path 146 | total_timesteps 4328.
number of affinization with epsilon = 3 is 14
average number of affinization = 18.68753129694542
Path 147 | total_timesteps 4350.
number of affinization with epsilon = 3 is 17
average number of affinization = 18.686686686686688
Path 148 | total_timesteps 4370.
number of affinization with epsilon = 3 is 4
average number of affinization = 18.679339669834917
Path 149 | total_timesteps 4378.
number of affinization with epsilon = 3 is 40
average number of affinization = 18.69
Path 150 | total_timesteps 4424.
number of affinization with epsilon = 3 is 56
average number of affinization = 18.70864567716142
Path 151 | total_timesteps 4488.
number of affinization with epsilon = 3 is 27
average number of affinization = 18.712787212787212
Path 152 | total_timesteps 4527.
number of affinization with epsilon = 3 is 21
average number of affinization = 18.71392910634049
Path 153 | total_timesteps 4555.
number of affinization with epsilon = 3 is 31
average number of affinization = 18.72005988023952
Path 154 | total_timesteps 4597.
number of affinization with epsilon = 3 is 30
average number of affinization = 18.72568578553616
Path 155 | total_timesteps 4639.
number of affinization with epsilon = 3 is 54
average number of affinization = 18.743270189431705
Path 156 | total_timesteps 4700.
number of affinization with epsilon = 3 is 50
average number of affinization = 18.758844045839563
Path 157 | total_timesteps 4759.
number of affinization with epsilon = 3 is 23
average number of affinization = 18.760956175298805
Path 158 | total_timesteps 4786.
number of affinization with epsilon = 3 is 31
average number of affinization = 18.767048282727725
Path 159 | total_timesteps 4822.
number of affinization with epsilon = 3 is 27
average number of affinization = 18.771144278606965
Path 160 | total_timesteps 4854.
number of affinization with epsilon = 3 is 16
average number of affinization = 18.769766285430133
Path 161 | total_timesteps 4876.
number of affinization with epsilon = 3 is 16
average number of affinization = 18.768389662027833
Path 162 | total_timesteps 4896.
number of affinization with epsilon = 3 is 21
average number of affinization = 18.76949826130154
Path 163 | total_timesteps 4920.
number of affinization with epsilon = 3 is 29
average number of affinization = 18.77457795431976
Path 164 | total_timesteps 4959.
number of affinization with epsilon = 3 is 42
average number of affinization = 18.786104218362283
Path 165 | total_timesteps 5015.
number of affinization with epsilon = 3 is 13
average number of affinization = 18.783234126984127
Path 166 | total_timesteps 5032.
number of affinization with epsilon = 3 is 22
average number of affinization = 18.784828953891918
Path 167 | total_timesteps 5058.
number of affinization with epsilon = 3 is 17
average number of affinization = 18.78394449950446
Path 168 | total_timesteps 5082.
number of affinization with epsilon = 3 is 29
average number of affinization = 18.789004457652304
Path 169 | total_timesteps 5116.
number of affinization with epsilon = 3 is 13
average number of affinization = 18.786138613861386
Path 170 | total_timesteps 5130.
number of affinization with epsilon = 3 is 12
average number of affinization = 18.782780801583375
Path 171 | total_timesteps 5148.
number of affinization with epsilon = 3 is 35
average number of affinization = 18.79080118694362
Path 172 | total_timesteps 5192.
number of affinization with epsilon = 3 is 26
average number of affinization = 18.794364804745427
Path 173 | total_timesteps 5223.
number of affinization with epsilon = 3 is 13
average number of affinization = 18.791501976284586
Path 174 | total_timesteps 5241.
number of affinization with epsilon = 3 is 14
average number of affinization = 18.789135802469136
Path 175 | total_timesteps 5262.
number of affinization with epsilon = 3 is 30
average number of affinization = 18.79466929911155
Path 176 | total_timesteps 5300.
number of affinization with epsilon = 3 is 31
average number of affinization = 18.80069067587568
Path 177 | total_timesteps 5339.
number of affinization with epsilon = 3 is 39
average number of affinization = 18.810650887573964
Path 178 | total_timesteps 5386.
number of affinization with epsilon = 3 is 33
average number of affinization = 18.817644159684573
Path 179 | total_timesteps 5422.
number of affinization with epsilon = 3 is 19
average number of affinization = 18.817733990147783
Path 180 | total_timesteps 5447.
number of affinization with epsilon = 3 is 47
average number of affinization = 18.831610044313145
Path 181 | total_timesteps 5506.
number of affinization with epsilon = 3 is 13
average number of affinization = 18.828740157480315
Path 182 | total_timesteps 5523.
number of affinization with epsilon = 3 is 27
average number of affinization = 18.83275946876537
Path 183 | total_timesteps 5555.
number of affinization with epsilon = 3 is 24
average number of affinization = 18.835299901671583
Path 184 | total_timesteps 5584.
number of affinization with epsilon = 3 is 15
average number of affinization = 18.833415233415234
Path 185 | total_timesteps 5600.
number of affinization with epsilon = 3 is 9
average number of affinization = 18.82858546168959
Path 186 | total_timesteps 5614.
number of affinization with epsilon = 3 is 19
average number of affinization = 18.828669612174767
Path 187 | total_timesteps 5640.
number of affinization with epsilon = 3 is 25
average number of affinization = 18.831697742885183
Path 188 | total_timesteps 5671.
number of affinization with epsilon = 3 is 42
average number of affinization = 18.843060323688082
Path 189 | total_timesteps 5719.
number of affinization with epsilon = 3 is 11
average number of affinization = 18.83921568627451
Path 190 | total_timesteps 5733.
number of affinization with epsilon = 3 is 44
average number of affinization = 18.8515433610975
Path 191 | total_timesteps 5785.
number of affinization with epsilon = 3 is 44
average number of affinization = 18.863858961802155
Path 192 | total_timesteps 5838.
number of affinization with epsilon = 3 is 20
average number of affinization = 18.86441507586882
Path 193 | total_timesteps 5865.
number of affinization with epsilon = 3 is 32
average number of affinization = 18.870841487279844
Path 194 | total_timesteps 5903.
number of affinization with epsilon = 3 is 35
average number of affinization = 18.87872860635697
Path 195 | total_timesteps 5946.
number of affinization with epsilon = 3 is 9
average number of affinization = 18.873900293255133
Path 196 | total_timesteps 5957.
number of affinization with epsilon = 3 is 18
average number of affinization = 18.873473375671715
Path 197 | total_timesteps 5978.
number of affinization with epsilon = 3 is 26
average number of affinization = 18.876953125
Done generating on-policy rollouts.
Updating normalization.
Done updating normalization.
----------------------------
| AverageReturn | -4.36    |
| Iteration     | 7        |
| MaximumReturn | 35.6     |
| MinimumReturn | -19      |
| TotalSamples  | 36131    |
----------------------------
itr #8 | 
Fitting dynamics.
Fitting model 0 (0-based) in the ensemble of 2 models
Validation loss = 0.025030096992850304
Validation loss = 0.023877693340182304
Validation loss = 0.02285158820450306
Validation loss = 0.022445200011134148
Validation loss = 0.02215391956269741
Validation loss = 0.022877894341945648
Validation loss = 0.022000296041369438
Validation loss = 0.031310707330703735
Validation loss = 0.022189408540725708
Validation loss = 0.025617968291044235
Validation loss = 0.02346799708902836
Fitting model 1 (0-based) in the ensemble of 2 models
Validation loss = 0.02325611561536789
Validation loss = 0.024608546867966652
Validation loss = 0.02264302968978882
Validation loss = 0.022001178935170174
Validation loss = 0.022643450647592545
Validation loss = 0.02180817537009716
Validation loss = 0.022272899746894836
Validation loss = 0.021206818521022797
Validation loss = 0.022137226536870003
Validation loss = 0.022148489952087402
Validation loss = 0.022095467895269394
Validation loss = 0.022830219939351082
Done fitting dynamics.
Updating randomness.
Done updating randomness.
Training policy using TRPO.
Re-initialize init_std.
Obtaining samples for iteration 0...
Obtaining samples for iteration 1...
Obtaining samples for iteration 2...
Obtaining samples for iteration 3...
Obtaining samples for iteration 4...
Obtaining samples for iteration 5...
Obtaining samples for iteration 6...
Obtaining samples for iteration 7...
Obtaining samples for iteration 8...
Obtaining samples for iteration 9...
Obtaining samples for iteration 10...
Obtaining samples for iteration 11...
Obtaining samples for iteration 12...
Obtaining samples for iteration 13...
Obtaining samples for iteration 14...
Obtaining samples for iteration 15...
Obtaining samples for iteration 16...
Obtaining samples for iteration 17...
Obtaining samples for iteration 18...
Obtaining samples for iteration 19...
Done training policy.
Generating on-policy rollouts.
Path 0 | total_timesteps 0.
number of affinization with epsilon = 3 is 24
average number of affinization = 18.879453391898487
Path 1 | total_timesteps 25.
number of affinization with epsilon = 3 is 20
average number of affinization = 18.88
Path 2 | total_timesteps 50.
number of affinization with epsilon = 3 is 21
average number of affinization = 18.881033642125793
Path 3 | total_timesteps 76.
number of affinization with epsilon = 3 is 39
average number of affinization = 18.89083820662768
Path 4 | total_timesteps 122.
number of affinization with epsilon = 3 is 73
average number of affinization = 18.9171943497321
Path 5 | total_timesteps 210.
number of affinization with epsilon = 3 is 40
average number of affinization = 18.927458617332036
Path 6 | total_timesteps 257.
number of affinization with epsilon = 3 is 35
average number of affinization = 18.9352798053528
Path 7 | total_timesteps 304.
number of affinization with epsilon = 3 is 13
average number of affinization = 18.93239299610895
Path 8 | total_timesteps 322.
number of affinization with epsilon = 3 is 28
average number of affinization = 18.936801166747692
Path 9 | total_timesteps 355.
number of affinization with epsilon = 3 is 21
average number of affinization = 18.937803692905735
Path 10 | total_timesteps 384.
number of affinization with epsilon = 3 is 30
average number of affinization = 18.943176299174358
Path 11 | total_timesteps 419.
number of affinization with epsilon = 3 is 27
average number of affinization = 18.947087378640777
Path 12 | total_timesteps 450.
number of affinization with epsilon = 3 is 9
average number of affinization = 18.94226103833091
Path 13 | total_timesteps 468.
number of affinization with epsilon = 3 is 20
average number of affinization = 18.942774005819594
Path 14 | total_timesteps 493.
number of affinization with epsilon = 3 is 24
average number of affinization = 18.945225399903055
Path 15 | total_timesteps 520.
number of affinization with epsilon = 3 is 9
average number of affinization = 18.940406976744185
Path 16 | total_timesteps 534.
number of affinization with epsilon = 3 is 22
average number of affinization = 18.941888619854723
Path 17 | total_timesteps 557.
number of affinization with epsilon = 3 is 9
average number of affinization = 18.937076476282673
Path 18 | total_timesteps 571.
number of affinization with epsilon = 3 is 33
average number of affinization = 18.943880019351717
Path 19 | total_timesteps 613.
number of affinization with epsilon = 3 is 16
average number of affinization = 18.942456479690524
Path 20 | total_timesteps 633.
number of affinization with epsilon = 3 is 22
average number of affinization = 18.943934267762202
Path 21 | total_timesteps 663.
number of affinization with epsilon = 3 is 31
average number of affinization = 18.94975845410628
Path 22 | total_timesteps 699.
number of affinization with epsilon = 3 is 29
average number of affinization = 18.954611298889425
Path 23 | total_timesteps 732.
number of affinization with epsilon = 3 is 25
average number of affinization = 18.957528957528957
Path 24 | total_timesteps 764.
number of affinization with epsilon = 3 is 33
average number of affinization = 18.96430294259527
Path 25 | total_timesteps 799.
number of affinization with epsilon = 3 is 7
average number of affinization = 18.958534233365476
Path 26 | total_timesteps 810.
number of affinization with epsilon = 3 is 32
average number of affinization = 18.964819277108433
Path 27 | total_timesteps 845.
number of affinization with epsilon = 3 is 14
average number of affinization = 18.96242774566474
Path 28 | total_timesteps 862.
number of affinization with epsilon = 3 is 31
average number of affinization = 18.968223399133365
Path 29 | total_timesteps 900.
number of affinization with epsilon = 3 is 18
average number of affinization = 18.967757459095285
Path 30 | total_timesteps 922.
number of affinization with epsilon = 3 is 24
average number of affinization = 18.97017797017797
Path 31 | total_timesteps 953.
number of affinization with epsilon = 3 is 27
average number of affinization = 18.974038461538463
Path 32 | total_timesteps 986.
number of affinization with epsilon = 3 is 28
average number of affinization = 18.97837578087458
Path 33 | total_timesteps 1019.
number of affinization with epsilon = 3 is 29
average number of affinization = 18.983189241114314
Path 34 | total_timesteps 1057.
number of affinization with epsilon = 3 is 16
average number of affinization = 18.981757081132983
Path 35 | total_timesteps 1078.
number of affinization with epsilon = 3 is 36
average number of affinization = 18.989923224568138
Path 36 | total_timesteps 1120.
number of affinization with epsilon = 3 is 33
average number of affinization = 18.99664268585132
Path 37 | total_timesteps 1156.
number of affinization with epsilon = 3 is 45
average number of affinization = 19.009108341323106
Path 38 | total_timesteps 1218.
number of affinization with epsilon = 3 is 32
average number of affinization = 19.015333013895543
Path 39 | total_timesteps 1257.
number of affinization with epsilon = 3 is 17
average number of affinization = 19.014367816091955
Path 40 | total_timesteps 1278.
number of affinization with epsilon = 3 is 43
average number of affinization = 19.02584968884634
Path 41 | total_timesteps 1331.
number of affinization with epsilon = 3 is 40
average number of affinization = 19.035885167464116
Path 42 | total_timesteps 1377.
number of affinization with epsilon = 3 is 17
average number of affinization = 19.034911525585844
Path 43 | total_timesteps 1399.
number of affinization with epsilon = 3 is 52
average number of affinization = 19.050669216061184
Path 44 | total_timesteps 1461.
number of affinization with epsilon = 3 is 36
average number of affinization = 19.058767319636885
Path 45 | total_timesteps 1504.
number of affinization with epsilon = 3 is 8
average number of affinization = 19.053486150907354
Path 46 | total_timesteps 1515.
number of affinization with epsilon = 3 is 18
average number of affinization = 19.052983293556085
Path 47 | total_timesteps 1541.
number of affinization with epsilon = 3 is 24
average number of affinization = 19.05534351145038
Path 48 | total_timesteps 1572.
number of affinization with epsilon = 3 is 43
average number of affinization = 19.066762041010968
Path 49 | total_timesteps 1621.
number of affinization with epsilon = 3 is 29
average number of affinization = 19.071496663489036
Path 50 | total_timesteps 1655.
number of affinization with epsilon = 3 is 29
average number of affinization = 19.076226774654597
Path 51 | total_timesteps 1691.
number of affinization with epsilon = 3 is 9
average number of affinization = 19.071428571428573
Path 52 | total_timesteps 1703.
number of affinization with epsilon = 3 is 70
average number of affinization = 19.095668729176584
Path 53 | total_timesteps 1792.
number of affinization with epsilon = 3 is 29
average number of affinization = 19.100380589914366
Path 54 | total_timesteps 1825.
number of affinization with epsilon = 3 is 31
average number of affinization = 19.10603899191631
Path 55 | total_timesteps 1863.
number of affinization with epsilon = 3 is 39
average number of affinization = 19.115494296577946
Path 56 | total_timesteps 1905.
number of affinization with epsilon = 3 is 14
average number of affinization = 19.11306413301663
Path 57 | total_timesteps 1922.
number of affinization with epsilon = 3 is 21
average number of affinization = 19.113960113960115
Path 58 | total_timesteps 1952.
number of affinization with epsilon = 3 is 30
average number of affinization = 19.119126720455625
Path 59 | total_timesteps 1986.
number of affinization with epsilon = 3 is 31
average number of affinization = 19.124762808349146
Path 60 | total_timesteps 2021.
number of affinization with epsilon = 3 is 31
average number of affinization = 19.130393551446183
Path 61 | total_timesteps 2055.
number of affinization with epsilon = 3 is 27
average number of affinization = 19.134123222748816
Path 62 | total_timesteps 2090.
number of affinization with epsilon = 3 is 33
average number of affinization = 19.140691615348175
Path 63 | total_timesteps 2129.
number of affinization with epsilon = 3 is 25
average number of affinization = 19.14346590909091
Path 64 | total_timesteps 2159.
number of affinization with epsilon = 3 is 48
average number of affinization = 19.157122574538572
Path 65 | total_timesteps 2221.
number of affinization with epsilon = 3 is 30
average number of affinization = 19.162251655629138
Path 66 | total_timesteps 2253.
number of affinization with epsilon = 3 is 19
average number of affinization = 19.162174940898346
Path 67 | total_timesteps 2277.
number of affinization with epsilon = 3 is 9
average number of affinization = 19.157372400756145
Path 68 | total_timesteps 2289.
number of affinization with epsilon = 3 is 18
average number of affinization = 19.156825696740672
Path 69 | total_timesteps 2314.
number of affinization with epsilon = 3 is 27
average number of affinization = 19.16052880075543
Path 70 | total_timesteps 2343.
number of affinization with epsilon = 3 is 30
average number of affinization = 19.165644171779142
Path 71 | total_timesteps 2379.
number of affinization with epsilon = 3 is 50
average number of affinization = 19.180188679245283
Path 72 | total_timesteps 2441.
number of affinization with epsilon = 3 is 40
average number of affinization = 19.19000471475719
Path 73 | total_timesteps 2491.
number of affinization with epsilon = 3 is 25
average number of affinization = 19.192742695570217
Path 74 | total_timesteps 2520.
number of affinization with epsilon = 3 is 23
average number of affinization = 19.19453603391427
Path 75 | total_timesteps 2550.
number of affinization with epsilon = 3 is 38
average number of affinization = 19.203389830508474
Path 76 | total_timesteps 2600.
number of affinization with epsilon = 3 is 15
average number of affinization = 19.20141176470588
Path 77 | total_timesteps 2616.
number of affinization with epsilon = 3 is 33
average number of affinization = 19.207902163687677
Path 78 | total_timesteps 2658.
number of affinization with epsilon = 3 is 34
average number of affinization = 19.21485660554772
Path 79 | total_timesteps 2697.
number of affinization with epsilon = 3 is 42
average number of affinization = 19.225563909774436
Path 80 | total_timesteps 2746.
number of affinization with epsilon = 3 is 27
average number of affinization = 19.22921559417567
Path 81 | total_timesteps 2777.
number of affinization with epsilon = 3 is 19
average number of affinization = 19.229107981220658
Path 82 | total_timesteps 2802.
number of affinization with epsilon = 3 is 19
average number of affinization = 19.229000469263255
Path 83 | total_timesteps 2825.
number of affinization with epsilon = 3 is 8
average number of affinization = 19.223733583489683
Path 84 | total_timesteps 2836.
number of affinization with epsilon = 3 is 41
average number of affinization = 19.233942803563057
Path 85 | total_timesteps 2884.
number of affinization with epsilon = 3 is 29
average number of affinization = 19.238519212746017
Path 86 | total_timesteps 2923.
number of affinization with epsilon = 3 is 44
average number of affinization = 19.250117096018734
Path 87 | total_timesteps 2977.
number of affinization with epsilon = 3 is 31
average number of affinization = 19.25561797752809
Path 88 | total_timesteps 3011.
number of affinization with epsilon = 3 is 14
average number of affinization = 19.253158633598503
Path 89 | total_timesteps 3029.
number of affinization with epsilon = 3 is 34
average number of affinization = 19.260056127221702
Path 90 | total_timesteps 3067.
number of affinization with epsilon = 3 is 35
average number of affinization = 19.267414679756897
Path 91 | total_timesteps 3105.
number of affinization with epsilon = 3 is 56
average number of affinization = 19.284579439252337
Path 92 | total_timesteps 3167.
number of affinization with epsilon = 3 is 15
average number of affinization = 19.282578234469874
Path 93 | total_timesteps 3184.
number of affinization with epsilon = 3 is 20
average number of affinization = 19.282913165266105
Path 94 | total_timesteps 3211.
number of affinization with epsilon = 3 is 25
average number of affinization = 19.28558096126925
Path 95 | total_timesteps 3240.
number of affinization with epsilon = 3 is 15
average number of affinization = 19.28358208955224
Path 96 | total_timesteps 3260.
number of affinization with epsilon = 3 is 21
average number of affinization = 19.284382284382286
Path 97 | total_timesteps 3290.
number of affinization with epsilon = 3 is 32
average number of affinization = 19.29030754892824
Path 98 | total_timesteps 3329.
number of affinization with epsilon = 3 is 21
average number of affinization = 19.291103865859338
Path 99 | total_timesteps 3354.
number of affinization with epsilon = 3 is 20
average number of affinization = 19.29143389199255
Path 100 | total_timesteps 3380.
number of affinization with epsilon = 3 is 11
average number of affinization = 19.287575616565846
Path 101 | total_timesteps 3396.
number of affinization with epsilon = 3 is 21
average number of affinization = 19.288372093023256
Path 102 | total_timesteps 3420.
number of affinization with epsilon = 3 is 39
average number of affinization = 19.2975360297536
Path 103 | total_timesteps 3467.
number of affinization with epsilon = 3 is 24
average number of affinization = 19.29972118959108
Path 104 | total_timesteps 3494.
number of affinization with epsilon = 3 is 50
average number of affinization = 19.313980492336274
Path 105 | total_timesteps 3551.
number of affinization with epsilon = 3 is 11
average number of affinization = 19.31012070566388
Path 106 | total_timesteps 3566.
number of affinization with epsilon = 3 is 32
average number of affinization = 19.31600928074246
Path 107 | total_timesteps 3603.
number of affinization with epsilon = 3 is 18
average number of affinization = 19.31539888682746
Path 108 | total_timesteps 3625.
number of affinization with epsilon = 3 is 29
average number of affinization = 19.319888734353267
Path 109 | total_timesteps 3661.
number of affinization with epsilon = 3 is 14
average number of affinization = 19.317423540315108
Path 110 | total_timesteps 3678.
number of affinization with epsilon = 3 is 21
average number of affinization = 19.31820287169986
Path 111 | total_timesteps 3703.
number of affinization with epsilon = 3 is 23
average number of affinization = 19.319907407407406
Path 112 | total_timesteps 3733.
number of affinization with epsilon = 3 is 9
average number of affinization = 19.31513188338732
Path 113 | total_timesteps 3746.
number of affinization with epsilon = 3 is 19
average number of affinization = 19.314986123959297
Path 114 | total_timesteps 3773.
number of affinization with epsilon = 3 is 29
average number of affinization = 19.319463707813224
Path 115 | total_timesteps 3806.
number of affinization with epsilon = 3 is 15
average number of affinization = 19.317467652495377
Path 116 | total_timesteps 3826.
number of affinization with epsilon = 3 is 52
average number of affinization = 19.33256351039261
Path 117 | total_timesteps 3883.
number of affinization with epsilon = 3 is 39
average number of affinization = 19.341643582640813
Path 118 | total_timesteps 3929.
number of affinization with epsilon = 3 is 19
average number of affinization = 19.34148592524227
Path 119 | total_timesteps 3950.
number of affinization with epsilon = 3 is 42
average number of affinization = 19.351937269372694
Path 120 | total_timesteps 3999.
number of affinization with epsilon = 3 is 12
average number of affinization = 19.348547717842322
Path 121 | total_timesteps 4016.
number of affinization with epsilon = 3 is 13
average number of affinization = 19.34562211981567
Path 122 | total_timesteps 4034.
number of affinization with epsilon = 3 is 36
average number of affinization = 19.353293413173652
Path 123 | total_timesteps 4077.
number of affinization with epsilon = 3 is 11
average number of affinization = 19.349447513812155
Path 124 | total_timesteps 4091.
number of affinization with epsilon = 3 is 31
average number of affinization = 19.354809019788313
Path 125 | total_timesteps 4131.
number of affinization with epsilon = 3 is 29
average number of affinization = 19.359245630174794
Path 126 | total_timesteps 4167.
number of affinization with epsilon = 3 is 25
average number of affinization = 19.36183908045977
Path 127 | total_timesteps 4196.
number of affinization with epsilon = 3 is 30
average number of affinization = 19.36672794117647
Path 128 | total_timesteps 4228.
number of affinization with epsilon = 3 is 39
average number of affinization = 19.37574644005512
Path 129 | total_timesteps 4275.
number of affinization with epsilon = 3 is 19
average number of affinization = 19.375573921028465
Path 130 | total_timesteps 4299.
number of affinization with epsilon = 3 is 19
average number of affinization = 19.375401560348784
Path 131 | total_timesteps 4323.
number of affinization with epsilon = 3 is 23
average number of affinization = 19.377064220183485
Path 132 | total_timesteps 4349.
number of affinization with epsilon = 3 is 11
average number of affinization = 19.37322329206786
Path 133 | total_timesteps 4365.
number of affinization with epsilon = 3 is 24
average number of affinization = 19.375343721356554
Path 134 | total_timesteps 4396.
number of affinization with epsilon = 3 is 21
average number of affinization = 19.37608795235914
Path 135 | total_timesteps 4419.
number of affinization with epsilon = 3 is 30
average number of affinization = 19.38095238095238
Path 136 | total_timesteps 4453.
number of affinization with epsilon = 3 is 30
average number of affinization = 19.385812356979404
Path 137 | total_timesteps 4489.
number of affinization with epsilon = 3 is 25
average number of affinization = 19.388380603842634
Path 138 | total_timesteps 4520.
number of affinization with epsilon = 3 is 8
average number of affinization = 19.383173296753544
Path 139 | total_timesteps 4535.
number of affinization with epsilon = 3 is 43
average number of affinization = 19.393967093235833
Path 140 | total_timesteps 4586.
number of affinization with epsilon = 3 is 32
average number of affinization = 19.399725902238465
Path 141 | total_timesteps 4624.
number of affinization with epsilon = 3 is 21
average number of affinization = 19.400456621004565
Path 142 | total_timesteps 4650.
number of affinization with epsilon = 3 is 49
average number of affinization = 19.413966225467824
Path 143 | total_timesteps 4710.
number of affinization with epsilon = 3 is 15
average number of affinization = 19.411952554744527
Path 144 | total_timesteps 4729.
number of affinization with epsilon = 3 is 17
average number of affinization = 19.410852713178294
Path 145 | total_timesteps 4750.
number of affinization with epsilon = 3 is 21
average number of affinization = 19.411577028258886
Path 146 | total_timesteps 4776.
number of affinization with epsilon = 3 is 42
average number of affinization = 19.421867881548977
Path 147 | total_timesteps 4830.
number of affinization with epsilon = 3 is 11
average number of affinization = 19.418032786885245
Path 148 | total_timesteps 4845.
number of affinization with epsilon = 3 is 33
average number of affinization = 19.42421483841602
Path 149 | total_timesteps 4883.
number of affinization with epsilon = 3 is 27
average number of affinization = 19.42766151046406
Path 150 | total_timesteps 4917.
number of affinization with epsilon = 3 is 24
average number of affinization = 19.42974079126876
Path 151 | total_timesteps 4950.
number of affinization with epsilon = 3 is 28
average number of affinization = 19.433636363636364
Path 152 | total_timesteps 4984.
number of affinization with epsilon = 3 is 25
average number of affinization = 19.436165379373012
Path 153 | total_timesteps 5015.
number of affinization with epsilon = 3 is 12
average number of affinization = 19.432788374205266
Path 154 | total_timesteps 5029.
number of affinization with epsilon = 3 is 20
average number of affinization = 19.433045846572856
Path 155 | total_timesteps 5054.
number of affinization with epsilon = 3 is 25
average number of affinization = 19.43557168784029
Path 156 | total_timesteps 5089.
number of affinization with epsilon = 3 is 17
average number of affinization = 19.434467120181406
Path 157 | total_timesteps 5110.
number of affinization with epsilon = 3 is 31
average number of affinization = 19.43970988213962
Path 158 | total_timesteps 5147.
number of affinization with epsilon = 3 is 26
average number of affinization = 19.442682374263708
Path 159 | total_timesteps 5177.
number of affinization with epsilon = 3 is 23
average number of affinization = 19.44429347826087
Path 160 | total_timesteps 5211.
number of affinization with epsilon = 3 is 17
average number of affinization = 19.443186962426438
Path 161 | total_timesteps 5231.
number of affinization with epsilon = 3 is 23
average number of affinization = 19.444796380090498
Path 162 | total_timesteps 5259.
number of affinization with epsilon = 3 is 61
average number of affinization = 19.463591135232928
Path 163 | total_timesteps 5331.
number of affinization with epsilon = 3 is 27
average number of affinization = 19.466998191681736
Path 164 | total_timesteps 5365.
number of affinization with epsilon = 3 is 24
average number of affinization = 19.46904654315409
Path 165 | total_timesteps 5396.
number of affinization with epsilon = 3 is 19
average number of affinization = 19.468834688346885
Path 166 | total_timesteps 5421.
number of affinization with epsilon = 3 is 15
average number of affinization = 19.466817155756207
Path 167 | total_timesteps 5439.
number of affinization with epsilon = 3 is 63
average number of affinization = 19.486462093862816
Path 168 | total_timesteps 5515.
number of affinization with epsilon = 3 is 24
average number of affinization = 19.48849797023004
Path 169 | total_timesteps 5546.
number of affinization with epsilon = 3 is 18
average number of affinization = 19.487826871055006
Path 170 | total_timesteps 5566.
number of affinization with epsilon = 3 is 33
average number of affinization = 19.493916178458765
Path 171 | total_timesteps 5604.
number of affinization with epsilon = 3 is 40
average number of affinization = 19.503153153153153
Path 172 | total_timesteps 5651.
number of affinization with epsilon = 3 is 24
average number of affinization = 19.5051778478163
Path 173 | total_timesteps 5680.
number of affinization with epsilon = 3 is 52
average number of affinization = 19.519801980198018
Path 174 | total_timesteps 5739.
number of affinization with epsilon = 3 is 23
average number of affinization = 19.521367521367523
Path 175 | total_timesteps 5766.
number of affinization with epsilon = 3 is 27
average number of affinization = 19.524730215827336
Path 176 | total_timesteps 5800.
number of affinization with epsilon = 3 is 29
average number of affinization = 19.528988764044943
Path 177 | total_timesteps 5837.
number of affinization with epsilon = 3 is 21
average number of affinization = 19.52964959568733
Path 178 | total_timesteps 5870.
number of affinization with epsilon = 3 is 47
average number of affinization = 19.541984732824428
Path 179 | total_timesteps 5923.
number of affinization with epsilon = 3 is 19
average number of affinization = 19.54174147217235
Path 180 | total_timesteps 5949.
number of affinization with epsilon = 3 is 27
average number of affinization = 19.545087483176314
Path 181 | total_timesteps 5982.
number of affinization with epsilon = 3 is 25
average number of affinization = 19.547533632286996
Done generating on-policy rollouts.
Updating normalization.
Done updating normalization.
----------------------------
| AverageReturn | -5.36    |
| Iteration     | 8        |
| MaximumReturn | 52.2     |
| MinimumReturn | -30.8    |
| TotalSamples  | 40139    |
----------------------------
itr #9 | 
Fitting dynamics.
Fitting model 0 (0-based) in the ensemble of 2 models
Validation loss = 0.02364104427397251
Validation loss = 0.020872516557574272
Validation loss = 0.02238515391945839
Validation loss = 0.021755952388048172
Validation loss = 0.021245557814836502
Validation loss = 0.022055165842175484
Fitting model 1 (0-based) in the ensemble of 2 models
Validation loss = 0.02370588108897209
Validation loss = 0.02134670503437519
Validation loss = 0.022495977580547333
Validation loss = 0.020854007452726364
Validation loss = 0.022179225459694862
Validation loss = 0.02077123150229454
Validation loss = 0.02187195047736168
Validation loss = 0.020801756531000137
Validation loss = 0.02181236818432808
Validation loss = 0.020935017615556717
Done fitting dynamics.
Updating randomness.
Done updating randomness.
Training policy using TRPO.
Re-initialize init_std.
Obtaining samples for iteration 0...
Obtaining samples for iteration 1...
Obtaining samples for iteration 2...
Obtaining samples for iteration 3...
Obtaining samples for iteration 4...
Obtaining samples for iteration 5...
Obtaining samples for iteration 6...
Obtaining samples for iteration 7...
Obtaining samples for iteration 8...
Obtaining samples for iteration 9...
Obtaining samples for iteration 10...
Obtaining samples for iteration 11...
Obtaining samples for iteration 12...
Obtaining samples for iteration 13...
Obtaining samples for iteration 14...
Obtaining samples for iteration 15...
Obtaining samples for iteration 16...
Obtaining samples for iteration 17...
Obtaining samples for iteration 18...
Obtaining samples for iteration 19...
Done training policy.
Generating on-policy rollouts.
Path 0 | total_timesteps 0.
number of affinization with epsilon = 3 is 14
average number of affinization = 19.545047064096817
Path 1 | total_timesteps 18.
number of affinization with epsilon = 3 is 41
average number of affinization = 19.554659498207887
Path 2 | total_timesteps 69.
number of affinization with epsilon = 3 is 22
average number of affinization = 19.55575459023735
Path 3 | total_timesteps 95.
number of affinization with epsilon = 3 is 27
average number of affinization = 19.55908683974933
Path 4 | total_timesteps 127.
number of affinization with epsilon = 3 is 10
average number of affinization = 19.55480984340045
Path 5 | total_timesteps 140.
number of affinization with epsilon = 3 is 24
average number of affinization = 19.55679785330948
Path 6 | total_timesteps 170.
number of affinization with epsilon = 3 is 28
average number of affinization = 19.56057219490389
Path 7 | total_timesteps 206.
number of affinization with epsilon = 3 is 17
average number of affinization = 19.559428060768543
Path 8 | total_timesteps 226.
number of affinization with epsilon = 3 is 48
average number of affinization = 19.572130415364
Path 9 | total_timesteps 285.
number of affinization with epsilon = 3 is 23
average number of affinization = 19.573660714285715
Path 10 | total_timesteps 313.
number of affinization with epsilon = 3 is 26
average number of affinization = 19.57652833556448
Path 11 | total_timesteps 342.
number of affinization with epsilon = 3 is 63
average number of affinization = 19.595896520963425
Path 12 | total_timesteps 413.
number of affinization with epsilon = 3 is 14
average number of affinization = 19.593401694159606
Path 13 | total_timesteps 431.
number of affinization with epsilon = 3 is 24
average number of affinization = 19.59536541889483
Path 14 | total_timesteps 460.
number of affinization with epsilon = 3 is 24
average number of affinization = 19.597327394209355
Path 15 | total_timesteps 489.
number of affinization with epsilon = 3 is 30
average number of affinization = 19.601959038290293
Path 16 | total_timesteps 526.
number of affinization with epsilon = 3 is 21
average number of affinization = 19.60258121940365
Path 17 | total_timesteps 554.
number of affinization with epsilon = 3 is 33
average number of affinization = 19.608540925266905
Path 18 | total_timesteps 593.
number of affinization with epsilon = 3 is 13
average number of affinization = 19.605602489995555
Path 19 | total_timesteps 610.
number of affinization with epsilon = 3 is 17
average number of affinization = 19.604444444444443
Path 20 | total_timesteps 629.
number of affinization with epsilon = 3 is 10
average number of affinization = 19.600177698800533
Path 21 | total_timesteps 642.
number of affinization with epsilon = 3 is 29
average number of affinization = 19.604351687388988
Path 22 | total_timesteps 674.
number of affinization with epsilon = 3 is 33
average number of affinization = 19.61029738126942
Path 23 | total_timesteps 712.
number of affinization with epsilon = 3 is 27
average number of affinization = 19.61357586512866
Path 24 | total_timesteps 746.
number of affinization with epsilon = 3 is 43
average number of affinization = 19.623946784922396
Path 25 | total_timesteps 793.
number of affinization with epsilon = 3 is 30
average number of affinization = 19.62854609929078
Path 26 | total_timesteps 830.
number of affinization with epsilon = 3 is 10
average number of affinization = 19.62428001772264
Path 27 | total_timesteps 841.
number of affinization with epsilon = 3 is 13
average number of affinization = 19.621346324180692
Path 28 | total_timesteps 858.
number of affinization with epsilon = 3 is 33
average number of affinization = 19.627268702965914
Path 29 | total_timesteps 900.
number of affinization with epsilon = 3 is 27
average number of affinization = 19.63053097345133
Path 30 | total_timesteps 931.
number of affinization with epsilon = 3 is 16
average number of affinization = 19.62892525431225
Path 31 | total_timesteps 950.
number of affinization with epsilon = 3 is 36
average number of affinization = 19.636162687886827
Path 32 | total_timesteps 992.
number of affinization with epsilon = 3 is 24
average number of affinization = 19.638091029606716
Path 33 | total_timesteps 1020.
number of affinization with epsilon = 3 is 22
average number of affinization = 19.639134275618375
Path 34 | total_timesteps 1046.
number of affinization with epsilon = 3 is 33
average number of affinization = 19.64503311258278
Path 35 | total_timesteps 1088.
number of affinization with epsilon = 3 is 29
average number of affinization = 19.649161518093557
Path 36 | total_timesteps 1123.
number of affinization with epsilon = 3 is 21
average number of affinization = 19.64975738861932
Path 37 | total_timesteps 1147.
number of affinization with epsilon = 3 is 33
average number of affinization = 19.655643738977073
Path 38 | total_timesteps 1192.
number of affinization with epsilon = 3 is 10
average number of affinization = 19.651388276773908
Path 39 | total_timesteps 1207.
number of affinization with epsilon = 3 is 15
average number of affinization = 19.64933920704846
Path 40 | total_timesteps 1224.
number of affinization with epsilon = 3 is 12
average number of affinization = 19.645970937912814
Path 41 | total_timesteps 1238.
number of affinization with epsilon = 3 is 24
average number of affinization = 19.64788732394366
Path 42 | total_timesteps 1268.
number of affinization with epsilon = 3 is 46
average number of affinization = 19.659480862296526
Path 43 | total_timesteps 1321.
number of affinization with epsilon = 3 is 31
average number of affinization = 19.664467897977133
Path 44 | total_timesteps 1361.
number of affinization with epsilon = 3 is 33
average number of affinization = 19.67032967032967
Path 45 | total_timesteps 1399.
number of affinization with epsilon = 3 is 36
average number of affinization = 19.67750439367311
Path 46 | total_timesteps 1441.
number of affinization with epsilon = 3 is 24
average number of affinization = 19.679402722880983
Path 47 | total_timesteps 1472.
number of affinization with epsilon = 3 is 27
average number of affinization = 19.682616330114136
Path 48 | total_timesteps 1505.
number of affinization with epsilon = 3 is 9
average number of affinization = 19.677928916191313
Path 49 | total_timesteps 1517.
number of affinization with epsilon = 3 is 24
average number of affinization = 19.67982456140351
Path 50 | total_timesteps 1544.
number of affinization with epsilon = 3 is 22
average number of affinization = 19.680841736080666
Path 51 | total_timesteps 1570.
number of affinization with epsilon = 3 is 35
average number of affinization = 19.68755477651183
Path 52 | total_timesteps 1612.
number of affinization with epsilon = 3 is 26
average number of affinization = 19.690319754708717
Path 53 | total_timesteps 1641.
number of affinization with epsilon = 3 is 35
average number of affinization = 19.697022767075307
Path 54 | total_timesteps 1686.
number of affinization with epsilon = 3 is 11
average number of affinization = 19.693216630196936
Path 55 | total_timesteps 1700.
number of affinization with epsilon = 3 is 22
average number of affinization = 19.694225721784775
Path 56 | total_timesteps 1725.
number of affinization with epsilon = 3 is 41
average number of affinization = 19.703541757761258
Path 57 | total_timesteps 1774.
number of affinization with epsilon = 3 is 23
average number of affinization = 19.704982517482517
Path 58 | total_timesteps 1801.
number of affinization with epsilon = 3 is 14
average number of affinization = 19.702490170380077
Path 59 | total_timesteps 1817.
number of affinization with epsilon = 3 is 19
average number of affinization = 19.702183406113537
Path 60 | total_timesteps 1837.
number of affinization with epsilon = 3 is 19
average number of affinization = 19.701876909646444
Path 61 | total_timesteps 1859.
number of affinization with epsilon = 3 is 13
average number of affinization = 19.698952879581153
Path 62 | total_timesteps 1876.
number of affinization with epsilon = 3 is 18
average number of affinization = 19.698211949411252
Path 63 | total_timesteps 1895.
number of affinization with epsilon = 3 is 15
average number of affinization = 19.696163905841324
Path 64 | total_timesteps 1917.
number of affinization with epsilon = 3 is 46
average number of affinization = 19.707625272331153
Path 65 | total_timesteps 1975.
number of affinization with epsilon = 3 is 37
average number of affinization = 19.715156794425088
Path 66 | total_timesteps 2019.
number of affinization with epsilon = 3 is 16
average number of affinization = 19.71353939921637
Path 67 | total_timesteps 2041.
number of affinization with epsilon = 3 is 11
average number of affinization = 19.709747606614446
Path 68 | total_timesteps 2054.
number of affinization with epsilon = 3 is 14
average number of affinization = 19.70726402783819
Path 69 | total_timesteps 2070.
number of affinization with epsilon = 3 is 16
average number of affinization = 19.705652173913045
Path 70 | total_timesteps 2087.
number of affinization with epsilon = 3 is 48
average number of affinization = 19.71794871794872
Path 71 | total_timesteps 2148.
number of affinization with epsilon = 3 is 30
average number of affinization = 19.72241529105126
Path 72 | total_timesteps 2181.
number of affinization with epsilon = 3 is 43
average number of affinization = 19.732522796352583
Path 73 | total_timesteps 2230.
number of affinization with epsilon = 3 is 21
average number of affinization = 19.733072916666668
Path 74 | total_timesteps 2255.
number of affinization with epsilon = 3 is 25
average number of affinization = 19.7353579175705
Path 75 | total_timesteps 2286.
number of affinization with epsilon = 3 is 22
average number of affinization = 19.736339982653945
Path 76 | total_timesteps 2315.
number of affinization with epsilon = 3 is 26
average number of affinization = 19.73905504984829
Path 77 | total_timesteps 2352.
number of affinization with epsilon = 3 is 43
average number of affinization = 19.749133448873483
Path 78 | total_timesteps 2402.
number of affinization with epsilon = 3 is 19
average number of affinization = 19.74880900822867
Path 79 | total_timesteps 2424.
number of affinization with epsilon = 3 is 21
average number of affinization = 19.74935064935065
Path 80 | total_timesteps 2450.
number of affinization with epsilon = 3 is 26
average number of affinization = 19.752055387278233
Path 81 | total_timesteps 2483.
number of affinization with epsilon = 3 is 23
average number of affinization = 19.753460207612456
Path 82 | total_timesteps 2512.
number of affinization with epsilon = 3 is 24
average number of affinization = 19.755296152183313
Path 83 | total_timesteps 2544.
number of affinization with epsilon = 3 is 28
average number of affinization = 19.75885911840968
Path 84 | total_timesteps 2576.
number of affinization with epsilon = 3 is 7
average number of affinization = 19.753347732181425
Path 85 | total_timesteps 2588.
number of affinization with epsilon = 3 is 10
average number of affinization = 19.749136442141623
Path 86 | total_timesteps 2599.
number of affinization with epsilon = 3 is 15
average number of affinization = 19.747086750107897
Path 87 | total_timesteps 2618.
number of affinization with epsilon = 3 is 21
average number of affinization = 19.74762726488352
Path 88 | total_timesteps 2645.
number of affinization with epsilon = 3 is 42
average number of affinization = 19.757222940922812
Path 89 | total_timesteps 2697.
number of affinization with epsilon = 3 is 16
average number of affinization = 19.755603448275863
Path 90 | total_timesteps 2718.
number of affinization with epsilon = 3 is 50
average number of affinization = 19.768634209392502
Path 91 | total_timesteps 2784.
number of affinization with epsilon = 3 is 21
average number of affinization = 19.76916451335056
Path 92 | total_timesteps 2810.
number of affinization with epsilon = 3 is 49
average number of affinization = 19.781747739991392
Path 93 | total_timesteps 2871.
number of affinization with epsilon = 3 is 15
average number of affinization = 19.779690189328743
Path 94 | total_timesteps 2888.
number of affinization with epsilon = 3 is 53
average number of affinization = 19.793978494623655
Path 95 | total_timesteps 2946.
number of affinization with epsilon = 3 is 13
average number of affinization = 19.791057609630265
Path 96 | total_timesteps 2964.
number of affinization with epsilon = 3 is 13
average number of affinization = 19.78813923506661
Path 97 | total_timesteps 2978.
number of affinization with epsilon = 3 is 13
average number of affinization = 19.785223367697593
Path 98 | total_timesteps 2995.
number of affinization with epsilon = 3 is 15
average number of affinization = 19.783168741949336
Path 99 | total_timesteps 3014.
number of affinization with epsilon = 3 is 16
average number of affinization = 19.78154506437768
Path 100 | total_timesteps 3032.
number of affinization with epsilon = 3 is 14
average number of affinization = 19.77906477906478
Path 101 | total_timesteps 3047.
number of affinization with epsilon = 3 is 32
average number of affinization = 19.784305317324186
Path 102 | total_timesteps 3084.
number of affinization with epsilon = 3 is 27
average number of affinization = 19.78739819974282
Path 103 | total_timesteps 3115.
number of affinization with epsilon = 3 is 36
average number of affinization = 19.794344473007712
Path 104 | total_timesteps 3154.
number of affinization with epsilon = 3 is 19
average number of affinization = 19.794004282655248
Path 105 | total_timesteps 3178.
number of affinization with epsilon = 3 is 44
average number of affinization = 19.804366438356166
Path 106 | total_timesteps 3227.
number of affinization with epsilon = 3 is 29
average number of affinization = 19.808301240907145
Path 107 | total_timesteps 3259.
number of affinization with epsilon = 3 is 8
average number of affinization = 19.803250641573996
Path 108 | total_timesteps 3271.
number of affinization with epsilon = 3 is 20
average number of affinization = 19.80333475844378
Path 109 | total_timesteps 3296.
number of affinization with epsilon = 3 is 16
average number of affinization = 19.801709401709402
Path 110 | total_timesteps 3316.
number of affinization with epsilon = 3 is 15
average number of affinization = 19.79965826569842
Path 111 | total_timesteps 3334.
number of affinization with epsilon = 3 is 34
average number of affinization = 19.805721605465415
Path 112 | total_timesteps 3379.
number of affinization with epsilon = 3 is 28
average number of affinization = 19.80921895006402
Path 113 | total_timesteps 3409.
number of affinization with epsilon = 3 is 32
average number of affinization = 19.81441979522184
Path 114 | total_timesteps 3448.
number of affinization with epsilon = 3 is 8
average number of affinization = 19.809381663113005
Path 115 | total_timesteps 3460.
number of affinization with epsilon = 3 is 11
average number of affinization = 19.805626598465473
Path 116 | total_timesteps 3476.
number of affinization with epsilon = 3 is 17
average number of affinization = 19.804431188751597
Path 117 | total_timesteps 3495.
number of affinization with epsilon = 3 is 21
average number of affinization = 19.80494037478705
Path 118 | total_timesteps 3521.
number of affinization with epsilon = 3 is 19
average number of affinization = 19.804597701149426
Path 119 | total_timesteps 3544.
number of affinization with epsilon = 3 is 24
average number of affinization = 19.806382978723406
Path 120 | total_timesteps 3574.
number of affinization with epsilon = 3 is 17
average number of affinization = 19.805189281156956
Path 121 | total_timesteps 3595.
number of affinization with epsilon = 3 is 25
average number of affinization = 19.807397959183675
Path 122 | total_timesteps 3622.
number of affinization with epsilon = 3 is 54
average number of affinization = 19.821929451763705
Path 123 | total_timesteps 3682.
number of affinization with epsilon = 3 is 19
average number of affinization = 19.82158028887001
Path 124 | total_timesteps 3706.
number of affinization with epsilon = 3 is 14
average number of affinization = 19.819108280254778
Path 125 | total_timesteps 3725.
number of affinization with epsilon = 3 is 38
average number of affinization = 19.826825127334466
Path 126 | total_timesteps 3770.
number of affinization with epsilon = 3 is 22
average number of affinization = 19.827747136190073
Path 127 | total_timesteps 3796.
number of affinization with epsilon = 3 is 18
average number of affinization = 19.826972010178118
Path 128 | total_timesteps 3817.
number of affinization with epsilon = 3 is 17
average number of affinization = 19.825773632895295
Path 129 | total_timesteps 3839.
number of affinization with epsilon = 3 is 11
average number of affinization = 19.822033898305083
Path 130 | total_timesteps 3852.
number of affinization with epsilon = 3 is 31
average number of affinization = 19.826768318509107
Path 131 | total_timesteps 3887.
number of affinization with epsilon = 3 is 47
average number of affinization = 19.83827265029636
Path 132 | total_timesteps 3946.
number of affinization with epsilon = 3 is 31
average number of affinization = 19.842996191282268
Path 133 | total_timesteps 3984.
number of affinization with epsilon = 3 is 19
average number of affinization = 19.84263959390863
Path 134 | total_timesteps 4009.
number of affinization with epsilon = 3 is 25
average number of affinization = 19.844820295983087
Path 135 | total_timesteps 4038.
number of affinization with epsilon = 3 is 18
average number of affinization = 19.844040574809807
Path 136 | total_timesteps 4061.
number of affinization with epsilon = 3 is 47
average number of affinization = 19.85551330798479
Path 137 | total_timesteps 4121.
number of affinization with epsilon = 3 is 9
average number of affinization = 19.850929054054053
Path 138 | total_timesteps 4135.
number of affinization with epsilon = 3 is 70
average number of affinization = 19.872097931616715
Path 139 | total_timesteps 4223.
number of affinization with epsilon = 3 is 19
average number of affinization = 19.871729957805908
Path 140 | total_timesteps 4246.
number of affinization with epsilon = 3 is 27
average number of affinization = 19.874736398144243
Path 141 | total_timesteps 4277.
number of affinization with epsilon = 3 is 51
average number of affinization = 19.88785834738617
Path 142 | total_timesteps 4339.
number of affinization with epsilon = 3 is 25
average number of affinization = 19.89001264222503
Path 143 | total_timesteps 4370.
number of affinization with epsilon = 3 is 15
average number of affinization = 19.887952822240944
Path 144 | total_timesteps 4390.
number of affinization with epsilon = 3 is 27
average number of affinization = 19.890947368421052
Path 145 | total_timesteps 4421.
number of affinization with epsilon = 3 is 45
average number of affinization = 19.901515151515152
Path 146 | total_timesteps 4479.
number of affinization with epsilon = 3 is 16
average number of affinization = 19.89987379049222
Path 147 | total_timesteps 4501.
number of affinization with epsilon = 3 is 17
average number of affinization = 19.8986543313709
Path 148 | total_timesteps 4519.
number of affinization with epsilon = 3 is 29
average number of affinization = 19.902480033627576
Path 149 | total_timesteps 4552.
number of affinization with epsilon = 3 is 34
average number of affinization = 19.908403361344536
Path 150 | total_timesteps 4593.
number of affinization with epsilon = 3 is 18
average number of affinization = 19.90760184796304
Path 151 | total_timesteps 4615.
number of affinization with epsilon = 3 is 46
average number of affinization = 19.91855583543241
Path 152 | total_timesteps 4670.
number of affinization with epsilon = 3 is 27
average number of affinization = 19.92152748636173
Path 153 | total_timesteps 4700.
number of affinization with epsilon = 3 is 34
average number of affinization = 19.92743288590604
Path 154 | total_timesteps 4739.
number of affinization with epsilon = 3 is 15
average number of affinization = 19.92536687631027
Path 155 | total_timesteps 4759.
number of affinization with epsilon = 3 is 16
average number of affinization = 19.923721709974853
Path 156 | total_timesteps 4782.
number of affinization with epsilon = 3 is 24
average number of affinization = 19.925429409300378
Path 157 | total_timesteps 4811.
number of affinization with epsilon = 3 is 12
average number of affinization = 19.92211055276382
Path 158 | total_timesteps 4827.
number of affinization with epsilon = 3 is 33
average number of affinization = 19.92758476349937
Path 159 | total_timesteps 4870.
number of affinization with epsilon = 3 is 37
average number of affinization = 19.934728033472805
Path 160 | total_timesteps 4913.
number of affinization with epsilon = 3 is 23
average number of affinization = 19.936010037641154
Path 161 | total_timesteps 4938.
number of affinization with epsilon = 3 is 8
average number of affinization = 19.931020066889634
Path 162 | total_timesteps 4948.
number of affinization with epsilon = 3 is 25
average number of affinization = 19.933138320100294
Path 163 | total_timesteps 4977.
number of affinization with epsilon = 3 is 24
average number of affinization = 19.93483709273183
Path 164 | total_timesteps 5011.
number of affinization with epsilon = 3 is 27
average number of affinization = 19.937787056367434
Path 165 | total_timesteps 5046.
number of affinization with epsilon = 3 is 29
average number of affinization = 19.941569282136896
Path 166 | total_timesteps 5080.
number of affinization with epsilon = 3 is 23
average number of affinization = 19.94284522319566
Path 167 | total_timesteps 5109.
number of affinization with epsilon = 3 is 7
average number of affinization = 19.93744787322769
Path 168 | total_timesteps 5120.
number of affinization with epsilon = 3 is 39
average number of affinization = 19.94539391413089
Path 169 | total_timesteps 5167.
number of affinization with epsilon = 3 is 57
average number of affinization = 19.960833333333333
Path 170 | total_timesteps 5234.
number of affinization with epsilon = 3 is 20
average number of affinization = 19.96084964598084
Path 171 | total_timesteps 5259.
number of affinization with epsilon = 3 is 9
average number of affinization = 19.956286427976686
Path 172 | total_timesteps 5270.
number of affinization with epsilon = 3 is 34
average number of affinization = 19.96213066999584
Path 173 | total_timesteps 5312.
number of affinization with epsilon = 3 is 19
average number of affinization = 19.96173044925125
Path 174 | total_timesteps 5334.
number of affinization with epsilon = 3 is 25
average number of affinization = 19.963825363825364
Path 175 | total_timesteps 5368.
number of affinization with epsilon = 3 is 37
average number of affinization = 19.970906068162925
Path 176 | total_timesteps 5416.
number of affinization with epsilon = 3 is 44
average number of affinization = 19.980889073535522
Path 177 | total_timesteps 5467.
number of affinization with epsilon = 3 is 19
average number of affinization = 19.98048172757475
Path 178 | total_timesteps 5489.
number of affinization with epsilon = 3 is 14
average number of affinization = 19.97799916977999
Path 179 | total_timesteps 5506.
number of affinization with epsilon = 3 is 12
average number of affinization = 19.974688796680496
Path 180 | total_timesteps 5521.
number of affinization with epsilon = 3 is 11
average number of affinization = 19.970966403981752
Path 181 | total_timesteps 5535.
number of affinization with epsilon = 3 is 34
average number of affinization = 19.976782752902157
Path 182 | total_timesteps 5574.
number of affinization with epsilon = 3 is 13
average number of affinization = 19.973891421467055
Path 183 | total_timesteps 5589.
number of affinization with epsilon = 3 is 11
average number of affinization = 19.970173985086994
Path 184 | total_timesteps 5602.
number of affinization with epsilon = 3 is 10
average number of affinization = 19.966045548654243
Path 185 | total_timesteps 5618.
number of affinization with epsilon = 3 is 36
average number of affinization = 19.9726821192053
Path 186 | total_timesteps 5666.
number of affinization with epsilon = 3 is 18
average number of affinization = 19.971865949524204
Path 187 | total_timesteps 5688.
number of affinization with epsilon = 3 is 33
average number of affinization = 19.977253928866833
Path 188 | total_timesteps 5727.
number of affinization with epsilon = 3 is 26
average number of affinization = 19.97974369574204
Path 189 | total_timesteps 5766.
number of affinization with epsilon = 3 is 12
average number of affinization = 19.976446280991734
Path 190 | total_timesteps 5783.
number of affinization with epsilon = 3 is 19
average number of affinization = 19.976042957455597
Path 191 | total_timesteps 5805.
number of affinization with epsilon = 3 is 18
average number of affinization = 19.975227085053675
Path 192 | total_timesteps 5832.
number of affinization with epsilon = 3 is 29
average number of affinization = 19.978951712752785
Path 193 | total_timesteps 5867.
number of affinization with epsilon = 3 is 18
average number of affinization = 19.978135313531354
Path 194 | total_timesteps 5892.
number of affinization with epsilon = 3 is 22
average number of affinization = 19.978969072164947
Path 195 | total_timesteps 5917.
number of affinization with epsilon = 3 is 31
average number of affinization = 19.98351195383347
Path 196 | total_timesteps 5955.
number of affinization with epsilon = 3 is 24
average number of affinization = 19.985166872682324
Path 197 | total_timesteps 5985.
number of affinization with epsilon = 3 is 22
average number of affinization = 19.985996705107084
Done generating on-policy rollouts.
Updating normalization.
Done updating normalization.
----------------------------
| AverageReturn | -4.66    |
| Iteration     | 9        |
| MaximumReturn | 66.5     |
| MinimumReturn | -19.6    |
| TotalSamples  | 44147    |
----------------------------
itr #10 | 
Fitting dynamics.
Fitting model 0 (0-based) in the ensemble of 2 models
Validation loss = 0.026236258447170258
Validation loss = 0.021084152162075043
Validation loss = 0.023673726245760918
Validation loss = 0.022939352318644524
Validation loss = 0.021285273134708405
Validation loss = 0.020665062591433525
Validation loss = 0.02173948474228382
Validation loss = 0.021322889253497124
Validation loss = 0.020396597683429718
Validation loss = 0.021042291074991226
Validation loss = 0.020059503614902496
Validation loss = 0.02080478146672249
Validation loss = 0.021321240812540054
Validation loss = 0.020617308095097542
Validation loss = 0.02067658305168152
Fitting model 1 (0-based) in the ensemble of 2 models
Validation loss = 0.021998705342411995
Validation loss = 0.022244350984692574
Validation loss = 0.020959585905075073
Validation loss = 0.022162942215800285
Validation loss = 0.020611615851521492
Validation loss = 0.020282557234168053
Validation loss = 0.020479323342442513
Validation loss = 0.02214287593960762
Validation loss = 0.019990000873804092
Validation loss = 0.020386824384331703
Validation loss = 0.020966453477740288
Validation loss = 0.021549386903643608
Validation loss = 0.019647598266601562
Validation loss = 0.021506957709789276
Validation loss = 0.02055913209915161
Validation loss = 0.020020155236124992
Validation loss = 0.020165715366601944
Done fitting dynamics.
Updating randomness.
Done updating randomness.
Training policy using TRPO.
Re-initialize init_std.
Obtaining samples for iteration 0...
Obtaining samples for iteration 1...
Obtaining samples for iteration 2...
Obtaining samples for iteration 3...
Obtaining samples for iteration 4...
Obtaining samples for iteration 5...
Obtaining samples for iteration 6...
Obtaining samples for iteration 7...
Obtaining samples for iteration 8...
Obtaining samples for iteration 9...
Obtaining samples for iteration 10...
Obtaining samples for iteration 11...
Obtaining samples for iteration 12...
Obtaining samples for iteration 13...
Obtaining samples for iteration 14...
Obtaining samples for iteration 15...
Obtaining samples for iteration 16...
Obtaining samples for iteration 17...
Obtaining samples for iteration 18...
Obtaining samples for iteration 19...
Done training policy.
Generating on-policy rollouts.
Path 0 | total_timesteps 0.
number of affinization with epsilon = 3 is 31
average number of affinization = 19.990531082750103
Path 1 | total_timesteps 32.
number of affinization with epsilon = 3 is 11
average number of affinization = 19.986831275720164
Path 2 | total_timesteps 48.
number of affinization with epsilon = 3 is 21
average number of affinization = 19.987248046071574
Path 3 | total_timesteps 73.
number of affinization with epsilon = 3 is 20
average number of affinization = 19.987253289473685
Path 4 | total_timesteps 95.
number of affinization with epsilon = 3 is 40
average number of affinization = 19.99547883271681
Path 5 | total_timesteps 144.
number of affinization with epsilon = 3 is 34
average number of affinization = 20.001232539030404
Path 6 | total_timesteps 186.
number of affinization with epsilon = 3 is 17
average number of affinization = 20.0
Path 7 | total_timesteps 206.
number of affinization with epsilon = 3 is 17
average number of affinization = 19.998768472906406
Path 8 | total_timesteps 231.
number of affinization with epsilon = 3 is 50
average number of affinization = 20.011079195732457
Path 9 | total_timesteps 292.
number of affinization with epsilon = 3 is 34
average number of affinization = 20.01681706316653
Path 10 | total_timesteps 335.
number of affinization with epsilon = 3 is 27
average number of affinization = 20.019680196801968
Path 11 | total_timesteps 368.
number of affinization with epsilon = 3 is 16
average number of affinization = 20.018032786885247
Path 12 | total_timesteps 390.
number of affinization with epsilon = 3 is 19
average number of affinization = 20.01761573125768
Path 13 | total_timesteps 416.
number of affinization with epsilon = 3 is 39
average number of affinization = 20.025389025389025
Path 14 | total_timesteps 466.
number of affinization with epsilon = 3 is 14
average number of affinization = 20.022922636103154
Path 15 | total_timesteps 482.
number of affinization with epsilon = 3 is 36
average number of affinization = 20.029459901800326
Path 16 | total_timesteps 526.
number of affinization with epsilon = 3 is 39
average number of affinization = 20.03721881390593
Path 17 | total_timesteps 575.
number of affinization with epsilon = 3 is 32
average number of affinization = 20.04210956663941
Path 18 | total_timesteps 614.
number of affinization with epsilon = 3 is 17
average number of affinization = 20.040866366979976
Path 19 | total_timesteps 638.
number of affinization with epsilon = 3 is 33
average number of affinization = 20.046160130718953
Path 20 | total_timesteps 683.
number of affinization with epsilon = 3 is 43
average number of affinization = 20.05553287055941
Path 21 | total_timesteps 733.
number of affinization with epsilon = 3 is 39
average number of affinization = 20.06326530612245
Path 22 | total_timesteps 780.
number of affinization with epsilon = 3 is 10
average number of affinization = 20.059159526723786
Path 23 | total_timesteps 792.
number of affinization with epsilon = 3 is 42
average number of affinization = 20.06810766721044
Path 24 | total_timesteps 846.
number of affinization with epsilon = 3 is 16
average number of affinization = 20.066449245821442
Path 25 | total_timesteps 867.
number of affinization with epsilon = 3 is 30
average number of affinization = 20.070497147514264
Path 26 | total_timesteps 905.
number of affinization with epsilon = 3 is 54
average number of affinization = 20.084317718940937
Path 27 | total_timesteps 966.
number of affinization with epsilon = 3 is 32
average number of affinization = 20.089169381107492
Path 28 | total_timesteps 1005.
number of affinization with epsilon = 3 is 38
average number of affinization = 20.096459096459096
Path 29 | total_timesteps 1055.
number of affinization with epsilon = 3 is 22
average number of affinization = 20.097233523189583
Path 30 | total_timesteps 1081.
number of affinization with epsilon = 3 is 13
average number of affinization = 20.09434729564864
Path 31 | total_timesteps 1102.
number of affinization with epsilon = 3 is 32
average number of affinization = 20.099186991869917
Path 32 | total_timesteps 1137.
number of affinization with epsilon = 3 is 18
average number of affinization = 20.098334010564813
Path 33 | total_timesteps 1158.
number of affinization with epsilon = 3 is 15
average number of affinization = 20.09626320064988
Path 34 | total_timesteps 1175.
number of affinization with epsilon = 3 is 29
average number of affinization = 20.09987819732034
Path 35 | total_timesteps 1212.
number of affinization with epsilon = 3 is 32
average number of affinization = 20.104707792207794
Path 36 | total_timesteps 1252.
number of affinization with epsilon = 3 is 31
average number of affinization = 20.109127789046653
Path 37 | total_timesteps 1288.
number of affinization with epsilon = 3 is 23
average number of affinization = 20.110300081103002
Path 38 | total_timesteps 1316.
number of affinization with epsilon = 3 is 28
average number of affinization = 20.11349817592217
Path 39 | total_timesteps 1354.
number of affinization with epsilon = 3 is 59
average number of affinization = 20.129254457050244
Path 40 | total_timesteps 1420.
number of affinization with epsilon = 3 is 67
average number of affinization = 20.148238153098422
Path 41 | total_timesteps 1497.
number of affinization with epsilon = 3 is 30
average number of affinization = 20.152226720647775
Path 42 | total_timesteps 1538.
number of affinization with epsilon = 3 is 10
average number of affinization = 20.14811817078106
Path 43 | total_timesteps 1551.
number of affinization with epsilon = 3 is 54
average number of affinization = 20.161812297734627
Path 44 | total_timesteps 1618.
number of affinization with epsilon = 3 is 18
average number of affinization = 20.160938131823695
Path 45 | total_timesteps 1643.
number of affinization with epsilon = 3 is 12
average number of affinization = 20.157639450282943
Path 46 | total_timesteps 1658.
number of affinization with epsilon = 3 is 18
average number of affinization = 20.156767676767675
Path 47 | total_timesteps 1679.
number of affinization with epsilon = 3 is 24
average number of affinization = 20.15831987075929
Path 48 | total_timesteps 1704.
number of affinization with epsilon = 3 is 23
average number of affinization = 20.159467097295114
Path 49 | total_timesteps 1733.
number of affinization with epsilon = 3 is 23
average number of affinization = 20.160613397901532
Path 50 | total_timesteps 1763.
number of affinization with epsilon = 3 is 54
average number of affinization = 20.17426381605486
Path 51 | total_timesteps 1823.
number of affinization with epsilon = 3 is 36
average number of affinization = 20.18064516129032
Path 52 | total_timesteps 1865.
number of affinization with epsilon = 3 is 14
average number of affinization = 20.178153970173316
Path 53 | total_timesteps 1884.
number of affinization with epsilon = 3 is 21
average number of affinization = 20.178485092667202
Path 54 | total_timesteps 1912.
number of affinization with epsilon = 3 is 24
average number of affinization = 20.18002416431736
Path 55 | total_timesteps 1942.
number of affinization with epsilon = 3 is 36
average number of affinization = 20.186392914653783
Path 56 | total_timesteps 1984.
number of affinization with epsilon = 3 is 23
average number of affinization = 20.187525150905433
Path 57 | total_timesteps 2010.
number of affinization with epsilon = 3 is 6
average number of affinization = 20.181818181818183
Path 58 | total_timesteps 2019.
number of affinization with epsilon = 3 is 31
average number of affinization = 20.18616807398472
Path 59 | total_timesteps 2057.
number of affinization with epsilon = 3 is 12
average number of affinization = 20.182877813504824
Path 60 | total_timesteps 2071.
number of affinization with epsilon = 3 is 19
average number of affinization = 20.18240257131378
Path 61 | total_timesteps 2097.
number of affinization with epsilon = 3 is 7
average number of affinization = 20.17710843373494
Path 62 | total_timesteps 2108.
number of affinization with epsilon = 3 is 55
average number of affinization = 20.1910879164994
Path 63 | total_timesteps 2174.
number of affinization with epsilon = 3 is 13
average number of affinization = 20.18820224719101
Path 64 | total_timesteps 2199.
number of affinization with epsilon = 3 is 18
average number of affinization = 20.187324508624148
Path 65 | total_timesteps 2220.
number of affinization with epsilon = 3 is 31
average number of affinization = 20.191659983961507
Path 66 | total_timesteps 2258.
number of affinization with epsilon = 3 is 25
average number of affinization = 20.193587174348696
Path 67 | total_timesteps 2288.
number of affinization with epsilon = 3 is 10
average number of affinization = 20.189503205128204
Path 68 | total_timesteps 2302.
number of affinization with epsilon = 3 is 8
average number of affinization = 20.184621545855027
Path 69 | total_timesteps 2313.
number of affinization with epsilon = 3 is 32
average number of affinization = 20.189351481184946
Path 70 | total_timesteps 2350.
number of affinization with epsilon = 3 is 15
average number of affinization = 20.187274909963985
Path 71 | total_timesteps 2374.
number of affinization with epsilon = 3 is 21
average number of affinization = 20.1876
Path 72 | total_timesteps 2399.
number of affinization with epsilon = 3 is 34
average number of affinization = 20.19312275089964
Path 73 | total_timesteps 2442.
number of affinization with epsilon = 3 is 47
average number of affinization = 20.203836930455637
Path 74 | total_timesteps 2496.
number of affinization with epsilon = 3 is 34
average number of affinization = 20.209348781462246
Path 75 | total_timesteps 2539.
number of affinization with epsilon = 3 is 22
average number of affinization = 20.21006389776358
Path 76 | total_timesteps 2565.
number of affinization with epsilon = 3 is 31
average number of affinization = 20.21437125748503
Path 77 | total_timesteps 2600.
number of affinization with epsilon = 3 is 31
average number of affinization = 20.218675179569033
Path 78 | total_timesteps 2639.
number of affinization with epsilon = 3 is 20
average number of affinization = 20.218587953729557
Path 79 | total_timesteps 2666.
number of affinization with epsilon = 3 is 32
average number of affinization = 20.22328548644338
Path 80 | total_timesteps 2705.
number of affinization with epsilon = 3 is 25
average number of affinization = 20.225189318453566
Path 81 | total_timesteps 2735.
number of affinization with epsilon = 3 is 66
average number of affinization = 20.24342629482072
Path 82 | total_timesteps 2811.
number of affinization with epsilon = 3 is 31
average number of affinization = 20.247710075667065
Path 83 | total_timesteps 2850.
number of affinization with epsilon = 3 is 15
average number of affinization = 20.24562101910828
Path 84 | total_timesteps 2868.
number of affinization with epsilon = 3 is 33
average number of affinization = 20.250696378830085
Path 85 | total_timesteps 2907.
number of affinization with epsilon = 3 is 70
average number of affinization = 20.270485282418456
Path 86 | total_timesteps 2994.
number of affinization with epsilon = 3 is 30
average number of affinization = 20.274353876739564
Path 87 | total_timesteps 3033.
number of affinization with epsilon = 3 is 10
average number of affinization = 20.27027027027027
Path 88 | total_timesteps 3044.
number of affinization with epsilon = 3 is 15
average number of affinization = 20.268176400476758
Path 89 | total_timesteps 3061.
number of affinization with epsilon = 3 is 20
average number of affinization = 20.268069896743448
Path 90 | total_timesteps 3087.
number of affinization with epsilon = 3 is 24
average number of affinization = 20.269551409289402
Path 91 | total_timesteps 3116.
number of affinization with epsilon = 3 is 31
average number of affinization = 20.273809523809526
Path 92 | total_timesteps 3153.
number of affinization with epsilon = 3 is 39
average number of affinization = 20.281237604125348
Path 93 | total_timesteps 3198.
number of affinization with epsilon = 3 is 29
average number of affinization = 20.28469468675654
Path 94 | total_timesteps 3232.
number of affinization with epsilon = 3 is 31
average number of affinization = 20.288941736028537
Path 95 | total_timesteps 3271.
number of affinization with epsilon = 3 is 22
average number of affinization = 20.289619651347067
Path 96 | total_timesteps 3297.
number of affinization with epsilon = 3 is 28
average number of affinization = 20.292673267326734
Path 97 | total_timesteps 3330.
number of affinization with epsilon = 3 is 41
average number of affinization = 20.300870942201108
Path 98 | total_timesteps 3374.
number of affinization with epsilon = 3 is 16
average number of affinization = 20.299168975069254
Path 99 | total_timesteps 3397.
number of affinization with epsilon = 3 is 21
average number of affinization = 20.299446202531644
Path 100 | total_timesteps 3426.
number of affinization with epsilon = 3 is 11
average number of affinization = 20.29576907868723
Path 101 | total_timesteps 3443.
number of affinization with epsilon = 3 is 29
average number of affinization = 20.299209486166006
Path 102 | total_timesteps 3479.
number of affinization with epsilon = 3 is 55
average number of affinization = 20.31291979454761
Path 103 | total_timesteps 3549.
number of affinization with epsilon = 3 is 36
average number of affinization = 20.31911532385466
Path 104 | total_timesteps 3589.
number of affinization with epsilon = 3 is 32
average number of affinization = 20.323726806158707
Path 105 | total_timesteps 3629.
number of affinization with epsilon = 3 is 57
average number of affinization = 20.33820047355959
Path 106 | total_timesteps 3696.
number of affinization with epsilon = 3 is 76
average number of affinization = 20.360157790927023
Path 107 | total_timesteps 3788.
number of affinization with epsilon = 3 is 19
average number of affinization = 20.3596214511041
Path 108 | total_timesteps 3809.
number of affinization with epsilon = 3 is 17
average number of affinization = 20.358297201419
Path 109 | total_timesteps 3836.
number of affinization with epsilon = 3 is 22
average number of affinization = 20.35894405043341
Path 110 | total_timesteps 3865.
number of affinization with epsilon = 3 is 33
average number of affinization = 20.363922804253644
Path 111 | total_timesteps 3903.
number of affinization with epsilon = 3 is 42
average number of affinization = 20.37244094488189
Path 112 | total_timesteps 3957.
number of affinization with epsilon = 3 is 39
average number of affinization = 20.379771743408106
Path 113 | total_timesteps 4007.
number of affinization with epsilon = 3 is 51
average number of affinization = 20.39181746656176
Path 114 | total_timesteps 4064.
number of affinization with epsilon = 3 is 42
average number of affinization = 20.40031458906803
Path 115 | total_timesteps 4114.
number of affinization with epsilon = 3 is 17
average number of affinization = 20.398977987421382
Path 116 | total_timesteps 4133.
number of affinization with epsilon = 3 is 28
average number of affinization = 20.40196463654224
Path 117 | total_timesteps 4167.
number of affinization with epsilon = 3 is 17
average number of affinization = 20.40062843676355
Path 118 | total_timesteps 4187.
number of affinization with epsilon = 3 is 31
average number of affinization = 20.40478994895956
Path 119 | total_timesteps 4221.
number of affinization with epsilon = 3 is 14
average number of affinization = 20.402276295133436
Path 120 | total_timesteps 4242.
number of affinization with epsilon = 3 is 28
average number of affinization = 20.405256963515104
Path 121 | total_timesteps 4278.
number of affinization with epsilon = 3 is 9
average number of affinization = 20.40078431372549
Path 122 | total_timesteps 4292.
number of affinization with epsilon = 3 is 37
average number of affinization = 20.407291258330066
Path 123 | total_timesteps 4334.
number of affinization with epsilon = 3 is 14
average number of affinization = 20.404780564263323
Path 124 | total_timesteps 4355.
number of affinization with epsilon = 3 is 28
average number of affinization = 20.407755581668624
Path 125 | total_timesteps 4388.
number of affinization with epsilon = 3 is 26
average number of affinization = 20.40994518402506
Path 126 | total_timesteps 4422.
number of affinization with epsilon = 3 is 34
average number of affinization = 20.415264187866928
Path 127 | total_timesteps 4460.
number of affinization with epsilon = 3 is 25
average number of affinization = 20.417057902973397
Path 128 | total_timesteps 4490.
number of affinization with epsilon = 3 is 26
average number of affinization = 20.419241298396557
Path 129 | total_timesteps 4524.
number of affinization with epsilon = 3 is 16
average number of affinization = 20.417513682564504
Path 130 | total_timesteps 4545.
number of affinization with epsilon = 3 is 45
average number of affinization = 20.427119968737788
Path 131 | total_timesteps 4595.
number of affinization with epsilon = 3 is 17
average number of affinization = 20.42578125
Path 132 | total_timesteps 4615.
number of affinization with epsilon = 3 is 24
average number of affinization = 20.427176884029677
Path 133 | total_timesteps 4644.
number of affinization with epsilon = 3 is 14
average number of affinization = 20.424668227946917
Path 134 | total_timesteps 4662.
number of affinization with epsilon = 3 is 17
average number of affinization = 20.42333203277409
Path 135 | total_timesteps 4690.
number of affinization with epsilon = 3 is 14
average number of affinization = 20.420826833073324
Path 136 | total_timesteps 4707.
number of affinization with epsilon = 3 is 14
average number of affinization = 20.418323586744638
Path 137 | total_timesteps 4725.
number of affinization with epsilon = 3 is 27
average number of affinization = 20.420888542478565
Path 138 | total_timesteps 4759.
number of affinization with epsilon = 3 is 24
average number of affinization = 20.422282820412935
Path 139 | total_timesteps 4786.
number of affinization with epsilon = 3 is 7
average number of affinization = 20.417056074766354
Path 140 | total_timesteps 4797.
number of affinization with epsilon = 3 is 32
average number of affinization = 20.421564811210587
Path 141 | total_timesteps 4838.
number of affinization with epsilon = 3 is 24
average number of affinization = 20.42295719844358
Path 142 | total_timesteps 4866.
number of affinization with epsilon = 3 is 57
average number of affinization = 20.43718397510696
Path 143 | total_timesteps 4935.
number of affinization with epsilon = 3 is 40
average number of affinization = 20.444790046656298
Path 144 | total_timesteps 4983.
number of affinization with epsilon = 3 is 41
average number of affinization = 20.452778857364944
Path 145 | total_timesteps 5028.
number of affinization with epsilon = 3 is 31
average number of affinization = 20.456876456876458
Path 146 | total_timesteps 5064.
number of affinization with epsilon = 3 is 42
average number of affinization = 20.465242718446603
Path 147 | total_timesteps 5113.
number of affinization with epsilon = 3 is 17
average number of affinization = 20.46389751552795
Path 148 | total_timesteps 5134.
number of affinization with epsilon = 3 is 30
average number of affinization = 20.467597982149787
Path 149 | total_timesteps 5172.
number of affinization with epsilon = 3 is 34
average number of affinization = 20.472847168347556
Path 150 | total_timesteps 5210.
number of affinization with epsilon = 3 is 26
average number of affinization = 20.47499030632028
Path 151 | total_timesteps 5242.
number of affinization with epsilon = 3 is 13
average number of affinization = 20.472093023255812
Path 152 | total_timesteps 5257.
number of affinization with epsilon = 3 is 27
average number of affinization = 20.474622239442077
Path 153 | total_timesteps 5287.
number of affinization with epsilon = 3 is 13
average number of affinization = 20.47172734314485
Path 154 | total_timesteps 5303.
number of affinization with epsilon = 3 is 38
average number of affinization = 20.478513356562136
Path 155 | total_timesteps 5350.
number of affinization with epsilon = 3 is 26
average number of affinization = 20.480650154798763
Path 156 | total_timesteps 5379.
number of affinization with epsilon = 3 is 46
average number of affinization = 20.490522243713734
Path 157 | total_timesteps 5428.
number of affinization with epsilon = 3 is 54
average number of affinization = 20.503480278422273
Path 158 | total_timesteps 5492.
number of affinization with epsilon = 3 is 29
average number of affinization = 20.50676459219173
Path 159 | total_timesteps 5528.
number of affinization with epsilon = 3 is 31
average number of affinization = 20.51081916537867
Path 160 | total_timesteps 5571.
number of affinization with epsilon = 3 is 41
average number of affinization = 20.518733101583624
Path 161 | total_timesteps 5617.
number of affinization with epsilon = 3 is 36
average number of affinization = 20.524710424710424
Path 162 | total_timesteps 5660.
number of affinization with epsilon = 3 is 18
average number of affinization = 20.523736009262834
Path 163 | total_timesteps 5682.
number of affinization with epsilon = 3 is 37
average number of affinization = 20.53009259259259
Path 164 | total_timesteps 5723.
number of affinization with epsilon = 3 is 15
average number of affinization = 20.52795989201697
Path 165 | total_timesteps 5743.
number of affinization with epsilon = 3 is 47
average number of affinization = 20.53816499614495
Path 166 | total_timesteps 5796.
number of affinization with epsilon = 3 is 23
average number of affinization = 20.53911368015414
Path 167 | total_timesteps 5823.
number of affinization with epsilon = 3 is 67
average number of affinization = 20.557010785824346
Path 168 | total_timesteps 5902.
number of affinization with epsilon = 3 is 29
average number of affinization = 20.56026184058529
Path 169 | total_timesteps 5936.
number of affinization with epsilon = 3 is 37
average number of affinization = 20.566589684372595
Path 170 | total_timesteps 5978.
number of affinization with epsilon = 3 is 46
average number of affinization = 20.576375529049635
Done generating on-policy rollouts.
Updating normalization.
Done updating normalization.
----------------------------
| AverageReturn | -6.07    |
| Iteration     | 10       |
| MaximumReturn | 49.6     |
| MinimumReturn | -36.9    |
| TotalSamples  | 48167    |
----------------------------
itr #11 | 
Fitting dynamics.
Fitting model 0 (0-based) in the ensemble of 2 models
Validation loss = 0.02171776257455349
Validation loss = 0.019987381994724274
Validation loss = 0.020332220941781998
Validation loss = 0.020574383437633514
Validation loss = 0.021306687965989113
Validation loss = 0.02162916213274002
Fitting model 1 (0-based) in the ensemble of 2 models
Validation loss = 0.020909860730171204
Validation loss = 0.02060786820948124
Validation loss = 0.020436802878975868
Validation loss = 0.019755525514483452
Validation loss = 0.020102521404623985
Validation loss = 0.019543267786502838
Validation loss = 0.019593166187405586
Validation loss = 0.020870162174105644
Validation loss = 0.019500313326716423
Validation loss = 0.01993572525680065
Validation loss = 0.019880488514900208
Validation loss = 0.019149400293827057
Validation loss = 0.019226403906941414
Validation loss = 0.018966883420944214
Validation loss = 0.02242855727672577
Validation loss = 0.01996503211557865
Validation loss = 0.02014213241636753
Validation loss = 0.019936317577958107
Done fitting dynamics.
Updating randomness.
Done updating randomness.
Training policy using TRPO.
Re-initialize init_std.
Obtaining samples for iteration 0...
Obtaining samples for iteration 1...
Obtaining samples for iteration 2...
Obtaining samples for iteration 3...
Obtaining samples for iteration 4...
Obtaining samples for iteration 5...
Obtaining samples for iteration 6...
Obtaining samples for iteration 7...
Obtaining samples for iteration 8...
Obtaining samples for iteration 9...
Obtaining samples for iteration 10...
Obtaining samples for iteration 11...
Obtaining samples for iteration 12...
Obtaining samples for iteration 13...
Obtaining samples for iteration 14...
Obtaining samples for iteration 15...
Obtaining samples for iteration 16...
Obtaining samples for iteration 17...
Obtaining samples for iteration 18...
Obtaining samples for iteration 19...
Done training policy.
Generating on-policy rollouts.
Path 0 | total_timesteps 0.
number of affinization with epsilon = 3 is 32
average number of affinization = 20.58076923076923
Path 1 | total_timesteps 38.
number of affinization with epsilon = 3 is 8
average number of affinization = 20.5759323337178
Path 2 | total_timesteps 48.
number of affinization with epsilon = 3 is 20
average number of affinization = 20.575710991544966
Path 3 | total_timesteps 78.
number of affinization with epsilon = 3 is 27
average number of affinization = 20.578179024202843
Path 4 | total_timesteps 113.
number of affinization with epsilon = 3 is 41
average number of affinization = 20.586021505376344
Path 5 | total_timesteps 164.
number of affinization with epsilon = 3 is 35
average number of affinization = 20.591554702495202
Path 6 | total_timesteps 201.
number of affinization with epsilon = 3 is 37
average number of affinization = 20.597851112816578
Path 7 | total_timesteps 244.
number of affinization with epsilon = 3 is 36
average number of affinization = 20.603759110088223
Path 8 | total_timesteps 290.
number of affinization with epsilon = 3 is 29
average number of affinization = 20.60697852760736
Path 9 | total_timesteps 324.
number of affinization with epsilon = 3 is 22
average number of affinization = 20.60751245688003
Path 10 | total_timesteps 352.
number of affinization with epsilon = 3 is 20
average number of affinization = 20.60727969348659
Path 11 | total_timesteps 375.
number of affinization with epsilon = 3 is 26
average number of affinization = 20.60934507851398
Path 12 | total_timesteps 406.
number of affinization with epsilon = 3 is 11
average number of affinization = 20.605666156202144
Path 13 | total_timesteps 420.
number of affinization with epsilon = 3 is 38
average number of affinization = 20.612323000382702
Path 14 | total_timesteps 462.
number of affinization with epsilon = 3 is 14
average number of affinization = 20.609793420045907
Path 15 | total_timesteps 478.
number of affinization with epsilon = 3 is 11
average number of affinization = 20.606118546845124
Path 16 | total_timesteps 495.
number of affinization with epsilon = 3 is 13
average number of affinization = 20.603211009174313
Path 17 | total_timesteps 509.
number of affinization with epsilon = 3 is 29
average number of affinization = 20.6064195643867
Path 18 | total_timesteps 546.
number of affinization with epsilon = 3 is 26
average number of affinization = 20.60847975553858
Path 19 | total_timesteps 579.
number of affinization with epsilon = 3 is 20
average number of affinization = 20.608247422680414
Path 20 | total_timesteps 604.
number of affinization with epsilon = 3 is 44
average number of affinization = 20.617175572519084
Path 21 | total_timesteps 657.
number of affinization with epsilon = 3 is 28
average number of affinization = 20.619992369324684
Path 22 | total_timesteps 690.
number of affinization with epsilon = 3 is 28
average number of affinization = 20.62280701754386
Path 23 | total_timesteps 725.
number of affinization with epsilon = 3 is 31
average number of affinization = 20.626763248189096
Path 24 | total_timesteps 758.
number of affinization with epsilon = 3 is 11
average number of affinization = 20.623094512195124
Path 25 | total_timesteps 773.
number of affinization with epsilon = 3 is 28
average number of affinization = 20.625904761904764
Path 26 | total_timesteps 808.
number of affinization with epsilon = 3 is 16
average number of affinization = 20.624143183549123
Path 27 | total_timesteps 826.
number of affinization with epsilon = 3 is 43
average number of affinization = 20.63266082984393
Path 28 | total_timesteps 876.
number of affinization with epsilon = 3 is 13
average number of affinization = 20.629756468797563
Path 29 | total_timesteps 894.
number of affinization with epsilon = 3 is 24
average number of affinization = 20.631038417649297
Path 30 | total_timesteps 926.
number of affinization with epsilon = 3 is 15
average number of affinization = 20.628897338403043
Path 31 | total_timesteps 943.
number of affinization with epsilon = 3 is 13
average number of affinization = 20.62599771949829
Path 32 | total_timesteps 957.
number of affinization with epsilon = 3 is 13
average number of affinization = 20.623100303951368
Path 33 | total_timesteps 973.
number of affinization with epsilon = 3 is 26
average number of affinization = 20.625142423091532
Path 34 | total_timesteps 1004.
number of affinization with epsilon = 3 is 37
average number of affinization = 20.631359149582384
Path 35 | total_timesteps 1050.
number of affinization with epsilon = 3 is 11
average number of affinization = 20.627703984819735
Path 36 | total_timesteps 1066.
number of affinization with epsilon = 3 is 44
average number of affinization = 20.636570561456754
Path 37 | total_timesteps 1116.
number of affinization with epsilon = 3 is 13
average number of affinization = 20.633674630261662
Path 38 | total_timesteps 1135.
number of affinization with epsilon = 3 is 25
average number of affinization = 20.63532979529947
Path 39 | total_timesteps 1166.
number of affinization with epsilon = 3 is 22
average number of affinization = 20.63584691170898
Path 40 | total_timesteps 1191.
number of affinization with epsilon = 3 is 14
average number of affinization = 20.633333333333333
Path 41 | total_timesteps 1207.
number of affinization with epsilon = 3 is 16
average number of affinization = 20.63157894736842
Path 42 | total_timesteps 1228.
number of affinization with epsilon = 3 is 21
average number of affinization = 20.631718395155186
Path 43 | total_timesteps 1258.
number of affinization with epsilon = 3 is 8
average number of affinization = 20.626939084373817
Path 44 | total_timesteps 1272.
number of affinization with epsilon = 3 is 20
average number of affinization = 20.626701966717096
Path 45 | total_timesteps 1296.
number of affinization with epsilon = 3 is 11
average number of affinization = 20.623062381852552
Path 46 | total_timesteps 1310.
number of affinization with epsilon = 3 is 30
average number of affinization = 20.626606198034768
Path 47 | total_timesteps 1349.
number of affinization with epsilon = 3 is 21
average number of affinization = 20.626747261050244
Path 48 | total_timesteps 1376.
number of affinization with epsilon = 3 is 10
average number of affinization = 20.62273413897281
Path 49 | total_timesteps 1390.
number of affinization with epsilon = 3 is 42
average number of affinization = 20.630804077010193
Path 50 | total_timesteps 1436.
number of affinization with epsilon = 3 is 20
average number of affinization = 20.63056603773585
Path 51 | total_timesteps 1460.
number of affinization with epsilon = 3 is 39
average number of affinization = 20.637495284798188
Path 52 | total_timesteps 1504.
number of affinization with epsilon = 3 is 10
average number of affinization = 20.63348416289593
Path 53 | total_timesteps 1516.
number of affinization with epsilon = 3 is 27
average number of affinization = 20.63588390501319
Path 54 | total_timesteps 1548.
number of affinization with epsilon = 3 is 9
average number of affinization = 20.63149962321025
Path 55 | total_timesteps 1559.
number of affinization with epsilon = 3 is 24
average number of affinization = 20.63276836158192
Path 56 | total_timesteps 1587.
number of affinization with epsilon = 3 is 19
average number of affinization = 20.63215361445783
Path 57 | total_timesteps 1613.
number of affinization with epsilon = 3 is 16
average number of affinization = 20.630410237109523
Path 58 | total_timesteps 1630.
number of affinization with epsilon = 3 is 35
average number of affinization = 20.63581640331076
Path 59 | total_timesteps 1673.
number of affinization with epsilon = 3 is 49
average number of affinization = 20.64648364046634
Path 60 | total_timesteps 1727.
number of affinization with epsilon = 3 is 19
average number of affinization = 20.645864661654134
Path 61 | total_timesteps 1752.
number of affinization with epsilon = 3 is 12
average number of affinization = 20.64261555806088
Path 62 | total_timesteps 1766.
number of affinization with epsilon = 3 is 21
average number of affinization = 20.6427498121713
Path 63 | total_timesteps 1790.
number of affinization with epsilon = 3 is 9
average number of affinization = 20.63837776943297
Path 64 | total_timesteps 1803.
number of affinization with epsilon = 3 is 10
average number of affinization = 20.634384384384383
Path 65 | total_timesteps 1818.
number of affinization with epsilon = 3 is 17
average number of affinization = 20.633020637898685
Path 66 | total_timesteps 1841.
number of affinization with epsilon = 3 is 7
average number of affinization = 20.627906976744185
Path 67 | total_timesteps 1850.
number of affinization with epsilon = 3 is 6
average number of affinization = 20.622422197225347
Path 68 | total_timesteps 1860.
number of affinization with epsilon = 3 is 22
average number of affinization = 20.622938530734633
Path 69 | total_timesteps 1887.
number of affinization with epsilon = 3 is 4
average number of affinization = 20.616710378418883
Path 70 | total_timesteps 1897.
number of affinization with epsilon = 3 is 39
average number of affinization = 20.623595505617978
Path 71 | total_timesteps 1941.
number of affinization with epsilon = 3 is 32
average number of affinization = 20.627854736053912
Path 72 | total_timesteps 1978.
number of affinization with epsilon = 3 is 9
average number of affinization = 20.623502994011975
Path 73 | total_timesteps 1993.
number of affinization with epsilon = 3 is 59
average number of affinization = 20.637860082304528
Path 74 | total_timesteps 2060.
number of affinization with epsilon = 3 is 44
average number of affinization = 20.646596858638745
Path 75 | total_timesteps 2113.
number of affinization with epsilon = 3 is 31
average number of affinization = 20.650467289719625
Path 76 | total_timesteps 2152.
number of affinization with epsilon = 3 is 23
average number of affinization = 20.65134529147982
Path 77 | total_timesteps 2180.
number of affinization with epsilon = 3 is 15
average number of affinization = 20.649234217407546
Path 78 | total_timesteps 2197.
number of affinization with epsilon = 3 is 21
average number of affinization = 20.64936519790889
Path 79 | total_timesteps 2221.
number of affinization with epsilon = 3 is 10
average number of affinization = 20.645390070921987
Path 80 | total_timesteps 2237.
number of affinization with epsilon = 3 is 24
average number of affinization = 20.646641791044775
Path 81 | total_timesteps 2265.
number of affinization with epsilon = 3 is 27
average number of affinization = 20.649011562849683
Path 82 | total_timesteps 2296.
number of affinization with epsilon = 3 is 10
average number of affinization = 20.64504101416853
Path 83 | total_timesteps 2310.
number of affinization with epsilon = 3 is 44
average number of affinization = 20.653745806932537
Path 84 | total_timesteps 2360.
number of affinization with epsilon = 3 is 38
average number of affinization = 20.660208643815203
Path 85 | total_timesteps 2404.
number of affinization with epsilon = 3 is 17
average number of affinization = 20.65884543761639
Path 86 | total_timesteps 2426.
number of affinization with epsilon = 3 is 14
average number of affinization = 20.656366344005956
Path 87 | total_timesteps 2445.
number of affinization with epsilon = 3 is 17
average number of affinization = 20.65500558243394
Path 88 | total_timesteps 2467.
number of affinization with epsilon = 3 is 18
average number of affinization = 20.654017857142858
Path 89 | total_timesteps 2487.
number of affinization with epsilon = 3 is 42
average number of affinization = 20.661956117515807
Path 90 | total_timesteps 2537.
number of affinization with epsilon = 3 is 25
average number of affinization = 20.6635687732342
Path 91 | total_timesteps 2565.
number of affinization with epsilon = 3 is 17
average number of affinization = 20.662207357859533
Path 92 | total_timesteps 2586.
number of affinization with epsilon = 3 is 15
average number of affinization = 20.66010401188707
Path 93 | total_timesteps 2602.
number of affinization with epsilon = 3 is 12
average number of affinization = 20.65688822874118
Path 94 | total_timesteps 2619.
number of affinization with epsilon = 3 is 60
average number of affinization = 20.671492204899778
Path 95 | total_timesteps 2697.
number of affinization with epsilon = 3 is 44
average number of affinization = 20.680148423005566
Path 96 | total_timesteps 2743.
number of affinization with epsilon = 3 is 22
average number of affinization = 20.680637982195847
Path 97 | total_timesteps 2768.
number of affinization with epsilon = 3 is 22
average number of affinization = 20.681127178346312
Path 98 | total_timesteps 2798.
number of affinization with epsilon = 3 is 11
average number of affinization = 20.677538917716827
Path 99 | total_timesteps 2812.
number of affinization with epsilon = 3 is 16
average number of affinization = 20.67580585402001
Path 100 | total_timesteps 2831.
number of affinization with epsilon = 3 is 32
average number of affinization = 20.68
Path 101 | total_timesteps 2868.
number of affinization with epsilon = 3 is 11
average number of affinization = 20.67641614216957
Path 102 | total_timesteps 2881.
number of affinization with epsilon = 3 is 26
average number of affinization = 20.67838638045892
Path 103 | total_timesteps 2912.
number of affinization with epsilon = 3 is 15
average number of affinization = 20.676285608583054
Path 104 | total_timesteps 2932.
number of affinization with epsilon = 3 is 16
average number of affinization = 20.674556213017752
Path 105 | total_timesteps 2952.
number of affinization with epsilon = 3 is 6
average number of affinization = 20.66913123844732
Path 106 | total_timesteps 2962.
number of affinization with epsilon = 3 is 34
average number of affinization = 20.674057649667407
Path 107 | total_timesteps 3004.
number of affinization with epsilon = 3 is 26
average number of affinization = 20.676025120059105
Path 108 | total_timesteps 3036.
number of affinization with epsilon = 3 is 26
average number of affinization = 20.677991137370753
Path 109 | total_timesteps 3064.
number of affinization with epsilon = 3 is 15
average number of affinization = 20.675895164267256
Path 110 | total_timesteps 3086.
number of affinization with epsilon = 3 is 23
average number of affinization = 20.676752767527674
Path 111 | total_timesteps 3111.
number of affinization with epsilon = 3 is 14
average number of affinization = 20.67428992991516
Path 112 | total_timesteps 3131.
number of affinization with epsilon = 3 is 25
average number of affinization = 20.675884955752213
Path 113 | total_timesteps 3161.
number of affinization with epsilon = 3 is 20
average number of affinization = 20.675635827497235
Path 114 | total_timesteps 3183.
number of affinization with epsilon = 3 is 29
average number of affinization = 20.67870302137067
Path 115 | total_timesteps 3221.
number of affinization with epsilon = 3 is 21
average number of affinization = 20.678821362799262
Path 116 | total_timesteps 3244.
number of affinization with epsilon = 3 is 19
average number of affinization = 20.67820324005891
Path 117 | total_timesteps 3267.
number of affinization with epsilon = 3 is 23
average number of affinization = 20.679057784320943
Path 118 | total_timesteps 3293.
number of affinization with epsilon = 3 is 19
average number of affinization = 20.678440029433407
Path 119 | total_timesteps 3317.
number of affinization with epsilon = 3 is 10
average number of affinization = 20.674512688488417
Path 120 | total_timesteps 3329.
number of affinization with epsilon = 3 is 19
average number of affinization = 20.67389705882353
Path 121 | total_timesteps 3350.
number of affinization with epsilon = 3 is 20
average number of affinization = 20.67364939360529
Path 122 | total_timesteps 3372.
number of affinization with epsilon = 3 is 15
average number of affinization = 20.671565025716387
Path 123 | total_timesteps 3390.
number of affinization with epsilon = 3 is 24
average number of affinization = 20.672787366874772
Path 124 | total_timesteps 3418.
number of affinization with epsilon = 3 is 24
average number of affinization = 20.674008810572687
Path 125 | total_timesteps 3448.
number of affinization with epsilon = 3 is 13
average number of affinization = 20.67119266055046
Path 126 | total_timesteps 3463.
number of affinization with epsilon = 3 is 25
average number of affinization = 20.672780630961114
Path 127 | total_timesteps 3491.
number of affinization with epsilon = 3 is 16
average number of affinization = 20.67106710671067
Path 128 | total_timesteps 3512.
number of affinization with epsilon = 3 is 22
average number of affinization = 20.671554252199414
Path 129 | total_timesteps 3540.
number of affinization with epsilon = 3 is 21
average number of affinization = 20.671674606082814
Path 130 | total_timesteps 3566.
number of affinization with epsilon = 3 is 43
average number of affinization = 20.67985347985348
Path 131 | total_timesteps 3616.
number of affinization with epsilon = 3 is 24
average number of affinization = 20.68106920541926
Path 132 | total_timesteps 3648.
number of affinization with epsilon = 3 is 30
average number of affinization = 20.684480234260615
Path 133 | total_timesteps 3683.
number of affinization with epsilon = 3 is 18
average number of affinization = 20.68349798755946
Path 134 | total_timesteps 3705.
number of affinization with epsilon = 3 is 19
average number of affinization = 20.68288222384784
Path 135 | total_timesteps 3731.
number of affinization with epsilon = 3 is 10
average number of affinization = 20.678976234003656
Path 136 | total_timesteps 3742.
number of affinization with epsilon = 3 is 10
average number of affinization = 20.675073099415204
Path 137 | total_timesteps 3754.
number of affinization with epsilon = 3 is 10
average number of affinization = 20.67117281695287
Path 138 | total_timesteps 3767.
number of affinization with epsilon = 3 is 31
average number of affinization = 20.674945215485756
Path 139 | total_timesteps 3801.
number of affinization with epsilon = 3 is 23
average number of affinization = 20.67579408543264
Path 140 | total_timesteps 3826.
number of affinization with epsilon = 3 is 16
average number of affinization = 20.674087591240877
Path 141 | total_timesteps 3844.
number of affinization with epsilon = 3 is 13
average number of affinization = 20.671287851149216
Path 142 | total_timesteps 3860.
number of affinization with epsilon = 3 is 12
average number of affinization = 20.66812545587163
Path 143 | total_timesteps 3875.
number of affinization with epsilon = 3 is 13
average number of affinization = 20.665329930732774
Path 144 | total_timesteps 3893.
number of affinization with epsilon = 3 is 22
average number of affinization = 20.665816326530614
Path 145 | total_timesteps 3918.
number of affinization with epsilon = 3 is 11
average number of affinization = 20.662295081967212
Path 146 | total_timesteps 3932.
number of affinization with epsilon = 3 is 25
average number of affinization = 20.663874726875456
Path 147 | total_timesteps 3960.
number of affinization with epsilon = 3 is 50
average number of affinization = 20.674554058973424
Path 148 | total_timesteps 4024.
number of affinization with epsilon = 3 is 15
average number of affinization = 20.67248908296943
Path 149 | total_timesteps 4047.
number of affinization with epsilon = 3 is 24
average number of affinization = 20.673699527100762
Path 150 | total_timesteps 4075.
number of affinization with epsilon = 3 is 21
average number of affinization = 20.67381818181818
Path 151 | total_timesteps 4098.
number of affinization with epsilon = 3 is 8
average number of affinization = 20.669211195928753
Path 152 | total_timesteps 4108.
number of affinization with epsilon = 3 is 18
average number of affinization = 20.66824127906977
Path 153 | total_timesteps 4132.
number of affinization with epsilon = 3 is 27
average number of affinization = 20.670541227751542
Path 154 | total_timesteps 4162.
number of affinization with epsilon = 3 is 25
average number of affinization = 20.67211328976035
Path 155 | total_timesteps 4191.
number of affinization with epsilon = 3 is 21
average number of affinization = 20.67223230490018
Path 156 | total_timesteps 4217.
number of affinization with epsilon = 3 is 31
average number of affinization = 20.675979680696663
Path 157 | total_timesteps 4256.
number of affinization with epsilon = 3 is 16
average number of affinization = 20.674283641639462
Path 158 | total_timesteps 4273.
number of affinization with epsilon = 3 is 11
average number of affinization = 20.67077592458303
Path 159 | total_timesteps 4289.
number of affinization with epsilon = 3 is 21
average number of affinization = 20.670895251902863
Path 160 | total_timesteps 4314.
number of affinization with epsilon = 3 is 26
average number of affinization = 20.672826086956523
Path 161 | total_timesteps 4344.
number of affinization with epsilon = 3 is 9
average number of affinization = 20.66859833393698
Path 162 | total_timesteps 4355.
number of affinization with epsilon = 3 is 17
average number of affinization = 20.667270094134686
Path 163 | total_timesteps 4378.
number of affinization with epsilon = 3 is 60
average number of affinization = 20.681505609844372
Path 164 | total_timesteps 4456.
number of affinization with epsilon = 3 is 12
average number of affinization = 20.67836468885673
Path 165 | total_timesteps 4471.
number of affinization with epsilon = 3 is 18
average number of affinization = 20.67739602169982
Path 166 | total_timesteps 4496.
number of affinization with epsilon = 3 is 14
average number of affinization = 20.674981923355027
Path 167 | total_timesteps 4513.
number of affinization with epsilon = 3 is 20
average number of affinization = 20.674737983375497
Path 168 | total_timesteps 4538.
number of affinization with epsilon = 3 is 24
average number of affinization = 20.67593930635838
Path 169 | total_timesteps 4567.
number of affinization with epsilon = 3 is 17
average number of affinization = 20.674611773203324
Path 170 | total_timesteps 4585.
number of affinization with epsilon = 3 is 19
average number of affinization = 20.674007220216605
Path 171 | total_timesteps 4609.
number of affinization with epsilon = 3 is 25
average number of affinization = 20.675568386863947
Path 172 | total_timesteps 4640.
number of affinization with epsilon = 3 is 12
average number of affinization = 20.672438672438673
Path 173 | total_timesteps 4658.
number of affinization with epsilon = 3 is 19
average number of affinization = 20.671835557158314
Path 174 | total_timesteps 4680.
number of affinization with epsilon = 3 is 40
average number of affinization = 20.678803172314346
Path 175 | total_timesteps 4725.
number of affinization with epsilon = 3 is 25
average number of affinization = 20.68036036036036
Path 176 | total_timesteps 4752.
number of affinization with epsilon = 3 is 32
average number of affinization = 20.68443804034582
Path 177 | total_timesteps 4791.
number of affinization with epsilon = 3 is 19
average number of affinization = 20.683831472812386
Path 178 | total_timesteps 4815.
number of affinization with epsilon = 3 is 18
average number of affinization = 20.682865370770337
Path 179 | total_timesteps 4836.
number of affinization with epsilon = 3 is 9
average number of affinization = 20.678661388988846
Path 180 | total_timesteps 4848.
number of affinization with epsilon = 3 is 43
average number of affinization = 20.686690647482013
Path 181 | total_timesteps 4903.
number of affinization with epsilon = 3 is 27
average number of affinization = 20.68896080546566
Path 182 | total_timesteps 4936.
number of affinization with epsilon = 3 is 8
average number of affinization = 20.684399712437095
Path 183 | total_timesteps 4946.
number of affinization with epsilon = 3 is 17
average number of affinization = 20.68307581746317
Path 184 | total_timesteps 4972.
number of affinization with epsilon = 3 is 30
average number of affinization = 20.686422413793103
Path 185 | total_timesteps 5008.
number of affinization with epsilon = 3 is 18
average number of affinization = 20.685457809694793
Path 186 | total_timesteps 5029.
number of affinization with epsilon = 3 is 16
average number of affinization = 20.683776022972
Path 187 | total_timesteps 5047.
number of affinization with epsilon = 3 is 10
average number of affinization = 20.67994259059921
Path 188 | total_timesteps 5062.
number of affinization with epsilon = 3 is 15
average number of affinization = 20.67790530846485
Path 189 | total_timesteps 5079.
number of affinization with epsilon = 3 is 23
average number of affinization = 20.67873789888849
Path 190 | total_timesteps 5106.
number of affinization with epsilon = 3 is 31
average number of affinization = 20.682437275985663
Path 191 | total_timesteps 5144.
number of affinization with epsilon = 3 is 22
average number of affinization = 20.682909351486924
Path 192 | total_timesteps 5169.
number of affinization with epsilon = 3 is 21
average number of affinization = 20.683022922636102
Path 193 | total_timesteps 5194.
number of affinization with epsilon = 3 is 23
average number of affinization = 20.683852488363765
Path 194 | total_timesteps 5220.
number of affinization with epsilon = 3 is 10
average number of affinization = 20.680028632784538
Path 195 | total_timesteps 5234.
number of affinization with epsilon = 3 is 18
average number of affinization = 20.67906976744186
Path 196 | total_timesteps 5257.
number of affinization with epsilon = 3 is 12
average number of affinization = 20.675965665236053
Path 197 | total_timesteps 5278.
number of affinization with epsilon = 3 is 26
average number of affinization = 20.67786914551305
Path 198 | total_timesteps 5309.
number of affinization with epsilon = 3 is 23
average number of affinization = 20.678699070764832
Path 199 | total_timesteps 5339.
number of affinization with epsilon = 3 is 25
average number of affinization = 20.68024294390854
Path 200 | total_timesteps 5368.
number of affinization with epsilon = 3 is 17
average number of affinization = 20.67892857142857
Path 201 | total_timesteps 5392.
number of affinization with epsilon = 3 is 51
average number of affinization = 20.689753659407355
Path 202 | total_timesteps 5455.
number of affinization with epsilon = 3 is 13
average number of affinization = 20.687009279086368
Path 203 | total_timesteps 5469.
number of affinization with epsilon = 3 is 27
average number of affinization = 20.68926150552979
Path 204 | total_timesteps 5503.
number of affinization with epsilon = 3 is 28
average number of affinization = 20.691868758915835
Path 205 | total_timesteps 5534.
number of affinization with epsilon = 3 is 22
average number of affinization = 20.692335115864527
Path 206 | total_timesteps 5559.
number of affinization with epsilon = 3 is 21
average number of affinization = 20.692444761225943
Path 207 | total_timesteps 5588.
number of affinization with epsilon = 3 is 11
average number of affinization = 20.68899180619879
Path 208 | total_timesteps 5604.
number of affinization with epsilon = 3 is 16
average number of affinization = 20.687321937321936
Path 209 | total_timesteps 5623.
number of affinization with epsilon = 3 is 17
average number of affinization = 20.686009255962976
Path 210 | total_timesteps 5642.
number of affinization with epsilon = 3 is 8
average number of affinization = 20.681494661921707
Path 211 | total_timesteps 5655.
number of affinization with epsilon = 3 is 20
average number of affinization = 20.68125222340804
Path 212 | total_timesteps 5677.
number of affinization with epsilon = 3 is 20
average number of affinization = 20.681009957325745
Path 213 | total_timesteps 5701.
number of affinization with epsilon = 3 is 19
average number of affinization = 20.68041237113402
Path 214 | total_timesteps 5727.
number of affinization with epsilon = 3 is 11
average number of affinization = 20.676972281449892
Path 215 | total_timesteps 5740.
number of affinization with epsilon = 3 is 22
average number of affinization = 20.677442273534634
Path 216 | total_timesteps 5769.
number of affinization with epsilon = 3 is 16
average number of affinization = 20.67578125
Path 217 | total_timesteps 5788.
number of affinization with epsilon = 3 is 12
average number of affinization = 20.672701455449058
Path 218 | total_timesteps 5803.
number of affinization with epsilon = 3 is 27
average number of affinization = 20.674946770759405
Path 219 | total_timesteps 5835.
number of affinization with epsilon = 3 is 53
average number of affinization = 20.68641362185172
Path 220 | total_timesteps 5898.
number of affinization with epsilon = 3 is 15
average number of affinization = 20.68439716312057
Path 221 | total_timesteps 5919.
number of affinization with epsilon = 3 is 8
average number of affinization = 20.679900744416873
Path 222 | total_timesteps 5931.
number of affinization with epsilon = 3 is 27
average number of affinization = 20.68214032600992
Path 223 | total_timesteps 5964.
number of affinization with epsilon = 3 is 15
average number of affinization = 20.680127523910734
Path 224 | total_timesteps 5985.
number of affinization with epsilon = 3 is 10
average number of affinization = 20.676345609065155
Path 225 | total_timesteps 5997.
number of affinization with epsilon = 3 is 12
average number of affinization = 20.673274336283185
Done generating on-policy rollouts.
Updating normalization.
Done updating normalization.
----------------------------
| AverageReturn | -6.19    |
| Iteration     | 11       |
| MaximumReturn | 30       |
| MinimumReturn | -23.8    |
| TotalSamples  | 52174    |
----------------------------
itr #12 | 
Fitting dynamics.
Fitting model 0 (0-based) in the ensemble of 2 models
Validation loss = 0.020826280117034912
Validation loss = 0.020672056823968887
Validation loss = 0.020011961460113525
Validation loss = 0.020708542317152023
Validation loss = 0.019828524440526962
Validation loss = 0.019482186064124107
Validation loss = 0.019532866775989532
Validation loss = 0.019315533339977264
Validation loss = 0.019692212343215942
Validation loss = 0.019313456490635872
Validation loss = 0.0195115115493536
Validation loss = 0.019308729097247124
Validation loss = 0.019568711519241333
Validation loss = 0.02042273059487343
Validation loss = 0.01923235133290291
Validation loss = 0.01939871534705162
Validation loss = 0.019535543397068977
Validation loss = 0.01943577080965042
Validation loss = 0.018914295360445976
Validation loss = 0.02065816894173622
Validation loss = 0.01970333606004715
Validation loss = 0.02119387499988079
Validation loss = 0.019956111907958984
Fitting model 1 (0-based) in the ensemble of 2 models
Validation loss = 0.02054438181221485
Validation loss = 0.019696978852152824
Validation loss = 0.019314255565404892
Validation loss = 0.019792567938566208
Validation loss = 0.02147086150944233
Validation loss = 0.019033726304769516
Validation loss = 0.0198768749833107
Validation loss = 0.020120196044445038
Validation loss = 0.019324688240885735
Validation loss = 0.020281903445720673
Done fitting dynamics.
Updating randomness.
Done updating randomness.
Training policy using TRPO.
Re-initialize init_std.
Obtaining samples for iteration 0...
Obtaining samples for iteration 1...
Obtaining samples for iteration 2...
Obtaining samples for iteration 3...
Obtaining samples for iteration 4...
Obtaining samples for iteration 5...
Obtaining samples for iteration 6...
Obtaining samples for iteration 7...
Obtaining samples for iteration 8...
Obtaining samples for iteration 9...
Obtaining samples for iteration 10...
Obtaining samples for iteration 11...
Obtaining samples for iteration 12...
Obtaining samples for iteration 13...
Obtaining samples for iteration 14...
Obtaining samples for iteration 15...
Obtaining samples for iteration 16...
Obtaining samples for iteration 17...
Obtaining samples for iteration 18...
Obtaining samples for iteration 19...
Done training policy.
Generating on-policy rollouts.
Path 0 | total_timesteps 0.
number of affinization with epsilon = 3 is 20
average number of affinization = 20.673036093418258
Path 1 | total_timesteps 28.
number of affinization with epsilon = 3 is 21
average number of affinization = 20.673151750972764
Path 2 | total_timesteps 53.
number of affinization with epsilon = 3 is 27
average number of affinization = 20.675388967468177
Path 3 | total_timesteps 86.
number of affinization with epsilon = 3 is 20
average number of affinization = 20.67515022976317
Path 4 | total_timesteps 111.
number of affinization with epsilon = 3 is 18
average number of affinization = 20.674204946996465
Path 5 | total_timesteps 130.
number of affinization with epsilon = 3 is 9
average number of affinization = 20.6700812433769
Path 6 | total_timesteps 141.
number of affinization with epsilon = 3 is 22
average number of affinization = 20.670550847457626
Path 7 | total_timesteps 166.
number of affinization with epsilon = 3 is 10
average number of affinization = 20.66678432756795
Path 8 | total_timesteps 177.
number of affinization with epsilon = 3 is 11
average number of affinization = 20.663373323923782
Path 9 | total_timesteps 190.
number of affinization with epsilon = 3 is 18
average number of affinization = 20.66243386243386
Path 10 | total_timesteps 213.
number of affinization with epsilon = 3 is 15
average number of affinization = 20.660437235543018
Path 11 | total_timesteps 233.
number of affinization with epsilon = 3 is 31
average number of affinization = 20.664081776524498
Path 12 | total_timesteps 268.
number of affinization with epsilon = 3 is 26
average number of affinization = 20.66596194503171
Path 13 | total_timesteps 302.
number of affinization with epsilon = 3 is 28
average number of affinization = 20.668545262416345
Path 14 | total_timesteps 332.
number of affinization with epsilon = 3 is 13
average number of affinization = 20.665845070422534
Path 15 | total_timesteps 348.
number of affinization with epsilon = 3 is 21
average number of affinization = 20.665962689193947
Path 16 | total_timesteps 375.
number of affinization with epsilon = 3 is 23
average number of affinization = 20.666783954961296
Path 17 | total_timesteps 402.
number of affinization with epsilon = 3 is 22
average number of affinization = 20.667252901864227
Path 18 | total_timesteps 429.
number of affinization with epsilon = 3 is 17
average number of affinization = 20.665963431786217
Path 19 | total_timesteps 447.
number of affinization with epsilon = 3 is 19
average number of affinization = 20.66537785588752
Path 20 | total_timesteps 467.
number of affinization with epsilon = 3 is 9
average number of affinization = 20.661278988053407
Path 21 | total_timesteps 478.
number of affinization with epsilon = 3 is 23
average number of affinization = 20.662100456621005
Path 22 | total_timesteps 506.
number of affinization with epsilon = 3 is 22
average number of affinization = 20.6625702247191
Path 23 | total_timesteps 534.
number of affinization with epsilon = 3 is 19
average number of affinization = 20.661986661986663
Path 24 | total_timesteps 555.
number of affinization with epsilon = 3 is 22
average number of affinization = 20.662456140350876
Path 25 | total_timesteps 580.
number of affinization with epsilon = 3 is 9
average number of affinization = 20.65836548579446
Path 26 | total_timesteps 591.
number of affinization with epsilon = 3 is 16
average number of affinization = 20.656732117812062
Path 27 | total_timesteps 608.
number of affinization with epsilon = 3 is 30
average number of affinization = 20.66000701016474
Path 28 | total_timesteps 645.
number of affinization with epsilon = 3 is 31
average number of affinization = 20.66362999299229
Path 29 | total_timesteps 681.
number of affinization with epsilon = 3 is 11
average number of affinization = 20.660245183887916
Path 30 | total_timesteps 694.
number of affinization with epsilon = 3 is 17
average number of affinization = 20.658963585434172
Path 31 | total_timesteps 715.
number of affinization with epsilon = 3 is 12
average number of affinization = 20.65593279663983
Path 32 | total_timesteps 730.
number of affinization with epsilon = 3 is 7
average number of affinization = 20.651154653603918
Path 33 | total_timesteps 741.
number of affinization with epsilon = 3 is 10
average number of affinization = 20.647429171038826
Path 34 | total_timesteps 753.
number of affinization with epsilon = 3 is 14
average number of affinization = 20.645104895104897
Path 35 | total_timesteps 771.
number of affinization with epsilon = 3 is 8
average number of affinization = 20.64068507514855
Path 36 | total_timesteps 782.
number of affinization with epsilon = 3 is 4
average number of affinization = 20.63487071977638
Path 37 | total_timesteps 790.
number of affinization with epsilon = 3 is 10
average number of affinization = 20.631156129933636
Path 38 | total_timesteps 802.
number of affinization with epsilon = 3 is 21
average number of affinization = 20.631284916201118
Path 39 | total_timesteps 825.
number of affinization with epsilon = 3 is 33
average number of affinization = 20.635602094240838
Path 40 | total_timesteps 863.
number of affinization with epsilon = 3 is 25
average number of affinization = 20.63712491277041
Path 41 | total_timesteps 893.
number of affinization with epsilon = 3 is 18
average number of affinization = 20.636205092431112
Path 42 | total_timesteps 916.
number of affinization with epsilon = 3 is 8
average number of affinization = 20.631799163179917
Path 43 | total_timesteps 928.
number of affinization with epsilon = 3 is 75
average number of affinization = 20.65074939003137
Path 44 | total_timesteps 1011.
number of affinization with epsilon = 3 is 9
average number of affinization = 20.646689895470384
Path 45 | total_timesteps 1022.
number of affinization with epsilon = 3 is 19
average number of affinization = 20.64611633577151
Path 46 | total_timesteps 1045.
number of affinization with epsilon = 3 is 40
average number of affinization = 20.652855153203344
Path 47 | total_timesteps 1094.
number of affinization with epsilon = 3 is 23
average number of affinization = 20.653672119735468
Path 48 | total_timesteps 1118.
number of affinization with epsilon = 3 is 20
average number of affinization = 20.653444676409187
Path 49 | total_timesteps 1143.
number of affinization with epsilon = 3 is 9
average number of affinization = 20.649391304347827
Path 50 | total_timesteps 1156.
number of affinization with epsilon = 3 is 12
average number of affinization = 20.646383866481223
Path 51 | total_timesteps 1169.
number of affinization with epsilon = 3 is 26
average number of affinization = 20.64824469933959
Path 52 | total_timesteps 1197.
number of affinization with epsilon = 3 is 5
average number of affinization = 20.64280750521195
Path 53 | total_timesteps 1205.
number of affinization with epsilon = 3 is 33
average number of affinization = 20.647099687391457
Path 54 | total_timesteps 1244.
number of affinization with epsilon = 3 is 14
average number of affinization = 20.644791666666666
Path 55 | total_timesteps 1264.
number of affinization with epsilon = 3 is 14
average number of affinization = 20.642485248177717
Path 56 | total_timesteps 1279.
number of affinization with epsilon = 3 is 8
average number of affinization = 20.638098542678694
Path 57 | total_timesteps 1288.
number of affinization with epsilon = 3 is 9
average number of affinization = 20.634061741241762
Path 58 | total_timesteps 1299.
number of affinization with epsilon = 3 is 24
average number of affinization = 20.635228848821082
Path 59 | total_timesteps 1326.
number of affinization with epsilon = 3 is 10
average number of affinization = 20.6315424610052
Path 60 | total_timesteps 1340.
number of affinization with epsilon = 3 is 9
average number of affinization = 20.627512127512126
Path 61 | total_timesteps 1351.
number of affinization with epsilon = 3 is 14
average number of affinization = 20.625216487703497
Path 62 | total_timesteps 1369.
number of affinization with epsilon = 3 is 11
average number of affinization = 20.621883656509695
Path 63 | total_timesteps 1381.
number of affinization with epsilon = 3 is 33
average number of affinization = 20.626168224299064
Path 64 | total_timesteps 1423.
number of affinization with epsilon = 3 is 15
average number of affinization = 20.6242214532872
Path 65 | total_timesteps 1442.
number of affinization with epsilon = 3 is 30
average number of affinization = 20.62746454514009
Path 66 | total_timesteps 1475.
number of affinization with epsilon = 3 is 20
average number of affinization = 20.627247579529737
Path 67 | total_timesteps 1497.
number of affinization with epsilon = 3 is 25
average number of affinization = 20.628759073625993
Path 68 | total_timesteps 1529.
number of affinization with epsilon = 3 is 21
average number of affinization = 20.628887353144435
Path 69 | total_timesteps 1551.
number of affinization with epsilon = 3 is 32
average number of affinization = 20.632815198618307
Path 70 | total_timesteps 1587.
number of affinization with epsilon = 3 is 9
average number of affinization = 20.628798342541437
Path 71 | total_timesteps 1600.
number of affinization with epsilon = 3 is 17
average number of affinization = 20.627545736969278
Path 72 | total_timesteps 1620.
number of affinization with epsilon = 3 is 34
average number of affinization = 20.63216011042098
Path 73 | total_timesteps 1657.
number of affinization with epsilon = 3 is 15
average number of affinization = 20.63021731631597
Path 74 | total_timesteps 1679.
number of affinization with epsilon = 3 is 20
average number of affinization = 20.63
Path 75 | total_timesteps 1702.
number of affinization with epsilon = 3 is 8
average number of affinization = 20.62564632885212
Path 76 | total_timesteps 1711.
number of affinization with epsilon = 3 is 29
average number of affinization = 20.628532046864233
Path 77 | total_timesteps 1749.
number of affinization with epsilon = 3 is 25
average number of affinization = 20.630037891836032
Path 78 | total_timesteps 1775.
number of affinization with epsilon = 3 is 33
average number of affinization = 20.634297520661157
Path 79 | total_timesteps 1815.
number of affinization with epsilon = 3 is 25
average number of affinization = 20.63580034423408
Path 80 | total_timesteps 1846.
number of affinization with epsilon = 3 is 23
average number of affinization = 20.63661390227116
Path 81 | total_timesteps 1874.
number of affinization with epsilon = 3 is 11
average number of affinization = 20.633298933608533
Path 82 | total_timesteps 1886.
number of affinization with epsilon = 3 is 22
average number of affinization = 20.633768913342504
Path 83 | total_timesteps 1915.
number of affinization with epsilon = 3 is 21
average number of affinization = 20.633894809212787
Path 84 | total_timesteps 1937.
number of affinization with epsilon = 3 is 20
average number of affinization = 20.63367697594502
Path 85 | total_timesteps 1963.
number of affinization with epsilon = 3 is 11
average number of affinization = 20.630367571281347
Path 86 | total_timesteps 1977.
number of affinization with epsilon = 3 is 19
average number of affinization = 20.629807692307693
Path 87 | total_timesteps 2000.
number of affinization with epsilon = 3 is 23
average number of affinization = 20.6306213525575
Path 88 | total_timesteps 2030.
number of affinization with epsilon = 3 is 12
average number of affinization = 20.627659574468087
Path 89 | total_timesteps 2047.
number of affinization with epsilon = 3 is 16
average number of affinization = 20.62607204116638
Path 90 | total_timesteps 2067.
number of affinization with epsilon = 3 is 19
average number of affinization = 20.625514403292183
Path 91 | total_timesteps 2090.
number of affinization with epsilon = 3 is 19
average number of affinization = 20.624957147754543
Path 92 | total_timesteps 2112.
number of affinization with epsilon = 3 is 25
average number of affinization = 20.626456477039067
Path 93 | total_timesteps 2143.
number of affinization with epsilon = 3 is 12
average number of affinization = 20.623501199040767
Path 94 | total_timesteps 2158.
number of affinization with epsilon = 3 is 25
average number of affinization = 20.625
Path 95 | total_timesteps 2187.
number of affinization with epsilon = 3 is 16
average number of affinization = 20.623416638137623
Path 96 | total_timesteps 2211.
number of affinization with epsilon = 3 is 26
average number of affinization = 20.625256673511295
Path 97 | total_timesteps 2240.
number of affinization with epsilon = 3 is 7
average number of affinization = 20.620595278823128
Path 98 | total_timesteps 2250.
number of affinization with epsilon = 3 is 24
average number of affinization = 20.62175102599179
Path 99 | total_timesteps 2278.
number of affinization with epsilon = 3 is 8
average number of affinization = 20.617435897435897
Path 100 | total_timesteps 2292.
number of affinization with epsilon = 3 is 39
average number of affinization = 20.62371838687628
Path 101 | total_timesteps 2338.
number of affinization with epsilon = 3 is 19
average number of affinization = 20.623163648787155
Path 102 | total_timesteps 2362.
number of affinization with epsilon = 3 is 10
average number of affinization = 20.619535519125684
Path 103 | total_timesteps 2377.
number of affinization with epsilon = 3 is 10
average number of affinization = 20.615909866848753
Path 104 | total_timesteps 2389.
number of affinization with epsilon = 3 is 23
average number of affinization = 20.616723549488054
Path 105 | total_timesteps 2414.
number of affinization with epsilon = 3 is 24
average number of affinization = 20.617877857386556
Path 106 | total_timesteps 2444.
number of affinization with epsilon = 3 is 26
average number of affinization = 20.619713506139153
Path 107 | total_timesteps 2474.
number of affinization with epsilon = 3 is 30
average number of affinization = 20.62291169451074
Path 108 | total_timesteps 2509.
number of affinization with epsilon = 3 is 18
average number of affinization = 20.622017723244717
Path 109 | total_timesteps 2533.
number of affinization with epsilon = 3 is 13
average number of affinization = 20.619420783645655
Path 110 | total_timesteps 2548.
number of affinization with epsilon = 3 is 15
average number of affinization = 20.617506811989102
Path 111 | total_timesteps 2566.
number of affinization with epsilon = 3 is 15
average number of affinization = 20.61559414368403
Path 112 | total_timesteps 2586.
number of affinization with epsilon = 3 is 15
average number of affinization = 20.613682777399593
Path 113 | total_timesteps 2603.
number of affinization with epsilon = 3 is 37
average number of affinization = 20.61925825110582
Path 114 | total_timesteps 2645.
number of affinization with epsilon = 3 is 21
average number of affinization = 20.61938775510204
Path 115 | total_timesteps 2672.
number of affinization with epsilon = 3 is 6
average number of affinization = 20.6144168650119
Path 116 | total_timesteps 2684.
number of affinization with epsilon = 3 is 14
average number of affinization = 20.612168592794017
Path 117 | total_timesteps 2700.
number of affinization with epsilon = 3 is 27
average number of affinization = 20.614339109751953
Path 118 | total_timesteps 2733.
number of affinization with epsilon = 3 is 45
average number of affinization = 20.622622282608695
Path 119 | total_timesteps 2785.
number of affinization with epsilon = 3 is 50
average number of affinization = 20.632597623089982
Path 120 | total_timesteps 2841.
number of affinization with epsilon = 3 is 18
average number of affinization = 20.631704005431093
Path 121 | total_timesteps 2862.
number of affinization with epsilon = 3 is 30
average number of affinization = 20.634882931795048
Path 122 | total_timesteps 2896.
number of affinization with epsilon = 3 is 21
average number of affinization = 20.635006784260515
Path 123 | total_timesteps 2920.
number of affinization with epsilon = 3 is 9
average number of affinization = 20.63106137673788
Path 124 | total_timesteps 2931.
number of affinization with epsilon = 3 is 31
average number of affinization = 20.63457627118644
Path 125 | total_timesteps 2968.
number of affinization with epsilon = 3 is 30
average number of affinization = 20.637749915282956
Path 126 | total_timesteps 3007.
number of affinization with epsilon = 3 is 16
average number of affinization = 20.63617886178862
Path 127 | total_timesteps 3026.
number of affinization with epsilon = 3 is 13
average number of affinization = 20.63359295631561
Path 128 | total_timesteps 3043.
number of affinization with epsilon = 3 is 11
average number of affinization = 20.630331753554504
Path 129 | total_timesteps 3057.
number of affinization with epsilon = 3 is 18
average number of affinization = 20.629441624365484
Path 130 | total_timesteps 3076.
number of affinization with epsilon = 3 is 15
average number of affinization = 20.627537212449255
Path 131 | total_timesteps 3094.
number of affinization with epsilon = 3 is 12
average number of affinization = 20.624619546838012
Path 132 | total_timesteps 3110.
number of affinization with epsilon = 3 is 18
average number of affinization = 20.623732251521297
Path 133 | total_timesteps 3135.
number of affinization with epsilon = 3 is 18
average number of affinization = 20.622845555931058
Path 134 | total_timesteps 3157.
number of affinization with epsilon = 3 is 27
average number of affinization = 20.625
Path 135 | total_timesteps 3187.
number of affinization with epsilon = 3 is 14
average number of affinization = 20.62276258020939
Path 136 | total_timesteps 3206.
number of affinization with epsilon = 3 is 14
average number of affinization = 20.62052667116813
Path 137 | total_timesteps 3223.
number of affinization with epsilon = 3 is 19
average number of affinization = 20.619979750253123
Path 138 | total_timesteps 3245.
number of affinization with epsilon = 3 is 21
average number of affinization = 20.620107962213226
Path 139 | total_timesteps 3268.
number of affinization with epsilon = 3 is 9
average number of affinization = 20.61618887015177
Path 140 | total_timesteps 3278.
number of affinization with epsilon = 3 is 13
average number of affinization = 20.613621038435603
Path 141 | total_timesteps 3293.
number of affinization with epsilon = 3 is 29
average number of affinization = 20.61644759015841
Path 142 | total_timesteps 3327.
number of affinization with epsilon = 3 is 34
average number of affinization = 20.620956873315365
Path 143 | total_timesteps 3365.
number of affinization with epsilon = 3 is 10
average number of affinization = 20.617379589087236
Path 144 | total_timesteps 3381.
number of affinization with epsilon = 3 is 35
average number of affinization = 20.622222222222224
Path 145 | total_timesteps 3420.
number of affinization with epsilon = 3 is 15
average number of affinization = 20.620329855267588
Path 146 | total_timesteps 3440.
number of affinization with epsilon = 3 is 18
average number of affinization = 20.619448183041722
Path 147 | total_timesteps 3463.
number of affinization with epsilon = 3 is 44
average number of affinization = 20.627312478977466
Path 148 | total_timesteps 3515.
number of affinization with epsilon = 3 is 9
average number of affinization = 20.623402824478816
Path 149 | total_timesteps 3528.
number of affinization with epsilon = 3 is 16
average number of affinization = 20.6218487394958
Path 150 | total_timesteps 3550.
number of affinization with epsilon = 3 is 22
average number of affinization = 20.622311827956988
Path 151 | total_timesteps 3577.
number of affinization with epsilon = 3 is 30
average number of affinization = 20.62546187437017
Path 152 | total_timesteps 3612.
number of affinization with epsilon = 3 is 25
average number of affinization = 20.626930826057755
Path 153 | total_timesteps 3642.
number of affinization with epsilon = 3 is 11
average number of affinization = 20.623699227928835
Path 154 | total_timesteps 3656.
number of affinization with epsilon = 3 is 18
average number of affinization = 20.622818791946308
Path 155 | total_timesteps 3678.
number of affinization with epsilon = 3 is 9
average number of affinization = 20.618919825561893
Path 156 | total_timesteps 3688.
number of affinization with epsilon = 3 is 19
average number of affinization = 20.618376928236085
Path 157 | total_timesteps 3711.
number of affinization with epsilon = 3 is 27
average number of affinization = 20.620516258799867
Path 158 | total_timesteps 3743.
number of affinization with epsilon = 3 is 12
average number of affinization = 20.617627345844504
Path 159 | total_timesteps 3758.
number of affinization with epsilon = 3 is 9
average number of affinization = 20.613735343383585
Path 160 | total_timesteps 3770.
number of affinization with epsilon = 3 is 29
average number of affinization = 20.616543871399866
Path 161 | total_timesteps 3804.
number of affinization with epsilon = 3 is 21
average number of affinization = 20.61667224640107
Path 162 | total_timesteps 3832.
number of affinization with epsilon = 3 is 24
average number of affinization = 20.617804551539493
Path 163 | total_timesteps 3861.
number of affinization with epsilon = 3 is 19
average number of affinization = 20.61726329876213
Path 164 | total_timesteps 3884.
number of affinization with epsilon = 3 is 17
average number of affinization = 20.616053511705687
Path 165 | total_timesteps 3905.
number of affinization with epsilon = 3 is 19
average number of affinization = 20.615513206285524
Path 166 | total_timesteps 3928.
number of affinization with epsilon = 3 is 13
average number of affinization = 20.612967914438503
Path 167 | total_timesteps 3944.
number of affinization with epsilon = 3 is 11
average number of affinization = 20.609756097560975
Path 168 | total_timesteps 3957.
number of affinization with epsilon = 3 is 36
average number of affinization = 20.61489645958584
Path 169 | total_timesteps 4000.
number of affinization with epsilon = 3 is 19
average number of affinization = 20.614357262103507
Path 170 | total_timesteps 4022.
number of affinization with epsilon = 3 is 35
average number of affinization = 20.619158878504674
Path 171 | total_timesteps 4066.
number of affinization with epsilon = 3 is 10
average number of affinization = 20.615615615615617
Path 172 | total_timesteps 4078.
number of affinization with epsilon = 3 is 20
average number of affinization = 20.61541027351568
Path 173 | total_timesteps 4100.
number of affinization with epsilon = 3 is 21
average number of affinization = 20.615538512837613
Path 174 | total_timesteps 4125.
number of affinization with epsilon = 3 is 8
average number of affinization = 20.611333333333334
Path 175 | total_timesteps 4139.
number of affinization with epsilon = 3 is 20
average number of affinization = 20.611129623458847
Path 176 | total_timesteps 4161.
number of affinization with epsilon = 3 is 10
average number of affinization = 20.60759493670886
Path 177 | total_timesteps 4174.
number of affinization with epsilon = 3 is 9
average number of affinization = 20.603729603729604
Path 178 | total_timesteps 4185.
number of affinization with epsilon = 3 is 14
average number of affinization = 20.601531291611185
Path 179 | total_timesteps 4200.
number of affinization with epsilon = 3 is 30
average number of affinization = 20.604658901830284
Path 180 | total_timesteps 4240.
number of affinization with epsilon = 3 is 24
average number of affinization = 20.605788423153694
Path 181 | total_timesteps 4268.
number of affinization with epsilon = 3 is 15
average number of affinization = 20.60392417692052
Path 182 | total_timesteps 4285.
number of affinization with epsilon = 3 is 21
average number of affinization = 20.60405585106383
Path 183 | total_timesteps 4309.
number of affinization with epsilon = 3 is 15
average number of affinization = 20.60219341974078
Path 184 | total_timesteps 4327.
number of affinization with epsilon = 3 is 8
average number of affinization = 20.59800664451827
Path 185 | total_timesteps 4339.
number of affinization with epsilon = 3 is 23
average number of affinization = 20.598804383925607
Path 186 | total_timesteps 4365.
number of affinization with epsilon = 3 is 12
average number of affinization = 20.595949535192563
Path 187 | total_timesteps 4379.
number of affinization with epsilon = 3 is 25
average number of affinization = 20.597411218055093
Path 188 | total_timesteps 4408.
number of affinization with epsilon = 3 is 26
average number of affinization = 20.599203715992036
Path 189 | total_timesteps 4437.
number of affinization with epsilon = 3 is 25
average number of affinization = 20.60066334991708
Path 190 | total_timesteps 4464.
number of affinization with epsilon = 3 is 23
average number of affinization = 20.601458885941646
Path 191 | total_timesteps 4490.
number of affinization with epsilon = 3 is 11
average number of affinization = 20.598276433543255
Path 192 | total_timesteps 4505.
number of affinization with epsilon = 3 is 11
average number of affinization = 20.59509609012591
Path 193 | total_timesteps 4519.
number of affinization with epsilon = 3 is 12
average number of affinization = 20.592249089102353
Path 194 | total_timesteps 4535.
number of affinization with epsilon = 3 is 10
average number of affinization = 20.588741721854305
Path 195 | total_timesteps 4547.
number of affinization with epsilon = 3 is 18
average number of affinization = 20.58788480635551
Path 196 | total_timesteps 4569.
number of affinization with epsilon = 3 is 20
average number of affinization = 20.58769027134348
Path 197 | total_timesteps 4592.
number of affinization with epsilon = 3 is 31
average number of affinization = 20.59113463446907
Path 198 | total_timesteps 4631.
number of affinization with epsilon = 3 is 17
average number of affinization = 20.58994708994709
Path 199 | total_timesteps 4650.
number of affinization with epsilon = 3 is 29
average number of affinization = 20.592727272727274
Path 200 | total_timesteps 4686.
number of affinization with epsilon = 3 is 19
average number of affinization = 20.592200925313946
Path 201 | total_timesteps 4707.
number of affinization with epsilon = 3 is 28
average number of affinization = 20.594648166501486
Path 202 | total_timesteps 4741.
number of affinization with epsilon = 3 is 23
average number of affinization = 20.59544253632761
Path 203 | total_timesteps 4766.
number of affinization with epsilon = 3 is 34
average number of affinization = 20.599867943215582
Path 204 | total_timesteps 4807.
number of affinization with epsilon = 3 is 19
average number of affinization = 20.5993399339934
Path 205 | total_timesteps 4828.
number of affinization with epsilon = 3 is 14
average number of affinization = 20.597162652589905
Path 206 | total_timesteps 4848.
number of affinization with epsilon = 3 is 29
average number of affinization = 20.599934036939313
Path 207 | total_timesteps 4883.
number of affinization with epsilon = 3 is 14
average number of affinization = 20.597757995384107
Path 208 | total_timesteps 4900.
number of affinization with epsilon = 3 is 23
average number of affinization = 20.598549769281476
Path 209 | total_timesteps 4927.
number of affinization with epsilon = 3 is 39
average number of affinization = 20.604612850082372
Path 210 | total_timesteps 4969.
number of affinization with epsilon = 3 is 24
average number of affinization = 20.60573122529644
Path 211 | total_timesteps 5004.
number of affinization with epsilon = 3 is 11
average number of affinization = 20.60256832400395
Path 212 | total_timesteps 5017.
number of affinization with epsilon = 3 is 19
average number of affinization = 20.602040816326532
Path 213 | total_timesteps 5038.
number of affinization with epsilon = 3 is 21
average number of affinization = 20.60217176702863
Path 214 | total_timesteps 5064.
number of affinization with epsilon = 3 is 20
average number of affinization = 20.601973684210527
Path 215 | total_timesteps 5088.
number of affinization with epsilon = 3 is 13
average number of affinization = 20.599473857283787
Path 216 | total_timesteps 5105.
number of affinization with epsilon = 3 is 9
average number of affinization = 20.595660749506905
Path 217 | total_timesteps 5117.
number of affinization with epsilon = 3 is 16
average number of affinization = 20.594150509365758
Path 218 | total_timesteps 5137.
number of affinization with epsilon = 3 is 22
average number of affinization = 20.5946123521682
Path 219 | total_timesteps 5161.
number of affinization with epsilon = 3 is 17
average number of affinization = 20.59343185550082
Path 220 | total_timesteps 5179.
number of affinization with epsilon = 3 is 14
average number of affinization = 20.591267235718977
Path 221 | total_timesteps 5196.
number of affinization with epsilon = 3 is 11
average number of affinization = 20.58811946176567
Path 222 | total_timesteps 5209.
number of affinization with epsilon = 3 is 20
average number of affinization = 20.587926509186353
Path 223 | total_timesteps 5234.
number of affinization with epsilon = 3 is 37
average number of affinization = 20.593309281731717
Path 224 | total_timesteps 5277.
number of affinization with epsilon = 3 is 41
average number of affinization = 20.6
Path 225 | total_timesteps 5326.
number of affinization with epsilon = 3 is 25
average number of affinization = 20.601442150114718
Path 226 | total_timesteps 5354.
number of affinization with epsilon = 3 is 15
average number of affinization = 20.599606815203146
Path 227 | total_timesteps 5371.
number of affinization with epsilon = 3 is 15
average number of affinization = 20.59777268260727
Path 228 | total_timesteps 5390.
number of affinization with epsilon = 3 is 16
average number of affinization = 20.596267190569744
Path 229 | total_timesteps 5413.
number of affinization with epsilon = 3 is 23
average number of affinization = 20.597054009819967
Path 230 | total_timesteps 5438.
number of affinization with epsilon = 3 is 27
average number of affinization = 20.599149214659686
Path 231 | total_timesteps 5468.
number of affinization with epsilon = 3 is 19
average number of affinization = 20.598626104023552
Path 232 | total_timesteps 5491.
number of affinization with epsilon = 3 is 13
average number of affinization = 20.59614126880314
Path 233 | total_timesteps 5507.
number of affinization with epsilon = 3 is 29
average number of affinization = 20.59888852566198
Path 234 | total_timesteps 5538.
number of affinization with epsilon = 3 is 21
average number of affinization = 20.599019607843136
Path 235 | total_timesteps 5566.
number of affinization with epsilon = 3 is 53
average number of affinization = 20.609604704344985
Path 236 | total_timesteps 5630.
number of affinization with epsilon = 3 is 20
average number of affinization = 20.60940561724363
Path 237 | total_timesteps 5655.
number of affinization with epsilon = 3 is 15
average number of affinization = 20.607574273587986
Path 238 | total_timesteps 5675.
number of affinization with epsilon = 3 is 15
average number of affinization = 20.60574412532637
Path 239 | total_timesteps 5694.
number of affinization with epsilon = 3 is 37
average number of affinization = 20.61109298531811
Path 240 | total_timesteps 5738.
number of affinization with epsilon = 3 is 26
average number of affinization = 20.612850619699934
Path 241 | total_timesteps 5765.
number of affinization with epsilon = 3 is 14
average number of affinization = 20.610694489729376
Path 242 | total_timesteps 5785.
number of affinization with epsilon = 3 is 20
average number of affinization = 20.610495436766623
Path 243 | total_timesteps 5807.
number of affinization with epsilon = 3 is 21
average number of affinization = 20.610622352557836
Path 244 | total_timesteps 5830.
number of affinization with epsilon = 3 is 43
average number of affinization = 20.617915309446254
Path 245 | total_timesteps 5879.
number of affinization with epsilon = 3 is 18
average number of affinization = 20.61706284597851
Path 246 | total_timesteps 5898.
number of affinization with epsilon = 3 is 16
average number of affinization = 20.615559895833332
Path 247 | total_timesteps 5916.
number of affinization with epsilon = 3 is 22
average number of affinization = 20.61601041327693
Path 248 | total_timesteps 5942.
number of affinization with epsilon = 3 is 9
average number of affinization = 20.612231620039037
Path 249 | total_timesteps 5953.
number of affinization with epsilon = 3 is 16
average number of affinization = 20.610731707317072
Path 250 | total_timesteps 5971.
number of affinization with epsilon = 3 is 40
average number of affinization = 20.61703511053316
Done generating on-policy rollouts.
Updating normalization.
Done updating normalization.
----------------------------
| AverageReturn | -6.04    |
| Iteration     | 12       |
| MaximumReturn | 62.1     |
| MinimumReturn | -20.6    |
| TotalSamples  | 56188    |
----------------------------
itr #13 | 
Fitting dynamics.
Fitting model 0 (0-based) in the ensemble of 2 models
Validation loss = 0.019505208358168602
Validation loss = 0.02300373651087284
Validation loss = 0.018818097189068794
Validation loss = 0.019811609759926796
Validation loss = 0.018452730029821396
Validation loss = 0.019727155566215515
Validation loss = 0.018862439319491386
Validation loss = 0.018631787970662117
Validation loss = 0.01908268593251705
Fitting model 1 (0-based) in the ensemble of 2 models
Validation loss = 0.01950443722307682
Validation loss = 0.018626954406499863
Validation loss = 0.019019898027181625
Validation loss = 0.01815006509423256
Validation loss = 0.01875831000506878
Validation loss = 0.018176591023802757
Validation loss = 0.0187302865087986
Validation loss = 0.01887792907655239
Done fitting dynamics.
Updating randomness.
Done updating randomness.
Training policy using TRPO.
Re-initialize init_std.
Obtaining samples for iteration 0...
Obtaining samples for iteration 1...
Obtaining samples for iteration 2...
Obtaining samples for iteration 3...
Obtaining samples for iteration 4...
Obtaining samples for iteration 5...
Obtaining samples for iteration 6...
Obtaining samples for iteration 7...
Obtaining samples for iteration 8...
Obtaining samples for iteration 9...
Obtaining samples for iteration 10...
Obtaining samples for iteration 11...
Obtaining samples for iteration 12...
Obtaining samples for iteration 13...
Obtaining samples for iteration 14...
Obtaining samples for iteration 15...
Obtaining samples for iteration 16...
Obtaining samples for iteration 17...
Obtaining samples for iteration 18...
Obtaining samples for iteration 19...
Done training policy.
Generating on-policy rollouts.
Path 0 | total_timesteps 0.
number of affinization with epsilon = 3 is 27
average number of affinization = 20.619109522261944
Path 1 | total_timesteps 30.
number of affinization with epsilon = 3 is 11
average number of affinization = 20.61598440545809
Path 2 | total_timesteps 42.
number of affinization with epsilon = 3 is 22
average number of affinization = 20.6164339071127
Path 3 | total_timesteps 67.
number of affinization with epsilon = 3 is 41
average number of affinization = 20.62305194805195
Path 4 | total_timesteps 115.
number of affinization with epsilon = 3 is 14
average number of affinization = 20.62090230444661
Path 5 | total_timesteps 133.
number of affinization with epsilon = 3 is 24
average number of affinization = 20.621998702141468
Path 6 | total_timesteps 162.
number of affinization with epsilon = 3 is 20
average number of affinization = 20.621796951021732
Path 7 | total_timesteps 184.
number of affinization with epsilon = 3 is 19
average number of affinization = 20.621271076523996
Path 8 | total_timesteps 205.
number of affinization with epsilon = 3 is 12
average number of affinization = 20.618476499189626
Path 9 | total_timesteps 220.
number of affinization with epsilon = 3 is 29
average number of affinization = 20.621192482177577
Path 10 | total_timesteps 255.
number of affinization with epsilon = 3 is 17
average number of affinization = 20.620019436345967
Path 11 | total_timesteps 274.
number of affinization with epsilon = 3 is 32
average number of affinization = 20.623704663212436
Path 12 | total_timesteps 315.
number of affinization with epsilon = 3 is 7
average number of affinization = 20.619294269990288
Path 13 | total_timesteps 324.
number of affinization with epsilon = 3 is 17
average number of affinization = 20.618122977346278
Path 14 | total_timesteps 343.
number of affinization with epsilon = 3 is 35
average number of affinization = 20.622775800711743
Path 15 | total_timesteps 387.
number of affinization with epsilon = 3 is 11
average number of affinization = 20.61966364812419
Path 16 | total_timesteps 402.
number of affinization with epsilon = 3 is 24
average number of affinization = 20.620756547041708
Path 17 | total_timesteps 430.
number of affinization with epsilon = 3 is 17
average number of affinization = 20.619586296056884
Path 18 | total_timesteps 452.
number of affinization with epsilon = 3 is 37
average number of affinization = 20.624878836833602
Path 19 | total_timesteps 494.
number of affinization with epsilon = 3 is 15
average number of affinization = 20.623062015503876
Path 20 | total_timesteps 512.
number of affinization with epsilon = 3 is 21
average number of affinization = 20.62318372618663
Path 21 | total_timesteps 539.
number of affinization with epsilon = 3 is 12
average number of affinization = 20.62040025823112
Path 22 | total_timesteps 556.
number of affinization with epsilon = 3 is 22
average number of affinization = 20.62084543401097
Path 23 | total_timesteps 582.
number of affinization with epsilon = 3 is 19
average number of affinization = 20.620322580645162
Path 24 | total_timesteps 605.
number of affinization with epsilon = 3 is 31
average number of affinization = 20.623669783940663
Path 25 | total_timesteps 644.
number of affinization with epsilon = 3 is 10
average number of affinization = 20.620245003223726
Path 26 | total_timesteps 656.
number of affinization with epsilon = 3 is 25
average number of affinization = 20.621656461488882
Path 27 | total_timesteps 691.
number of affinization with epsilon = 3 is 12
average number of affinization = 20.618878865979383
Path 28 | total_timesteps 706.
number of affinization with epsilon = 3 is 16
average number of affinization = 20.617391304347827
Path 29 | total_timesteps 729.
number of affinization with epsilon = 3 is 22
average number of affinization = 20.617836445589184
Path 30 | total_timesteps 754.
number of affinization with epsilon = 3 is 9
average number of affinization = 20.61409719987126
Path 31 | total_timesteps 764.
number of affinization with epsilon = 3 is 21
average number of affinization = 20.614221364221365
Path 32 | total_timesteps 790.
number of affinization with epsilon = 3 is 19
average number of affinization = 20.613702155033774
Path 33 | total_timesteps 813.
number of affinization with epsilon = 3 is 14
average number of affinization = 20.611575562700963
Path 34 | total_timesteps 833.
number of affinization with epsilon = 3 is 10
average number of affinization = 20.608164577306333
Path 35 | total_timesteps 847.
number of affinization with epsilon = 3 is 19
average number of affinization = 20.607647814910024
Path 36 | total_timesteps 870.
number of affinization with epsilon = 3 is 21
average number of affinization = 20.607773851590107
Path 37 | total_timesteps 895.
number of affinization with epsilon = 3 is 13
average number of affinization = 20.6053307642903
Path 38 | total_timesteps 909.
number of affinization with epsilon = 3 is 19
average number of affinization = 20.60481540930979
Path 39 | total_timesteps 934.
number of affinization with epsilon = 3 is 41
average number of affinization = 20.611360718870348
Path 40 | total_timesteps 983.
number of affinization with epsilon = 3 is 9
average number of affinization = 20.60763554700032
Path 41 | total_timesteps 995.
number of affinization with epsilon = 3 is 13
average number of affinization = 20.605195638229635
Path 42 | total_timesteps 1012.
number of affinization with epsilon = 3 is 13
average number of affinization = 20.602757294004487
Path 43 | total_timesteps 1027.
number of affinization with epsilon = 3 is 10
average number of affinization = 20.599358974358974
Path 44 | total_timesteps 1039.
number of affinization with epsilon = 3 is 22
average number of affinization = 20.599807753925024
Path 45 | total_timesteps 1065.
number of affinization with epsilon = 3 is 22
average number of affinization = 20.600256245996157
Path 46 | total_timesteps 1092.
number of affinization with epsilon = 3 is 7
average number of affinization = 20.595901376881205
Path 47 | total_timesteps 1103.
number of affinization with epsilon = 3 is 20
average number of affinization = 20.59571062740077
Path 48 | total_timesteps 1127.
number of affinization with epsilon = 3 is 17
average number of affinization = 20.59456
Path 49 | total_timesteps 1148.
number of affinization with epsilon = 3 is 22
average number of affinization = 20.595009596928982
Path 50 | total_timesteps 1173.
number of affinization with epsilon = 3 is 11
average number of affinization = 20.591941157659097
Path 51 | total_timesteps 1187.
number of affinization with epsilon = 3 is 11
average number of affinization = 20.588874680306905
Path 52 | total_timesteps 1202.
number of affinization with epsilon = 3 is 15
average number of affinization = 20.587088526685843
Path 53 | total_timesteps 1219.
number of affinization with epsilon = 3 is 23
average number of affinization = 20.58785942492013
Path 54 | total_timesteps 1248.
number of affinization with epsilon = 3 is 18
average number of affinization = 20.58703289683807
Path 55 | total_timesteps 1268.
number of affinization with epsilon = 3 is 8
average number of affinization = 20.58301404853129
Path 56 | total_timesteps 1277.
number of affinization with epsilon = 3 is 26
average number of affinization = 20.584743057772105
Path 57 | total_timesteps 1310.
number of affinization with epsilon = 3 is 29
average number of affinization = 20.587428206764518
Path 58 | total_timesteps 1345.
number of affinization with epsilon = 3 is 15
average number of affinization = 20.585645933014355
Path 59 | total_timesteps 1363.
number of affinization with epsilon = 3 is 18
average number of affinization = 20.584821428571427
Path 60 | total_timesteps 1387.
number of affinization with epsilon = 3 is 28
average number of affinization = 20.587185208798214
Path 61 | total_timesteps 1419.
number of affinization with epsilon = 3 is 20
average number of affinization = 20.58699808795411
Path 62 | total_timesteps 1444.
number of affinization with epsilon = 3 is 21
average number of affinization = 20.58712965912711
Path 63 | total_timesteps 1468.
number of affinization with epsilon = 3 is 33
average number of affinization = 20.59108280254777
Path 64 | total_timesteps 1504.
number of affinization with epsilon = 3 is 25
average number of affinization = 20.5924864692773
Path 65 | total_timesteps 1535.
number of affinization with epsilon = 3 is 11
average number of affinization = 20.589433481858688
Path 66 | total_timesteps 1547.
number of affinization with epsilon = 3 is 15
average number of affinization = 20.587655106586066
Path 67 | total_timesteps 1566.
number of affinization with epsilon = 3 is 17
average number of affinization = 20.58651399491094
Path 68 | total_timesteps 1587.
number of affinization with epsilon = 3 is 15
average number of affinization = 20.584737678855326
Path 69 | total_timesteps 1605.
number of affinization with epsilon = 3 is 9
average number of affinization = 20.581055308328036
Path 70 | total_timesteps 1616.
number of affinization with epsilon = 3 is 9
average number of affinization = 20.57737527804258
Path 71 | total_timesteps 1630.
number of affinization with epsilon = 3 is 25
average number of affinization = 20.578780177890724
Path 72 | total_timesteps 1663.
number of affinization with epsilon = 3 is 12
average number of affinization = 20.576055890758973
Path 73 | total_timesteps 1685.
number of affinization with epsilon = 3 is 27
average number of affinization = 20.578095238095237
Path 74 | total_timesteps 1718.
number of affinization with epsilon = 3 is 15
average number of affinization = 20.576324976198034
Path 75 | total_timesteps 1734.
number of affinization with epsilon = 3 is 40
average number of affinization = 20.58248730964467
Path 76 | total_timesteps 1780.
number of affinization with epsilon = 3 is 24
average number of affinization = 20.583571202029812
Path 77 | total_timesteps 1815.
number of affinization with epsilon = 3 is 29
average number of affinization = 20.586239695624602
Path 78 | total_timesteps 1847.
number of affinization with epsilon = 3 is 13
average number of affinization = 20.583835182250397
Path 79 | total_timesteps 1864.
number of affinization with epsilon = 3 is 9
average number of affinization = 20.580164765525982
Path 80 | total_timesteps 1874.
number of affinization with epsilon = 3 is 37
average number of affinization = 20.585365853658537
Path 81 | total_timesteps 1918.
number of affinization with epsilon = 3 is 29
average number of affinization = 20.5880303989867
Path 82 | total_timesteps 1952.
number of affinization with epsilon = 3 is 40
average number of affinization = 20.59417537195315
Path 83 | total_timesteps 2001.
number of affinization with epsilon = 3 is 15
average number of affinization = 20.59240506329114
Path 84 | total_timesteps 2018.
number of affinization with epsilon = 3 is 25
average number of affinization = 20.59379943055995
Path 85 | total_timesteps 2052.
number of affinization with epsilon = 3 is 18
average number of affinization = 20.592979127134726
Path 86 | total_timesteps 2072.
number of affinization with epsilon = 3 is 24
average number of affinization = 20.594056275687638
Path 87 | total_timesteps 2102.
number of affinization with epsilon = 3 is 15
average number of affinization = 20.59228824273072
Path 88 | total_timesteps 2119.
number of affinization with epsilon = 3 is 13
average number of affinization = 20.58988941548183
Path 89 | total_timesteps 2135.
number of affinization with epsilon = 3 is 27
average number of affinization = 20.59191408717625
Path 90 | total_timesteps 2170.
number of affinization with epsilon = 3 is 22
average number of affinization = 20.592358699084308
Path 91 | total_timesteps 2198.
number of affinization with epsilon = 3 is 10
average number of affinization = 20.589015151515152
Path 92 | total_timesteps 2209.
number of affinization with epsilon = 3 is 16
average number of affinization = 20.587567055853583
Path 93 | total_timesteps 2228.
number of affinization with epsilon = 3 is 23
average number of affinization = 20.58832807570978
Path 94 | total_timesteps 2257.
number of affinization with epsilon = 3 is 7
average number of affinization = 20.58404288867865
Path 95 | total_timesteps 2266.
number of affinization with epsilon = 3 is 10
average number of affinization = 20.580706179066834
Path 96 | total_timesteps 2279.
number of affinization with epsilon = 3 is 48
average number of affinization = 20.589347620548377
Path 97 | total_timesteps 2335.
number of affinization with epsilon = 3 is 14
average number of affinization = 20.587271581600504
Path 98 | total_timesteps 2357.
number of affinization with epsilon = 3 is 21
average number of affinization = 20.58740157480315
Path 99 | total_timesteps 2384.
number of affinization with epsilon = 3 is 45
average number of affinization = 20.59508816120907
Path 100 | total_timesteps 2438.
number of affinization with epsilon = 3 is 29
average number of affinization = 20.597733711048157
Path 101 | total_timesteps 2473.
number of affinization with epsilon = 3 is 12
average number of affinization = 20.595028319697924
Path 102 | total_timesteps 2493.
number of affinization with epsilon = 3 is 21
average number of affinization = 20.59515570934256
Path 103 | total_timesteps 2518.
number of affinization with epsilon = 3 is 12
average number of affinization = 20.59245283018868
Path 104 | total_timesteps 2534.
number of affinization with epsilon = 3 is 15
average number of affinization = 20.59069475007859
Path 105 | total_timesteps 2552.
number of affinization with epsilon = 3 is 19
average number of affinization = 20.5901948460088
Path 106 | total_timesteps 2575.
number of affinization with epsilon = 3 is 24
average number of affinization = 20.591266101162425
Path 107 | total_timesteps 2603.
number of affinization with epsilon = 3 is 53
average number of affinization = 20.60144472361809
Path 108 | total_timesteps 2670.
number of affinization with epsilon = 3 is 12
average number of affinization = 20.598744113029827
Path 109 | total_timesteps 2690.
number of affinization with epsilon = 3 is 35
average number of affinization = 20.603264281230384
Path 110 | total_timesteps 2733.
number of affinization with epsilon = 3 is 8
average number of affinization = 20.59930969563853
Path 111 | total_timesteps 2745.
number of affinization with epsilon = 3 is 16
average number of affinization = 20.597867001254706
Path 112 | total_timesteps 2763.
number of affinization with epsilon = 3 is 19
average number of affinization = 20.597365945437442
Path 113 | total_timesteps 2785.
number of affinization with epsilon = 3 is 30
average number of affinization = 20.600313479623825
Path 114 | total_timesteps 2819.
number of affinization with epsilon = 3 is 14
average number of affinization = 20.598245064243184
Path 115 | total_timesteps 2836.
number of affinization with epsilon = 3 is 26
average number of affinization = 20.599937343358395
Path 116 | total_timesteps 2866.
number of affinization with epsilon = 3 is 33
average number of affinization = 20.603820858127154
Path 117 | total_timesteps 2905.
number of affinization with epsilon = 3 is 22
average number of affinization = 20.604257983719474
Path 118 | total_timesteps 2929.
number of affinization with epsilon = 3 is 11
average number of affinization = 20.601251956181535
Path 119 | total_timesteps 2942.
number of affinization with epsilon = 3 is 21
average number of affinization = 20.601376720901126
Path 120 | total_timesteps 2969.
number of affinization with epsilon = 3 is 35
average number of affinization = 20.60588051298092
Path 121 | total_timesteps 3007.
number of affinization with epsilon = 3 is 13
average number of affinization = 20.603502188868042
Path 122 | total_timesteps 3024.
number of affinization with epsilon = 3 is 27
average number of affinization = 20.60550171928728
Path 123 | total_timesteps 3056.
number of affinization with epsilon = 3 is 23
average number of affinization = 20.60625
Path 124 | total_timesteps 3083.
number of affinization with epsilon = 3 is 86
average number of affinization = 20.626679162761636
Path 125 | total_timesteps 3180.
number of affinization with epsilon = 3 is 11
average number of affinization = 20.62367270455965
Path 126 | total_timesteps 3195.
number of affinization with epsilon = 3 is 9
average number of affinization = 20.62004370902279
Path 127 | total_timesteps 3207.
number of affinization with epsilon = 3 is 26
average number of affinization = 20.621722846441948
Path 128 | total_timesteps 3237.
number of affinization with epsilon = 3 is 8
average number of affinization = 20.617784711388456
Path 129 | total_timesteps 3246.
number of affinization with epsilon = 3 is 14
average number of affinization = 20.61572052401747
Path 130 | total_timesteps 3263.
number of affinization with epsilon = 3 is 37
average number of affinization = 20.620829435609604
Path 131 | total_timesteps 3307.
number of affinization with epsilon = 3 is 25
average number of affinization = 20.622194513715712
Path 132 | total_timesteps 3335.
number of affinization with epsilon = 3 is 26
average number of affinization = 20.623870364599565
Path 133 | total_timesteps 3367.
number of affinization with epsilon = 3 is 14
average number of affinization = 20.621806853582555
Path 134 | total_timesteps 3384.
number of affinization with epsilon = 3 is 14
average number of affinization = 20.619744627841794
Path 135 | total_timesteps 3403.
number of affinization with epsilon = 3 is 34
average number of affinization = 20.623910336239103
Path 136 | total_timesteps 3442.
number of affinization with epsilon = 3 is 18
average number of affinization = 20.62309368191721
Path 137 | total_timesteps 3463.
number of affinization with epsilon = 3 is 15
average number of affinization = 20.621344119477286
Path 138 | total_timesteps 3481.
number of affinization with epsilon = 3 is 17
average number of affinization = 20.620217729393467
Path 139 | total_timesteps 3505.
number of affinization with epsilon = 3 is 5
average number of affinization = 20.615360696517413
Path 140 | total_timesteps 3513.
number of affinization with epsilon = 3 is 24
average number of affinization = 20.61641280696301
Path 141 | total_timesteps 3546.
number of affinization with epsilon = 3 is 12
average number of affinization = 20.613735239279055
Path 142 | total_timesteps 3563.
number of affinization with epsilon = 3 is 32
average number of affinization = 20.617272444858653
Path 143 | total_timesteps 3600.
number of affinization with epsilon = 3 is 16
average number of affinization = 20.61583850931677
Path 144 | total_timesteps 3619.
number of affinization with epsilon = 3 is 16
average number of affinization = 20.61440546414157
Path 145 | total_timesteps 3638.
number of affinization with epsilon = 3 is 49
average number of affinization = 20.623215394165115
Path 146 | total_timesteps 3693.
number of affinization with epsilon = 3 is 22
average number of affinization = 20.62364256903506
Path 147 | total_timesteps 3720.
number of affinization with epsilon = 3 is 18
average number of affinization = 20.622828784119108
Path 148 | total_timesteps 3742.
number of affinization with epsilon = 3 is 13
average number of affinization = 20.62046511627907
Path 149 | total_timesteps 3760.
number of affinization with epsilon = 3 is 13
average number of affinization = 20.61810291382517
Path 150 | total_timesteps 3776.
number of affinization with epsilon = 3 is 11
average number of affinization = 20.615122404710256
Path 151 | total_timesteps 3789.
number of affinization with epsilon = 3 is 16
average number of affinization = 20.6136926889715
Path 152 | total_timesteps 3808.
number of affinization with epsilon = 3 is 12
average number of affinization = 20.611025085165686
Path 153 | total_timesteps 3825.
number of affinization with epsilon = 3 is 20
average number of affinization = 20.610835913312695
Path 154 | total_timesteps 3851.
number of affinization with epsilon = 3 is 16
average number of affinization = 20.609408851748686
Path 155 | total_timesteps 3869.
number of affinization with epsilon = 3 is 17
average number of affinization = 20.60829207920792
Path 156 | total_timesteps 3895.
number of affinization with epsilon = 3 is 19
average number of affinization = 20.607794618001854
Path 157 | total_timesteps 3915.
number of affinization with epsilon = 3 is 11
average number of affinization = 20.60482374768089
Path 158 | total_timesteps 3931.
number of affinization with epsilon = 3 is 17
average number of affinization = 20.60370942812983
Path 159 | total_timesteps 3950.
number of affinization with epsilon = 3 is 19
average number of affinization = 20.603213844252164
Path 160 | total_timesteps 3970.
number of affinization with epsilon = 3 is 44
average number of affinization = 20.610441767068274
Path 161 | total_timesteps 4021.
number of affinization with epsilon = 3 is 25
average number of affinization = 20.611797405806055
Path 162 | total_timesteps 4050.
number of affinization with epsilon = 3 is 17
average number of affinization = 20.61068230935474
Path 163 | total_timesteps 4068.
number of affinization with epsilon = 3 is 22
average number of affinization = 20.61111111111111
Path 164 | total_timesteps 4096.
number of affinization with epsilon = 3 is 49
average number of affinization = 20.61987041036717
Path 165 | total_timesteps 4150.
number of affinization with epsilon = 3 is 10
average number of affinization = 20.616594694632944
Path 166 | total_timesteps 4166.
number of affinization with epsilon = 3 is 21
average number of affinization = 20.616712920135676
Path 167 | total_timesteps 4191.
number of affinization with epsilon = 3 is 20
average number of affinization = 20.61652281134402
Path 168 | total_timesteps 4213.
number of affinization with epsilon = 3 is 10
average number of affinization = 20.613251155624038
Path 169 | total_timesteps 4226.
number of affinization with epsilon = 3 is 37
average number of affinization = 20.61829944547135
Path 170 | total_timesteps 4272.
number of affinization with epsilon = 3 is 29
average number of affinization = 20.620880813058207
Path 171 | total_timesteps 4311.
number of affinization with epsilon = 3 is 20
average number of affinization = 20.620689655172413
Path 172 | total_timesteps 4336.
number of affinization with epsilon = 3 is 16
average number of affinization = 20.619267466912895
Path 173 | total_timesteps 4356.
number of affinization with epsilon = 3 is 31
average number of affinization = 20.62246153846154
Path 174 | total_timesteps 4391.
number of affinization with epsilon = 3 is 10
average number of affinization = 20.619194094124886
Path 175 | total_timesteps 4402.
number of affinization with epsilon = 3 is 30
average number of affinization = 20.622078720787208
Path 176 | total_timesteps 4438.
number of affinization with epsilon = 3 is 32
average number of affinization = 20.62557639102367
Path 177 | total_timesteps 4473.
number of affinization with epsilon = 3 is 34
average number of affinization = 20.629686539643515
Path 178 | total_timesteps 4514.
number of affinization with epsilon = 3 is 25
average number of affinization = 20.631029185867895
Path 179 | total_timesteps 4542.
number of affinization with epsilon = 3 is 28
average number of affinization = 20.633292383292382
Path 180 | total_timesteps 4580.
number of affinization with epsilon = 3 is 27
average number of affinization = 20.635247159963157
Path 181 | total_timesteps 4611.
number of affinization with epsilon = 3 is 30
average number of affinization = 20.638121546961326
Path 182 | total_timesteps 4642.
number of affinization with epsilon = 3 is 35
average number of affinization = 20.642528382939553
Path 183 | total_timesteps 4683.
number of affinization with epsilon = 3 is 25
average number of affinization = 20.643865030674846
Path 184 | total_timesteps 4713.
number of affinization with epsilon = 3 is 17
average number of affinization = 20.642747623428395
Path 185 | total_timesteps 4736.
number of affinization with epsilon = 3 is 11
average number of affinization = 20.63979153893317
Path 186 | total_timesteps 4752.
number of affinization with epsilon = 3 is 17
average number of affinization = 20.638676064970884
Path 187 | total_timesteps 4773.
number of affinization with epsilon = 3 is 12
average number of affinization = 20.636029411764707
Path 188 | total_timesteps 4788.
number of affinization with epsilon = 3 is 13
average number of affinization = 20.633690658499233
Path 189 | total_timesteps 4803.
number of affinization with epsilon = 3 is 30
average number of affinization = 20.63655848132272
Path 190 | total_timesteps 4838.
number of affinization with epsilon = 3 is 9
average number of affinization = 20.632996632996633
Path 191 | total_timesteps 4848.
number of affinization with epsilon = 3 is 17
average number of affinization = 20.63188494492044
Path 192 | total_timesteps 4868.
number of affinization with epsilon = 3 is 19
average number of affinization = 20.63138574487611
Path 193 | total_timesteps 4892.
number of affinization with epsilon = 3 is 21
average number of affinization = 20.631498470948014
Path 194 | total_timesteps 4916.
number of affinization with epsilon = 3 is 8
average number of affinization = 20.6276368083155
Path 195 | total_timesteps 4929.
number of affinization with epsilon = 3 is 9
average number of affinization = 20.624083129584353
Path 196 | total_timesteps 4939.
number of affinization with epsilon = 3 is 11
average number of affinization = 20.621142682554233
Path 197 | total_timesteps 4952.
number of affinization with epsilon = 3 is 16
average number of affinization = 20.619731215638364
Path 198 | total_timesteps 4972.
number of affinization with epsilon = 3 is 29
average number of affinization = 20.62229007633588
Path 199 | total_timesteps 5008.
number of affinization with epsilon = 3 is 21
average number of affinization = 20.62240537240537
Path 200 | total_timesteps 5035.
number of affinization with epsilon = 3 is 20
average number of affinization = 20.62221544095209
Path 201 | total_timesteps 5061.
number of affinization with epsilon = 3 is 22
average number of affinization = 20.622635753508238
Path 202 | total_timesteps 5087.
number of affinization with epsilon = 3 is 25
average number of affinization = 20.623970722781337
Path 203 | total_timesteps 5114.
number of affinization with epsilon = 3 is 16
average number of affinization = 20.622560975609755
Path 204 | total_timesteps 5131.
number of affinization with epsilon = 3 is 33
average number of affinization = 20.626333434928377
Path 205 | total_timesteps 5169.
number of affinization with epsilon = 3 is 26
average number of affinization = 20.62797074954296
Path 206 | total_timesteps 5199.
number of affinization with epsilon = 3 is 15
average number of affinization = 20.626256472738348
Path 207 | total_timesteps 5221.
number of affinization with epsilon = 3 is 20
average number of affinization = 20.626065773447017
Path 208 | total_timesteps 5246.
number of affinization with epsilon = 3 is 11
average number of affinization = 20.623135464231353
Path 209 | total_timesteps 5259.
number of affinization with epsilon = 3 is 33
average number of affinization = 20.626902008520997
Path 210 | total_timesteps 5301.
number of affinization with epsilon = 3 is 10
average number of affinization = 20.623668999087315
Path 211 | total_timesteps 5313.
number of affinization with epsilon = 3 is 23
average number of affinization = 20.62439172749392
Path 212 | total_timesteps 5337.
number of affinization with epsilon = 3 is 16
average number of affinization = 20.62298570994223
Path 213 | total_timesteps 5358.
number of affinization with epsilon = 3 is 14
average number of affinization = 20.6209726443769
Path 214 | total_timesteps 5374.
number of affinization with epsilon = 3 is 19
average number of affinization = 20.620480097234882
Path 215 | total_timesteps 5398.
number of affinization with epsilon = 3 is 19
average number of affinization = 20.619987849331714
Path 216 | total_timesteps 5423.
number of affinization with epsilon = 3 is 30
average number of affinization = 20.622836319465534
Path 217 | total_timesteps 5460.
number of affinization with epsilon = 3 is 34
average number of affinization = 20.62689738919247
Path 218 | total_timesteps 5498.
number of affinization with epsilon = 3 is 7
average number of affinization = 20.622761760242792
Path 219 | total_timesteps 5507.
number of affinization with epsilon = 3 is 40
average number of affinization = 20.62864077669903
Path 220 | total_timesteps 5554.
number of affinization with epsilon = 3 is 31
average number of affinization = 20.631786472550804
Path 221 | total_timesteps 5592.
number of affinization with epsilon = 3 is 20
average number of affinization = 20.631594906003638
Path 222 | total_timesteps 5618.
number of affinization with epsilon = 3 is 26
average number of affinization = 20.633222188541982
Path 223 | total_timesteps 5649.
number of affinization with epsilon = 3 is 13
average number of affinization = 20.630909090909093
Path 224 | total_timesteps 5666.
number of affinization with epsilon = 3 is 18
average number of affinization = 20.63011208724629
Path 225 | total_timesteps 5685.
number of affinization with epsilon = 3 is 71
average number of affinization = 20.645366444579043
Path 226 | total_timesteps 5772.
number of affinization with epsilon = 3 is 10
average number of affinization = 20.642143505903725
Path 227 | total_timesteps 5784.
number of affinization with epsilon = 3 is 13
average number of affinization = 20.639830508474578
Path 228 | total_timesteps 5801.
number of affinization with epsilon = 3 is 29
average number of affinization = 20.64236006051437
Path 229 | total_timesteps 5836.
number of affinization with epsilon = 3 is 25
average number of affinization = 20.64367816091954
Path 230 | total_timesteps 5864.
number of affinization with epsilon = 3 is 18
average number of affinization = 20.64287874206229
Path 231 | total_timesteps 5888.
number of affinization with epsilon = 3 is 23
average number of affinization = 20.643591293833133
Path 232 | total_timesteps 5919.
number of affinization with epsilon = 3 is 22
average number of affinization = 20.644001208824417
Path 233 | total_timesteps 5943.
number of affinization with epsilon = 3 is 15
average number of affinization = 20.642296072507552
Path 234 | total_timesteps 5961.
number of affinization with epsilon = 3 is 42
average number of affinization = 20.648746602234976
Done generating on-policy rollouts.
Updating normalization.
Done updating normalization.
----------------------------
| AverageReturn | -6.51    |
| Iteration     | 13       |
| MaximumReturn | 13.3     |
| MinimumReturn | -28.5    |
| TotalSamples  | 60198    |
----------------------------
itr #14 | 
Fitting dynamics.
Fitting model 0 (0-based) in the ensemble of 2 models
Validation loss = 0.019136065617203712
Validation loss = 0.018461834639310837
Validation loss = 0.01959315501153469
Validation loss = 0.01801925152540207
Validation loss = 0.018285365775227547
Validation loss = 0.01791100762784481
Validation loss = 0.0200961884111166
Validation loss = 0.018720010295510292
Validation loss = 0.019300149753689766
Validation loss = 0.01871182769536972
Fitting model 1 (0-based) in the ensemble of 2 models
Validation loss = 0.018977360799908638
Validation loss = 0.018592894077301025
Validation loss = 0.018397392705082893
Validation loss = 0.01822970248758793
Validation loss = 0.018113721162080765
Validation loss = 0.01821848936378956
Validation loss = 0.018291091546416283
Validation loss = 0.01803038828074932
Validation loss = 0.01772349141538143
Validation loss = 0.018863331526517868
Validation loss = 0.01783984899520874
Validation loss = 0.017802298069000244
Validation loss = 0.018343830481171608
Done fitting dynamics.
Updating randomness.
Done updating randomness.
Training policy using TRPO.
Re-initialize init_std.
Obtaining samples for iteration 0...
Obtaining samples for iteration 1...
Obtaining samples for iteration 2...
Obtaining samples for iteration 3...
Obtaining samples for iteration 4...
Obtaining samples for iteration 5...
Obtaining samples for iteration 6...
Obtaining samples for iteration 7...
Obtaining samples for iteration 8...
Obtaining samples for iteration 9...
Obtaining samples for iteration 10...
Obtaining samples for iteration 11...
Obtaining samples for iteration 12...
Obtaining samples for iteration 13...
Obtaining samples for iteration 14...
Obtaining samples for iteration 15...
Obtaining samples for iteration 16...
Obtaining samples for iteration 17...
Obtaining samples for iteration 18...
Obtaining samples for iteration 19...
Done training policy.
Generating on-policy rollouts.
Path 0 | total_timesteps 0.
number of affinization with epsilon = 3 is 8
average number of affinization = 20.644927536231883
Path 1 | total_timesteps 12.
number of affinization with epsilon = 3 is 32
average number of affinization = 20.64835496528826
Path 2 | total_timesteps 51.
number of affinization with epsilon = 3 is 14
average number of affinization = 20.64634882317441
Path 3 | total_timesteps 66.
number of affinization with epsilon = 3 is 13
average number of affinization = 20.644042232277528
Path 4 | total_timesteps 82.
number of affinization with epsilon = 3 is 13
average number of affinization = 20.64173703256936
Path 5 | total_timesteps 98.
number of affinization with epsilon = 3 is 12
average number of affinization = 20.63913174555321
Path 6 | total_timesteps 116.
number of affinization with epsilon = 3 is 14
average number of affinization = 20.637130801687764
Path 7 | total_timesteps 132.
number of affinization with epsilon = 3 is 20
average number of affinization = 20.636938836999096
Path 8 | total_timesteps 154.
number of affinization with epsilon = 3 is 20
average number of affinization = 20.636746987951806
Path 9 | total_timesteps 175.
number of affinization with epsilon = 3 is 8
average number of affinization = 20.632941884974404
Path 10 | total_timesteps 185.
number of affinization with epsilon = 3 is 11
average number of affinization = 20.630042143287177
Path 11 | total_timesteps 197.
number of affinization with epsilon = 3 is 7
average number of affinization = 20.625940415287392
Path 12 | total_timesteps 206.
number of affinization with epsilon = 3 is 16
average number of affinization = 20.624548736462096
Path 13 | total_timesteps 227.
number of affinization with epsilon = 3 is 14
average number of affinization = 20.622556390977444
Path 14 | total_timesteps 243.
number of affinization with epsilon = 3 is 27
average number of affinization = 20.624473842453398
Path 15 | total_timesteps 273.
number of affinization with epsilon = 3 is 25
average number of affinization = 20.625788999098287
Path 16 | total_timesteps 300.
number of affinization with epsilon = 3 is 15
average number of affinization = 20.624098557692307
Path 17 | total_timesteps 318.
number of affinization with epsilon = 3 is 31
average number of affinization = 20.62721537999399
Path 18 | total_timesteps 352.
number of affinization with epsilon = 3 is 39
average number of affinization = 20.632732732732734
Path 19 | total_timesteps 394.
number of affinization with epsilon = 3 is 31
average number of affinization = 20.635845091564097
Path 20 | total_timesteps 427.
number of affinization with epsilon = 3 is 16
average number of affinization = 20.634453781512605
Path 21 | total_timesteps 449.
number of affinization with epsilon = 3 is 13
average number of affinization = 20.632163216321633
Path 22 | total_timesteps 465.
number of affinization with epsilon = 3 is 16
average number of affinization = 20.630773845230955
Path 23 | total_timesteps 484.
number of affinization with epsilon = 3 is 26
average number of affinization = 20.632383808095952
Path 24 | total_timesteps 514.
number of affinization with epsilon = 3 is 9
average number of affinization = 20.628896882494004
Path 25 | total_timesteps 525.
number of affinization with epsilon = 3 is 14
average number of affinization = 20.62691039856158
Path 26 | total_timesteps 542.
number of affinization with epsilon = 3 is 23
average number of affinization = 20.627621330137806
Path 27 | total_timesteps 570.
number of affinization with epsilon = 3 is 9
average number of affinization = 20.624138963761606
Path 28 | total_timesteps 580.
number of affinization with epsilon = 3 is 9
average number of affinization = 20.62065868263473
Path 29 | total_timesteps 591.
number of affinization with epsilon = 3 is 7
average number of affinization = 20.61658186171805
Path 30 | total_timesteps 599.
number of affinization with epsilon = 3 is 12
average number of affinization = 20.61400359066427
Path 31 | total_timesteps 613.
number of affinization with epsilon = 3 is 61
average number of affinization = 20.62608435536943
Path 32 | total_timesteps 685.
number of affinization with epsilon = 3 is 21
average number of affinization = 20.626196172248804
Path 33 | total_timesteps 713.
number of affinization with epsilon = 3 is 11
average number of affinization = 20.623318385650226
Path 34 | total_timesteps 725.
number of affinization with epsilon = 3 is 31
average number of affinization = 20.626419605499102
Path 35 | total_timesteps 761.
number of affinization with epsilon = 3 is 10
average number of affinization = 20.623244696743352
Path 36 | total_timesteps 776.
number of affinization with epsilon = 3 is 49
average number of affinization = 20.631720430107528
Path 37 | total_timesteps 831.
number of affinization with epsilon = 3 is 8
average number of affinization = 20.627948641385487
Path 38 | total_timesteps 842.
number of affinization with epsilon = 3 is 16
average number of affinization = 20.626567164179104
Path 39 | total_timesteps 861.
number of affinization with epsilon = 3 is 16
average number of affinization = 20.625186511489108
Path 40 | total_timesteps 879.
number of affinization with epsilon = 3 is 19
average number of affinization = 20.62470167064439
Path 41 | total_timesteps 901.
number of affinization with epsilon = 3 is 16
average number of affinization = 20.623322397852668
Path 42 | total_timesteps 922.
number of affinization with epsilon = 3 is 17
average number of affinization = 20.622242098986284
Path 43 | total_timesteps 941.
number of affinization with epsilon = 3 is 15
average number of affinization = 20.620566318926976
Path 44 | total_timesteps 958.
number of affinization with epsilon = 3 is 19
average number of affinization = 20.620083432657925
Path 45 | total_timesteps 980.
number of affinization with epsilon = 3 is 14
average number of affinization = 20.61811140899613
Path 46 | total_timesteps 996.
number of affinization with epsilon = 3 is 18
average number of affinization = 20.61733174508636
Path 47 | total_timesteps 1015.
number of affinization with epsilon = 3 is 13
average number of affinization = 20.615064007144984
Path 48 | total_timesteps 1034.
number of affinization with epsilon = 3 is 13
average number of affinization = 20.61279761904762
Path 49 | total_timesteps 1049.
number of affinization with epsilon = 3 is 10
average number of affinization = 20.60963998809878
Path 50 | total_timesteps 1060.
number of affinization with epsilon = 3 is 7
average number of affinization = 20.605591909577633
Path 51 | total_timesteps 1070.
number of affinization with epsilon = 3 is 37
average number of affinization = 20.6104668450788
Path 52 | total_timesteps 1111.
number of affinization with epsilon = 3 is 26
average number of affinization = 20.612068965517242
Path 53 | total_timesteps 1141.
number of affinization with epsilon = 3 is 12
average number of affinization = 20.609509658246658
Path 54 | total_timesteps 1155.
number of affinization with epsilon = 3 is 10
average number of affinization = 20.60635769459299
Path 55 | total_timesteps 1169.
number of affinization with epsilon = 3 is 14
average number of affinization = 20.604395604395606
Path 56 | total_timesteps 1184.
number of affinization with epsilon = 3 is 12
average number of affinization = 20.60184085510689
Path 57 | total_timesteps 1200.
number of affinization with epsilon = 3 is 17
average number of affinization = 20.600771742356784
Path 58 | total_timesteps 1220.
number of affinization with epsilon = 3 is 20
average number of affinization = 20.60059347181009
Path 59 | total_timesteps 1245.
number of affinization with epsilon = 3 is 14
average number of affinization = 20.59863541975675
Path 60 | total_timesteps 1261.
number of affinization with epsilon = 3 is 28
average number of affinization = 20.600830367734282
Path 61 | total_timesteps 1291.
number of affinization with epsilon = 3 is 20
average number of affinization = 20.600652238363473
Path 62 | total_timesteps 1316.
number of affinization with epsilon = 3 is 39
average number of affinization = 20.606105512744517
Path 63 | total_timesteps 1361.
number of affinization with epsilon = 3 is 22
average number of affinization = 20.60651851851852
Path 64 | total_timesteps 1388.
number of affinization with epsilon = 3 is 18
average number of affinization = 20.60574644549763
Path 65 | total_timesteps 1407.
number of affinization with epsilon = 3 is 13
average number of affinization = 20.603494225644063
Path 66 | total_timesteps 1423.
number of affinization with epsilon = 3 is 16
average number of affinization = 20.602131438721138
Path 67 | total_timesteps 1440.
number of affinization with epsilon = 3 is 42
average number of affinization = 20.60846404261616
Path 68 | total_timesteps 1486.
number of affinization with epsilon = 3 is 68
average number of affinization = 20.622485207100592
Path 69 | total_timesteps 1567.
number of affinization with epsilon = 3 is 12
average number of affinization = 20.619934930493937
Path 70 | total_timesteps 1584.
number of affinization with epsilon = 3 is 16
average number of affinization = 20.618568894145476
Path 71 | total_timesteps 1603.
number of affinization with epsilon = 3 is 14
average number of affinization = 20.616612474135383
Path 72 | total_timesteps 1619.
number of affinization with epsilon = 3 is 15
average number of affinization = 20.614952718676122
Path 73 | total_timesteps 1636.
number of affinization with epsilon = 3 is 24
average number of affinization = 20.61595273264402
Path 74 | total_timesteps 1665.
number of affinization with epsilon = 3 is 34
average number of affinization = 20.619905493207323
Path 75 | total_timesteps 1704.
number of affinization with epsilon = 3 is 31
average number of affinization = 20.622970180100385
Path 76 | total_timesteps 1739.
number of affinization with epsilon = 3 is 9
average number of affinization = 20.619539551357732
Path 77 | total_timesteps 1749.
number of affinization with epsilon = 3 is 12
average number of affinization = 20.616996164060193
Path 78 | total_timesteps 1763.
number of affinization with epsilon = 3 is 9
average number of affinization = 20.613569321533923
Path 79 | total_timesteps 1775.
number of affinization with epsilon = 3 is 5
average number of affinization = 20.608964907107048
Path 80 | total_timesteps 1786.
number of affinization with epsilon = 3 is 21
average number of affinization = 20.609080188679247
Path 81 | total_timesteps 1809.
number of affinization with epsilon = 3 is 13
average number of affinization = 20.60683760683761
Path 82 | total_timesteps 1825.
number of affinization with epsilon = 3 is 10
average number of affinization = 20.60371243370654
Path 83 | total_timesteps 1837.
number of affinization with epsilon = 3 is 13
average number of affinization = 20.601472754050075
Path 84 | total_timesteps 1855.
number of affinization with epsilon = 3 is 24
average number of affinization = 20.602473498233216
Path 85 | total_timesteps 1880.
number of affinization with epsilon = 3 is 11
average number of affinization = 20.59964674712982
Path 86 | total_timesteps 1892.
number of affinization with epsilon = 3 is 36
average number of affinization = 20.604178928781636
Path 87 | total_timesteps 1934.
number of affinization with epsilon = 3 is 35
average number of affinization = 20.6084142394822
Path 88 | total_timesteps 1973.
number of affinization with epsilon = 3 is 11
average number of affinization = 20.605588235294118
Path 89 | total_timesteps 1986.
number of affinization with epsilon = 3 is 12
average number of affinization = 20.603057924139957
Path 90 | total_timesteps 2001.
number of affinization with epsilon = 3 is 6
average number of affinization = 20.598765432098766
Path 91 | total_timesteps 2009.
number of affinization with epsilon = 3 is 10
average number of affinization = 20.595650896267998
Path 92 | total_timesteps 2021.
number of affinization with epsilon = 3 is 9
average number of affinization = 20.592244418331376
Path 93 | total_timesteps 2032.
number of affinization with epsilon = 3 is 28
average number of affinization = 20.594419970631424
Path 94 | total_timesteps 2066.
number of affinization with epsilon = 3 is 17
average number of affinization = 20.593364650616557
Path 95 | total_timesteps 2086.
number of affinization with epsilon = 3 is 11
average number of affinization = 20.590548869973585
Path 96 | total_timesteps 2100.
number of affinization with epsilon = 3 is 20
average number of affinization = 20.59037558685446
Path 97 | total_timesteps 2122.
number of affinization with epsilon = 3 is 18
average number of affinization = 20.58961572308595
Path 98 | total_timesteps 2142.
number of affinization with epsilon = 3 is 25
average number of affinization = 20.59090909090909
Path 99 | total_timesteps 2170.
number of affinization with epsilon = 3 is 10
average number of affinization = 20.58780416300205
Path 100 | total_timesteps 2182.
number of affinization with epsilon = 3 is 57
average number of affinization = 20.59847596717468
Path 101 | total_timesteps 2251.
number of affinization with epsilon = 3 is 15
average number of affinization = 20.596835628479344
Path 102 | total_timesteps 2267.
number of affinization with epsilon = 3 is 17
average number of affinization = 20.59578207381371
Path 103 | total_timesteps 2288.
number of affinization with epsilon = 3 is 9
average number of affinization = 20.59238653001464
Path 104 | total_timesteps 2300.
number of affinization with epsilon = 3 is 10
average number of affinization = 20.589285714285715
Path 105 | total_timesteps 2311.
number of affinization with epsilon = 3 is 9
average number of affinization = 20.585894059116185
Path 106 | total_timesteps 2324.
number of affinization with epsilon = 3 is 23
average number of affinization = 20.586600351082506
Path 107 | total_timesteps 2352.
number of affinization with epsilon = 3 is 13
average number of affinization = 20.58438139806961
Path 108 | total_timesteps 2368.
number of affinization with epsilon = 3 is 13
average number of affinization = 20.58216374269006
Path 109 | total_timesteps 2382.
number of affinization with epsilon = 3 is 38
average number of affinization = 20.587255188541363
Path 110 | total_timesteps 2423.
number of affinization with epsilon = 3 is 23
average number of affinization = 20.587960257159555
Path 111 | total_timesteps 2447.
number of affinization with epsilon = 3 is 12
average number of affinization = 20.585451358457494
Path 112 | total_timesteps 2461.
number of affinization with epsilon = 3 is 14
average number of affinization = 20.58352803738318
Path 113 | total_timesteps 2477.
number of affinization with epsilon = 3 is 6
average number of affinization = 20.5792700729927
Path 114 | total_timesteps 2487.
number of affinization with epsilon = 3 is 11
average number of affinization = 20.576474022183305
Path 115 | total_timesteps 2500.
number of affinization with epsilon = 3 is 10
average number of affinization = 20.573387802742925
Path 116 | total_timesteps 2515.
number of affinization with epsilon = 3 is 15
average number of affinization = 20.57176196032672
Path 117 | total_timesteps 2533.
number of affinization with epsilon = 3 is 19
average number of affinization = 20.57130358705162
Path 118 | total_timesteps 2554.
number of affinization with epsilon = 3 is 27
average number of affinization = 20.5731778425656
Path 119 | total_timesteps 2590.
number of affinization with epsilon = 3 is 34
average number of affinization = 20.577091227047507
Path 120 | total_timesteps 2629.
number of affinization with epsilon = 3 is 15
average number of affinization = 20.5754662004662
Path 121 | total_timesteps 2646.
number of affinization with epsilon = 3 is 10
average number of affinization = 20.572385668511505
Path 122 | total_timesteps 2658.
number of affinization with epsilon = 3 is 11
average number of affinization = 20.569598136284217
Path 123 | total_timesteps 2672.
number of affinization with epsilon = 3 is 7
average number of affinization = 20.56564774381368
Path 124 | total_timesteps 2683.
number of affinization with epsilon = 3 is 12
average number of affinization = 20.563154831199068
Path 125 | total_timesteps 2702.
number of affinization with epsilon = 3 is 24
average number of affinization = 20.564154786150713
Path 126 | total_timesteps 2729.
number of affinization with epsilon = 3 is 10
average number of affinization = 20.56108202443281
Path 127 | total_timesteps 2741.
number of affinization with epsilon = 3 is 19
average number of affinization = 20.560628089560918
Path 128 | total_timesteps 2761.
number of affinization with epsilon = 3 is 14
average number of affinization = 20.558720930232557
Path 129 | total_timesteps 2777.
number of affinization with epsilon = 3 is 29
average number of affinization = 20.56117407730311
Path 130 | total_timesteps 2808.
number of affinization with epsilon = 3 is 15
average number of affinization = 20.559558396281233
Path 131 | total_timesteps 2829.
number of affinization with epsilon = 3 is 20
average number of affinization = 20.559395875689805
Path 132 | total_timesteps 2852.
number of affinization with epsilon = 3 is 25
average number of affinization = 20.56068524970964
Path 133 | total_timesteps 2883.
number of affinization with epsilon = 3 is 12
average number of affinization = 20.558200290275764
Path 134 | total_timesteps 2898.
number of affinization with epsilon = 3 is 21
average number of affinization = 20.558328496807892
Path 135 | total_timesteps 2924.
number of affinization with epsilon = 3 is 12
average number of affinization = 20.555845662895273
Path 136 | total_timesteps 2938.
number of affinization with epsilon = 3 is 9
average number of affinization = 20.552494199535964
Path 137 | total_timesteps 2950.
number of affinization with epsilon = 3 is 16
average number of affinization = 20.551174253406785
Path 138 | total_timesteps 2970.
number of affinization with epsilon = 3 is 8
average number of affinization = 20.54753623188406
Path 139 | total_timesteps 2980.
number of affinization with epsilon = 3 is 43
average number of affinization = 20.554042306577802
Path 140 | total_timesteps 3030.
number of affinization with epsilon = 3 is 17
average number of affinization = 20.553012746234067
Path 141 | total_timesteps 3049.
number of affinization with epsilon = 3 is 17
average number of affinization = 20.55198378221836
Path 142 | total_timesteps 3069.
number of affinization with epsilon = 3 is 14
average number of affinization = 20.55008685581934
Path 143 | total_timesteps 3086.
number of affinization with epsilon = 3 is 21
average number of affinization = 20.550217076700434
Path 144 | total_timesteps 3110.
number of affinization with epsilon = 3 is 25
average number of affinization = 20.55150462962963
Path 145 | total_timesteps 3139.
number of affinization with epsilon = 3 is 21
average number of affinization = 20.551634365056408
Path 146 | total_timesteps 3164.
number of affinization with epsilon = 3 is 24
average number of affinization = 20.55263157894737
Path 147 | total_timesteps 3193.
number of affinization with epsilon = 3 is 15
average number of affinization = 20.551026308181555
Path 148 | total_timesteps 3210.
number of affinization with epsilon = 3 is 7
average number of affinization = 20.547109826589594
Path 149 | total_timesteps 3219.
number of affinization with epsilon = 3 is 17
average number of affinization = 20.54608494654724
Path 150 | total_timesteps 3239.
number of affinization with epsilon = 3 is 18
average number of affinization = 20.545349508954363
Path 151 | total_timesteps 3261.
number of affinization with epsilon = 3 is 15
average number of affinization = 20.54374819520647
Path 152 | total_timesteps 3277.
number of affinization with epsilon = 3 is 16
average number of affinization = 20.54243648960739
Path 153 | total_timesteps 3297.
number of affinization with epsilon = 3 is 13
average number of affinization = 20.54025974025974
Path 154 | total_timesteps 3312.
number of affinization with epsilon = 3 is 20
average number of affinization = 20.540103866128103
Path 155 | total_timesteps 3335.
number of affinization with epsilon = 3 is 12
average number of affinization = 20.537640611479667
Path 156 | total_timesteps 3349.
number of affinization with epsilon = 3 is 25
average number of affinization = 20.53892733564014
Path 157 | total_timesteps 3380.
number of affinization with epsilon = 3 is 14
average number of affinization = 20.5370423753243
Path 158 | total_timesteps 3396.
number of affinization with epsilon = 3 is 8
average number of affinization = 20.53342939481268
Path 159 | total_timesteps 3406.
number of affinization with epsilon = 3 is 13
average number of affinization = 20.531259003169115
Path 160 | total_timesteps 3423.
number of affinization with epsilon = 3 is 47
average number of affinization = 20.538882488479263
Path 161 | total_timesteps 3476.
number of affinization with epsilon = 3 is 18
average number of affinization = 20.53815145407429
Path 162 | total_timesteps 3497.
number of affinization with epsilon = 3 is 24
average number of affinization = 20.539147956246403
Path 163 | total_timesteps 3525.
number of affinization with epsilon = 3 is 13
average number of affinization = 20.536978417266187
Path 164 | total_timesteps 3539.
number of affinization with epsilon = 3 is 14
average number of affinization = 20.535097813578826
Path 165 | total_timesteps 3555.
number of affinization with epsilon = 3 is 12
average number of affinization = 20.53264308311763
Path 166 | total_timesteps 3570.
number of affinization with epsilon = 3 is 17
average number of affinization = 20.531627372052903
Path 167 | total_timesteps 3589.
number of affinization with epsilon = 3 is 33
average number of affinization = 20.535211267605632
Path 168 | total_timesteps 3626.
number of affinization with epsilon = 3 is 8
average number of affinization = 20.5316091954023
Path 169 | total_timesteps 3636.
number of affinization with epsilon = 3 is 13
average number of affinization = 20.529445561620225
Path 170 | total_timesteps 3653.
number of affinization with epsilon = 3 is 14
average number of affinization = 20.527570361861
Path 171 | total_timesteps 3668.
number of affinization with epsilon = 3 is 15
average number of affinization = 20.525983347688776
Path 172 | total_timesteps 3686.
number of affinization with epsilon = 3 is 19
average number of affinization = 20.525545350172216
Path 173 | total_timesteps 3706.
number of affinization with epsilon = 3 is 22
average number of affinization = 20.52596843615495
Path 174 | total_timesteps 3730.
number of affinization with epsilon = 3 is 16
average number of affinization = 20.52467010900746
Path 175 | total_timesteps 3752.
number of affinization with epsilon = 3 is 16
average number of affinization = 20.5233725265271
Path 176 | total_timesteps 3771.
number of affinization with epsilon = 3 is 18
average number of affinization = 20.522649082568808
Path 177 | total_timesteps 3792.
number of affinization with epsilon = 3 is 16
average number of affinization = 20.521352823158498
Path 178 | total_timesteps 3812.
number of affinization with epsilon = 3 is 27
average number of affinization = 20.523209169054443
Path 179 | total_timesteps 3842.
number of affinization with epsilon = 3 is 6
average number of affinization = 20.5190489830994
Path 180 | total_timesteps 3852.
number of affinization with epsilon = 3 is 24
average number of affinization = 20.520045819014893
Path 181 | total_timesteps 3879.
number of affinization with epsilon = 3 is 5
average number of affinization = 20.515602633839105
Path 182 | total_timesteps 3886.
number of affinization with epsilon = 3 is 8
average number of affinization = 20.512020606754437
Path 183 | total_timesteps 3899.
number of affinization with epsilon = 3 is 23
average number of affinization = 20.512732474964235
Path 184 | total_timesteps 3926.
number of affinization with epsilon = 3 is 24
average number of affinization = 20.513729977116704
Path 185 | total_timesteps 3954.
number of affinization with epsilon = 3 is 16
average number of affinization = 20.512439233628825
Path 186 | total_timesteps 3975.
number of affinization with epsilon = 3 is 6
average number of affinization = 20.50829045168668
Path 187 | total_timesteps 3984.
number of affinization with epsilon = 3 is 12
average number of affinization = 20.5058588168048
Path 188 | total_timesteps 4002.
number of affinization with epsilon = 3 is 17
average number of affinization = 20.504857142857144
Path 189 | total_timesteps 4023.
number of affinization with epsilon = 3 is 11
average number of affinization = 20.502142245072836
Path 190 | total_timesteps 4038.
number of affinization with epsilon = 3 is 20
average number of affinization = 20.501998857795545
Path 191 | total_timesteps 4061.
number of affinization with epsilon = 3 is 22
average number of affinization = 20.502426491578646
Path 192 | total_timesteps 4087.
number of affinization with epsilon = 3 is 14
average number of affinization = 20.500570776255707
Path 193 | total_timesteps 4104.
number of affinization with epsilon = 3 is 12
average number of affinization = 20.4981455064194
Path 194 | total_timesteps 4118.
number of affinization with epsilon = 3 is 11
average number of affinization = 20.495436394751852
Path 195 | total_timesteps 4130.
number of affinization with epsilon = 3 is 20
average number of affinization = 20.49529512403764
Path 196 | total_timesteps 4157.
number of affinization with epsilon = 3 is 19
average number of affinization = 20.494868871151652
Path 197 | total_timesteps 4178.
number of affinization with epsilon = 3 is 10
average number of affinization = 20.491878027928184
Path 198 | total_timesteps 4190.
number of affinization with epsilon = 3 is 11
average number of affinization = 20.48917378917379
Path 199 | total_timesteps 4205.
number of affinization with epsilon = 3 is 14
average number of affinization = 20.487325548276843
Path 200 | total_timesteps 4222.
number of affinization with epsilon = 3 is 13
average number of affinization = 20.485193621867882
Path 201 | total_timesteps 4239.
number of affinization with epsilon = 3 is 21
average number of affinization = 20.485340165101054
Path 202 | total_timesteps 4263.
number of affinization with epsilon = 3 is 23
average number of affinization = 20.48605577689243
Path 203 | total_timesteps 4289.
number of affinization with epsilon = 3 is 7
average number of affinization = 20.48221906116643
Path 204 | total_timesteps 4298.
number of affinization with epsilon = 3 is 16
average number of affinization = 20.48094425483504
Path 205 | total_timesteps 4317.
number of affinization with epsilon = 3 is 14
average number of affinization = 20.479101506966163
Path 206 | total_timesteps 4336.
number of affinization with epsilon = 3 is 18
average number of affinization = 20.47839681637294
Path 207 | total_timesteps 4356.
number of affinization with epsilon = 3 is 26
average number of affinization = 20.47996589940324
Path 208 | total_timesteps 4386.
number of affinization with epsilon = 3 is 22
average number of affinization = 20.480397727272727
Path 209 | total_timesteps 4413.
number of affinization with epsilon = 3 is 12
average number of affinization = 20.477989207611476
Path 210 | total_timesteps 4427.
number of affinization with epsilon = 3 is 28
average number of affinization = 20.480124929017602
Path 211 | total_timesteps 4465.
number of affinization with epsilon = 3 is 14
average number of affinization = 20.47828555208629
Path 212 | total_timesteps 4481.
number of affinization with epsilon = 3 is 20
average number of affinization = 20.478149829738932
Path 213 | total_timesteps 4506.
number of affinization with epsilon = 3 is 35
average number of affinization = 20.4822695035461
Path 214 | total_timesteps 4550.
number of affinization with epsilon = 3 is 18
average number of affinization = 20.481565513329553
Path 215 | total_timesteps 4571.
number of affinization with epsilon = 3 is 26
average number of affinization = 20.483130138928267
Path 216 | total_timesteps 4602.
number of affinization with epsilon = 3 is 24
average number of affinization = 20.484126984126984
Path 217 | total_timesteps 4630.
number of affinization with epsilon = 3 is 35
average number of affinization = 20.488240294701047
Path 218 | total_timesteps 4669.
number of affinization with epsilon = 3 is 24
average number of affinization = 20.489235127478754
Path 219 | total_timesteps 4696.
number of affinization with epsilon = 3 is 25
average number of affinization = 20.490512602662136
Path 220 | total_timesteps 4726.
number of affinization with epsilon = 3 is 10
average number of affinization = 20.487542468856173
Path 221 | total_timesteps 4738.
number of affinization with epsilon = 3 is 17
average number of affinization = 20.486555335409
Path 222 | total_timesteps 4761.
number of affinization with epsilon = 3 is 15
average number of affinization = 20.485002829654782
Path 223 | total_timesteps 4781.
number of affinization with epsilon = 3 is 9
average number of affinization = 20.481753889674682
Path 224 | total_timesteps 4791.
number of affinization with epsilon = 3 is 11
average number of affinization = 20.479072398190045
Path 225 | total_timesteps 4806.
number of affinization with epsilon = 3 is 12
average number of affinization = 20.476675148430875
Path 226 | total_timesteps 4821.
number of affinization with epsilon = 3 is 21
average number of affinization = 20.476823063877898
Path 227 | total_timesteps 4845.
number of affinization with epsilon = 3 is 12
average number of affinization = 20.474427804464536
Path 228 | total_timesteps 4859.
number of affinization with epsilon = 3 is 40
average number of affinization = 20.47994350282486
Path 229 | total_timesteps 4902.
number of affinization with epsilon = 3 is 12
average number of affinization = 20.477548715052244
Path 230 | total_timesteps 4917.
number of affinization with epsilon = 3 is 38
average number of affinization = 20.48249576510446
Path 231 | total_timesteps 4963.
number of affinization with epsilon = 3 is 27
average number of affinization = 20.484335309060118
Path 232 | total_timesteps 4991.
number of affinization with epsilon = 3 is 15
average number of affinization = 20.482787810383748
Path 233 | total_timesteps 5007.
number of affinization with epsilon = 3 is 10
average number of affinization = 20.479830747531736
Path 234 | total_timesteps 5022.
number of affinization with epsilon = 3 is 30
average number of affinization = 20.482515510434293
Path 235 | total_timesteps 5057.
number of affinization with epsilon = 3 is 5
average number of affinization = 20.47815054976036
Path 236 | total_timesteps 5065.
number of affinization with epsilon = 3 is 24
average number of affinization = 20.479143179255917
Path 237 | total_timesteps 5094.
number of affinization with epsilon = 3 is 16
average number of affinization = 20.477881093265708
Path 238 | total_timesteps 5113.
number of affinization with epsilon = 3 is 24
average number of affinization = 20.47887323943662
Path 239 | total_timesteps 5138.
number of affinization with epsilon = 3 is 10
average number of affinization = 20.475922275415375
Path 240 | total_timesteps 5152.
number of affinization with epsilon = 3 is 11
average number of affinization = 20.473254504504503
Path 241 | total_timesteps 5166.
number of affinization with epsilon = 3 is 16
average number of affinization = 20.4719954967633
Path 242 | total_timesteps 5187.
number of affinization with epsilon = 3 is 11
average number of affinization = 20.46933033202026
Path 243 | total_timesteps 5201.
number of affinization with epsilon = 3 is 18
average number of affinization = 20.46863572433193
Path 244 | total_timesteps 5221.
number of affinization with epsilon = 3 is 19
average number of affinization = 20.46822272215973
Path 245 | total_timesteps 5244.
number of affinization with epsilon = 3 is 10
average number of affinization = 20.465279730109643
Path 246 | total_timesteps 5259.
number of affinization with epsilon = 3 is 12
average number of affinization = 20.46290050590219
Path 247 | total_timesteps 5274.
number of affinization with epsilon = 3 is 17
average number of affinization = 20.46192750772689
Path 248 | total_timesteps 5298.
number of affinization with epsilon = 3 is 33
average number of affinization = 20.465449438202246
Path 249 | total_timesteps 5334.
number of affinization with epsilon = 3 is 38
average number of affinization = 20.47037349059253
Path 250 | total_timesteps 5379.
number of affinization with epsilon = 3 is 10
average number of affinization = 20.467434025828187
Path 251 | total_timesteps 5393.
number of affinization with epsilon = 3 is 20
average number of affinization = 20.467302834689868
Path 252 | total_timesteps 5421.
number of affinization with epsilon = 3 is 11
average number of affinization = 20.464646464646464
Path 253 | total_timesteps 5436.
number of affinization with epsilon = 3 is 14
average number of affinization = 20.462833099579242
Path 254 | total_timesteps 5452.
number of affinization with epsilon = 3 is 17
average number of affinization = 20.461862030286035
Path 255 | total_timesteps 5473.
number of affinization with epsilon = 3 is 18
average number of affinization = 20.46117185309784
Path 256 | total_timesteps 5494.
number of affinization with epsilon = 3 is 10
average number of affinization = 20.4582399103139
Path 257 | total_timesteps 5506.
number of affinization with epsilon = 3 is 8
average number of affinization = 20.454749229476043
Path 258 | total_timesteps 5516.
number of affinization with epsilon = 3 is 6
average number of affinization = 20.450700280112045
Path 259 | total_timesteps 5525.
number of affinization with epsilon = 3 is 32
average number of affinization = 20.453934472136655
Path 260 | total_timesteps 5561.
number of affinization with epsilon = 3 is 34
average number of affinization = 20.457726763717805
Path 261 | total_timesteps 5597.
number of affinization with epsilon = 3 is 15
average number of affinization = 20.45619927232018
Path 262 | total_timesteps 5615.
number of affinization with epsilon = 3 is 12
average number of affinization = 20.45383324006715
Path 263 | total_timesteps 5629.
number of affinization with epsilon = 3 is 21
average number of affinization = 20.453986013986015
Path 264 | total_timesteps 5655.
number of affinization with epsilon = 3 is 13
average number of affinization = 20.451901565995527
Path 265 | total_timesteps 5670.
number of affinization with epsilon = 3 is 22
average number of affinization = 20.452334358400893
Path 266 | total_timesteps 5693.
number of affinization with epsilon = 3 is 13
average number of affinization = 20.450251537171603
Path 267 | total_timesteps 5708.
number of affinization with epsilon = 3 is 8
average number of affinization = 20.44677284157586
Path 268 | total_timesteps 5720.
number of affinization with epsilon = 3 is 9
average number of affinization = 20.443575418994413
Path 269 | total_timesteps 5731.
number of affinization with epsilon = 3 is 12
average number of affinization = 20.44121753700084
Path 270 | total_timesteps 5744.
number of affinization with epsilon = 3 is 32
average number of affinization = 20.444444444444443
Path 271 | total_timesteps 5781.
number of affinization with epsilon = 3 is 14
average number of affinization = 20.442645827518838
Path 272 | total_timesteps 5798.
number of affinization with epsilon = 3 is 8
average number of affinization = 20.439174107142858
Path 273 | total_timesteps 5809.
number of affinization with epsilon = 3 is 18
average number of affinization = 20.438493723849373
Path 274 | total_timesteps 5832.
number of affinization with epsilon = 3 is 18
average number of affinization = 20.43781372002231
Path 275 | total_timesteps 5852.
number of affinization with epsilon = 3 is 13
average number of affinization = 20.43574017284639
Path 276 | total_timesteps 5867.
number of affinization with epsilon = 3 is 8
average number of affinization = 20.432274247491637
Path 277 | total_timesteps 5876.
number of affinization with epsilon = 3 is 28
average number of affinization = 20.43438283644469
Path 278 | total_timesteps 5907.
number of affinization with epsilon = 3 is 32
average number of affinization = 20.437604456824513
Path 279 | total_timesteps 5944.
number of affinization with epsilon = 3 is 20
average number of affinization = 20.437482595377332
Path 280 | total_timesteps 5966.
number of affinization with epsilon = 3 is 17
average number of affinization = 20.43652561247216
Path 281 | total_timesteps 5989.
number of affinization with epsilon = 3 is 14
average number of affinization = 20.434734205399387
Done generating on-policy rollouts.
Updating normalization.
Done updating normalization.
----------------------------
| AverageReturn | -6.48    |
| Iteration     | 14       |
| MaximumReturn | 30.5     |
| MinimumReturn | -21.8    |
| TotalSamples  | 64200    |
----------------------------
itr #15 | 
Fitting dynamics.
Fitting model 0 (0-based) in the ensemble of 2 models
Validation loss = 0.01878242939710617
Validation loss = 0.01771068572998047
Validation loss = 0.018784984946250916
Validation loss = 0.017740454524755478
Validation loss = 0.017641743645071983
Validation loss = 0.01765553653240204
Validation loss = 0.017493873834609985
Validation loss = 0.017725300043821335
Validation loss = 0.01732352189719677
Validation loss = 0.01793619990348816
Validation loss = 0.01734638586640358
Validation loss = 0.018099835142493248
Validation loss = 0.01696387305855751
Validation loss = 0.01771037094295025
Validation loss = 0.01768060028553009
Validation loss = 0.017545457929372787
Validation loss = 0.01801377348601818
Fitting model 1 (0-based) in the ensemble of 2 models
Validation loss = 0.017805207520723343
Validation loss = 0.01766773872077465
Validation loss = 0.017676815390586853
Validation loss = 0.01827971450984478
Validation loss = 0.017112424597144127
Validation loss = 0.01720045879483223
Validation loss = 0.017718028277158737
Validation loss = 0.01770828291773796
Validation loss = 0.0184455756098032
Done fitting dynamics.
Updating randomness.
Done updating randomness.
Training policy using TRPO.
Re-initialize init_std.
Obtaining samples for iteration 0...
Obtaining samples for iteration 1...
Obtaining samples for iteration 2...
Obtaining samples for iteration 3...
Obtaining samples for iteration 4...
Obtaining samples for iteration 5...
Obtaining samples for iteration 6...
Obtaining samples for iteration 7...
Obtaining samples for iteration 8...
Obtaining samples for iteration 9...
Obtaining samples for iteration 10...
Obtaining samples for iteration 11...
Obtaining samples for iteration 12...
Obtaining samples for iteration 13...
Obtaining samples for iteration 14...
Obtaining samples for iteration 15...
Obtaining samples for iteration 16...
Obtaining samples for iteration 17...
Obtaining samples for iteration 18...
Obtaining samples for iteration 19...
Done training policy.
Generating on-policy rollouts.
Path 0 | total_timesteps 0.
number of affinization with epsilon = 3 is 14
average number of affinization = 20.432943795214246
Path 1 | total_timesteps 19.
number of affinization with epsilon = 3 is 12
average number of affinization = 20.43059805285118
Path 2 | total_timesteps 34.
number of affinization with epsilon = 3 is 9
average number of affinization = 20.427419354838708
Path 3 | total_timesteps 47.
number of affinization with epsilon = 3 is 17
average number of affinization = 20.426466499860997
Path 4 | total_timesteps 69.
number of affinization with epsilon = 3 is 12
average number of affinization = 20.424124513618676
Path 5 | total_timesteps 84.
number of affinization with epsilon = 3 is 21
average number of affinization = 20.424284523478743
Path 6 | total_timesteps 112.
number of affinization with epsilon = 3 is 11
average number of affinization = 20.421666666666667
Path 7 | total_timesteps 127.
number of affinization with epsilon = 3 is 22
average number of affinization = 20.42210497084143
Path 8 | total_timesteps 152.
number of affinization with epsilon = 3 is 15
average number of affinization = 20.42059966685175
Path 9 | total_timesteps 169.
number of affinization with epsilon = 3 is 8
average number of affinization = 20.417152373022482
Path 10 | total_timesteps 179.
number of affinization with epsilon = 3 is 28
average number of affinization = 20.419256381798004
Path 11 | total_timesteps 212.
number of affinization with epsilon = 3 is 7
average number of affinization = 20.415533980582524
Path 12 | total_timesteps 225.
number of affinization with epsilon = 3 is 21
average number of affinization = 20.41569606211869
Path 13 | total_timesteps 250.
number of affinization with epsilon = 3 is 54
average number of affinization = 20.425006930967562
Path 14 | total_timesteps 314.
number of affinization with epsilon = 3 is 23
average number of affinization = 20.425720620842572
Path 15 | total_timesteps 341.
number of affinization with epsilon = 3 is 20
average number of affinization = 20.425602660016626
Path 16 | total_timesteps 364.
number of affinization with epsilon = 3 is 43
average number of affinization = 20.43185595567867
Path 17 | total_timesteps 414.
number of affinization with epsilon = 3 is 28
average number of affinization = 20.433951813901967
Path 18 | total_timesteps 444.
number of affinization with epsilon = 3 is 6
average number of affinization = 20.42995570321152
Path 19 | total_timesteps 452.
number of affinization with epsilon = 3 is 14
average number of affinization = 20.42817603099917
Path 20 | total_timesteps 469.
number of affinization with epsilon = 3 is 13
average number of affinization = 20.42612064194798
Path 21 | total_timesteps 483.
number of affinization with epsilon = 3 is 25
average number of affinization = 20.42738589211618
Path 22 | total_timesteps 511.
number of affinization with epsilon = 3 is 8
average number of affinization = 20.42394911504425
Path 23 | total_timesteps 521.
number of affinization with epsilon = 3 is 32
average number of affinization = 20.427149571468068
Path 24 | total_timesteps 555.
number of affinization with epsilon = 3 is 27
average number of affinization = 20.428966279712547
Path 25 | total_timesteps 587.
number of affinization with epsilon = 3 is 12
average number of affinization = 20.42663719259464
Path 26 | total_timesteps 600.
number of affinization with epsilon = 3 is 7
average number of affinization = 20.42292817679558
Path 27 | total_timesteps 610.
number of affinization with epsilon = 3 is 9
average number of affinization = 20.419773543220106
Path 28 | total_timesteps 623.
number of affinization with epsilon = 3 is 16
average number of affinization = 20.418553285477635
Path 29 | total_timesteps 641.
number of affinization with epsilon = 3 is 12
average number of affinization = 20.416229643941485
Path 30 | total_timesteps 658.
number of affinization with epsilon = 3 is 18
average number of affinization = 20.415562913907284
Path 31 | total_timesteps 678.
number of affinization with epsilon = 3 is 12
average number of affinization = 20.413241379310346
Path 32 | total_timesteps 693.
number of affinization with epsilon = 3 is 19
average number of affinization = 20.412851627137343
Path 33 | total_timesteps 715.
number of affinization with epsilon = 3 is 23
average number of affinization = 20.413564929693962
Path 34 | total_timesteps 743.
number of affinization with epsilon = 3 is 9
average number of affinization = 20.41041896361632
Path 35 | total_timesteps 755.
number of affinization with epsilon = 3 is 12
average number of affinization = 20.408101405345825
Path 36 | total_timesteps 769.
number of affinization with epsilon = 3 is 10
average number of affinization = 20.405234159779614
Path 37 | total_timesteps 781.
number of affinization with epsilon = 3 is 23
average number of affinization = 20.4059487744423
Path 38 | total_timesteps 810.
number of affinization with epsilon = 3 is 15
average number of affinization = 20.40446035242291
Path 39 | total_timesteps 828.
number of affinization with epsilon = 3 is 11
average number of affinization = 20.401871731351502
Path 40 | total_timesteps 843.
number of affinization with epsilon = 3 is 32
average number of affinization = 20.40506329113924
Path 41 | total_timesteps 882.
number of affinization with epsilon = 3 is 17
average number of affinization = 20.404126547455295
Path 42 | total_timesteps 902.
number of affinization with epsilon = 3 is 16
average number of affinization = 20.40291529152915
Path 43 | total_timesteps 922.
number of affinization with epsilon = 3 is 14
average number of affinization = 20.401154797910365
Path 44 | total_timesteps 940.
number of affinization with epsilon = 3 is 15
average number of affinization = 20.399670148433206
Path 45 | total_timesteps 956.
number of affinization with epsilon = 3 is 20
average number of affinization = 20.39956031876889
Path 46 | total_timesteps 983.
number of affinization with epsilon = 3 is 19
average number of affinization = 20.399175824175824
Path 47 | total_timesteps 1005.
number of affinization with epsilon = 3 is 36
average number of affinization = 20.40346058775062
Path 48 | total_timesteps 1047.
number of affinization with epsilon = 3 is 10
average number of affinization = 20.400604063701262
Path 49 | total_timesteps 1061.
number of affinization with epsilon = 3 is 11
average number of affinization = 20.398023606917377
Path 50 | total_timesteps 1076.
number of affinization with epsilon = 3 is 29
average number of affinization = 20.40038419319429
Path 51 | total_timesteps 1111.
number of affinization with epsilon = 3 is 19
average number of affinization = 20.4
Path 52 | total_timesteps 1132.
number of affinization with epsilon = 3 is 20
average number of affinization = 20.399890290729566
Path 53 | total_timesteps 1156.
number of affinization with epsilon = 3 is 13
average number of affinization = 20.397861255826708
Path 54 | total_timesteps 1172.
number of affinization with epsilon = 3 is 7
average number of affinization = 20.39418859649123
Path 55 | total_timesteps 1181.
number of affinization with epsilon = 3 is 14
average number of affinization = 20.3924362839134
Path 56 | total_timesteps 1201.
number of affinization with epsilon = 3 is 13
average number of affinization = 20.39041095890411
Path 57 | total_timesteps 1216.
number of affinization with epsilon = 3 is 13
average number of affinization = 20.388386743357984
Path 58 | total_timesteps 1234.
number of affinization with epsilon = 3 is 10
average number of affinization = 20.3855421686747
Path 59 | total_timesteps 1249.
number of affinization with epsilon = 3 is 11
average number of affinization = 20.382972898987134
Path 60 | total_timesteps 1267.
number of affinization with epsilon = 3 is 24
average number of affinization = 20.383962780514505
Path 61 | total_timesteps 1296.
number of affinization with epsilon = 3 is 9
average number of affinization = 20.380848153214774
Path 62 | total_timesteps 1307.
number of affinization with epsilon = 3 is 20
average number of affinization = 20.38074398249453
Path 63 | total_timesteps 1330.
number of affinization with epsilon = 3 is 29
average number of affinization = 20.383100902379
Path 64 | total_timesteps 1364.
number of affinization with epsilon = 3 is 19
average number of affinization = 20.382722799343902
Path 65 | total_timesteps 1386.
number of affinization with epsilon = 3 is 11
average number of affinization = 20.380158513254987
Path 66 | total_timesteps 1399.
number of affinization with epsilon = 3 is 7
average number of affinization = 20.376502732240436
Path 67 | total_timesteps 1409.
number of affinization with epsilon = 3 is 19
average number of affinization = 20.376126741327507
Path 68 | total_timesteps 1434.
number of affinization with epsilon = 3 is 30
average number of affinization = 20.378754778809395
Path 69 | total_timesteps 1466.
number of affinization with epsilon = 3 is 16
average number of affinization = 20.37755937755938
Path 70 | total_timesteps 1483.
number of affinization with epsilon = 3 is 14
average number of affinization = 20.375818777292576
Path 71 | total_timesteps 1501.
number of affinization with epsilon = 3 is 21
average number of affinization = 20.37598908594816
Path 72 | total_timesteps 1525.
number of affinization with epsilon = 3 is 9
average number of affinization = 20.372885979268958
Path 73 | total_timesteps 1537.
number of affinization with epsilon = 3 is 7
average number of affinization = 20.369239160076358
Path 74 | total_timesteps 1546.
number of affinization with epsilon = 3 is 12
average number of affinization = 20.366957470010906
Path 75 | total_timesteps 1561.
number of affinization with epsilon = 3 is 19
average number of affinization = 20.366584900517854
Path 76 | total_timesteps 1586.
number of affinization with epsilon = 3 is 14
average number of affinization = 20.36485013623978
Path 77 | total_timesteps 1603.
number of affinization with epsilon = 3 is 12
average number of affinization = 20.362571506401526
Path 78 | total_timesteps 1620.
number of affinization with epsilon = 3 is 10
average number of affinization = 20.359749455337692
Path 79 | total_timesteps 1632.
number of affinization with epsilon = 3 is 5
average number of affinization = 20.355567655867137
Path 80 | total_timesteps 1640.
number of affinization with epsilon = 3 is 16
average number of affinization = 20.354382144801306
Path 81 | total_timesteps 1659.
number of affinization with epsilon = 3 is 22
average number of affinization = 20.354829931972787
Path 82 | total_timesteps 1686.
number of affinization with epsilon = 3 is 15
average number of affinization = 20.353373231773666
Path 83 | total_timesteps 1703.
number of affinization with epsilon = 3 is 29
average number of affinization = 20.355724775632307
Path 84 | total_timesteps 1736.
number of affinization with epsilon = 3 is 18
average number of affinization = 20.355084284937465
Path 85 | total_timesteps 1755.
number of affinization with epsilon = 3 is 17
average number of affinization = 20.354172329437347
Path 86 | total_timesteps 1774.
number of affinization with epsilon = 3 is 16
average number of affinization = 20.352989130434782
Path 87 | total_timesteps 1794.
number of affinization with epsilon = 3 is 9
average number of affinization = 20.34990491714208
Path 88 | total_timesteps 1804.
number of affinization with epsilon = 3 is 15
average number of affinization = 20.348451928299838
Path 89 | total_timesteps 1823.
number of affinization with epsilon = 3 is 8
average number of affinization = 20.345099103991313
Path 90 | total_timesteps 1835.
number of affinization with epsilon = 3 is 9
average number of affinization = 20.34201954397394
Path 91 | total_timesteps 1845.
number of affinization with epsilon = 3 is 14
average number of affinization = 20.340298507462688
Path 92 | total_timesteps 1864.
number of affinization with epsilon = 3 is 16
average number of affinization = 20.33912099837222
Path 93 | total_timesteps 1882.
number of affinization with epsilon = 3 is 19
average number of affinization = 20.33875779766748
Path 94 | total_timesteps 1907.
number of affinization with epsilon = 3 is 7
average number of affinization = 20.335140997830802
Path 95 | total_timesteps 1917.
number of affinization with epsilon = 3 is 12
average number of affinization = 20.33288153971266
Path 96 | total_timesteps 1934.
number of affinization with epsilon = 3 is 10
average number of affinization = 20.33008130081301
Path 97 | total_timesteps 1945.
number of affinization with epsilon = 3 is 13
average number of affinization = 20.328095367109185
Path 98 | total_timesteps 1959.
number of affinization with epsilon = 3 is 15
average number of affinization = 20.326652221018417
Path 99 | total_timesteps 1977.
number of affinization with epsilon = 3 is 12
average number of affinization = 20.324397508800434
Path 100 | total_timesteps 1991.
number of affinization with epsilon = 3 is 12
average number of affinization = 20.322144017325392
Path 101 | total_timesteps 2004.
number of affinization with epsilon = 3 is 19
average number of affinization = 20.321786197564276
Path 102 | total_timesteps 2027.
number of affinization with epsilon = 3 is 14
average number of affinization = 20.320075757575758
Path 103 | total_timesteps 2042.
number of affinization with epsilon = 3 is 22
average number of affinization = 20.320530159588856
Path 104 | total_timesteps 2067.
number of affinization with epsilon = 3 is 39
average number of affinization = 20.325581395348838
Path 105 | total_timesteps 2108.
number of affinization with epsilon = 3 is 19
average number of affinization = 20.32522303325223
Path 106 | total_timesteps 2129.
number of affinization with epsilon = 3 is 27
average number of affinization = 20.32702702702703
Path 107 | total_timesteps 2158.
number of affinization with epsilon = 3 is 18
average number of affinization = 20.326398270737638
Path 108 | total_timesteps 2180.
number of affinization with epsilon = 3 is 21
average number of affinization = 20.326580226904376
Path 109 | total_timesteps 2204.
number of affinization with epsilon = 3 is 19
average number of affinization = 20.326221982176612
Path 110 | total_timesteps 2225.
number of affinization with epsilon = 3 is 18
average number of affinization = 20.3255939524838
Path 111 | total_timesteps 2246.
number of affinization with epsilon = 3 is 20
average number of affinization = 20.325506072874493
Path 112 | total_timesteps 2269.
number of affinization with epsilon = 3 is 8
average number of affinization = 20.322180248246088
Path 113 | total_timesteps 2278.
number of affinization with epsilon = 3 is 17
average number of affinization = 20.3212840571891
Path 114 | total_timesteps 2301.
number of affinization with epsilon = 3 is 14
average number of affinization = 20.31957928802589
Path 115 | total_timesteps 2317.
number of affinization with epsilon = 3 is 8
average number of affinization = 20.316257751415478
Path 116 | total_timesteps 2326.
number of affinization with epsilon = 3 is 17
average number of affinization = 20.315363881401616
Path 117 | total_timesteps 2348.
number of affinization with epsilon = 3 is 33
average number of affinization = 20.318781999461063
Path 118 | total_timesteps 2385.
number of affinization with epsilon = 3 is 16
average number of affinization = 20.317618534482758
Path 119 | total_timesteps 2405.
number of affinization with epsilon = 3 is 8
average number of affinization = 20.314301104228388
Path 120 | total_timesteps 2414.
number of affinization with epsilon = 3 is 9
average number of affinization = 20.311254711900915
Path 121 | total_timesteps 2426.
number of affinization with epsilon = 3 is 13
average number of affinization = 20.3092866756393
Path 122 | total_timesteps 2445.
number of affinization with epsilon = 3 is 29
average number of affinization = 20.31162540365985
Path 123 | total_timesteps 2478.
number of affinization with epsilon = 3 is 15
average number of affinization = 20.310196394942157
Path 124 | total_timesteps 2495.
number of affinization with epsilon = 3 is 13
average number of affinization = 20.308230231307153
Path 125 | total_timesteps 2513.
number of affinization with epsilon = 3 is 13
average number of affinization = 20.30626512503361
Path 126 | total_timesteps 2529.
number of affinization with epsilon = 3 is 22
average number of affinization = 20.30672043010753
Path 127 | total_timesteps 2556.
number of affinization with epsilon = 3 is 9
average number of affinization = 20.30368180596614
Path 128 | total_timesteps 2568.
number of affinization with epsilon = 3 is 30
average number of affinization = 20.30628694250403
Path 129 | total_timesteps 2603.
number of affinization with epsilon = 3 is 33
average number of affinization = 20.30969648133226
Path 130 | total_timesteps 2642.
number of affinization with epsilon = 3 is 38
average number of affinization = 20.314446831364126
Path 131 | total_timesteps 2685.
number of affinization with epsilon = 3 is 20
average number of affinization = 20.314362416107382
Path 132 | total_timesteps 2708.
number of affinization with epsilon = 3 is 7
average number of affinization = 20.310789049919485
Path 133 | total_timesteps 2719.
number of affinization with epsilon = 3 is 15
average number of affinization = 20.309364099812182
Path 134 | total_timesteps 2738.
number of affinization with epsilon = 3 is 40
average number of affinization = 20.31464592274678
Path 135 | total_timesteps 2785.
number of affinization with epsilon = 3 is 7
average number of affinization = 20.311075355323144
Path 136 | total_timesteps 2796.
number of affinization with epsilon = 3 is 17
average number of affinization = 20.31018766756032
Path 137 | total_timesteps 2814.
number of affinization with epsilon = 3 is 31
average number of affinization = 20.31305280085768
Path 138 | total_timesteps 2848.
number of affinization with epsilon = 3 is 13
average number of affinization = 20.311093247588424
Path 139 | total_timesteps 2864.
number of affinization with epsilon = 3 is 14
average number of affinization = 20.309402625234394
Path 140 | total_timesteps 2881.
number of affinization with epsilon = 3 is 21
average number of affinization = 20.309587573647562
Path 141 | total_timesteps 2905.
number of affinization with epsilon = 3 is 17
average number of affinization = 20.308701472556894
Path 142 | total_timesteps 2927.
number of affinization with epsilon = 3 is 14
average number of affinization = 20.307012847965737
Path 143 | total_timesteps 2945.
number of affinization with epsilon = 3 is 15
average number of affinization = 20.305592721434305
Path 144 | total_timesteps 2962.
number of affinization with epsilon = 3 is 9
average number of affinization = 20.302568218298557
Path 145 | total_timesteps 2974.
number of affinization with epsilon = 3 is 33
average number of affinization = 20.30596416154052
Path 146 | total_timesteps 3013.
number of affinization with epsilon = 3 is 27
average number of affinization = 20.307754010695188
Path 147 | total_timesteps 3045.
number of affinization with epsilon = 3 is 18
average number of affinization = 20.307137129109865
Path 148 | total_timesteps 3067.
number of affinization with epsilon = 3 is 13
average number of affinization = 20.305184393372528
Path 149 | total_timesteps 3082.
number of affinization with epsilon = 3 is 29
average number of affinization = 20.30750734704782
Path 150 | total_timesteps 3116.
number of affinization with epsilon = 3 is 13
average number of affinization = 20.305555555555557
Path 151 | total_timesteps 3130.
number of affinization with epsilon = 3 is 13
average number of affinization = 20.303604806408543
Path 152 | total_timesteps 3144.
number of affinization with epsilon = 3 is 18
average number of affinization = 20.302989855846235
Path 153 | total_timesteps 3164.
number of affinization with epsilon = 3 is 17
average number of affinization = 20.302108353349347
Path 154 | total_timesteps 3187.
number of affinization with epsilon = 3 is 12
average number of affinization = 20.29989327641409
Path 155 | total_timesteps 3202.
number of affinization with epsilon = 3 is 23
average number of affinization = 20.300613496932517
Path 156 | total_timesteps 3233.
number of affinization with epsilon = 3 is 21
average number of affinization = 20.3008
Path 157 | total_timesteps 3256.
number of affinization with epsilon = 3 is 20
average number of affinization = 20.300719808051188
Path 158 | total_timesteps 3280.
number of affinization with epsilon = 3 is 17
average number of affinization = 20.299840085287848
Path 159 | total_timesteps 3301.
number of affinization with epsilon = 3 is 53
average number of affinization = 20.30855315747402
Path 160 | total_timesteps 3367.
number of affinization with epsilon = 3 is 7
average number of affinization = 20.305007991475758
Path 161 | total_timesteps 3378.
number of affinization with epsilon = 3 is 16
average number of affinization = 20.30386151797603
Path 162 | total_timesteps 3396.
number of affinization with epsilon = 3 is 6
average number of affinization = 20.300053248136315
Path 163 | total_timesteps 3406.
number of affinization with epsilon = 3 is 35
average number of affinization = 20.30396593026351
Path 164 | total_timesteps 3443.
number of affinization with epsilon = 3 is 17
average number of affinization = 20.303086748270356
Path 165 | total_timesteps 3461.
number of affinization with epsilon = 3 is 8
average number of affinization = 20.299813780260706
Path 166 | total_timesteps 3475.
number of affinization with epsilon = 3 is 25
average number of affinization = 20.301063829787235
Path 167 | total_timesteps 3504.
number of affinization with epsilon = 3 is 18
average number of affinization = 20.30045200744483
Path 168 | total_timesteps 3526.
number of affinization with epsilon = 3 is 14
average number of affinization = 20.29877724614567
Path 169 | total_timesteps 3545.
number of affinization with epsilon = 3 is 11
average number of affinization = 20.296306138719107
Path 170 | total_timesteps 3557.
number of affinization with epsilon = 3 is 22
average number of affinization = 20.296758767268862
Path 171 | total_timesteps 3585.
number of affinization with epsilon = 3 is 13
average number of affinization = 20.294820717131476
Path 172 | total_timesteps 3604.
number of affinization with epsilon = 3 is 21
average number of affinization = 20.295007966011685
Path 173 | total_timesteps 3630.
number of affinization with epsilon = 3 is 12
average number of affinization = 20.292805946376426
Path 174 | total_timesteps 3643.
number of affinization with epsilon = 3 is 16
average number of affinization = 20.291666666666668
Path 175 | total_timesteps 3662.
number of affinization with epsilon = 3 is 15
average number of affinization = 20.290262669143008
Path 176 | total_timesteps 3681.
number of affinization with epsilon = 3 is 30
average number of affinization = 20.29283819628647
Path 177 | total_timesteps 3713.
number of affinization with epsilon = 3 is 16
average number of affinization = 20.291699814372844
Path 178 | total_timesteps 3733.
number of affinization with epsilon = 3 is 16
average number of affinization = 20.290562036055142
Path 179 | total_timesteps 3750.
number of affinization with epsilon = 3 is 13
average number of affinization = 20.28862973760933
Path 180 | total_timesteps 3764.
number of affinization with epsilon = 3 is 10
average number of affinization = 20.285903550609433
Path 181 | total_timesteps 3778.
number of affinization with epsilon = 3 is 28
average number of affinization = 20.28794701986755
Path 182 | total_timesteps 3808.
number of affinization with epsilon = 3 is 9
average number of affinization = 20.284957627118644
Path 183 | total_timesteps 3820.
number of affinization with epsilon = 3 is 23
average number of affinization = 20.285676462801163
Path 184 | total_timesteps 3848.
number of affinization with epsilon = 3 is 5
average number of affinization = 20.28163049232398
Path 185 | total_timesteps 3857.
number of affinization with epsilon = 3 is 5
average number of affinization = 20.277586663138397
Path 186 | total_timesteps 3864.
number of affinization with epsilon = 3 is 18
average number of affinization = 20.27698412698413
Path 187 | total_timesteps 3886.
number of affinization with epsilon = 3 is 9
average number of affinization = 20.274001586881777
Path 188 | total_timesteps 3897.
number of affinization with epsilon = 3 is 7
average number of affinization = 20.270491803278688
Path 189 | total_timesteps 3907.
number of affinization with epsilon = 3 is 9
average number of affinization = 20.26751255617235
Path 190 | total_timesteps 3918.
number of affinization with epsilon = 3 is 12
average number of affinization = 20.265327695560252
Path 191 | total_timesteps 3932.
number of affinization with epsilon = 3 is 19
average number of affinization = 20.264993394980184
Path 192 | total_timesteps 3953.
number of affinization with epsilon = 3 is 20
average number of affinization = 20.264923402007394
Path 193 | total_timesteps 3975.
number of affinization with epsilon = 3 is 25
average number of affinization = 20.266173752310536
Path 194 | total_timesteps 4005.
number of affinization with epsilon = 3 is 17
average number of affinization = 20.26531151003168
Path 195 | total_timesteps 4023.
number of affinization with epsilon = 3 is 11
average number of affinization = 20.262866191607284
Path 196 | total_timesteps 4035.
number of affinization with epsilon = 3 is 11
average number of affinization = 20.26042216358839
Path 197 | total_timesteps 4048.
number of affinization with epsilon = 3 is 34
average number of affinization = 20.264046425745185
Path 198 | total_timesteps 4088.
number of affinization with epsilon = 3 is 36
average number of affinization = 20.268196202531644
Path 199 | total_timesteps 4128.
number of affinization with epsilon = 3 is 50
average number of affinization = 20.276034800949116
Path 200 | total_timesteps 4185.
number of affinization with epsilon = 3 is 13
average number of affinization = 20.274117026884554
Path 201 | total_timesteps 4199.
number of affinization with epsilon = 3 is 19
average number of affinization = 20.273781291172597
Path 202 | total_timesteps 4220.
number of affinization with epsilon = 3 is 26
average number of affinization = 20.275289778714438
Path 203 | total_timesteps 4251.
number of affinization with epsilon = 3 is 11
average number of affinization = 20.272846984461417
Path 204 | total_timesteps 4265.
number of affinization with epsilon = 3 is 16
average number of affinization = 20.27172195892575
Path 205 | total_timesteps 4282.
number of affinization with epsilon = 3 is 18
average number of affinization = 20.271123979994737
Path 206 | total_timesteps 4305.
number of affinization with epsilon = 3 is 36
average number of affinization = 20.275263157894738
Path 207 | total_timesteps 4347.
number of affinization with epsilon = 3 is 9
average number of affinization = 20.27229676400947
Path 208 | total_timesteps 4359.
number of affinization with epsilon = 3 is 13
average number of affinization = 20.270384008416624
Path 209 | total_timesteps 4375.
number of affinization with epsilon = 3 is 14
average number of affinization = 20.26873520904549
Path 210 | total_timesteps 4393.
number of affinization with epsilon = 3 is 20
average number of affinization = 20.268664563617246
Path 211 | total_timesteps 4415.
number of affinization with epsilon = 3 is 11
average number of affinization = 20.26622864651774
Path 212 | total_timesteps 4431.
number of affinization with epsilon = 3 is 19
average number of affinization = 20.265895953757227
Path 213 | total_timesteps 4452.
number of affinization with epsilon = 3 is 13
average number of affinization = 20.263987391646967
Path 214 | total_timesteps 4468.
number of affinization with epsilon = 3 is 7
average number of affinization = 20.26050420168067
Path 215 | total_timesteps 4477.
number of affinization with epsilon = 3 is 9
average number of affinization = 20.257547912838014
Path 216 | total_timesteps 4488.
number of affinization with epsilon = 3 is 32
average number of affinization = 20.26062992125984
Path 217 | total_timesteps 4528.
number of affinization with epsilon = 3 is 45
average number of affinization = 20.26712149042246
Path 218 | total_timesteps 4578.
number of affinization with epsilon = 3 is 14
average number of affinization = 20.265477439664217
Path 219 | total_timesteps 4596.
number of affinization with epsilon = 3 is 7
average number of affinization = 20.261998426435877
Path 220 | total_timesteps 4606.
number of affinization with epsilon = 3 is 16
average number of affinization = 20.26088096486628
Path 221 | total_timesteps 4629.
number of affinization with epsilon = 3 is 24
average number of affinization = 20.261861074705113
Path 222 | total_timesteps 4656.
number of affinization with epsilon = 3 is 12
average number of affinization = 20.25969601677149
Path 223 | total_timesteps 4671.
number of affinization with epsilon = 3 is 12
average number of affinization = 20.257532093266963
Path 224 | total_timesteps 4689.
number of affinization with epsilon = 3 is 10
average number of affinization = 20.25484546883185
Path 225 | total_timesteps 4703.
number of affinization with epsilon = 3 is 18
average number of affinization = 20.254255040586543
Path 226 | total_timesteps 4723.
number of affinization with epsilon = 3 is 7
average number of affinization = 20.250785340314135
Path 227 | total_timesteps 4733.
number of affinization with epsilon = 3 is 10
average number of affinization = 20.24810259094478
Path 228 | total_timesteps 4746.
number of affinization with epsilon = 3 is 29
average number of affinization = 20.25039246467818
Path 229 | total_timesteps 4781.
number of affinization with epsilon = 3 is 18
average number of affinization = 20.249803818990323
Path 230 | total_timesteps 4804.
number of affinization with epsilon = 3 is 56
average number of affinization = 20.259152719665273
Path 231 | total_timesteps 4870.
number of affinization with epsilon = 3 is 9
average number of affinization = 20.256209150326796
Path 232 | total_timesteps 4880.
number of affinization with epsilon = 3 is 10
average number of affinization = 20.25352848928385
Path 233 | total_timesteps 4891.
number of affinization with epsilon = 3 is 6
average number of affinization = 20.24980402403972
Path 234 | total_timesteps 4902.
number of affinization with epsilon = 3 is 11
average number of affinization = 20.247387669801462
Path 235 | total_timesteps 4914.
number of affinization with epsilon = 3 is 30
average number of affinization = 20.249934708801252
Path 236 | total_timesteps 4949.
number of affinization with epsilon = 3 is 18
average number of affinization = 20.24934725848564
Path 237 | total_timesteps 4970.
number of affinization with epsilon = 3 is 21
average number of affinization = 20.249543200208823
Path 238 | total_timesteps 4996.
number of affinization with epsilon = 3 is 8
average number of affinization = 20.24634655532359
Path 239 | total_timesteps 5005.
number of affinization with epsilon = 3 is 17
average number of affinization = 20.24549960866162
Path 240 | total_timesteps 5024.
number of affinization with epsilon = 3 is 20
average number of affinization = 20.245435576421492
Path 241 | total_timesteps 5048.
number of affinization with epsilon = 3 is 28
average number of affinization = 20.247457627118646
Path 242 | total_timesteps 5079.
number of affinization with epsilon = 3 is 23
average number of affinization = 20.248175182481752
Path 243 | total_timesteps 5105.
number of affinization with epsilon = 3 is 18
average number of affinization = 20.247589262444617
Path 244 | total_timesteps 5124.
number of affinization with epsilon = 3 is 11
average number of affinization = 20.24517978113601
Path 245 | total_timesteps 5137.
number of affinization with epsilon = 3 is 20
average number of affinization = 20.245115915603023
Path 246 | total_timesteps 5160.
number of affinization with epsilon = 3 is 18
average number of affinization = 20.24453125
Path 247 | total_timesteps 5182.
number of affinization with epsilon = 3 is 16
average number of affinization = 20.24342619109607
Path 248 | total_timesteps 5200.
number of affinization with epsilon = 3 is 19
average number of affinization = 20.243102550754816
Path 249 | total_timesteps 5222.
number of affinization with epsilon = 3 is 12
average number of affinization = 20.24095758521988
Path 250 | total_timesteps 5240.
number of affinization with epsilon = 3 is 28
average number of affinization = 20.242976066597294
Path 251 | total_timesteps 5269.
number of affinization with epsilon = 3 is 10
average number of affinization = 20.240312093628088
Path 252 | total_timesteps 5280.
number of affinization with epsilon = 3 is 17
average number of affinization = 20.23946957878315
Path 253 | total_timesteps 5301.
number of affinization with epsilon = 3 is 28
average number of affinization = 20.241486872887965
Path 254 | total_timesteps 5334.
number of affinization with epsilon = 3 is 27
average number of affinization = 20.243243243243242
Path 255 | total_timesteps 5365.
number of affinization with epsilon = 3 is 24
average number of affinization = 20.244219277734476
Path 256 | total_timesteps 5392.
number of affinization with epsilon = 3 is 10
average number of affinization = 20.241558441558443
Path 257 | total_timesteps 5406.
number of affinization with epsilon = 3 is 12
average number of affinization = 20.239418332900545
Path 258 | total_timesteps 5419.
number of affinization with epsilon = 3 is 24
average number of affinization = 20.240394600207683
Path 259 | total_timesteps 5449.
number of affinization with epsilon = 3 is 17
average number of affinization = 20.23955359460161
Path 260 | total_timesteps 5470.
number of affinization with epsilon = 3 is 14
average number of affinization = 20.23793461338869
Path 261 | total_timesteps 5486.
number of affinization with epsilon = 3 is 15
average number of affinization = 20.23657587548638
Path 262 | total_timesteps 5509.
number of affinization with epsilon = 3 is 13
average number of affinization = 20.234699170124482
Path 263 | total_timesteps 5527.
number of affinization with epsilon = 3 is 15
average number of affinization = 20.233341975628726
Path 264 | total_timesteps 5544.
number of affinization with epsilon = 3 is 16
average number of affinization = 20.23224468636599
Path 265 | total_timesteps 5565.
number of affinization with epsilon = 3 is 17
average number of affinization = 20.231407100285047
Path 266 | total_timesteps 5585.
number of affinization with epsilon = 3 is 22
average number of affinization = 20.231865284974095
Path 267 | total_timesteps 5610.
number of affinization with epsilon = 3 is 16
average number of affinization = 20.23076923076923
Path 268 | total_timesteps 5629.
number of affinization with epsilon = 3 is 6
average number of affinization = 20.227084412221647
Path 269 | total_timesteps 5636.
number of affinization with epsilon = 3 is 12
average number of affinization = 20.224954698420916
Path 270 | total_timesteps 5652.
number of affinization with epsilon = 3 is 14
average number of affinization = 20.223343685300208
Path 271 | total_timesteps 5669.
number of affinization with epsilon = 3 is 16
average number of affinization = 20.222250970245796
Path 272 | total_timesteps 5688.
number of affinization with epsilon = 3 is 8
average number of affinization = 20.219089498189344
Path 273 | total_timesteps 5700.
number of affinization with epsilon = 3 is 38
average number of affinization = 20.2236876131368
Path 274 | total_timesteps 5745.
number of affinization with epsilon = 3 is 8
average number of affinization = 20.22052740434333
Path 275 | total_timesteps 5757.
number of affinization with epsilon = 3 is 28
average number of affinization = 20.222538123546137
Path 276 | total_timesteps 5789.
number of affinization with epsilon = 3 is 6
average number of affinization = 20.218863049095606
Path 277 | total_timesteps 5800.
number of affinization with epsilon = 3 is 18
average number of affinization = 20.218289847584604
Path 278 | total_timesteps 5821.
number of affinization with epsilon = 3 is 9
average number of affinization = 20.21539256198347
Path 279 | total_timesteps 5833.
number of affinization with epsilon = 3 is 19
average number of affinization = 20.215078750322746
Path 280 | total_timesteps 5856.
number of affinization with epsilon = 3 is 8
average number of affinization = 20.21192565823438
Path 281 | total_timesteps 5866.
number of affinization with epsilon = 3 is 6
average number of affinization = 20.20825806451613
Path 282 | total_timesteps 5874.
number of affinization with epsilon = 3 is 21
average number of affinization = 20.20846233230134
Path 283 | total_timesteps 5902.
number of affinization with epsilon = 3 is 24
average number of affinization = 20.209440288883158
Path 284 | total_timesteps 5932.
number of affinization with epsilon = 3 is 36
average number of affinization = 20.213512119649305
Path 285 | total_timesteps 5974.
number of affinization with epsilon = 3 is 20
average number of affinization = 20.213457076566126
Path 286 | total_timesteps 5997.
number of affinization with epsilon = 3 is 14
average number of affinization = 20.21185567010309
Done generating on-policy rollouts.
Updating normalization.
Done updating normalization.
----------------------------
| AverageReturn | -6.76    |
| Iteration     | 15       |
| MaximumReturn | 17.9     |
| MinimumReturn | -23      |
| TotalSamples  | 68209    |
----------------------------
itr #16 | 
Fitting dynamics.
Fitting model 0 (0-based) in the ensemble of 2 models
Validation loss = 0.01752496510744095
Validation loss = 0.017311377450823784
Validation loss = 0.0171583853662014
Validation loss = 0.017049089074134827
Validation loss = 0.018380315974354744
Validation loss = 0.01718325912952423
Validation loss = 0.017700770869851112
Validation loss = 0.016763456165790558
Validation loss = 0.017467521131038666
Validation loss = 0.01704978384077549
Validation loss = 0.016989607363939285
Validation loss = 0.016930442303419113
Fitting model 1 (0-based) in the ensemble of 2 models
Validation loss = 0.017029210925102234
Validation loss = 0.016941340640187263
Validation loss = 0.018042538315057755
Validation loss = 0.016742318868637085
Validation loss = 0.016504421830177307
Validation loss = 0.017444564029574394
Validation loss = 0.01659385859966278
Validation loss = 0.016972800716757774
Validation loss = 0.016657747328281403
Done fitting dynamics.
Updating randomness.
Done updating randomness.
Training policy using TRPO.
Re-initialize init_std.
Obtaining samples for iteration 0...
Obtaining samples for iteration 1...
Obtaining samples for iteration 2...
Obtaining samples for iteration 3...
Obtaining samples for iteration 4...
Obtaining samples for iteration 5...
Obtaining samples for iteration 6...
Obtaining samples for iteration 7...
Obtaining samples for iteration 8...
Obtaining samples for iteration 9...
Obtaining samples for iteration 10...
Obtaining samples for iteration 11...
Obtaining samples for iteration 12...
Obtaining samples for iteration 13...
Obtaining samples for iteration 14...
Obtaining samples for iteration 15...
Obtaining samples for iteration 16...
Obtaining samples for iteration 17...
Obtaining samples for iteration 18...
Obtaining samples for iteration 19...
Done training policy.
Generating on-policy rollouts.
Path 0 | total_timesteps 0.
number of affinization with epsilon = 3 is 14
average number of affinization = 20.210255088894616
Path 1 | total_timesteps 18.
number of affinization with epsilon = 3 is 13
average number of affinization = 20.208397733127253
Path 2 | total_timesteps 33.
number of affinization with epsilon = 3 is 18
average number of affinization = 20.20782899819727
Path 3 | total_timesteps 52.
number of affinization with epsilon = 3 is 9
average number of affinization = 20.204943357363543
Path 4 | total_timesteps 62.
number of affinization with epsilon = 3 is 14
average number of affinization = 20.203346203346204
Path 5 | total_timesteps 79.
number of affinization with epsilon = 3 is 12
average number of affinization = 20.201235203293876
Path 6 | total_timesteps 95.
number of affinization with epsilon = 3 is 31
average number of affinization = 20.204013377926422
Path 7 | total_timesteps 135.
number of affinization with epsilon = 3 is 11
average number of affinization = 20.20164609053498
Path 8 | total_timesteps 150.
number of affinization with epsilon = 3 is 11
average number of affinization = 20.19928002057084
Path 9 | total_timesteps 162.
number of affinization with epsilon = 3 is 26
average number of affinization = 20.20077120822622
Path 10 | total_timesteps 189.
number of affinization with epsilon = 3 is 17
average number of affinization = 20.19994859933179
Path 11 | total_timesteps 208.
number of affinization with epsilon = 3 is 14
average number of affinization = 20.1983556012333
Path 12 | total_timesteps 227.
number of affinization with epsilon = 3 is 4
average number of affinization = 20.194194708451064
Path 13 | total_timesteps 235.
number of affinization with epsilon = 3 is 66
average number of affinization = 20.205957883923986
Path 14 | total_timesteps 307.
number of affinization with epsilon = 3 is 13
average number of affinization = 20.20410783055199
Path 15 | total_timesteps 326.
number of affinization with epsilon = 3 is 32
average number of affinization = 20.207135523613964
Path 16 | total_timesteps 364.
number of affinization with epsilon = 3 is 9
average number of affinization = 20.20425968693867
Path 17 | total_timesteps 375.
number of affinization with epsilon = 3 is 11
average number of affinization = 20.201898409440737
Path 18 | total_timesteps 390.
number of affinization with epsilon = 3 is 20
average number of affinization = 20.201846627340345
Path 19 | total_timesteps 412.
number of affinization with epsilon = 3 is 10
average number of affinization = 20.19923076923077
Path 20 | total_timesteps 424.
number of affinization with epsilon = 3 is 11
average number of affinization = 20.19687259677006
Path 21 | total_timesteps 438.
number of affinization with epsilon = 3 is 8
average number of affinization = 20.193746796514606
Path 22 | total_timesteps 450.
number of affinization with epsilon = 3 is 8
average number of affinization = 20.190622598001536
Path 23 | total_timesteps 461.
number of affinization with epsilon = 3 is 11
average number of affinization = 20.188268442622952
Path 24 | total_timesteps 476.
number of affinization with epsilon = 3 is 10
average number of affinization = 20.185659411011525
Path 25 | total_timesteps 489.
number of affinization with epsilon = 3 is 12
average number of affinization = 20.183563748079877
Path 26 | total_timesteps 503.
number of affinization with epsilon = 3 is 10
average number of affinization = 20.18095725620681
Path 27 | total_timesteps 517.
number of affinization with epsilon = 3 is 9
average number of affinization = 20.178096212896623
Path 28 | total_timesteps 527.
number of affinization with epsilon = 3 is 11
average number of affinization = 20.175748273215657
Path 29 | total_timesteps 540.
number of affinization with epsilon = 3 is 9
average number of affinization = 20.172890025575448
Path 30 | total_timesteps 550.
number of affinization with epsilon = 3 is 13
average number of affinization = 20.171055995908976
Path 31 | total_timesteps 565.
number of affinization with epsilon = 3 is 8
average number of affinization = 20.167944785276074
Path 32 | total_timesteps 574.
number of affinization with epsilon = 3 is 18
average number of affinization = 20.167390748786097
Path 33 | total_timesteps 593.
number of affinization with epsilon = 3 is 9
average number of affinization = 20.164537557485946
Path 34 | total_timesteps 604.
number of affinization with epsilon = 3 is 14
average number of affinization = 20.16296296296296
Path 35 | total_timesteps 619.
number of affinization with epsilon = 3 is 8
average number of affinization = 20.15985699693565
Path 36 | total_timesteps 629.
number of affinization with epsilon = 3 is 11
average number of affinization = 20.15751850906306
Path 37 | total_timesteps 641.
number of affinization with epsilon = 3 is 9
average number of affinization = 20.15467075038285
Path 38 | total_timesteps 652.
number of affinization with epsilon = 3 is 26
average number of affinization = 20.156162286297526
Path 39 | total_timesteps 683.
number of affinization with epsilon = 3 is 8
average number of affinization = 20.153061224489797
Path 40 | total_timesteps 694.
number of affinization with epsilon = 3 is 11
average number of affinization = 20.150726855394034
Path 41 | total_timesteps 706.
number of affinization with epsilon = 3 is 13
average number of affinization = 20.148903620601732
Path 42 | total_timesteps 724.
number of affinization with epsilon = 3 is 16
average number of affinization = 20.14784603619679
Path 43 | total_timesteps 742.
number of affinization with epsilon = 3 is 7
average number of affinization = 20.144495412844037
Path 44 | total_timesteps 751.
number of affinization with epsilon = 3 is 19
average number of affinization = 20.144203821656053
Path 45 | total_timesteps 772.
number of affinization with epsilon = 3 is 29
average number of affinization = 20.146459500764138
Path 46 | total_timesteps 805.
number of affinization with epsilon = 3 is 13
average number of affinization = 20.14463967405144
Path 47 | total_timesteps 821.
number of affinization with epsilon = 3 is 10
average number of affinization = 20.14205702647658
Path 48 | total_timesteps 833.
number of affinization with epsilon = 3 is 7
average number of affinization = 20.138712140493766
Path 49 | total_timesteps 842.
number of affinization with epsilon = 3 is 10
average number of affinization = 20.13613231552163
Path 50 | total_timesteps 855.
number of affinization with epsilon = 3 is 21
average number of affinization = 20.1363520732638
Path 51 | total_timesteps 877.
number of affinization with epsilon = 3 is 21
average number of affinization = 20.136571719226858
Path 52 | total_timesteps 900.
number of affinization with epsilon = 3 is 8
average number of affinization = 20.13348588863463
Path 53 | total_timesteps 911.
number of affinization with epsilon = 3 is 12
average number of affinization = 20.131418403660398
Path 54 | total_timesteps 925.
number of affinization with epsilon = 3 is 12
average number of affinization = 20.129351969504448
Path 55 | total_timesteps 939.
number of affinization with epsilon = 3 is 14
average number of affinization = 20.127794715447155
Path 56 | total_timesteps 957.
number of affinization with epsilon = 3 is 20
average number of affinization = 20.127762255524512
Path 57 | total_timesteps 982.
number of affinization with epsilon = 3 is 10
average number of affinization = 20.125190452006095
Path 58 | total_timesteps 995.
number of affinization with epsilon = 3 is 19
average number of affinization = 20.124904798172125
Path 59 | total_timesteps 1021.
number of affinization with epsilon = 3 is 7
average number of affinization = 20.121573604060913
Path 60 | total_timesteps 1034.
number of affinization with epsilon = 3 is 11
average number of affinization = 20.1192590713017
Path 61 | total_timesteps 1048.
number of affinization with epsilon = 3 is 10
average number of affinization = 20.116692034500254
Path 62 | total_timesteps 1062.
number of affinization with epsilon = 3 is 9
average number of affinization = 20.113872685772254
Path 63 | total_timesteps 1072.
number of affinization with epsilon = 3 is 16
average number of affinization = 20.11282961460446
Path 64 | total_timesteps 1091.
number of affinization with epsilon = 3 is 11
average number of affinization = 20.110519645120405
Path 65 | total_timesteps 1103.
number of affinization with epsilon = 3 is 12
average number of affinization = 20.10846426761277
Path 66 | total_timesteps 1119.
number of affinization with epsilon = 3 is 10
average number of affinization = 20.105903217633646
Path 67 | total_timesteps 1135.
number of affinization with epsilon = 3 is 15
average number of affinization = 20.104609929078013
Path 68 | total_timesteps 1151.
number of affinization with epsilon = 3 is 9
average number of affinization = 20.10179792352494
Path 69 | total_timesteps 1162.
number of affinization with epsilon = 3 is 11
average number of affinization = 20.099493670886076
Path 70 | total_timesteps 1175.
number of affinization with epsilon = 3 is 12
average number of affinization = 20.097443685143002
Path 71 | total_timesteps 1191.
number of affinization with epsilon = 3 is 10
average number of affinization = 20.094888663967613
Path 72 | total_timesteps 1203.
number of affinization with epsilon = 3 is 7
average number of affinization = 20.091576018214013
Path 73 | total_timesteps 1212.
number of affinization with epsilon = 3 is 13
average number of affinization = 20.089782498735456
Path 74 | total_timesteps 1226.
number of affinization with epsilon = 3 is 14
average number of affinization = 20.088242730720605
Path 75 | total_timesteps 1245.
number of affinization with epsilon = 3 is 11
average number of affinization = 20.085945399393328
Path 76 | total_timesteps 1260.
number of affinization with epsilon = 3 is 7
average number of affinization = 20.082638362395755
Path 77 | total_timesteps 1272.
number of affinization with epsilon = 3 is 13
average number of affinization = 20.080848913592725
Path 78 | total_timesteps 1287.
number of affinization with epsilon = 3 is 9
average number of affinization = 20.07805001262945
Path 79 | total_timesteps 1297.
number of affinization with epsilon = 3 is 11
average number of affinization = 20.075757575757574
Path 80 | total_timesteps 1315.
number of affinization with epsilon = 3 is 16
average number of affinization = 20.074728603887905
Path 81 | total_timesteps 1333.
number of affinization with epsilon = 3 is 16
average number of affinization = 20.07370015143867
Path 82 | total_timesteps 1352.
number of affinization with epsilon = 3 is 10
average number of affinization = 20.07115821347464
Path 83 | total_timesteps 1365.
number of affinization with epsilon = 3 is 8
average number of affinization = 20.06811301715439
Path 84 | total_timesteps 1375.
number of affinization with epsilon = 3 is 9
average number of affinization = 20.065321563682218
Path 85 | total_timesteps 1387.
number of affinization with epsilon = 3 is 19
average number of affinization = 20.065052950075643
Path 86 | total_timesteps 1411.
number of affinization with epsilon = 3 is 28
average number of affinization = 20.067053188807662
Path 87 | total_timesteps 1445.
number of affinization with epsilon = 3 is 9
average number of affinization = 20.064264112903224
Path 88 | total_timesteps 1456.
number of affinization with epsilon = 3 is 9
average number of affinization = 20.061476442428823
Path 89 | total_timesteps 1466.
number of affinization with epsilon = 3 is 7
average number of affinization = 20.058186397984887
Path 90 | total_timesteps 1475.
number of affinization with epsilon = 3 is 11
average number of affinization = 20.05590531352304
Path 91 | total_timesteps 1490.
number of affinization with epsilon = 3 is 21
average number of affinization = 20.05614300100705
Path 92 | total_timesteps 1514.
number of affinization with epsilon = 3 is 8
average number of affinization = 20.053108482255222
Path 93 | total_timesteps 1523.
number of affinization with epsilon = 3 is 12
average number of affinization = 20.051082033215902
Path 94 | total_timesteps 1536.
number of affinization with epsilon = 3 is 8
average number of affinization = 20.04805031446541
Path 95 | total_timesteps 1547.
number of affinization with epsilon = 3 is 30
average number of affinization = 20.050553319919516
Path 96 | total_timesteps 1583.
number of affinization with epsilon = 3 is 13
average number of affinization = 20.048780487804876
Path 97 | total_timesteps 1597.
number of affinization with epsilon = 3 is 13
average number of affinization = 20.04700854700855
Path 98 | total_timesteps 1612.
number of affinization with epsilon = 3 is 36
average number of affinization = 20.051017843679315
Path 99 | total_timesteps 1657.
number of affinization with epsilon = 3 is 37
average number of affinization = 20.055276381909547
Path 100 | total_timesteps 1699.
number of affinization with epsilon = 3 is 10
average number of affinization = 20.052750565184628
Path 101 | total_timesteps 1710.
number of affinization with epsilon = 3 is 24
average number of affinization = 20.053741838272224
Path 102 | total_timesteps 1740.
number of affinization with epsilon = 3 is 9
average number of affinization = 20.05096660808436
Path 103 | total_timesteps 1752.
number of affinization with epsilon = 3 is 14
average number of affinization = 20.04944779116466
Path 104 | total_timesteps 1768.
number of affinization with epsilon = 3 is 9
average number of affinization = 20.046675031367627
Path 105 | total_timesteps 1780.
number of affinization with epsilon = 3 is 13
average number of affinization = 20.044907175112897
Path 106 | total_timesteps 1796.
number of affinization with epsilon = 3 is 12
average number of affinization = 20.042889390519186
Path 107 | total_timesteps 1810.
number of affinization with epsilon = 3 is 12
average number of affinization = 20.040872617853562
Path 108 | total_timesteps 1824.
number of affinization with epsilon = 3 is 13
average number of affinization = 20.039107545750813
Path 109 | total_timesteps 1842.
number of affinization with epsilon = 3 is 11
average number of affinization = 20.03684210526316
Path 110 | total_timesteps 1854.
number of affinization with epsilon = 3 is 17
average number of affinization = 20.036081182660986
Path 111 | total_timesteps 1875.
number of affinization with epsilon = 3 is 11
average number of affinization = 20.03381763527054
Path 112 | total_timesteps 1890.
number of affinization with epsilon = 3 is 13
average number of affinization = 20.0320560981718
Path 113 | total_timesteps 1906.
number of affinization with epsilon = 3 is 9
average number of affinization = 20.029293940911366
Path 114 | total_timesteps 1916.
number of affinization with epsilon = 3 is 7
average number of affinization = 20.026032540675846
Path 115 | total_timesteps 1927.
number of affinization with epsilon = 3 is 38
average number of affinization = 20.03053053053053
Path 116 | total_timesteps 1972.
number of affinization with epsilon = 3 is 24
average number of affinization = 20.03152364273205
Path 117 | total_timesteps 2000.
number of affinization with epsilon = 3 is 5
average number of affinization = 20.02776388194097
Path 118 | total_timesteps 2009.
number of affinization with epsilon = 3 is 19
average number of affinization = 20.02750687671918
Path 119 | total_timesteps 2032.
number of affinization with epsilon = 3 is 15
average number of affinization = 20.02625
Path 120 | total_timesteps 2049.
number of affinization with epsilon = 3 is 7
average number of affinization = 20.02299425143714
Path 121 | total_timesteps 2060.
number of affinization with epsilon = 3 is 7
average number of affinization = 20.019740129935034
Path 122 | total_timesteps 2071.
number of affinization with epsilon = 3 is 32
average number of affinization = 20.022732950287285
Path 123 | total_timesteps 2107.
number of affinization with epsilon = 3 is 12
average number of affinization = 20.02072927072927
Path 124 | total_timesteps 2120.
number of affinization with epsilon = 3 is 9
average number of affinization = 20.017977528089887
Path 125 | total_timesteps 2131.
number of affinization with epsilon = 3 is 11
average number of affinization = 20.015726410384424
Path 126 | total_timesteps 2144.
number of affinization with epsilon = 3 is 16
average number of affinization = 20.01472423259296
Path 127 | total_timesteps 2166.
number of affinization with epsilon = 3 is 17
average number of affinization = 20.013972055888225
Path 128 | total_timesteps 2186.
number of affinization with epsilon = 3 is 10
average number of affinization = 20.01147418308805
Path 129 | total_timesteps 2200.
number of affinization with epsilon = 3 is 22
average number of affinization = 20.011970074812968
Path 130 | total_timesteps 2223.
number of affinization with epsilon = 3 is 10
average number of affinization = 20.00947394664672
Path 131 | total_timesteps 2236.
number of affinization with epsilon = 3 is 5
average number of affinization = 20.005732801595215
Path 132 | total_timesteps 2246.
number of affinization with epsilon = 3 is 7
average number of affinization = 20.002491901320706
Path 133 | total_timesteps 2255.
number of affinization with epsilon = 3 is 26
average number of affinization = 20.0039860488291
Path 134 | total_timesteps 2286.
number of affinization with epsilon = 3 is 16
average number of affinization = 20.00298879202989
Path 135 | total_timesteps 2307.
number of affinization with epsilon = 3 is 10
average number of affinization = 20.000498007968126
Path 136 | total_timesteps 2319.
number of affinization with epsilon = 3 is 5
average number of affinization = 19.996763754045308
Path 137 | total_timesteps 2327.
number of affinization with epsilon = 3 is 25
average number of affinization = 19.998008959681435
Path 138 | total_timesteps 2354.
number of affinization with epsilon = 3 is 27
average number of affinization = 19.99975118188604
Path 139 | total_timesteps 2385.
number of affinization with epsilon = 3 is 14
average number of affinization = 19.998258706467663
Path 140 | total_timesteps 2402.
number of affinization with epsilon = 3 is 6
average number of affinization = 19.994777418552598
Path 141 | total_timesteps 2414.
number of affinization with epsilon = 3 is 12
average number of affinization = 19.99278965688712
Path 142 | total_timesteps 2428.
number of affinization with epsilon = 3 is 12
average number of affinization = 19.990802883420333
Path 143 | total_timesteps 2443.
number of affinization with epsilon = 3 is 12
average number of affinization = 19.988817097415506
Path 144 | total_timesteps 2457.
number of affinization with epsilon = 3 is 19
average number of affinization = 19.98857142857143
Path 145 | total_timesteps 2479.
number of affinization with epsilon = 3 is 4
average number of affinization = 19.984600099354196
Path 146 | total_timesteps 2486.
number of affinization with epsilon = 3 is 21
average number of affinization = 19.98485224733052
Path 147 | total_timesteps 2513.
number of affinization with epsilon = 3 is 12
average number of affinization = 19.98286991062562
Path 148 | total_timesteps 2529.
number of affinization with epsilon = 3 is 25
average number of affinization = 19.984115165053364
Path 149 | total_timesteps 2557.
number of affinization with epsilon = 3 is 26
average number of affinization = 19.98560794044665
Path 150 | total_timesteps 2590.
number of affinization with epsilon = 3 is 11
average number of affinization = 19.983378814190026
Path 151 | total_timesteps 2604.
number of affinization with epsilon = 3 is 9
average number of affinization = 19.980654761904763
Path 152 | total_timesteps 2615.
number of affinization with epsilon = 3 is 21
average number of affinization = 19.980907513017605
Path 153 | total_timesteps 2637.
number of affinization with epsilon = 3 is 20
average number of affinization = 19.980912245909767
Path 154 | total_timesteps 2662.
number of affinization with epsilon = 3 is 17
average number of affinization = 19.980173482032217
Path 155 | total_timesteps 2685.
number of affinization with epsilon = 3 is 42
average number of affinization = 19.985629335976213
Path 156 | total_timesteps 2732.
number of affinization with epsilon = 3 is 9
average number of affinization = 19.98290810007431
Path 157 | total_timesteps 2744.
number of affinization with epsilon = 3 is 8
average number of affinization = 19.979940564635957
Path 158 | total_timesteps 2755.
number of affinization with epsilon = 3 is 22
average number of affinization = 19.980440703144343
Path 159 | total_timesteps 2780.
number of affinization with epsilon = 3 is 17
average number of affinization = 19.97970297029703
Path 160 | total_timesteps 2802.
number of affinization with epsilon = 3 is 8
average number of affinization = 19.976738431081415
Path 161 | total_timesteps 2812.
number of affinization with epsilon = 3 is 7
average number of affinization = 19.9735279564572
Path 162 | total_timesteps 2820.
number of affinization with epsilon = 3 is 11
average number of affinization = 19.971308434330943
Path 163 | total_timesteps 2833.
number of affinization with epsilon = 3 is 19
average number of affinization = 19.97106824925816
Path 164 | total_timesteps 2853.
number of affinization with epsilon = 3 is 16
average number of affinization = 19.97008652657602
Path 165 | total_timesteps 2871.
number of affinization with epsilon = 3 is 18
average number of affinization = 19.969599604547703
Path 166 | total_timesteps 2890.
number of affinization with epsilon = 3 is 8
average number of affinization = 19.96664195700519
Path 167 | total_timesteps 2903.
number of affinization with epsilon = 3 is 5
average number of affinization = 19.96294466403162
Path 168 | total_timesteps 2911.
number of affinization with epsilon = 3 is 18
average number of affinization = 19.962459866633736
Path 169 | total_timesteps 2933.
number of affinization with epsilon = 3 is 6
average number of affinization = 19.959012345679014
Path 170 | total_timesteps 2942.
number of affinization with epsilon = 3 is 8
average number of affinization = 19.95606023204147
Path 171 | total_timesteps 2953.
number of affinization with epsilon = 3 is 19
average number of affinization = 19.955824284304047
Path 172 | total_timesteps 2974.
number of affinization with epsilon = 3 is 11
average number of affinization = 19.95361460646435
Path 173 | total_timesteps 2988.
number of affinization with epsilon = 3 is 20
average number of affinization = 19.95362604834731
Path 174 | total_timesteps 3009.
number of affinization with epsilon = 3 is 18
average number of affinization = 19.953144266337855
Path 175 | total_timesteps 3030.
number of affinization with epsilon = 3 is 11
average number of affinization = 19.95093688362919
Path 176 | total_timesteps 3044.
number of affinization with epsilon = 3 is 7
average number of affinization = 19.947744638895735
Path 177 | total_timesteps 3054.
number of affinization with epsilon = 3 is 9
average number of affinization = 19.945046821094135
Path 178 | total_timesteps 3066.
number of affinization with epsilon = 3 is 11
average number of affinization = 19.942843064794285
Path 179 | total_timesteps 3078.
number of affinization with epsilon = 3 is 11
average number of affinization = 19.94064039408867
Path 180 | total_timesteps 3092.
number of affinization with epsilon = 3 is 21
average number of affinization = 19.940901255848313
Path 181 | total_timesteps 3119.
number of affinization with epsilon = 3 is 25
average number of affinization = 19.942146725750863
Path 182 | total_timesteps 3147.
number of affinization with epsilon = 3 is 6
average number of affinization = 19.938715235047994
Path 183 | total_timesteps 3155.
number of affinization with epsilon = 3 is 11
average number of affinization = 19.936515748031496
Path 184 | total_timesteps 3168.
number of affinization with epsilon = 3 is 25
average number of affinization = 19.937761377613775
Path 185 | total_timesteps 3197.
number of affinization with epsilon = 3 is 11
average number of affinization = 19.935563207083128
Path 186 | total_timesteps 3209.
number of affinization with epsilon = 3 is 15
average number of affinization = 19.934349643471847
Path 187 | total_timesteps 3225.
number of affinization with epsilon = 3 is 9
average number of affinization = 19.93166175024582
Path 188 | total_timesteps 3236.
number of affinization with epsilon = 3 is 7
average number of affinization = 19.92848365691816
Path 189 | total_timesteps 3245.
number of affinization with epsilon = 3 is 14
average number of affinization = 19.927027027027027
Path 190 | total_timesteps 3262.
number of affinization with epsilon = 3 is 25
average number of affinization = 19.928273151559814
Path 191 | total_timesteps 3291.
number of affinization with epsilon = 3 is 10
average number of affinization = 19.925834970530452
Path 192 | total_timesteps 3308.
number of affinization with epsilon = 3 is 8
average number of affinization = 19.922906948195433
Path 193 | total_timesteps 3317.
number of affinization with epsilon = 3 is 11
average number of affinization = 19.920716740304368
Path 194 | total_timesteps 3331.
number of affinization with epsilon = 3 is 12
average number of affinization = 19.91877300613497
Path 195 | total_timesteps 3346.
number of affinization with epsilon = 3 is 17
average number of affinization = 19.918056918547595
Path 196 | total_timesteps 3367.
number of affinization with epsilon = 3 is 6
average number of affinization = 19.914643119941132
Path 197 | total_timesteps 3377.
number of affinization with epsilon = 3 is 33
average number of affinization = 19.91785188818048
Path 198 | total_timesteps 3414.
number of affinization with epsilon = 3 is 12
average number of affinization = 19.915910762441776
Path 199 | total_timesteps 3430.
number of affinization with epsilon = 3 is 13
average number of affinization = 19.91421568627451
Path 200 | total_timesteps 3445.
number of affinization with epsilon = 3 is 15
average number of affinization = 19.9130115167851
Path 201 | total_timesteps 3463.
number of affinization with epsilon = 3 is 16
average number of affinization = 19.912052915237627
Path 202 | total_timesteps 3485.
number of affinization with epsilon = 3 is 18
average number of affinization = 19.911584619152585
Path 203 | total_timesteps 3506.
number of affinization with epsilon = 3 is 12
average number of affinization = 19.909647404505385
Path 204 | total_timesteps 3520.
number of affinization with epsilon = 3 is 8
average number of affinization = 19.90673194614443
Path 205 | total_timesteps 3529.
number of affinization with epsilon = 3 is 6
average number of affinization = 19.90332843857073
Path 206 | total_timesteps 3536.
number of affinization with epsilon = 3 is 17
average number of affinization = 19.90261805725471
Path 207 | total_timesteps 3557.
number of affinization with epsilon = 3 is 23
average number of affinization = 19.903375733855185
Path 208 | total_timesteps 3585.
number of affinization with epsilon = 3 is 4
average number of affinization = 19.899486426999268
Path 209 | total_timesteps 3593.
number of affinization with epsilon = 3 is 13
average number of affinization = 19.897799511002447
Path 210 | total_timesteps 3608.
number of affinization with epsilon = 3 is 9
average number of affinization = 19.895135663651917
Path 211 | total_timesteps 3618.
number of affinization with epsilon = 3 is 17
average number of affinization = 19.89442815249267
Path 212 | total_timesteps 3636.
number of affinization with epsilon = 3 is 8
average number of affinization = 19.891522110921084
Path 213 | total_timesteps 3647.
number of affinization with epsilon = 3 is 12
average number of affinization = 19.889594528578407
Path 214 | total_timesteps 3663.
number of affinization with epsilon = 3 is 14
average number of affinization = 19.88815628815629
Path 215 | total_timesteps 3678.
number of affinization with epsilon = 3 is 25
average number of affinization = 19.889404296875
Path 216 | total_timesteps 3704.
number of affinization with epsilon = 3 is 21
average number of affinization = 19.88967537222358
Path 217 | total_timesteps 3727.
number of affinization with epsilon = 3 is 13
average number of affinization = 19.887994143484626
Path 218 | total_timesteps 3742.
number of affinization with epsilon = 3 is 9
average number of affinization = 19.885337887289584
Path 219 | total_timesteps 3753.
number of affinization with epsilon = 3 is 25
average number of affinization = 19.88658536585366
Path 220 | total_timesteps 3781.
number of affinization with epsilon = 3 is 11
average number of affinization = 19.884418434528165
Path 221 | total_timesteps 3795.
number of affinization with epsilon = 3 is 10
average number of affinization = 19.882008776206728
Path 222 | total_timesteps 3808.
number of affinization with epsilon = 3 is 8
average number of affinization = 19.8791128442603
Path 223 | total_timesteps 3820.
number of affinization with epsilon = 3 is 13
average number of affinization = 19.87743664717349
Path 224 | total_timesteps 3835.
number of affinization with epsilon = 3 is 31
average number of affinization = 19.880146163215592
Path 225 | total_timesteps 3871.
number of affinization with epsilon = 3 is 19
average number of affinization = 19.879931807111543
Path 226 | total_timesteps 3893.
number of affinization with epsilon = 3 is 9
average number of affinization = 19.877282688093498
Path 227 | total_timesteps 3903.
number of affinization with epsilon = 3 is 18
average number of affinization = 19.87682570593963
Path 228 | total_timesteps 3924.
number of affinization with epsilon = 3 is 7
average number of affinization = 19.873691895838405
Path 229 | total_timesteps 3933.
number of affinization with epsilon = 3 is 8
average number of affinization = 19.87080291970803
Path 230 | total_timesteps 3942.
number of affinization with epsilon = 3 is 15
average number of affinization = 19.869618097786425
Path 231 | total_timesteps 3963.
number of affinization with epsilon = 3 is 16
average number of affinization = 19.868677042801558
Path 232 | total_timesteps 3981.
number of affinization with epsilon = 3 is 22
average number of affinization = 19.86919523462193
Path 233 | total_timesteps 4008.
number of affinization with epsilon = 3 is 11
average number of affinization = 19.867039377734564
Path 234 | total_timesteps 4020.
number of affinization with epsilon = 3 is 39
average number of affinization = 19.871688942891858
Path 235 | total_timesteps 4061.
number of affinization with epsilon = 3 is 23
average number of affinization = 19.872448979591837
Path 236 | total_timesteps 4090.
number of affinization with epsilon = 3 is 14
average number of affinization = 19.871022589264026
Path 237 | total_timesteps 4107.
number of affinization with epsilon = 3 is 10
average number of affinization = 19.86862554638174
Path 238 | total_timesteps 4119.
number of affinization with epsilon = 3 is 21
average number of affinization = 19.868900218499636
Path 239 | total_timesteps 4144.
number of affinization with epsilon = 3 is 22
average number of affinization = 19.869417475728156
Path 240 | total_timesteps 4171.
number of affinization with epsilon = 3 is 26
average number of affinization = 19.870905120116475
Path 241 | total_timesteps 4202.
number of affinization with epsilon = 3 is 7
average number of affinization = 19.867782629791364
Path 242 | total_timesteps 4214.
number of affinization with epsilon = 3 is 26
average number of affinization = 19.869269949066215
Path 243 | total_timesteps 4244.
number of affinization with epsilon = 3 is 20
average number of affinization = 19.869301648884576
Path 244 | total_timesteps 4268.
number of affinization with epsilon = 3 is 11
average number of affinization = 19.867151515151516
Path 245 | total_timesteps 4283.
number of affinization with epsilon = 3 is 11
average number of affinization = 19.86500242365487
Path 246 | total_timesteps 4296.
number of affinization with epsilon = 3 is 20
average number of affinization = 19.86503513448025
Path 247 | total_timesteps 4321.
number of affinization with epsilon = 3 is 20
average number of affinization = 19.865067829457363
Path 248 | total_timesteps 4347.
number of affinization with epsilon = 3 is 9
average number of affinization = 19.86243642528457
Path 249 | total_timesteps 4360.
number of affinization with epsilon = 3 is 12
average number of affinization = 19.860532687651332
Path 250 | total_timesteps 4375.
number of affinization with epsilon = 3 is 13
average number of affinization = 19.858871943839265
Path 251 | total_timesteps 4389.
number of affinization with epsilon = 3 is 14
average number of affinization = 19.857454017424974
Path 252 | total_timesteps 4405.
number of affinization with epsilon = 3 is 11
average number of affinization = 19.855310912170335
Path 253 | total_timesteps 4421.
number of affinization with epsilon = 3 is 12
average number of affinization = 19.85341074020319
Path 254 | total_timesteps 4436.
number of affinization with epsilon = 3 is 26
average number of affinization = 19.85489721886336
Path 255 | total_timesteps 4466.
number of affinization with epsilon = 3 is 7
average number of affinization = 19.85178916827853
Path 256 | total_timesteps 4475.
number of affinization with epsilon = 3 is 14
average number of affinization = 19.850374667633552
Path 257 | total_timesteps 4497.
number of affinization with epsilon = 3 is 14
average number of affinization = 19.84896085065249
Path 258 | total_timesteps 4514.
number of affinization with epsilon = 3 is 4
average number of affinization = 19.845131674317468
Path 259 | total_timesteps 4522.
number of affinization with epsilon = 3 is 15
average number of affinization = 19.843961352657004
Path 260 | total_timesteps 4541.
number of affinization with epsilon = 3 is 15
average number of affinization = 19.842791596232793
Path 261 | total_timesteps 4560.
number of affinization with epsilon = 3 is 7
average number of affinization = 19.83969097054563
Path 262 | total_timesteps 4569.
number of affinization with epsilon = 3 is 17
average number of affinization = 19.839005551532704
Path 263 | total_timesteps 4590.
number of affinization with epsilon = 3 is 8
average number of affinization = 19.83614864864865
Path 264 | total_timesteps 4600.
number of affinization with epsilon = 3 is 11
average number of affinization = 19.834016887816645
Path 265 | total_timesteps 4613.
number of affinization with epsilon = 3 is 8
average number of affinization = 19.83116256632899
Path 266 | total_timesteps 4623.
number of affinization with epsilon = 3 is 7
average number of affinization = 19.828068483240898
Path 267 | total_timesteps 4634.
number of affinization with epsilon = 3 is 41
average number of affinization = 19.833172613307617
Path 268 | total_timesteps 4680.
number of affinization with epsilon = 3 is 10
average number of affinization = 19.830802603036876
Path 269 | total_timesteps 4693.
number of affinization with epsilon = 3 is 14
average number of affinization = 19.829397590361445
Path 270 | total_timesteps 4710.
number of affinization with epsilon = 3 is 7
average number of affinization = 19.82630691399663
Path 271 | total_timesteps 4721.
number of affinization with epsilon = 3 is 15
average number of affinization = 19.82514450867052
Path 272 | total_timesteps 4739.
number of affinization with epsilon = 3 is 7
average number of affinization = 19.82205634481098
Path 273 | total_timesteps 4747.
number of affinization with epsilon = 3 is 8
average number of affinization = 19.81921039961483
Path 274 | total_timesteps 4757.
number of affinization with epsilon = 3 is 24
average number of affinization = 19.820216606498196
Path 275 | total_timesteps 4789.
number of affinization with epsilon = 3 is 12
average number of affinization = 19.818334937439847
Path 276 | total_timesteps 4802.
number of affinization with epsilon = 3 is 12
average number of affinization = 19.816454173682946
Path 277 | total_timesteps 4817.
number of affinization with epsilon = 3 is 8
average number of affinization = 19.813612313612314
Path 278 | total_timesteps 4828.
number of affinization with epsilon = 3 is 11
average number of affinization = 19.8114931473912
Path 279 | total_timesteps 4841.
number of affinization with epsilon = 3 is 25
average number of affinization = 19.812740384615385
Path 280 | total_timesteps 4874.
number of affinization with epsilon = 3 is 21
average number of affinization = 19.813025714972362
Path 281 | total_timesteps 4897.
number of affinization with epsilon = 3 is 19
average number of affinization = 19.812830370014417
Path 282 | total_timesteps 4923.
number of affinization with epsilon = 3 is 5
average number of affinization = 19.80927215950036
Path 283 | total_timesteps 4934.
number of affinization with epsilon = 3 is 8
average number of affinization = 19.806436119116235
Path 284 | total_timesteps 4945.
number of affinization with epsilon = 3 is 6
average number of affinization = 19.8031212484994
Path 285 | total_timesteps 4953.
number of affinization with epsilon = 3 is 11
average number of affinization = 19.80100816130581
Path 286 | total_timesteps 4967.
number of affinization with epsilon = 3 is 9
average number of affinization = 19.798416126709864
Path 287 | total_timesteps 4978.
number of affinization with epsilon = 3 is 44
average number of affinization = 19.8042226487524
Path 288 | total_timesteps 5030.
number of affinization with epsilon = 3 is 25
average number of affinization = 19.80546893739506
Path 289 | total_timesteps 5062.
number of affinization with epsilon = 3 is 26
average number of affinization = 19.80695443645084
Path 290 | total_timesteps 5092.
number of affinization with epsilon = 3 is 10
average number of affinization = 19.804603212658836
Path 291 | total_timesteps 5105.
number of affinization with epsilon = 3 is 23
average number of affinization = 19.80536912751678
Path 292 | total_timesteps 5135.
number of affinization with epsilon = 3 is 12
average number of affinization = 19.803498682003355
Path 293 | total_timesteps 5148.
number of affinization with epsilon = 3 is 11
average number of affinization = 19.801389554384283
Path 294 | total_timesteps 5161.
number of affinization with epsilon = 3 is 10
average number of affinization = 19.799041916167663
Path 295 | total_timesteps 5173.
number of affinization with epsilon = 3 is 10
average number of affinization = 19.79669540229885
Path 296 | total_timesteps 5185.
number of affinization with epsilon = 3 is 7
average number of affinization = 19.79363179315298
Path 297 | total_timesteps 5194.
number of affinization with epsilon = 3 is 15
average number of affinization = 19.792484442316898
Path 298 | total_timesteps 5214.
number of affinization with epsilon = 3 is 29
average number of affinization = 19.794687724335965
Path 299 | total_timesteps 5250.
number of affinization with epsilon = 3 is 14
average number of affinization = 19.793301435406697
Path 300 | total_timesteps 5265.
number of affinization with epsilon = 3 is 12
average number of affinization = 19.79143745515427
Path 301 | total_timesteps 5278.
number of affinization with epsilon = 3 is 15
average number of affinization = 19.790291726446675
Path 302 | total_timesteps 5298.
number of affinization with epsilon = 3 is 9
average number of affinization = 19.787712168300263
Path 303 | total_timesteps 5309.
number of affinization with epsilon = 3 is 11
average number of affinization = 19.78561185468451
Path 304 | total_timesteps 5322.
number of affinization with epsilon = 3 is 24
average number of affinization = 19.786618876941457
Path 305 | total_timesteps 5350.
number of affinization with epsilon = 3 is 25
average number of affinization = 19.78786430960344
Path 306 | total_timesteps 5379.
number of affinization with epsilon = 3 is 12
average number of affinization = 19.786004299020778
Path 307 | total_timesteps 5392.
number of affinization with epsilon = 3 is 17
average number of affinization = 19.78533906399236
Path 308 | total_timesteps 5415.
number of affinization with epsilon = 3 is 15
average number of affinization = 19.784196705657674
Path 309 | total_timesteps 5432.
number of affinization with epsilon = 3 is 18
average number of affinization = 19.783770883054892
Path 310 | total_timesteps 5452.
number of affinization with epsilon = 3 is 12
average number of affinization = 19.781913624433308
Path 311 | total_timesteps 5465.
number of affinization with epsilon = 3 is 10
average number of affinization = 19.779580152671755
Path 312 | total_timesteps 5479.
number of affinization with epsilon = 3 is 16
average number of affinization = 19.778678750298116
Path 313 | total_timesteps 5498.
number of affinization with epsilon = 3 is 8
average number of affinization = 19.77587029089175
Path 314 | total_timesteps 5509.
number of affinization with epsilon = 3 is 16
average number of affinization = 19.774970202622168
Path 315 | total_timesteps 5528.
number of affinization with epsilon = 3 is 12
average number of affinization = 19.77311725452812
Path 316 | total_timesteps 5545.
number of affinization with epsilon = 3 is 17
average number of affinization = 19.772456516559448
Path 317 | total_timesteps 5564.
number of affinization with epsilon = 3 is 17
average number of affinization = 19.771796093377798
Path 318 | total_timesteps 5585.
number of affinization with epsilon = 3 is 18
average number of affinization = 19.771374136699215
Path 319 | total_timesteps 5609.
number of affinization with epsilon = 3 is 14
average number of affinization = 19.77
Path 320 | total_timesteps 5627.
number of affinization with epsilon = 3 is 23
average number of affinization = 19.770768864556057
Path 321 | total_timesteps 5654.
number of affinization with epsilon = 3 is 23
average number of affinization = 19.771537363160398
Path 322 | total_timesteps 5686.
number of affinization with epsilon = 3 is 16
average number of affinization = 19.770640019034023
Path 323 | total_timesteps 5703.
number of affinization with epsilon = 3 is 11
average number of affinization = 19.768553758325403
Path 324 | total_timesteps 5716.
number of affinization with epsilon = 3 is 19
average number of affinization = 19.76837098692033
Path 325 | total_timesteps 5737.
number of affinization with epsilon = 3 is 15
average number of affinization = 19.76723728007608
Path 326 | total_timesteps 5753.
number of affinization with epsilon = 3 is 10
average number of affinization = 19.764915616829093
Path 327 | total_timesteps 5767.
number of affinization with epsilon = 3 is 9
average number of affinization = 19.76235741444867
Path 328 | total_timesteps 5777.
number of affinization with epsilon = 3 is 18
average number of affinization = 19.76193870277976
Path 329 | total_timesteps 5799.
number of affinization with epsilon = 3 is 29
average number of affinization = 19.764133016627078
Path 330 | total_timesteps 5830.
number of affinization with epsilon = 3 is 10
average number of affinization = 19.76181429589171
Path 331 | total_timesteps 5844.
number of affinization with epsilon = 3 is 13
average number of affinization = 19.760208926875592
Path 332 | total_timesteps 5861.
number of affinization with epsilon = 3 is 16
average number of affinization = 19.75931640161405
Path 333 | total_timesteps 5880.
number of affinization with epsilon = 3 is 16
average number of affinization = 19.75842429995254
Path 334 | total_timesteps 5902.
number of affinization with epsilon = 3 is 16
average number of affinization = 19.75753262158956
Path 335 | total_timesteps 5919.
number of affinization with epsilon = 3 is 22
average number of affinization = 19.758064516129032
Path 336 | total_timesteps 5943.
number of affinization with epsilon = 3 is 10
average number of affinization = 19.75575053355466
Path 337 | total_timesteps 5955.
number of affinization with epsilon = 3 is 4
average number of affinization = 19.752015173067804
Path 338 | total_timesteps 5963.
number of affinization with epsilon = 3 is 13
average number of affinization = 19.750414790234654
Path 339 | total_timesteps 5980.
number of affinization with epsilon = 3 is 9
average number of affinization = 19.7478672985782
Path 340 | total_timesteps 5994.
number of affinization with epsilon = 3 is 7
average number of affinization = 19.744847192608386
Done generating on-policy rollouts.
Updating normalization.
Done updating normalization.
----------------------------
| AverageReturn | -6.21    |
| Iteration     | 16       |
| MaximumReturn | 12.5     |
| MinimumReturn | -34.4    |
| TotalSamples  | 72211    |
----------------------------
itr #17 | 
Fitting dynamics.
Fitting model 0 (0-based) in the ensemble of 2 models
Validation loss = 0.01716480404138565
Validation loss = 0.017061268910765648
Validation loss = 0.017129473388195038
Validation loss = 0.016641447320580482
Validation loss = 0.01655173860490322
Validation loss = 0.017384342849254608
Validation loss = 0.016266336664557457
Validation loss = 0.01632443070411682
Validation loss = 0.01672513037919998
Validation loss = 0.016091594472527504
Validation loss = 0.016454726457595825
Validation loss = 0.01660819724202156
Validation loss = 0.016463221982121468
Validation loss = 0.016028085723519325
Validation loss = 0.016655493527650833
Validation loss = 0.01706225425004959
Validation loss = 0.015893228352069855
Validation loss = 0.016758287325501442
Validation loss = 0.01612885855138302
Validation loss = 0.0172718595713377
Validation loss = 0.017018012702465057
Fitting model 1 (0-based) in the ensemble of 2 models
Validation loss = 0.01651953160762787
Validation loss = 0.01677829958498478
Validation loss = 0.016900040209293365
Validation loss = 0.016593411564826965
Validation loss = 0.016313724219799042
Validation loss = 0.016403688117861748
Validation loss = 0.016582168638706207
Validation loss = 0.017279203981161118
Validation loss = 0.01677118055522442
Done fitting dynamics.
Updating randomness.
Done updating randomness.
Training policy using TRPO.
Re-initialize init_std.
Obtaining samples for iteration 0...
Obtaining samples for iteration 1...
Obtaining samples for iteration 2...
Obtaining samples for iteration 3...
Obtaining samples for iteration 4...
Obtaining samples for iteration 5...
Obtaining samples for iteration 6...
Obtaining samples for iteration 7...
Obtaining samples for iteration 8...
Obtaining samples for iteration 9...
Obtaining samples for iteration 10...
Obtaining samples for iteration 11...
Obtaining samples for iteration 12...
Obtaining samples for iteration 13...
Obtaining samples for iteration 14...
Obtaining samples for iteration 15...
Obtaining samples for iteration 16...
Obtaining samples for iteration 17...
Obtaining samples for iteration 18...
Obtaining samples for iteration 19...
Done training policy.
Generating on-policy rollouts.
Path 0 | total_timesteps 0.
number of affinization with epsilon = 3 is 20
average number of affinization = 19.744907626717197
Path 1 | total_timesteps 22.
number of affinization with epsilon = 3 is 19
average number of affinization = 19.744731233720103
Path 2 | total_timesteps 42.
number of affinization with epsilon = 3 is 21
average number of affinization = 19.74502840909091
Path 3 | total_timesteps 68.
number of affinization with epsilon = 3 is 22
average number of affinization = 19.745562130177515
Path 4 | total_timesteps 92.
number of affinization with epsilon = 3 is 15
average number of affinization = 19.74443918599148
Path 5 | total_timesteps 111.
number of affinization with epsilon = 3 is 13
average number of affinization = 19.74284362431985
Path 6 | total_timesteps 128.
number of affinization with epsilon = 3 is 23
average number of affinization = 19.743614001892148
Path 7 | total_timesteps 159.
number of affinization with epsilon = 3 is 12
average number of affinization = 19.741782927406007
Path 8 | total_timesteps 174.
number of affinization with epsilon = 3 is 6
average number of affinization = 19.73853427895981
Path 9 | total_timesteps 182.
number of affinization with epsilon = 3 is 9
average number of affinization = 19.735996218388088
Path 10 | total_timesteps 192.
number of affinization with epsilon = 3 is 12
average number of affinization = 19.734168241965975
Path 11 | total_timesteps 206.
number of affinization with epsilon = 3 is 23
average number of affinization = 19.734939759036145
Path 12 | total_timesteps 232.
number of affinization with epsilon = 3 is 16
average number of affinization = 19.734057628719885
Path 13 | total_timesteps 250.
number of affinization with epsilon = 3 is 9
average number of affinization = 19.731523022432114
Path 14 | total_timesteps 262.
number of affinization with epsilon = 3 is 8
average number of affinization = 19.728753541076486
Path 15 | total_timesteps 272.
number of affinization with epsilon = 3 is 29
average number of affinization = 19.730941704035875
Path 16 | total_timesteps 305.
number of affinization with epsilon = 3 is 15
average number of affinization = 19.729825389334593
Path 17 | total_timesteps 323.
number of affinization with epsilon = 3 is 14
average number of affinization = 19.728473696626562
Path 18 | total_timesteps 340.
number of affinization with epsilon = 3 is 15
average number of affinization = 19.727358490566036
Path 19 | total_timesteps 357.
number of affinization with epsilon = 3 is 9
average number of affinization = 19.724829049752415
Path 20 | total_timesteps 376.
number of affinization with epsilon = 3 is 12
average number of affinization = 19.723008015087224
Path 21 | total_timesteps 389.
number of affinization with epsilon = 3 is 14
average number of affinization = 19.721659203393823
Path 22 | total_timesteps 406.
number of affinization with epsilon = 3 is 26
average number of affinization = 19.723138548539115
Path 23 | total_timesteps 439.
number of affinization with epsilon = 3 is 9
average number of affinization = 19.720612485276796
Path 24 | total_timesteps 451.
number of affinization with epsilon = 3 is 24
average number of affinization = 19.721620348563352
Path 25 | total_timesteps 481.
number of affinization with epsilon = 3 is 14
average number of affinization = 19.720273133976924
Path 26 | total_timesteps 499.
number of affinization with epsilon = 3 is 15
average number of affinization = 19.719161958568737
Path 27 | total_timesteps 517.
number of affinization with epsilon = 3 is 10
average number of affinization = 19.7168745587197
Path 28 | total_timesteps 531.
number of affinization with epsilon = 3 is 24
average number of affinization = 19.717882352941178
Path 29 | total_timesteps 560.
number of affinization with epsilon = 3 is 18
average number of affinization = 19.71747824041402
Path 30 | total_timesteps 582.
number of affinization with epsilon = 3 is 11
average number of affinization = 19.715428033866417
Path 31 | total_timesteps 597.
number of affinization with epsilon = 3 is 16
average number of affinization = 19.71455443216553
Path 32 | total_timesteps 617.
number of affinization with epsilon = 3 is 10
average number of affinization = 19.712270803949224
Path 33 | total_timesteps 629.
number of affinization with epsilon = 3 is 9
average number of affinization = 19.70975323149236
Path 34 | total_timesteps 639.
number of affinization with epsilon = 3 is 7
average number of affinization = 19.706766917293233
Path 35 | total_timesteps 648.
number of affinization with epsilon = 3 is 21
average number of affinization = 19.707070707070706
Path 36 | total_timesteps 674.
number of affinization with epsilon = 3 is 29
average number of affinization = 19.709253170502585
Path 37 | total_timesteps 709.
number of affinization with epsilon = 3 is 19
average number of affinization = 19.709086640056352
Path 38 | total_timesteps 730.
number of affinization with epsilon = 3 is 42
average number of affinization = 19.714319248826293
Path 39 | total_timesteps 776.
number of affinization with epsilon = 3 is 23
average number of affinization = 19.71509035437691
Path 40 | total_timesteps 804.
number of affinization with epsilon = 3 is 26
average number of affinization = 19.71656499296105
Path 41 | total_timesteps 833.
number of affinization with epsilon = 3 is 25
average number of affinization = 19.71780436312456
Path 42 | total_timesteps 863.
number of affinization with epsilon = 3 is 12
average number of affinization = 19.715994371482175
Path 43 | total_timesteps 878.
number of affinization with epsilon = 3 is 5
average number of affinization = 19.712543962485345
Path 44 | total_timesteps 888.
number of affinization with epsilon = 3 is 8
average number of affinization = 19.70979840600094
Path 45 | total_timesteps 898.
number of affinization with epsilon = 3 is 15
average number of affinization = 19.70869463323178
Path 46 | total_timesteps 914.
number of affinization with epsilon = 3 is 16
average number of affinization = 19.707825679475164
Path 47 | total_timesteps 932.
number of affinization with epsilon = 3 is 14
average number of affinization = 19.706488639025533
Path 48 | total_timesteps 950.
number of affinization with epsilon = 3 is 13
average number of affinization = 19.704918032786885
Path 49 | total_timesteps 966.
number of affinization with epsilon = 3 is 26
average number of affinization = 19.706391945680167
Path 50 | total_timesteps 994.
number of affinization with epsilon = 3 is 7
average number of affinization = 19.703417602996254
Path 51 | total_timesteps 1002.
number of affinization with epsilon = 3 is 8
average number of affinization = 19.70067868008425
Path 52 | total_timesteps 1013.
number of affinization with epsilon = 3 is 17
average number of affinization = 19.70004679457183
Path 53 | total_timesteps 1034.
number of affinization with epsilon = 3 is 19
average number of affinization = 19.699883040935674
Path 54 | total_timesteps 1056.
number of affinization with epsilon = 3 is 10
average number of affinization = 19.697614593077642
Path 55 | total_timesteps 1070.
number of affinization with epsilon = 3 is 15
average number of affinization = 19.696516249707738
Path 56 | total_timesteps 1089.
number of affinization with epsilon = 3 is 20
average number of affinization = 19.69658719027583
Path 57 | total_timesteps 1111.
number of affinization with epsilon = 3 is 7
average number of affinization = 19.69362000467399
Path 58 | total_timesteps 1120.
number of affinization with epsilon = 3 is 10
average number of affinization = 19.691355140186914
Path 59 | total_timesteps 1131.
number of affinization with epsilon = 3 is 11
average number of affinization = 19.68932492408316
Path 60 | total_timesteps 1144.
number of affinization with epsilon = 3 is 12
average number of affinization = 19.68752919196637
Path 61 | total_timesteps 1158.
number of affinization with epsilon = 3 is 14
average number of affinization = 19.686201260798505
Path 62 | total_timesteps 1178.
number of affinization with epsilon = 3 is 15
average number of affinization = 19.685107376283845
Path 63 | total_timesteps 1195.
number of affinization with epsilon = 3 is 11
average number of affinization = 19.683080513418904
Path 64 | total_timesteps 1208.
number of affinization with epsilon = 3 is 14
average number of affinization = 19.681754549696688
Path 65 | total_timesteps 1224.
number of affinization with epsilon = 3 is 15
average number of affinization = 19.68066246792629
Path 66 | total_timesteps 1240.
number of affinization with epsilon = 3 is 14
average number of affinization = 19.679337686567163
Path 67 | total_timesteps 1258.
number of affinization with epsilon = 3 is 24
average number of affinization = 19.6803450687806
Path 68 | total_timesteps 1289.
number of affinization with epsilon = 3 is 18
average number of affinization = 19.67995337995338
Path 69 | total_timesteps 1310.
number of affinization with epsilon = 3 is 13
average number of affinization = 19.678396644138896
Path 70 | total_timesteps 1326.
number of affinization with epsilon = 3 is 15
average number of affinization = 19.67730661696179
Path 71 | total_timesteps 1344.
number of affinization with epsilon = 3 is 23
average number of affinization = 19.67808059631959
Path 72 | total_timesteps 1370.
number of affinization with epsilon = 3 is 9
average number of affinization = 19.675593851886354
Path 73 | total_timesteps 1382.
number of affinization with epsilon = 3 is 12
average number of affinization = 19.67380675203725
Path 74 | total_timesteps 1397.
number of affinization with epsilon = 3 is 33
average number of affinization = 19.676908752327748
Path 75 | total_timesteps 1439.
number of affinization with epsilon = 3 is 7
average number of affinization = 19.673958575750525
Path 76 | total_timesteps 1448.
number of affinization with epsilon = 3 is 20
average number of affinization = 19.674034434620754
Path 77 | total_timesteps 1472.
number of affinization with epsilon = 3 is 22
average number of affinization = 19.674575482670388
Path 78 | total_timesteps 1499.
number of affinization with epsilon = 3 is 11
average number of affinization = 19.672558139534885
Path 79 | total_timesteps 1512.
number of affinization with epsilon = 3 is 19
average number of affinization = 19.672401767030923
Path 80 | total_timesteps 1533.
number of affinization with epsilon = 3 is 8
average number of affinization = 19.66968851696885
Path 81 | total_timesteps 1544.
number of affinization with epsilon = 3 is 11
average number of affinization = 19.667673716012086
Path 82 | total_timesteps 1557.
number of affinization with epsilon = 3 is 8
average number of affinization = 19.66496282527881
Path 83 | total_timesteps 1567.
number of affinization with epsilon = 3 is 16
average number of affinization = 19.66411149825784
Path 84 | total_timesteps 1585.
number of affinization with epsilon = 3 is 21
average number of affinization = 19.66442173711101
Path 85 | total_timesteps 1610.
number of affinization with epsilon = 3 is 10
average number of affinization = 19.66217785001161
Path 86 | total_timesteps 1622.
number of affinization with epsilon = 3 is 20
average number of affinization = 19.66225626740947
Path 87 | total_timesteps 1646.
number of affinization with epsilon = 3 is 12
average number of affinization = 19.660478069157577
Path 88 | total_timesteps 1661.
number of affinization with epsilon = 3 is 13
average number of affinization = 19.65893271461717
Path 89 | total_timesteps 1676.
number of affinization with epsilon = 3 is 10
average number of affinization = 19.656692182788216
Path 90 | total_timesteps 1690.
number of affinization with epsilon = 3 is 28
average number of affinization = 19.658627087198514
Path 91 | total_timesteps 1722.
number of affinization with epsilon = 3 is 19
average number of affinization = 19.658474379782053
Path 92 | total_timesteps 1746.
number of affinization with epsilon = 3 is 7
average number of affinization = 19.65554010199351
Path 93 | total_timesteps 1755.
number of affinization with epsilon = 3 is 13
average number of affinization = 19.653997682502897
Path 94 | total_timesteps 1772.
number of affinization with epsilon = 3 is 17
average number of affinization = 19.6533827618165
Path 95 | total_timesteps 1796.
number of affinization with epsilon = 3 is 16
average number of affinization = 19.652536483669216
Path 96 | total_timesteps 1815.
number of affinization with epsilon = 3 is 15
average number of affinization = 19.65145900880037
Path 97 | total_timesteps 1835.
number of affinization with epsilon = 3 is 7
average number of affinization = 19.648529752257467
Path 98 | total_timesteps 1845.
number of affinization with epsilon = 3 is 17
average number of affinization = 19.647916666666667
Path 99 | total_timesteps 1866.
number of affinization with epsilon = 3 is 19
average number of affinization = 19.647766720666514
Path 100 | total_timesteps 1891.
number of affinization with epsilon = 3 is 19
average number of affinization = 19.64761684405368
Path 101 | total_timesteps 1915.
number of affinization with epsilon = 3 is 24
average number of affinization = 19.648623640990053
Path 102 | total_timesteps 1942.
number of affinization with epsilon = 3 is 11
average number of affinization = 19.646623496762256
Path 103 | total_timesteps 1954.
number of affinization with epsilon = 3 is 16
average number of affinization = 19.64578034682081
Path 104 | total_timesteps 1973.
number of affinization with epsilon = 3 is 9
average number of affinization = 19.64331946370781
Path 105 | total_timesteps 1983.
number of affinization with epsilon = 3 is 9
average number of affinization = 19.640859718049455
Path 106 | total_timesteps 1994.
number of affinization with epsilon = 3 is 20
average number of affinization = 19.640942698706098
Path 107 | total_timesteps 2017.
number of affinization with epsilon = 3 is 10
average number of affinization = 19.638715638715638
Path 108 | total_timesteps 2028.
number of affinization with epsilon = 3 is 8
average number of affinization = 19.636027713625865
Path 109 | total_timesteps 2039.
number of affinization with epsilon = 3 is 6
average number of affinization = 19.63287924266913
Path 110 | total_timesteps 2047.
number of affinization with epsilon = 3 is 27
average number of affinization = 19.634579870729457
Path 111 | total_timesteps 2079.
number of affinization with epsilon = 3 is 9
average number of affinization = 19.632125548119085
Path 112 | total_timesteps 2090.
number of affinization with epsilon = 3 is 8
average number of affinization = 19.629441624365484
Path 113 | total_timesteps 2101.
number of affinization with epsilon = 3 is 24
average number of affinization = 19.63044982698962
Path 114 | total_timesteps 2130.
number of affinization with epsilon = 3 is 27
average number of affinization = 19.632149446494466
Path 115 | total_timesteps 2160.
number of affinization with epsilon = 3 is 11
average number of affinization = 19.630159096149413
Path 116 | total_timesteps 2172.
number of affinization with epsilon = 3 is 17
average number of affinization = 19.629552789303826
Path 117 | total_timesteps 2192.
number of affinization with epsilon = 3 is 9
average number of affinization = 19.627103019128832
Path 118 | total_timesteps 2203.
number of affinization with epsilon = 3 is 10
average number of affinization = 19.624884792626727
Path 119 | total_timesteps 2216.
number of affinization with epsilon = 3 is 10
average number of affinization = 19.622667588113337
Path 120 | total_timesteps 2228.
number of affinization with epsilon = 3 is 11
average number of affinization = 19.620681713496086
Path 121 | total_timesteps 2240.
number of affinization with epsilon = 3 is 24
average number of affinization = 19.621690075984343
Path 122 | total_timesteps 2269.
number of affinization with epsilon = 3 is 20
average number of affinization = 19.621777163904234
Path 123 | total_timesteps 2292.
number of affinization with epsilon = 3 is 17
average number of affinization = 19.621173762945915
Path 124 | total_timesteps 2311.
number of affinization with epsilon = 3 is 8
average number of affinization = 19.61849976990336
Path 125 | total_timesteps 2320.
number of affinization with epsilon = 3 is 13
average number of affinization = 19.616977225672876
Path 126 | total_timesteps 2335.
number of affinization with epsilon = 3 is 12
average number of affinization = 19.61522539098436
Path 127 | total_timesteps 2351.
number of affinization with epsilon = 3 is 9
average number of affinization = 19.612784548171994
Path 128 | total_timesteps 2363.
number of affinization with epsilon = 3 is 16
average number of affinization = 19.611954022988506
Path 129 | total_timesteps 2382.
number of affinization with epsilon = 3 is 24
average number of affinization = 19.612962537347737
Path 130 | total_timesteps 2411.
number of affinization with epsilon = 3 is 7
average number of affinization = 19.610064338235293
Path 131 | total_timesteps 2421.
number of affinization with epsilon = 3 is 6
average number of affinization = 19.60693774408454
Path 132 | total_timesteps 2429.
number of affinization with epsilon = 3 is 18
average number of affinization = 19.60656867248507
Path 133 | total_timesteps 2450.
number of affinization with epsilon = 3 is 11
average number of affinization = 19.604592422502872
Path 134 | total_timesteps 2462.
number of affinization with epsilon = 3 is 11
average number of affinization = 19.602617079889807
Path 135 | total_timesteps 2476.
number of affinization with epsilon = 3 is 12
average number of affinization = 19.60087215974294
Path 136 | total_timesteps 2491.
number of affinization with epsilon = 3 is 9
average number of affinization = 19.598439651216154
Path 137 | total_timesteps 2501.
number of affinization with epsilon = 3 is 17
average number of affinization = 19.59784354209681
Path 138 | total_timesteps 2520.
number of affinization with epsilon = 3 is 9
average number of affinization = 19.595412844036698
Path 139 | total_timesteps 2532.
number of affinization with epsilon = 3 is 10
average number of affinization = 19.593212565925246
Path 140 | total_timesteps 2545.
number of affinization with epsilon = 3 is 17
average number of affinization = 19.59261806510775
Path 141 | total_timesteps 2566.
number of affinization with epsilon = 3 is 28
average number of affinization = 19.594545037818015
Path 142 | total_timesteps 2598.
number of affinization with epsilon = 3 is 20
average number of affinization = 19.594637946837764
Path 143 | total_timesteps 2621.
number of affinization with epsilon = 3 is 20
average number of affinization = 19.594730813287516
Path 144 | total_timesteps 2643.
number of affinization with epsilon = 3 is 28
average number of affinization = 19.59665597801191
Path 145 | total_timesteps 2675.
number of affinization with epsilon = 3 is 14
average number of affinization = 19.595374398900848
Path 146 | total_timesteps 2691.
number of affinization with epsilon = 3 is 14
average number of affinization = 19.594093406593405
Path 147 | total_timesteps 2708.
number of affinization with epsilon = 3 is 15
average number of affinization = 19.593041886015108
Path 148 | total_timesteps 2724.
number of affinization with epsilon = 3 is 16
average number of affinization = 19.592219679633867
Path 149 | total_timesteps 2743.
number of affinization with epsilon = 3 is 11
average number of affinization = 19.59025394646534
Path 150 | total_timesteps 2757.
number of affinization with epsilon = 3 is 15
average number of affinization = 19.589204025617565
Path 151 | total_timesteps 2775.
number of affinization with epsilon = 3 is 19
average number of affinization = 19.589069288817747
Path 152 | total_timesteps 2797.
number of affinization with epsilon = 3 is 13
average number of affinization = 19.587562871513487
Path 153 | total_timesteps 2811.
number of affinization with epsilon = 3 is 7
average number of affinization = 19.584685714285715
Path 154 | total_timesteps 2821.
number of affinization with epsilon = 3 is 27
average number of affinization = 19.5863802559415
Path 155 | total_timesteps 2849.
number of affinization with epsilon = 3 is 21
average number of affinization = 19.58670322138451
Path 156 | total_timesteps 2873.
number of affinization with epsilon = 3 is 10
average number of affinization = 19.584513476473276
Path 157 | total_timesteps 2885.
number of affinization with epsilon = 3 is 8
average number of affinization = 19.581868006394153
Path 158 | total_timesteps 2894.
number of affinization with epsilon = 3 is 10
average number of affinization = 19.579680365296802
Path 159 | total_timesteps 2906.
number of affinization with epsilon = 3 is 11
average number of affinization = 19.577721981282814
Path 160 | total_timesteps 2918.
number of affinization with epsilon = 3 is 13
average number of affinization = 19.576220903696942
Path 161 | total_timesteps 2933.
number of affinization with epsilon = 3 is 11
average number of affinization = 19.574264202600958
Path 162 | total_timesteps 2945.
number of affinization with epsilon = 3 is 17
average number of affinization = 19.57367700729927
Path 163 | total_timesteps 2964.
number of affinization with epsilon = 3 is 17
average number of affinization = 19.57309007981756
Path 164 | total_timesteps 2982.
number of affinization with epsilon = 3 is 7
average number of affinization = 19.570223438212494
Path 165 | total_timesteps 2991.
number of affinization with epsilon = 3 is 10
average number of affinization = 19.568041942101665
Path 166 | total_timesteps 3002.
number of affinization with epsilon = 3 is 8
average number of affinization = 19.565405651777574
Path 167 | total_timesteps 3015.
number of affinization with epsilon = 3 is 13
average number of affinization = 19.56390977443609
Path 168 | total_timesteps 3029.
number of affinization with epsilon = 3 is 4
average number of affinization = 19.560364464692483
Path 169 | total_timesteps 3036.
number of affinization with epsilon = 3 is 17
average number of affinization = 19.55978137098611
Path 170 | total_timesteps 3056.
number of affinization with epsilon = 3 is 11
average number of affinization = 19.55783242258652
Path 171 | total_timesteps 3070.
number of affinization with epsilon = 3 is 20
average number of affinization = 19.557933075347144
Path 172 | total_timesteps 3093.
number of affinization with epsilon = 3 is 14
average number of affinization = 19.55666818388712
Path 173 | total_timesteps 3108.
number of affinization with epsilon = 3 is 10
average number of affinization = 19.554493742889647
Path 174 | total_timesteps 3124.
number of affinization with epsilon = 3 is 17
average number of affinization = 19.553912647861694
Path 175 | total_timesteps 3144.
number of affinization with epsilon = 3 is 16
average number of affinization = 19.553104389356378
Path 176 | total_timesteps 3162.
number of affinization with epsilon = 3 is 28
average number of affinization = 19.555025011368805
Path 177 | total_timesteps 3197.
number of affinization with epsilon = 3 is 8
average number of affinization = 19.55239827233462
Path 178 | total_timesteps 3207.
number of affinization with epsilon = 3 is 20
average number of affinization = 19.5525
Path 179 | total_timesteps 3230.
number of affinization with epsilon = 3 is 20
average number of affinization = 19.552601681436037
Path 180 | total_timesteps 3253.
number of affinization with epsilon = 3 is 20
average number of affinization = 19.55270331667424
Path 181 | total_timesteps 3281.
number of affinization with epsilon = 3 is 13
average number of affinization = 19.551215080626847
Path 182 | total_timesteps 3297.
number of affinization with epsilon = 3 is 9
average number of affinization = 19.548819255222526
Path 183 | total_timesteps 3308.
number of affinization with epsilon = 3 is 21
average number of affinization = 19.549148694665153
Path 184 | total_timesteps 3331.
number of affinization with epsilon = 3 is 12
average number of affinization = 19.547435315478893
Path 185 | total_timesteps 3345.
number of affinization with epsilon = 3 is 13
average number of affinization = 19.545949625595643
Path 186 | total_timesteps 3360.
number of affinization with epsilon = 3 is 10
average number of affinization = 19.54378402903811
Path 187 | total_timesteps 3372.
number of affinization with epsilon = 3 is 14
average number of affinization = 19.54252665003402
Path 188 | total_timesteps 3388.
number of affinization with epsilon = 3 is 11
average number of affinization = 19.540589569160996
Path 189 | total_timesteps 3402.
number of affinization with epsilon = 3 is 12
average number of affinization = 19.538880072545908
Path 190 | total_timesteps 3417.
number of affinization with epsilon = 3 is 7
average number of affinization = 19.536038077969174
Path 191 | total_timesteps 3425.
number of affinization with epsilon = 3 is 10
average number of affinization = 19.53387718105597
Path 192 | total_timesteps 3438.
number of affinization with epsilon = 3 is 23
average number of affinization = 19.534662437698234
Path 193 | total_timesteps 3465.
number of affinization with epsilon = 3 is 19
average number of affinization = 19.534541336353342
Path 194 | total_timesteps 3488.
number of affinization with epsilon = 3 is 14
average number of affinization = 19.53328804347826
Path 195 | total_timesteps 3505.
number of affinization with epsilon = 3 is 20
average number of affinization = 19.533393706135385
Path 196 | total_timesteps 3530.
number of affinization with epsilon = 3 is 10
average number of affinization = 19.5312358533273
Path 197 | total_timesteps 3542.
number of affinization with epsilon = 3 is 15
average number of affinization = 19.53021045485404
Path 198 | total_timesteps 3559.
number of affinization with epsilon = 3 is 14
average number of affinization = 19.5289592760181
Path 199 | total_timesteps 3577.
number of affinization with epsilon = 3 is 18
average number of affinization = 19.528613435874238
Path 200 | total_timesteps 3596.
number of affinization with epsilon = 3 is 13
average number of affinization = 19.527137042062414
Path 201 | total_timesteps 3616.
number of affinization with epsilon = 3 is 13
average number of affinization = 19.52566131584897
Path 202 | total_timesteps 3631.
number of affinization with epsilon = 3 is 12
average number of affinization = 19.52396021699819
Path 203 | total_timesteps 3645.
number of affinization with epsilon = 3 is 42
average number of affinization = 19.5290395480226
Path 204 | total_timesteps 3689.
number of affinization with epsilon = 3 is 8
average number of affinization = 19.52643470402169
Path 205 | total_timesteps 3698.
number of affinization with epsilon = 3 is 19
average number of affinization = 19.526315789473685
Path 206 | total_timesteps 3718.
number of affinization with epsilon = 3 is 8
average number of affinization = 19.523712737127372
Path 207 | total_timesteps 3731.
number of affinization with epsilon = 3 is 17
average number of affinization = 19.52314292165274
Path 208 | total_timesteps 3749.
number of affinization with epsilon = 3 is 12
average number of affinization = 19.521444695259593
Path 209 | total_timesteps 3764.
number of affinization with epsilon = 3 is 5
average number of affinization = 19.518167456556082
Path 210 | total_timesteps 3772.
number of affinization with epsilon = 3 is 11
average number of affinization = 19.51624548736462
Path 211 | total_timesteps 3784.
number of affinization with epsilon = 3 is 7
average number of affinization = 19.51342206180916
Path 212 | total_timesteps 3795.
number of affinization with epsilon = 3 is 14
average number of affinization = 19.512178619756426
Path 213 | total_timesteps 3812.
number of affinization with epsilon = 3 is 13
average number of affinization = 19.510710259301014
Path 214 | total_timesteps 3827.
number of affinization with epsilon = 3 is 24
average number of affinization = 19.511722272317403
Path 215 | total_timesteps 3854.
number of affinization with epsilon = 3 is 18
average number of affinization = 19.5113815641199
Path 216 | total_timesteps 3877.
number of affinization with epsilon = 3 is 11
average number of affinization = 19.509463722397477
Path 217 | total_timesteps 3890.
number of affinization with epsilon = 3 is 7
average number of affinization = 19.506645640910115
Path 218 | total_timesteps 3898.
number of affinization with epsilon = 3 is 13
average number of affinization = 19.50518018018018
Path 219 | total_timesteps 3914.
number of affinization with epsilon = 3 is 12
average number of affinization = 19.503490204908804
Path 220 | total_timesteps 3928.
number of affinization with epsilon = 3 is 14
average number of affinization = 19.502251238181
Path 221 | total_timesteps 3944.
number of affinization with epsilon = 3 is 12
average number of affinization = 19.500562682871934
Path 222 | total_timesteps 3958.
number of affinization with epsilon = 3 is 14
average number of affinization = 19.49932493249325
Path 223 | total_timesteps 3973.
number of affinization with epsilon = 3 is 6
average number of affinization = 19.496287964004498
Path 224 | total_timesteps 3981.
number of affinization with epsilon = 3 is 9
average number of affinization = 19.493927125506072
Path 225 | total_timesteps 3991.
number of affinization with epsilon = 3 is 10
average number of affinization = 19.4917922194738
Path 226 | total_timesteps 4004.
number of affinization with epsilon = 3 is 8
average number of affinization = 19.489208633093526
Path 227 | total_timesteps 4015.
number of affinization with epsilon = 3 is 14
average number of affinization = 19.48797482580355
Path 228 | total_timesteps 4031.
number of affinization with epsilon = 3 is 12
average number of affinization = 19.486292134831462
Path 229 | total_timesteps 4046.
number of affinization with epsilon = 3 is 8
average number of affinization = 19.48371152549989
Path 230 | total_timesteps 4057.
number of affinization with epsilon = 3 is 33
average number of affinization = 19.48674752920036
Path 231 | total_timesteps 4096.
number of affinization with epsilon = 3 is 34
average number of affinization = 19.490006737031216
Path 232 | total_timesteps 4132.
number of affinization with epsilon = 3 is 12
average number of affinization = 19.48832510103278
Path 233 | total_timesteps 4148.
number of affinization with epsilon = 3 is 6
average number of affinization = 19.48529741863075
Path 234 | total_timesteps 4158.
number of affinization with epsilon = 3 is 8
average number of affinization = 19.482719928186714
Path 235 | total_timesteps 4169.
number of affinization with epsilon = 3 is 10
average number of affinization = 19.480592326677137
Path 236 | total_timesteps 4181.
number of affinization with epsilon = 3 is 7
average number of affinization = 19.47779273216689
Path 237 | total_timesteps 4191.
number of affinization with epsilon = 3 is 14
average number of affinization = 19.476564252074457
Path 238 | total_timesteps 4207.
number of affinization with epsilon = 3 is 17
average number of affinization = 19.476008968609865
Path 239 | total_timesteps 4228.
number of affinization with epsilon = 3 is 16
average number of affinization = 19.475229769110065
Path 240 | total_timesteps 4247.
number of affinization with epsilon = 3 is 22
average number of affinization = 19.475795607350964
Path 241 | total_timesteps 4276.
number of affinization with epsilon = 3 is 15
average number of affinization = 19.47479274030921
Path 242 | total_timesteps 4292.
number of affinization with epsilon = 3 is 21
average number of affinization = 19.475134408602152
Path 243 | total_timesteps 4319.
number of affinization with epsilon = 3 is 16
average number of affinization = 19.474356103023517
Path 244 | total_timesteps 4338.
number of affinization with epsilon = 3 is 16
average number of affinization = 19.47357814599194
Path 245 | total_timesteps 4356.
number of affinization with epsilon = 3 is 9
average number of affinization = 19.471233490038056
Path 246 | total_timesteps 4368.
number of affinization with epsilon = 3 is 12
average number of affinization = 19.46956132497762
Path 247 | total_timesteps 4384.
number of affinization with epsilon = 3 is 10
average number of affinization = 19.467442380845828
Path 248 | total_timesteps 4395.
number of affinization with epsilon = 3 is 16
average number of affinization = 19.466666666666665
Path 249 | total_timesteps 4415.
number of affinization with epsilon = 3 is 7
average number of affinization = 19.4638783269962
Path 250 | total_timesteps 4426.
number of affinization with epsilon = 3 is 19
average number of affinization = 19.46377459749553
Path 251 | total_timesteps 4446.
number of affinization with epsilon = 3 is 7
average number of affinization = 19.460988151128998
Path 252 | total_timesteps 4456.
number of affinization with epsilon = 3 is 18
average number of affinization = 19.46066160035762
Path 253 | total_timesteps 4475.
number of affinization with epsilon = 3 is 19
average number of affinization = 19.460558659217877
Path 254 | total_timesteps 4497.
number of affinization with epsilon = 3 is 7
average number of affinization = 19.457774798927613
Path 255 | total_timesteps 4506.
number of affinization with epsilon = 3 is 8
average number of affinization = 19.455215546124638
Path 256 | total_timesteps 4516.
number of affinization with epsilon = 3 is 44
average number of affinization = 19.4606967396159
Path 257 | total_timesteps 4568.
number of affinization with epsilon = 3 is 12
average number of affinization = 19.459031033712883
Path 258 | total_timesteps 4583.
number of affinization with epsilon = 3 is 6
average number of affinization = 19.456026785714286
Path 259 | total_timesteps 4592.
number of affinization with epsilon = 3 is 8
average number of affinization = 19.45347020754296
Path 260 | total_timesteps 4601.
number of affinization with epsilon = 3 is 8
average number of affinization = 19.45091477019188
Path 261 | total_timesteps 4611.
number of affinization with epsilon = 3 is 18
average number of affinization = 19.450591122016508
Path 262 | total_timesteps 4631.
number of affinization with epsilon = 3 is 7
average number of affinization = 19.447814451382694
Path 263 | total_timesteps 4641.
number of affinization with epsilon = 3 is 7
average number of affinization = 19.445039018952063
Path 264 | total_timesteps 4649.
number of affinization with epsilon = 3 is 11
average number of affinization = 19.443156486847972
Path 265 | total_timesteps 4663.
number of affinization with epsilon = 3 is 18
average number of affinization = 19.442834856251395
Path 266 | total_timesteps 4687.
number of affinization with epsilon = 3 is 21
average number of affinization = 19.443181818181817
Path 267 | total_timesteps 4711.
number of affinization with epsilon = 3 is 8
average number of affinization = 19.440632657607484
Path 268 | total_timesteps 4722.
number of affinization with epsilon = 3 is 12
average number of affinization = 19.438975501113585
Path 269 | total_timesteps 4736.
number of affinization with epsilon = 3 is 12
average number of affinization = 19.437319082609665
Path 270 | total_timesteps 4751.
number of affinization with epsilon = 3 is 8
average number of affinization = 19.434772929652716
Path 271 | total_timesteps 4762.
number of affinization with epsilon = 3 is 19
average number of affinization = 19.4346761629201
Path 272 | total_timesteps 4787.
number of affinization with epsilon = 3 is 11
average number of affinization = 19.432799287939474
Path 273 | total_timesteps 4801.
number of affinization with epsilon = 3 is 5
average number of affinization = 19.429588431590656
Path 274 | total_timesteps 4809.
number of affinization with epsilon = 3 is 13
average number of affinization = 19.428158362989326
Path 275 | total_timesteps 4826.
number of affinization with epsilon = 3 is 18
average number of affinization = 19.427840782744052
Path 276 | total_timesteps 4851.
number of affinization with epsilon = 3 is 8
average number of affinization = 19.425300133392618
Path 277 | total_timesteps 4862.
number of affinization with epsilon = 3 is 21
average number of affinization = 19.42565014447655
Path 278 | total_timesteps 4884.
number of affinization with epsilon = 3 is 19
average number of affinization = 19.425555555555555
Path 279 | total_timesteps 4907.
number of affinization with epsilon = 3 is 11
average number of affinization = 19.42368362586092
Path 280 | total_timesteps 4919.
number of affinization with epsilon = 3 is 7
average number of affinization = 19.420924033762773
Path 281 | total_timesteps 4929.
number of affinization with epsilon = 3 is 10
average number of affinization = 19.41883188985121
Path 282 | total_timesteps 4940.
number of affinization with epsilon = 3 is 7
average number of affinization = 19.41607460035524
Path 283 | total_timesteps 4950.
number of affinization with epsilon = 3 is 11
average number of affinization = 19.4142064372919
Path 284 | total_timesteps 4964.
number of affinization with epsilon = 3 is 16
average number of affinization = 19.413448735019973
Path 285 | total_timesteps 4982.
number of affinization with epsilon = 3 is 10
average number of affinization = 19.411360106501
Path 286 | total_timesteps 4993.
number of affinization with epsilon = 3 is 20
average number of affinization = 19.411490683229815
Path 287 | total_timesteps 5015.
number of affinization with epsilon = 3 is 17
average number of affinization = 19.410955866045686
Path 288 | total_timesteps 5038.
number of affinization with epsilon = 3 is 14
average number of affinization = 19.409756097560976
Path 289 | total_timesteps 5056.
number of affinization with epsilon = 3 is 34
average number of affinization = 19.412990467745512
Path 290 | total_timesteps 5096.
number of affinization with epsilon = 3 is 9
average number of affinization = 19.410682624113477
Path 291 | total_timesteps 5107.
number of affinization with epsilon = 3 is 9
average number of affinization = 19.4083758032351
Path 292 | total_timesteps 5122.
number of affinization with epsilon = 3 is 14
average number of affinization = 19.407177669472752
Path 293 | total_timesteps 5137.
number of affinization with epsilon = 3 is 18
average number of affinization = 19.40686600221484
Path 294 | total_timesteps 5160.
number of affinization with epsilon = 3 is 8
average number of affinization = 19.404340124003543
Path 295 | total_timesteps 5169.
number of affinization with epsilon = 3 is 26
average number of affinization = 19.405800309940226
Path 296 | total_timesteps 5197.
number of affinization with epsilon = 3 is 10
average number of affinization = 19.40371845949535
Path 297 | total_timesteps 5209.
number of affinization with epsilon = 3 is 22
average number of affinization = 19.40429298517371
Path 298 | total_timesteps 5234.
number of affinization with epsilon = 3 is 10
average number of affinization = 19.40221238938053
Path 299 | total_timesteps 5246.
number of affinization with epsilon = 3 is 10
average number of affinization = 19.400132714001327
Path 300 | total_timesteps 5258.
number of affinization with epsilon = 3 is 13
average number of affinization = 19.39871738168952
Path 301 | total_timesteps 5274.
number of affinization with epsilon = 3 is 15
average number of affinization = 19.397744859606455
Path 302 | total_timesteps 5291.
number of affinization with epsilon = 3 is 9
average number of affinization = 19.395446507515473
Path 303 | total_timesteps 5301.
number of affinization with epsilon = 3 is 33
average number of affinization = 19.398453038674035
Path 304 | total_timesteps 5342.
number of affinization with epsilon = 3 is 12
average number of affinization = 19.39681838267786
Path 305 | total_timesteps 5356.
number of affinization with epsilon = 3 is 24
average number of affinization = 19.397835210956483
Path 306 | total_timesteps 5381.
number of affinization with epsilon = 3 is 11
average number of affinization = 19.395980565371026
Path 307 | total_timesteps 5396.
number of affinization with epsilon = 3 is 6
average number of affinization = 19.393022742327226
Path 308 | total_timesteps 5405.
number of affinization with epsilon = 3 is 10
average number of affinization = 19.390949227373067
Path 309 | total_timesteps 5416.
number of affinization with epsilon = 3 is 17
average number of affinization = 19.390421540498785
Path 310 | total_timesteps 5436.
number of affinization with epsilon = 3 is 15
average number of affinization = 19.38945278022948
Path 311 | total_timesteps 5457.
number of affinization with epsilon = 3 is 11
average number of affinization = 19.387602029561
Path 312 | total_timesteps 5469.
number of affinization with epsilon = 3 is 10
average number of affinization = 19.385531539479487
Path 313 | total_timesteps 5483.
number of affinization with epsilon = 3 is 8
average number of affinization = 19.383020948180818
Path 314 | total_timesteps 5494.
number of affinization with epsilon = 3 is 24
average number of affinization = 19.38403880070547
Path 315 | total_timesteps 5523.
number of affinization with epsilon = 3 is 17
average number of affinization = 19.383513334802732
Path 316 | total_timesteps 5541.
number of affinization with epsilon = 3 is 8
average number of affinization = 19.38100484795064
Path 317 | total_timesteps 5551.
number of affinization with epsilon = 3 is 5
average number of affinization = 19.377836527869576
Path 318 | total_timesteps 5558.
number of affinization with epsilon = 3 is 11
average number of affinization = 19.375991189427314
Path 319 | total_timesteps 5570.
number of affinization with epsilon = 3 is 10
average number of affinization = 19.37392644791896
Path 320 | total_timesteps 5582.
number of affinization with epsilon = 3 is 22
average number of affinization = 19.37450462351387
Path 321 | total_timesteps 5607.
number of affinization with epsilon = 3 is 21
average number of affinization = 19.374862425709882
Path 322 | total_timesteps 5633.
number of affinization with epsilon = 3 is 15
average number of affinization = 19.373899647887324
Path 323 | total_timesteps 5652.
number of affinization with epsilon = 3 is 21
average number of affinization = 19.374257425742574
Path 324 | total_timesteps 5676.
number of affinization with epsilon = 3 is 8
average number of affinization = 19.37175538935328
Path 325 | total_timesteps 5688.
number of affinization with epsilon = 3 is 17
average number of affinization = 19.371233780514626
Path 326 | total_timesteps 5707.
number of affinization with epsilon = 3 is 9
average number of affinization = 19.368953386103783
Path 327 | total_timesteps 5718.
number of affinization with epsilon = 3 is 9
average number of affinization = 19.366673994284458
Path 328 | total_timesteps 5728.
number of affinization with epsilon = 3 is 23
average number of affinization = 19.36747252747253
Path 329 | total_timesteps 5755.
number of affinization with epsilon = 3 is 18
average number of affinization = 19.36717205009888
Path 330 | total_timesteps 5775.
number of affinization with epsilon = 3 is 17
average number of affinization = 19.36665202108963
Path 331 | total_timesteps 5794.
number of affinization with epsilon = 3 is 30
average number of affinization = 19.368987480781904
Path 332 | total_timesteps 5828.
number of affinization with epsilon = 3 is 16
average number of affinization = 19.368247694334652
Path 333 | total_timesteps 5847.
number of affinization with epsilon = 3 is 41
average number of affinization = 19.372996706915476
Path 334 | total_timesteps 5892.
number of affinization with epsilon = 3 is 26
average number of affinization = 19.37445127304653
Path 335 | total_timesteps 5922.
number of affinization with epsilon = 3 is 8
average number of affinization = 19.371955233706387
Path 336 | total_timesteps 5931.
number of affinization with epsilon = 3 is 15
average number of affinization = 19.370996050899517
Path 337 | total_timesteps 5948.
number of affinization with epsilon = 3 is 31
average number of affinization = 19.373546830445274
Path 338 | total_timesteps 5988.
number of affinization with epsilon = 3 is 18
average number of affinization = 19.37324561403509
Done generating on-policy rollouts.
Updating normalization.
Done updating normalization.
----------------------------
| AverageReturn | -6.37    |
| Iteration     | 17       |
| MaximumReturn | 8.17     |
| MinimumReturn | -18.5    |
| TotalSamples  | 76219    |
----------------------------
itr #18 | 
Fitting dynamics.
Fitting model 0 (0-based) in the ensemble of 2 models
Validation loss = 0.016279058530926704
Validation loss = 0.01574157364666462
Validation loss = 0.015915388241410255
Validation loss = 0.016437655314803123
Validation loss = 0.01564546674489975
Validation loss = 0.016455113887786865
Validation loss = 0.015806177631020546
Validation loss = 0.015709364786744118
Validation loss = 0.015679974108934402
Fitting model 1 (0-based) in the ensemble of 2 models
Validation loss = 0.01620221510529518
Validation loss = 0.01602540910243988
Validation loss = 0.017016444355249405
Validation loss = 0.016622493043541908
Validation loss = 0.016044698655605316
Validation loss = 0.016238147392868996
Done fitting dynamics.
Updating randomness.
Done updating randomness.
Training policy using TRPO.
Re-initialize init_std.
Obtaining samples for iteration 0...
Obtaining samples for iteration 1...
Obtaining samples for iteration 2...
Obtaining samples for iteration 3...
Obtaining samples for iteration 4...
Obtaining samples for iteration 5...
Obtaining samples for iteration 6...
Obtaining samples for iteration 7...
Obtaining samples for iteration 8...
Obtaining samples for iteration 9...
Obtaining samples for iteration 10...
Obtaining samples for iteration 11...
Obtaining samples for iteration 12...
Obtaining samples for iteration 13...
Obtaining samples for iteration 14...
Obtaining samples for iteration 15...
Obtaining samples for iteration 16...
Obtaining samples for iteration 17...
Obtaining samples for iteration 18...
Obtaining samples for iteration 19...
Done training policy.
Generating on-policy rollouts.
Path 0 | total_timesteps 0.
number of affinization with epsilon = 3 is 21
average number of affinization = 19.37360228020171
Path 1 | total_timesteps 24.
number of affinization with epsilon = 3 is 15
average number of affinization = 19.372643577378344
Path 2 | total_timesteps 42.
number of affinization with epsilon = 3 is 10
average number of affinization = 19.37058952443568
Path 3 | total_timesteps 54.
number of affinization with epsilon = 3 is 30
average number of affinization = 19.372918492550394
Path 4 | total_timesteps 89.
number of affinization with epsilon = 3 is 26
average number of affinization = 19.374370208105148
Path 5 | total_timesteps 119.
number of affinization with epsilon = 3 is 19
average number of affinization = 19.374288217257995
Path 6 | total_timesteps 142.
number of affinization with epsilon = 3 is 21
average number of affinization = 19.374644186555727
Path 7 | total_timesteps 168.
number of affinization with epsilon = 3 is 21
average number of affinization = 19.375
Path 8 | total_timesteps 194.
number of affinization with epsilon = 3 is 14
average number of affinization = 19.3738235937842
Path 9 | total_timesteps 213.
number of affinization with epsilon = 3 is 9
average number of affinization = 19.371553610503284
Path 10 | total_timesteps 225.
number of affinization with epsilon = 3 is 17
average number of affinization = 19.371034784511046
Path 11 | total_timesteps 245.
number of affinization with epsilon = 3 is 26
average number of affinization = 19.372484689413824
Path 12 | total_timesteps 278.
number of affinization with epsilon = 3 is 14
average number of affinization = 19.371309862234856
Path 13 | total_timesteps 294.
number of affinization with epsilon = 3 is 26
average number of affinization = 19.372759073021424
Path 14 | total_timesteps 330.
number of affinization with epsilon = 3 is 19
average number of affinization = 19.372677595628414
Path 15 | total_timesteps 354.
number of affinization with epsilon = 3 is 14
average number of affinization = 19.371503496503497
Path 16 | total_timesteps 371.
number of affinization with epsilon = 3 is 18
average number of affinization = 19.371203845313524
Path 17 | total_timesteps 392.
number of affinization with epsilon = 3 is 17
average number of affinization = 19.37068588903451
Path 18 | total_timesteps 411.
number of affinization with epsilon = 3 is 12
average number of affinization = 19.369076217514742
Path 19 | total_timesteps 425.
number of affinization with epsilon = 3 is 43
average number of affinization = 19.374235807860263
Path 20 | total_timesteps 480.
number of affinization with epsilon = 3 is 6
average number of affinization = 19.3713163064833
Path 21 | total_timesteps 491.
number of affinization with epsilon = 3 is 10
average number of affinization = 19.369271060672194
Path 22 | total_timesteps 504.
number of affinization with epsilon = 3 is 16
average number of affinization = 19.368535893519528
Path 23 | total_timesteps 529.
number of affinization with epsilon = 3 is 19
average number of affinization = 19.3684554973822
Path 24 | total_timesteps 552.
number of affinization with epsilon = 3 is 16
average number of affinization = 19.36772082878953
Path 25 | total_timesteps 570.
number of affinization with epsilon = 3 is 10
average number of affinization = 19.365678150894027
Path 26 | total_timesteps 583.
number of affinization with epsilon = 3 is 10
average number of affinization = 19.363636363636363
Path 27 | total_timesteps 600.
number of affinization with epsilon = 3 is 5
average number of affinization = 19.36050566695728
Path 28 | total_timesteps 607.
number of affinization with epsilon = 3 is 9
average number of affinization = 19.358247984310307
Path 29 | total_timesteps 618.
number of affinization with epsilon = 3 is 15
average number of affinization = 19.357298474945534
Path 30 | total_timesteps 634.
number of affinization with epsilon = 3 is 17
average number of affinization = 19.356785014158135
Path 31 | total_timesteps 654.
number of affinization with epsilon = 3 is 19
average number of affinization = 19.35670731707317
Path 32 | total_timesteps 679.
number of affinization with epsilon = 3 is 30
average number of affinization = 19.359024602656216
Path 33 | total_timesteps 713.
number of affinization with epsilon = 3 is 7
average number of affinization = 19.356334349151066
Path 34 | total_timesteps 722.
number of affinization with epsilon = 3 is 6
average number of affinization = 19.35342763873776
Path 35 | total_timesteps 732.
number of affinization with epsilon = 3 is 26
average number of affinization = 19.354873803307225
Path 36 | total_timesteps 764.
number of affinization with epsilon = 3 is 11
average number of affinization = 19.353056341092017
Path 37 | total_timesteps 777.
number of affinization with epsilon = 3 is 40
average number of affinization = 19.357546759460636
Path 38 | total_timesteps 822.
number of affinization with epsilon = 3 is 13
average number of affinization = 19.356164383561644
Path 39 | total_timesteps 839.
number of affinization with epsilon = 3 is 21
average number of affinization = 19.356521739130436
Path 40 | total_timesteps 861.
number of affinization with epsilon = 3 is 15
average number of affinization = 19.35557487502717
Path 41 | total_timesteps 877.
number of affinization with epsilon = 3 is 18
average number of affinization = 19.355280312907432
Path 42 | total_timesteps 899.
number of affinization with epsilon = 3 is 18
average number of affinization = 19.354985878774713
Path 43 | total_timesteps 918.
number of affinization with epsilon = 3 is 19
average number of affinization = 19.35490877497828
Path 44 | total_timesteps 940.
number of affinization with epsilon = 3 is 8
average number of affinization = 19.35244299674267
Path 45 | total_timesteps 951.
number of affinization with epsilon = 3 is 8
average number of affinization = 19.349978289188016
Path 46 | total_timesteps 963.
number of affinization with epsilon = 3 is 14
average number of affinization = 19.34881701758194
Path 47 | total_timesteps 978.
number of affinization with epsilon = 3 is 18
average number of affinization = 19.348524305555557
Path 48 | total_timesteps 1000.
number of affinization with epsilon = 3 is 19
average number of affinization = 19.348448687350835
Path 49 | total_timesteps 1024.
number of affinization with epsilon = 3 is 23
average number of affinization = 19.349240780911064
Path 50 | total_timesteps 1049.
number of affinization with epsilon = 3 is 16
average number of affinization = 19.348514422034267
Path 51 | total_timesteps 1066.
number of affinization with epsilon = 3 is 18
average number of affinization = 19.34822202948829
Path 52 | total_timesteps 1087.
number of affinization with epsilon = 3 is 11
average number of affinization = 19.3464123130284
Path 53 | total_timesteps 1099.
number of affinization with epsilon = 3 is 15
average number of affinization = 19.345470307758994
Path 54 | total_timesteps 1116.
number of affinization with epsilon = 3 is 25
average number of affinization = 19.346695557963162
Path 55 | total_timesteps 1145.
number of affinization with epsilon = 3 is 31
average number of affinization = 19.349220103986134
Path 56 | total_timesteps 1180.
number of affinization with epsilon = 3 is 18
average number of affinization = 19.348927875243664
Path 57 | total_timesteps 1199.
number of affinization with epsilon = 3 is 17
average number of affinization = 19.34841922910351
Path 58 | total_timesteps 1219.
number of affinization with epsilon = 3 is 24
average number of affinization = 19.34942628274518
Path 59 | total_timesteps 1248.
number of affinization with epsilon = 3 is 13
average number of affinization = 19.34805194805195
Path 60 | total_timesteps 1264.
number of affinization with epsilon = 3 is 10
average number of affinization = 19.34602899805237
Path 61 | total_timesteps 1275.
number of affinization with epsilon = 3 is 21
average number of affinization = 19.34638684552142
Path 62 | total_timesteps 1299.
number of affinization with epsilon = 3 is 23
average number of affinization = 19.347177157689813
Path 63 | total_timesteps 1326.
number of affinization with epsilon = 3 is 12
average number of affinization = 19.345588235294116
Path 64 | total_timesteps 1340.
number of affinization with epsilon = 3 is 24
average number of affinization = 19.346594594594595
Path 65 | total_timesteps 1368.
number of affinization with epsilon = 3 is 14
average number of affinization = 19.345438824038045
Path 66 | total_timesteps 1383.
number of affinization with epsilon = 3 is 11
average number of affinization = 19.343635184784958
Path 67 | total_timesteps 1396.
number of affinization with epsilon = 3 is 22
average number of affinization = 19.344209161624892
Path 68 | total_timesteps 1421.
number of affinization with epsilon = 3 is 16
average number of affinization = 19.34348671419313
Path 69 | total_timesteps 1439.
number of affinization with epsilon = 3 is 8
average number of affinization = 19.341036717062636
Path 70 | total_timesteps 1449.
number of affinization with epsilon = 3 is 27
average number of affinization = 19.342690563593177
Path 71 | total_timesteps 1479.
number of affinization with epsilon = 3 is 22
average number of affinization = 19.343264248704664
Path 72 | total_timesteps 1505.
number of affinization with epsilon = 3 is 20
average number of affinization = 19.343406000431685
Path 73 | total_timesteps 1528.
number of affinization with epsilon = 3 is 37
average number of affinization = 19.34721622788088
Path 74 | total_timesteps 1571.
number of affinization with epsilon = 3 is 10
average number of affinization = 19.34519956850054
Path 75 | total_timesteps 1585.
number of affinization with epsilon = 3 is 14
average number of affinization = 19.34404659188956
Path 76 | total_timesteps 1604.
number of affinization with epsilon = 3 is 12
average number of affinization = 19.342462799223636
Path 77 | total_timesteps 1620.
number of affinization with epsilon = 3 is 7
average number of affinization = 19.339801638637343
Path 78 | total_timesteps 1634.
number of affinization with epsilon = 3 is 20
average number of affinization = 19.33994395343824
Path 79 | total_timesteps 1658.
number of affinization with epsilon = 3 is 17
average number of affinization = 19.339439655172413
Path 80 | total_timesteps 1681.
number of affinization with epsilon = 3 is 19
average number of affinization = 19.339366515837103
Path 81 | total_timesteps 1703.
number of affinization with epsilon = 3 is 11
average number of affinization = 19.337570012925465
Path 82 | total_timesteps 1716.
number of affinization with epsilon = 3 is 8
average number of affinization = 19.33512814990308
Path 83 | total_timesteps 1727.
number of affinization with epsilon = 3 is 8
average number of affinization = 19.33268733850129
Path 84 | total_timesteps 1738.
number of affinization with epsilon = 3 is 17
average number of affinization = 19.332185145317546
Path 85 | total_timesteps 1756.
number of affinization with epsilon = 3 is 23
average number of affinization = 19.332974601808008
Path 86 | total_timesteps 1782.
number of affinization with epsilon = 3 is 12
average number of affinization = 19.33139659995696
Path 87 | total_timesteps 1796.
number of affinization with epsilon = 3 is 9
average number of affinization = 19.329173838209982
Path 88 | total_timesteps 1806.
number of affinization with epsilon = 3 is 22
average number of affinization = 19.329748332974834
Path 89 | total_timesteps 1831.
number of affinization with epsilon = 3 is 9
average number of affinization = 19.32752688172043
Path 90 | total_timesteps 1843.
number of affinization with epsilon = 3 is 17
average number of affinization = 19.327026445925608
Path 91 | total_timesteps 1865.
number of affinization with epsilon = 3 is 12
average number of affinization = 19.325451418744628
Path 92 | total_timesteps 1880.
number of affinization with epsilon = 3 is 24
average number of affinization = 19.326456049860305
Path 93 | total_timesteps 1908.
number of affinization with epsilon = 3 is 6
average number of affinization = 19.32359260850881
Path 94 | total_timesteps 1917.
number of affinization with epsilon = 3 is 12
average number of affinization = 19.322019334049408
Path 95 | total_timesteps 1930.
number of affinization with epsilon = 3 is 18
average number of affinization = 19.321735395189002
Path 96 | total_timesteps 1950.
number of affinization with epsilon = 3 is 14
average number of affinization = 19.320592656216448
Path 97 | total_timesteps 1969.
number of affinization with epsilon = 3 is 8
average number of affinization = 19.318162301416915
Path 98 | total_timesteps 1979.
number of affinization with epsilon = 3 is 7
average number of affinization = 19.31551835157759
Path 99 | total_timesteps 1988.
number of affinization with epsilon = 3 is 13
average number of affinization = 19.314163090128755
Path 100 | total_timesteps 2004.
number of affinization with epsilon = 3 is 8
average number of affinization = 19.311735679038833
Path 101 | total_timesteps 2015.
number of affinization with epsilon = 3 is 14
average number of affinization = 19.31059631059631
Path 102 | total_timesteps 2031.
number of affinization with epsilon = 3 is 10
average number of affinization = 19.308599613982416
Path 103 | total_timesteps 2046.
number of affinization with epsilon = 3 is 8
average number of affinization = 19.306174957118355
Path 104 | total_timesteps 2058.
number of affinization with epsilon = 3 is 18
average number of affinization = 19.3058949624866
Path 105 | total_timesteps 2079.
number of affinization with epsilon = 3 is 8
average number of affinization = 19.30347192456065
Path 106 | total_timesteps 2089.
number of affinization with epsilon = 3 is 11
average number of affinization = 19.301692736233125
Path 107 | total_timesteps 2103.
number of affinization with epsilon = 3 is 13
average number of affinization = 19.300342759211652
Path 108 | total_timesteps 2120.
number of affinization with epsilon = 3 is 13
average number of affinization = 19.298993360462624
Path 109 | total_timesteps 2136.
number of affinization with epsilon = 3 is 7
average number of affinization = 19.296359743040686
Path 110 | total_timesteps 2146.
number of affinization with epsilon = 3 is 12
average number of affinization = 19.294797687861273
Path 111 | total_timesteps 2159.
number of affinization with epsilon = 3 is 26
average number of affinization = 19.296232876712327
Path 112 | total_timesteps 2189.
number of affinization with epsilon = 3 is 22
average number of affinization = 19.296811470147656
Path 113 | total_timesteps 2213.
number of affinization with epsilon = 3 is 8
average number of affinization = 19.2943945228926
Path 114 | total_timesteps 2223.
number of affinization with epsilon = 3 is 14
average number of affinization = 19.29326203208556
Path 115 | total_timesteps 2243.
number of affinization with epsilon = 3 is 11
average number of affinization = 19.29148845166809
Path 116 | total_timesteps 2256.
number of affinization with epsilon = 3 is 16
average number of affinization = 19.290784691041267
Path 117 | total_timesteps 2273.
number of affinization with epsilon = 3 is 7
average number of affinization = 19.288157332193244
Path 118 | total_timesteps 2281.
number of affinization with epsilon = 3 is 27
average number of affinization = 19.28980551399872
Path 119 | total_timesteps 2310.
number of affinization with epsilon = 3 is 17
average number of affinization = 19.28931623931624
Path 120 | total_timesteps 2328.
number of affinization with epsilon = 3 is 12
average number of affinization = 19.287759025849176
Path 121 | total_timesteps 2342.
number of affinization with epsilon = 3 is 8
average number of affinization = 19.285348141819735
Path 122 | total_timesteps 2354.
number of affinization with epsilon = 3 is 13
average number of affinization = 19.284005979073243
Path 123 | total_timesteps 2371.
number of affinization with epsilon = 3 is 14
average number of affinization = 19.282877882152007
Path 124 | total_timesteps 2388.
number of affinization with epsilon = 3 is 4
average number of affinization = 19.279615795090717
Path 125 | total_timesteps 2395.
number of affinization with epsilon = 3 is 20
average number of affinization = 19.2797695262484
Path 126 | total_timesteps 2417.
number of affinization with epsilon = 3 is 15
average number of affinization = 19.278856411350542
Path 127 | total_timesteps 2435.
number of affinization with epsilon = 3 is 11
average number of affinization = 19.277090443686006
Path 128 | total_timesteps 2447.
number of affinization with epsilon = 3 is 15
average number of affinization = 19.27617828961399
Path 129 | total_timesteps 2467.
number of affinization with epsilon = 3 is 10
average number of affinization = 19.274200426439233
Path 130 | total_timesteps 2478.
number of affinization with epsilon = 3 is 10
average number of affinization = 19.27222340652313
Path 131 | total_timesteps 2490.
number of affinization with epsilon = 3 is 11
average number of affinization = 19.270460358056265
Path 132 | total_timesteps 2504.
number of affinization with epsilon = 3 is 18
average number of affinization = 19.270189644150864
Path 133 | total_timesteps 2527.
number of affinization with epsilon = 3 is 17
average number of affinization = 19.269706007669367
Path 134 | total_timesteps 2547.
number of affinization with epsilon = 3 is 11
average number of affinization = 19.26794462193823
Path 135 | total_timesteps 2560.
number of affinization with epsilon = 3 is 11
average number of affinization = 19.26618398637138
Path 136 | total_timesteps 2576.
number of affinization with epsilon = 3 is 16
average number of affinization = 19.265488609750903
Path 137 | total_timesteps 2595.
number of affinization with epsilon = 3 is 11
average number of affinization = 19.263729246487866
Path 138 | total_timesteps 2609.
number of affinization with epsilon = 3 is 16
average number of affinization = 19.26303468823154
Path 139 | total_timesteps 2628.
number of affinization with epsilon = 3 is 15
average number of affinization = 19.262127659574467
Path 140 | total_timesteps 2647.
number of affinization with epsilon = 3 is 17
average number of affinization = 19.26164645820038
Path 141 | total_timesteps 2666.
number of affinization with epsilon = 3 is 26
average number of affinization = 19.263079540621014
Path 142 | total_timesteps 2698.
number of affinization with epsilon = 3 is 24
average number of affinization = 19.264086753136297
Path 143 | total_timesteps 2727.
number of affinization with epsilon = 3 is 7
average number of affinization = 19.261479591836736
Path 144 | total_timesteps 2736.
number of affinization with epsilon = 3 is 12
average number of affinization = 19.259936238044634
Path 145 | total_timesteps 2750.
number of affinization with epsilon = 3 is 20
average number of affinization = 19.26009349766256
Path 146 | total_timesteps 2772.
number of affinization with epsilon = 3 is 18
average number of affinization = 19.25982579137455
Path 147 | total_timesteps 2794.
number of affinization with epsilon = 3 is 6
average number of affinization = 19.257009345794394
Path 148 | total_timesteps 2804.
number of affinization with epsilon = 3 is 13
average number of affinization = 19.25568061159482
Path 149 | total_timesteps 2818.
number of affinization with epsilon = 3 is 29
average number of affinization = 19.25774946921444
Path 150 | total_timesteps 2851.
number of affinization with epsilon = 3 is 16
average number of affinization = 19.25705794947994
Path 151 | total_timesteps 2869.
number of affinization with epsilon = 3 is 10
average number of affinization = 19.25509337860781
Path 152 | total_timesteps 2882.
number of affinization with epsilon = 3 is 20
average number of affinization = 19.255251432208784
Path 153 | total_timesteps 2909.
number of affinization with epsilon = 3 is 14
average number of affinization = 19.254136614340265
Path 154 | total_timesteps 2929.
number of affinization with epsilon = 3 is 5
average number of affinization = 19.251113467656417
Path 155 | total_timesteps 2939.
number of affinization with epsilon = 3 is 14
average number of affinization = 19.25
Path 156 | total_timesteps 2957.
number of affinization with epsilon = 3 is 11
average number of affinization = 19.24825100699597
Path 157 | total_timesteps 2974.
number of affinization with epsilon = 3 is 24
average number of affinization = 19.24925816023739
Path 158 | total_timesteps 3001.
number of affinization with epsilon = 3 is 9
average number of affinization = 19.247086247086248
Path 159 | total_timesteps 3011.
number of affinization with epsilon = 3 is 32
average number of affinization = 19.24978813559322
Path 160 | total_timesteps 3047.
number of affinization with epsilon = 3 is 38
average number of affinization = 19.253759796653252
Path 161 | total_timesteps 3088.
number of affinization with epsilon = 3 is 26
average number of affinization = 19.255188479457857
Path 162 | total_timesteps 3119.
number of affinization with epsilon = 3 is 23
average number of affinization = 19.25598136777472
Path 163 | total_timesteps 3146.
number of affinization with epsilon = 3 is 12
average number of affinization = 19.254445385266724
Path 164 | total_timesteps 3162.
number of affinization with epsilon = 3 is 16
average number of affinization = 19.253756613756615
Path 165 | total_timesteps 3183.
number of affinization with epsilon = 3 is 18
average number of affinization = 19.25349132458739
Path 166 | total_timesteps 3202.
number of affinization with epsilon = 3 is 18
average number of affinization = 19.253226147662364
Path 167 | total_timesteps 3224.
number of affinization with epsilon = 3 is 25
average number of affinization = 19.254441624365484
Path 168 | total_timesteps 3253.
number of affinization with epsilon = 3 is 20
average number of affinization = 19.25459928103193
Path 169 | total_timesteps 3280.
number of affinization with epsilon = 3 is 31
average number of affinization = 19.25708245243129
Path 170 | total_timesteps 3316.
number of affinization with epsilon = 3 is 17
average number of affinization = 19.256605368843797
Path 171 | total_timesteps 3339.
number of affinization with epsilon = 3 is 12
average number of affinization = 19.255071851225697
Path 172 | total_timesteps 3355.
number of affinization with epsilon = 3 is 18
average number of affinization = 19.254806676526517
Path 173 | total_timesteps 3377.
number of affinization with epsilon = 3 is 16
average number of affinization = 19.254119138149555
Path 174 | total_timesteps 3396.
number of affinization with epsilon = 3 is 20
average number of affinization = 19.25427666314678
Path 175 | total_timesteps 3422.
number of affinization with epsilon = 3 is 10
average number of affinization = 19.252322635135137
Path 176 | total_timesteps 3433.
number of affinization with epsilon = 3 is 15
average number of affinization = 19.251424952501583
Path 177 | total_timesteps 3452.
number of affinization with epsilon = 3 is 11
average number of affinization = 19.249683410721822
Path 178 | total_timesteps 3467.
number of affinization with epsilon = 3 is 12
average number of affinization = 19.248153618906944
Path 179 | total_timesteps 3484.
number of affinization with epsilon = 3 is 39
average number of affinization = 19.252320675105484
Path 180 | total_timesteps 3529.
number of affinization with epsilon = 3 is 15
average number of affinization = 19.25142375026366
Path 181 | total_timesteps 3546.
number of affinization with epsilon = 3 is 25
average number of affinization = 19.25263601855757
Path 182 | total_timesteps 3574.
number of affinization with epsilon = 3 is 10
average number of affinization = 19.25068522032469
Path 183 | total_timesteps 3587.
number of affinization with epsilon = 3 is 11
average number of affinization = 19.248946037099493
Path 184 | total_timesteps 3599.
number of affinization with epsilon = 3 is 18
average number of affinization = 19.24868282402529
Path 185 | total_timesteps 3621.
number of affinization with epsilon = 3 is 19
average number of affinization = 19.248630425621577
Path 186 | total_timesteps 3645.
number of affinization with epsilon = 3 is 15
average number of affinization = 19.247735411839056
Path 187 | total_timesteps 3664.
number of affinization with epsilon = 3 is 15
average number of affinization = 19.246840775063184
Path 188 | total_timesteps 3681.
number of affinization with epsilon = 3 is 26
average number of affinization = 19.248262792166773
Path 189 | total_timesteps 3711.
number of affinization with epsilon = 3 is 17
average number of affinization = 19.24778947368421
Path 190 | total_timesteps 3732.
number of affinization with epsilon = 3 is 13
average number of affinization = 19.24647442643654
Path 191 | total_timesteps 3748.
number of affinization with epsilon = 3 is 12
average number of affinization = 19.244949494949495
Path 192 | total_timesteps 3763.
number of affinization with epsilon = 3 is 9
average number of affinization = 19.242794024826427
Path 193 | total_timesteps 3775.
number of affinization with epsilon = 3 is 12
average number of affinization = 19.241270509045016
Path 194 | total_timesteps 3789.
number of affinization with epsilon = 3 is 22
average number of affinization = 19.241850683491062
Path 195 | total_timesteps 3819.
number of affinization with epsilon = 3 is 19
average number of affinization = 19.241799831791422
Path 196 | total_timesteps 3844.
number of affinization with epsilon = 3 is 13
average number of affinization = 19.240487702333404
Path 197 | total_timesteps 3860.
number of affinization with epsilon = 3 is 21
average number of affinization = 19.240857503152586
Path 198 | total_timesteps 3884.
number of affinization with epsilon = 3 is 12
average number of affinization = 19.239335994956924
Path 199 | total_timesteps 3898.
number of affinization with epsilon = 3 is 20
average number of affinization = 19.23949579831933
Path 200 | total_timesteps 3922.
number of affinization with epsilon = 3 is 8
average number of affinization = 19.237135055660577
Path 201 | total_timesteps 3931.
number of affinization with epsilon = 3 is 16
average number of affinization = 19.23645527089458
Path 202 | total_timesteps 3950.
number of affinization with epsilon = 3 is 4
average number of affinization = 19.233256351039262
Path 203 | total_timesteps 3957.
number of affinization with epsilon = 3 is 6
average number of affinization = 19.230478589420656
Path 204 | total_timesteps 3968.
number of affinization with epsilon = 3 is 7
average number of affinization = 19.22791185729276
Path 205 | total_timesteps 3981.
number of affinization with epsilon = 3 is 10
average number of affinization = 19.2259756609316
Path 206 | total_timesteps 3992.
number of affinization with epsilon = 3 is 29
average number of affinization = 19.228026012166982
Path 207 | total_timesteps 4024.
number of affinization with epsilon = 3 is 20
average number of affinization = 19.22818791946309
Path 208 | total_timesteps 4048.
number of affinization with epsilon = 3 is 11
average number of affinization = 19.226462570769552
Path 209 | total_timesteps 4063.
number of affinization with epsilon = 3 is 35
average number of affinization = 19.229769392033543
Path 210 | total_timesteps 4104.
number of affinization with epsilon = 3 is 13
average number of affinization = 19.228463634458183
Path 211 | total_timesteps 4121.
number of affinization with epsilon = 3 is 7
average number of affinization = 19.225901089689856
Path 212 | total_timesteps 4129.
number of affinization with epsilon = 3 is 14
average number of affinization = 19.224806201550386
Path 213 | total_timesteps 4145.
number of affinization with epsilon = 3 is 12
average number of affinization = 19.223292836196062
Path 214 | total_timesteps 4158.
number of affinization with epsilon = 3 is 19
average number of affinization = 19.22324607329843
Path 215 | total_timesteps 4178.
number of affinization with epsilon = 3 is 11
average number of affinization = 19.221524288107204
Path 216 | total_timesteps 4194.
number of affinization with epsilon = 3 is 13
average number of affinization = 19.220221896587816
Path 217 | total_timesteps 4208.
number of affinization with epsilon = 3 is 11
average number of affinization = 19.21850146504814
Path 218 | total_timesteps 4221.
number of affinization with epsilon = 3 is 22
average number of affinization = 19.21908349026993
Path 219 | total_timesteps 4246.
number of affinization with epsilon = 3 is 18
average number of affinization = 19.218828451882846
Path 220 | total_timesteps 4269.
number of affinization with epsilon = 3 is 10
average number of affinization = 19.21690023007739
Path 221 | total_timesteps 4284.
number of affinization with epsilon = 3 is 8
average number of affinization = 19.214554579673777
Path 222 | total_timesteps 4294.
number of affinization with epsilon = 3 is 13
average number of affinization = 19.213255279113525
Path 223 | total_timesteps 4309.
number of affinization with epsilon = 3 is 15
average number of affinization = 19.212374581939798
Path 224 | total_timesteps 4326.
number of affinization with epsilon = 3 is 6
average number of affinization = 19.209613375130616
Path 225 | total_timesteps 4335.
number of affinization with epsilon = 3 is 8
average number of affinization = 19.207271207689093
Path 226 | total_timesteps 4345.
number of affinization with epsilon = 3 is 8
average number of affinization = 19.20493001880092
Path 227 | total_timesteps 4356.
number of affinization with epsilon = 3 is 8
average number of affinization = 19.202589807852966
Path 228 | total_timesteps 4367.
number of affinization with epsilon = 3 is 27
average number of affinization = 19.204217999582376
Path 229 | total_timesteps 4398.
number of affinization with epsilon = 3 is 14
average number of affinization = 19.203131524008352
Path 230 | total_timesteps 4413.
number of affinization with epsilon = 3 is 17
average number of affinization = 19.20267167605928
Path 231 | total_timesteps 4432.
number of affinization with epsilon = 3 is 10
average number of affinization = 19.20075125208681
Path 232 | total_timesteps 4444.
number of affinization with epsilon = 3 is 16
average number of affinization = 19.200083455038598
Path 233 | total_timesteps 4463.
number of affinization with epsilon = 3 is 11
average number of affinization = 19.19837296620776
Path 234 | total_timesteps 4477.
number of affinization with epsilon = 3 is 8
average number of affinization = 19.196037539103234
Path 235 | total_timesteps 4487.
number of affinization with epsilon = 3 is 20
average number of affinization = 19.196205170975812
Path 236 | total_timesteps 4511.
number of affinization with epsilon = 3 is 10
average number of affinization = 19.19428809672712
Path 237 | total_timesteps 4523.
number of affinization with epsilon = 3 is 14
average number of affinization = 19.19320550229262
Path 238 | total_timesteps 4538.
number of affinization with epsilon = 3 is 19
average number of affinization = 19.19316524275891
Path 239 | total_timesteps 4562.
number of affinization with epsilon = 3 is 6
average number of affinization = 19.190416666666668
Path 240 | total_timesteps 4571.
number of affinization with epsilon = 3 is 14
average number of affinization = 19.18933555509269
Path 241 | total_timesteps 4595.
number of affinization with epsilon = 3 is 22
average number of affinization = 19.189920866305705
Path 242 | total_timesteps 4621.
number of affinization with epsilon = 3 is 21
average number of affinization = 19.19029773058505
Path 243 | total_timesteps 4645.
number of affinization with epsilon = 3 is 9
average number of affinization = 19.188176519567026
Path 244 | total_timesteps 4656.
number of affinization with epsilon = 3 is 27
average number of affinization = 19.189802289282
Path 245 | total_timesteps 4685.
number of affinization with epsilon = 3 is 29
average number of affinization = 19.19184352892218
Path 246 | total_timesteps 4717.
number of affinization with epsilon = 3 is 14
average number of affinization = 19.19076346993967
Path 247 | total_timesteps 4733.
number of affinization with epsilon = 3 is 9
average number of affinization = 19.188643926788686
Path 248 | total_timesteps 4743.
number of affinization with epsilon = 3 is 11
average number of affinization = 19.186941152006654
Path 249 | total_timesteps 4755.
number of affinization with epsilon = 3 is 13
average number of affinization = 19.185654885654884
Path 250 | total_timesteps 4773.
number of affinization with epsilon = 3 is 21
average number of affinization = 19.186032009977136
Path 251 | total_timesteps 4801.
number of affinization with epsilon = 3 is 15
average number of affinization = 19.185162094763093
Path 252 | total_timesteps 4820.
number of affinization with epsilon = 3 is 21
average number of affinization = 19.1855391647621
Path 253 | total_timesteps 4844.
number of affinization with epsilon = 3 is 6
average number of affinization = 19.18280016618197
Path 254 | total_timesteps 4853.
number of affinization with epsilon = 3 is 19
average number of affinization = 19.18276220145379
Path 255 | total_timesteps 4876.
number of affinization with epsilon = 3 is 10
average number of affinization = 19.180855481727576
Path 256 | total_timesteps 4887.
number of affinization with epsilon = 3 is 17
average number of affinization = 19.180402740294788
Path 257 | total_timesteps 4909.
number of affinization with epsilon = 3 is 15
average number of affinization = 19.17953507679535
Path 258 | total_timesteps 4927.
number of affinization with epsilon = 3 is 7
average number of affinization = 19.177007677941482
Path 259 | total_timesteps 4935.
number of affinization with epsilon = 3 is 18
average number of affinization = 19.176763485477178
Path 260 | total_timesteps 4956.
number of affinization with epsilon = 3 is 28
average number of affinization = 19.178593652769134
Path 261 | total_timesteps 4988.
number of affinization with epsilon = 3 is 11
average number of affinization = 19.17689755288262
Path 262 | total_timesteps 5001.
number of affinization with epsilon = 3 is 31
average number of affinization = 19.179348952933857
Path 263 | total_timesteps 5035.
number of affinization with epsilon = 3 is 17
average number of affinization = 19.178897180762853
Path 264 | total_timesteps 5056.
number of affinization with epsilon = 3 is 8
average number of affinization = 19.17658031088083
Path 265 | total_timesteps 5066.
number of affinization with epsilon = 3 is 21
average number of affinization = 19.17695814338997
Path 266 | total_timesteps 5092.
number of affinization with epsilon = 3 is 15
average number of affinization = 19.17609281126994
Path 267 | total_timesteps 5108.
number of affinization with epsilon = 3 is 25
average number of affinization = 19.177299088649544
Path 268 | total_timesteps 5136.
number of affinization with epsilon = 3 is 27
average number of affinization = 19.17891903085525
Path 269 | total_timesteps 5165.
number of affinization with epsilon = 3 is 11
average number of affinization = 19.177225672877846
Path 270 | total_timesteps 5177.
number of affinization with epsilon = 3 is 24
average number of affinization = 19.178223970192505
Path 271 | total_timesteps 5205.
number of affinization with epsilon = 3 is 9
average number of affinization = 19.176117549668874
Path 272 | total_timesteps 5218.
number of affinization with epsilon = 3 is 13
average number of affinization = 19.174839644113387
Path 273 | total_timesteps 5233.
number of affinization with epsilon = 3 is 17
average number of affinization = 19.174389739346296
Path 274 | total_timesteps 5255.
number of affinization with epsilon = 3 is 17
average number of affinization = 19.173940020682522
Path 275 | total_timesteps 5275.
number of affinization with epsilon = 3 is 11
average number of affinization = 19.172249793217535
Path 276 | total_timesteps 5290.
number of affinization with epsilon = 3 is 10
average number of affinization = 19.170353524912137
Path 277 | total_timesteps 5301.
number of affinization with epsilon = 3 is 10
average number of affinization = 19.168458040512608
Path 278 | total_timesteps 5312.
number of affinization with epsilon = 3 is 24
average number of affinization = 19.16945649927671
Path 279 | total_timesteps 5340.
number of affinization with epsilon = 3 is 8
average number of affinization = 19.16714876033058
Path 280 | total_timesteps 5349.
number of affinization with epsilon = 3 is 19
average number of affinization = 19.16711423259657
Path 281 | total_timesteps 5373.
number of affinization with epsilon = 3 is 25
average number of affinization = 19.168318876497317
Path 282 | total_timesteps 5406.
number of affinization with epsilon = 3 is 36
average number of affinization = 19.171794342349784
Path 283 | total_timesteps 5447.
number of affinization with epsilon = 3 is 14
average number of affinization = 19.17072667217176
Path 284 | total_timesteps 5463.
number of affinization with epsilon = 3 is 25
average number of affinization = 19.171929824561403
Path 285 | total_timesteps 5490.
number of affinization with epsilon = 3 is 11
average number of affinization = 19.170243499793646
Path 286 | total_timesteps 5504.
number of affinization with epsilon = 3 is 6
average number of affinization = 19.167526304930885
Path 287 | total_timesteps 5512.
number of affinization with epsilon = 3 is 12
average number of affinization = 19.16604785478548
Path 288 | total_timesteps 5526.
number of affinization with epsilon = 3 is 24
average number of affinization = 19.167044751495155
Path 289 | total_timesteps 5553.
number of affinization with epsilon = 3 is 6
average number of affinization = 19.164329896907216
Path 290 | total_timesteps 5561.
number of affinization with epsilon = 3 is 6
average number of affinization = 19.161616161616163
Path 291 | total_timesteps 5570.
number of affinization with epsilon = 3 is 21
average number of affinization = 19.16199505358615
Path 292 | total_timesteps 5597.
number of affinization with epsilon = 3 is 24
average number of affinization = 19.162991963733774
Path 293 | total_timesteps 5624.
number of affinization with epsilon = 3 is 12
average number of affinization = 19.161516275236917
Path 294 | total_timesteps 5639.
number of affinization with epsilon = 3 is 12
average number of affinization = 19.160041194644695
Path 295 | total_timesteps 5655.
number of affinization with epsilon = 3 is 26
average number of affinization = 19.16144975288303
Path 296 | total_timesteps 5685.
number of affinization with epsilon = 3 is 11
average number of affinization = 19.159769404982498
Path 297 | total_timesteps 5700.
number of affinization with epsilon = 3 is 7
average number of affinization = 19.15726636475916
Path 298 | total_timesteps 5709.
number of affinization with epsilon = 3 is 10
average number of affinization = 19.155381765795433
Path 299 | total_timesteps 5722.
number of affinization with epsilon = 3 is 19
average number of affinization = 19.155349794238685
Path 300 | total_timesteps 5744.
number of affinization with epsilon = 3 is 9
average number of affinization = 19.153260645957623
Path 301 | total_timesteps 5757.
number of affinization with epsilon = 3 is 28
average number of affinization = 19.155080213903744
Path 302 | total_timesteps 5793.
number of affinization with epsilon = 3 is 17
average number of affinization = 19.15463705531565
Path 303 | total_timesteps 5813.
number of affinization with epsilon = 3 is 14
average number of affinization = 19.15357730263158
Path 304 | total_timesteps 5833.
number of affinization with epsilon = 3 is 18
average number of affinization = 19.15334018499486
Path 305 | total_timesteps 5857.
number of affinization with epsilon = 3 is 16
average number of affinization = 19.152692149609535
Path 306 | total_timesteps 5876.
number of affinization with epsilon = 3 is 13
average number of affinization = 19.151427984384632
Path 307 | total_timesteps 5894.
number of affinization with epsilon = 3 is 6
average number of affinization = 19.14872637633525
Path 308 | total_timesteps 5901.
number of affinization with epsilon = 3 is 29
average number of affinization = 19.15074964058328
Path 309 | total_timesteps 5936.
number of affinization with epsilon = 3 is 16
average number of affinization = 19.150102669404518
Path 310 | total_timesteps 5953.
number of affinization with epsilon = 3 is 15
average number of affinization = 19.149250667214126
Path 311 | total_timesteps 5973.
number of affinization with epsilon = 3 is 7
average number of affinization = 19.14675697865353
Path 312 | total_timesteps 5983.
number of affinization with epsilon = 3 is 11
average number of affinization = 19.145085163143854
Path 313 | total_timesteps 5997.
number of affinization with epsilon = 3 is 15
average number of affinization = 19.144234714813294
Done generating on-policy rollouts.
Updating normalization.
Done updating normalization.
----------------------------
| AverageReturn | -7.29    |
| Iteration     | 18       |
| MaximumReturn | 13.6     |
| MinimumReturn | -21.9    |
| TotalSamples  | 80229    |
----------------------------
itr #19 | 
Fitting dynamics.
Fitting model 0 (0-based) in the ensemble of 2 models
Validation loss = 0.01585761271417141
Validation loss = 0.015788698568940163
Validation loss = 0.015972334891557693
Validation loss = 0.016377558931708336
Validation loss = 0.015340390615165234
Validation loss = 0.015830563381314278
Validation loss = 0.01531541533768177
Validation loss = 0.015525437891483307
Validation loss = 0.0159003809094429
Validation loss = 0.016074450686573982
Validation loss = 0.015734761953353882
Fitting model 1 (0-based) in the ensemble of 2 models
Validation loss = 0.01607784628868103
Validation loss = 0.015556946396827698
Validation loss = 0.016230780631303787
Validation loss = 0.015964794903993607
Validation loss = 0.01599455252289772
Validation loss = 0.015664637088775635
Done fitting dynamics.
Updating randomness.
Done updating randomness.
Training policy using TRPO.
Re-initialize init_std.
Obtaining samples for iteration 0...
Obtaining samples for iteration 1...
Obtaining samples for iteration 2...
Obtaining samples for iteration 3...
Obtaining samples for iteration 4...
Obtaining samples for iteration 5...
Obtaining samples for iteration 6...
Obtaining samples for iteration 7...
Obtaining samples for iteration 8...
Obtaining samples for iteration 9...
Obtaining samples for iteration 10...
Obtaining samples for iteration 11...
Obtaining samples for iteration 12...
Obtaining samples for iteration 13...
Obtaining samples for iteration 14...
Obtaining samples for iteration 15...
Obtaining samples for iteration 16...
Obtaining samples for iteration 17...
Obtaining samples for iteration 18...
Obtaining samples for iteration 19...
Done training policy.
Generating on-policy rollouts.
Path 0 | total_timesteps 0.
number of affinization with epsilon = 3 is 23
average number of affinization = 19.14502564102564
Path 1 | total_timesteps 29.
number of affinization with epsilon = 3 is 13
average number of affinization = 19.143765381460213
Path 2 | total_timesteps 45.
number of affinization with epsilon = 3 is 9
average number of affinization = 19.14168546237441
Path 3 | total_timesteps 57.
number of affinization with epsilon = 3 is 9
average number of affinization = 19.13960639606396
Path 4 | total_timesteps 69.
number of affinization with epsilon = 3 is 15
average number of affinization = 19.13875794220127
Path 5 | total_timesteps 88.
number of affinization with epsilon = 3 is 12
average number of affinization = 19.137295081967213
Path 6 | total_timesteps 104.
number of affinization with epsilon = 3 is 15
average number of affinization = 19.13644744929318
Path 7 | total_timesteps 123.
number of affinization with epsilon = 3 is 18
average number of affinization = 19.13621466612044
Path 8 | total_timesteps 146.
number of affinization with epsilon = 3 is 18
average number of affinization = 19.135981978292033
Path 9 | total_timesteps 171.
number of affinization with epsilon = 3 is 18
average number of affinization = 19.135749385749385
Path 10 | total_timesteps 195.
number of affinization with epsilon = 3 is 16
average number of affinization = 19.13510747185261
Path 11 | total_timesteps 212.
number of affinization with epsilon = 3 is 29
average number of affinization = 19.137126483831356
Path 12 | total_timesteps 243.
number of affinization with epsilon = 3 is 21
average number of affinization = 19.137507673419275
Path 13 | total_timesteps 265.
number of affinization with epsilon = 3 is 10
average number of affinization = 19.13563829787234
Path 14 | total_timesteps 277.
number of affinization with epsilon = 3 is 12
average number of affinization = 19.13417876866435
Path 15 | total_timesteps 291.
number of affinization with epsilon = 3 is 37
average number of affinization = 19.137832310838444
Path 16 | total_timesteps 332.
number of affinization with epsilon = 3 is 12
average number of affinization = 19.136372929871193
Path 17 | total_timesteps 349.
number of affinization with epsilon = 3 is 20
average number of affinization = 19.136549468520034
Path 18 | total_timesteps 371.
number of affinization with epsilon = 3 is 19
average number of affinization = 19.136521561414266
Path 19 | total_timesteps 392.
number of affinization with epsilon = 3 is 12
average number of affinization = 19.13506334286882
Path 20 | total_timesteps 408.
number of affinization with epsilon = 3 is 25
average number of affinization = 19.136261491317672
Path 21 | total_timesteps 436.
number of affinization with epsilon = 3 is 8
average number of affinization = 19.133986928104576
Path 22 | total_timesteps 450.
number of affinization with epsilon = 3 is 18
average number of affinization = 19.13375536042475
Path 23 | total_timesteps 471.
number of affinization with epsilon = 3 is 13
average number of affinization = 19.13250306247448
Path 24 | total_timesteps 491.
number of affinization with epsilon = 3 is 9
average number of affinization = 19.130434782608695
Path 25 | total_timesteps 504.
number of affinization with epsilon = 3 is 11
average number of affinization = 19.128775510204083
Path 26 | total_timesteps 517.
number of affinization with epsilon = 3 is 13
average number of affinization = 19.127524994899
Path 27 | total_timesteps 531.
number of affinization with epsilon = 3 is 7
average number of affinization = 19.125050999592002
Path 28 | total_timesteps 542.
number of affinization with epsilon = 3 is 10
average number of affinization = 19.123189883744647
Path 29 | total_timesteps 554.
number of affinization with epsilon = 3 is 14
average number of affinization = 19.12214518760196
Path 30 | total_timesteps 569.
number of affinization with epsilon = 3 is 9
average number of affinization = 19.120081549439348
Path 31 | total_timesteps 583.
number of affinization with epsilon = 3 is 24
average number of affinization = 19.121076233183857
Path 32 | total_timesteps 611.
number of affinization with epsilon = 3 is 16
average number of affinization = 19.12044018748726
Path 33 | total_timesteps 632.
number of affinization with epsilon = 3 is 26
average number of affinization = 19.121841890790545
Path 34 | total_timesteps 662.
number of affinization with epsilon = 3 is 19
average number of affinization = 19.121817070686493
Path 35 | total_timesteps 686.
number of affinization with epsilon = 3 is 8
average number of affinization = 19.119551934826884
Path 36 | total_timesteps 695.
number of affinization with epsilon = 3 is 13
average number of affinization = 19.11830584402362
Path 37 | total_timesteps 710.
number of affinization with epsilon = 3 is 11
average number of affinization = 19.116653094462542
Path 38 | total_timesteps 723.
number of affinization with epsilon = 3 is 7
average number of affinization = 19.114186851211073
Path 39 | total_timesteps 732.
number of affinization with epsilon = 3 is 16
average number of affinization = 19.113553113553113
Path 40 | total_timesteps 750.
number of affinization with epsilon = 3 is 10
average number of affinization = 19.1116988809766
Path 41 | total_timesteps 764.
number of affinization with epsilon = 3 is 20
average number of affinization = 19.11187957689178
Path 42 | total_timesteps 789.
number of affinization with epsilon = 3 is 9
average number of affinization = 19.109823062843198
Path 43 | total_timesteps 801.
number of affinization with epsilon = 3 is 13
average number of affinization = 19.108580723871494
Path 44 | total_timesteps 815.
number of affinization with epsilon = 3 is 17
average number of affinization = 19.108152063427525
Path 45 | total_timesteps 835.
number of affinization with epsilon = 3 is 9
average number of affinization = 19.10609756097561
Path 46 | total_timesteps 847.
number of affinization with epsilon = 3 is 43
average number of affinization = 19.110953058321478
Path 47 | total_timesteps 896.
number of affinization with epsilon = 3 is 22
average number of affinization = 19.111540024380332
Path 48 | total_timesteps 926.
number of affinization with epsilon = 3 is 41
average number of affinization = 19.115986187284175
Path 49 | total_timesteps 971.
number of affinization with epsilon = 3 is 7
average number of affinization = 19.113525588952072
Path 50 | total_timesteps 983.
number of affinization with epsilon = 3 is 17
average number of affinization = 19.113096446700506
Path 51 | total_timesteps 1005.
number of affinization with epsilon = 3 is 13
average number of affinization = 19.111855460820138
Path 52 | total_timesteps 1020.
number of affinization with epsilon = 3 is 9
average number of affinization = 19.10980312563426
Path 53 | total_timesteps 1030.
number of affinization with epsilon = 3 is 10
average number of affinization = 19.107954545454547
Path 54 | total_timesteps 1044.
number of affinization with epsilon = 3 is 8
average number of affinization = 19.10570095354027
Path 55 | total_timesteps 1057.
number of affinization with epsilon = 3 is 13
average number of affinization = 19.10446247464503
Path 56 | total_timesteps 1074.
number of affinization with epsilon = 3 is 11
average number of affinization = 19.102818900831473
Path 57 | total_timesteps 1086.
number of affinization with epsilon = 3 is 13
average number of affinization = 19.101581508515814
Path 58 | total_timesteps 1104.
number of affinization with epsilon = 3 is 14
average number of affinization = 19.100547334279344
Path 59 | total_timesteps 1122.
number of affinization with epsilon = 3 is 11
average number of affinization = 19.09890555330361
Path 60 | total_timesteps 1134.
number of affinization with epsilon = 3 is 16
average number of affinization = 19.098277608915907
Path 61 | total_timesteps 1151.
number of affinization with epsilon = 3 is 21
average number of affinization = 19.098662884927066
Path 62 | total_timesteps 1179.
number of affinization with epsilon = 3 is 13
average number of affinization = 19.097427587603807
Path 63 | total_timesteps 1195.
number of affinization with epsilon = 3 is 6
average number of affinization = 19.094775212636694
Path 64 | total_timesteps 1203.
number of affinization with epsilon = 3 is 10
average number of affinization = 19.09293379226564
Path 65 | total_timesteps 1217.
number of affinization with epsilon = 3 is 27
average number of affinization = 19.094534412955465
Path 66 | total_timesteps 1246.
number of affinization with epsilon = 3 is 8
average number of affinization = 19.092289010321796
Path 67 | total_timesteps 1258.
number of affinization with epsilon = 3 is 7
average number of affinization = 19.08984216916228
Path 68 | total_timesteps 1268.
number of affinization with epsilon = 3 is 8
average number of affinization = 19.087598624317216
Path 69 | total_timesteps 1278.
number of affinization with epsilon = 3 is 13
average number of affinization = 19.086367313915858
Path 70 | total_timesteps 1293.
number of affinization with epsilon = 3 is 8
average number of affinization = 19.084125379170878
Path 71 | total_timesteps 1303.
number of affinization with epsilon = 3 is 15
average number of affinization = 19.08329963606955
Path 72 | total_timesteps 1321.
number of affinization with epsilon = 3 is 13
average number of affinization = 19.082069941378613
Path 73 | total_timesteps 1337.
number of affinization with epsilon = 3 is 15
average number of affinization = 19.081244947453516
Path 74 | total_timesteps 1353.
number of affinization with epsilon = 3 is 13
average number of affinization = 19.080016164881794
Path 75 | total_timesteps 1367.
number of affinization with epsilon = 3 is 8
average number of affinization = 19.07777777777778
Path 76 | total_timesteps 1378.
number of affinization with epsilon = 3 is 9
average number of affinization = 19.07574227428802
Path 77 | total_timesteps 1388.
number of affinization with epsilon = 3 is 7
average number of affinization = 19.073303715670438
Path 78 | total_timesteps 1398.
number of affinization with epsilon = 3 is 9
average number of affinization = 19.07126993741167
Path 79 | total_timesteps 1408.
number of affinization with epsilon = 3 is 11
average number of affinization = 19.069640694388372
Path 80 | total_timesteps 1423.
number of affinization with epsilon = 3 is 11
average number of affinization = 19.068012108980827
Path 81 | total_timesteps 1437.
number of affinization with epsilon = 3 is 47
average number of affinization = 19.07364810330912
Path 82 | total_timesteps 1495.
number of affinization with epsilon = 3 is 12
average number of affinization = 19.072221101472664
Path 83 | total_timesteps 1510.
number of affinization with epsilon = 3 is 6
average number of affinization = 19.06958450988302
Path 84 | total_timesteps 1518.
number of affinization with epsilon = 3 is 11
average number of affinization = 19.067957249445453
Path 85 | total_timesteps 1533.
number of affinization with epsilon = 3 is 6
average number of affinization = 19.065322580645162
Path 86 | total_timesteps 1543.
number of affinization with epsilon = 3 is 41
average number of affinization = 19.069744003225157
Path 87 | total_timesteps 1588.
number of affinization with epsilon = 3 is 14
average number of affinization = 19.068722289399435
Path 88 | total_timesteps 1603.
number of affinization with epsilon = 3 is 13
average number of affinization = 19.067499496272415
Path 89 | total_timesteps 1620.
number of affinization with epsilon = 3 is 11
average number of affinization = 19.06587429492345
Path 90 | total_timesteps 1633.
number of affinization with epsilon = 3 is 13
average number of affinization = 19.06465256797583
Path 91 | total_timesteps 1649.
number of affinization with epsilon = 3 is 9
average number of affinization = 19.062625855819572
Path 92 | total_timesteps 1661.
number of affinization with epsilon = 3 is 8
average number of affinization = 19.060398630964364
Path 93 | total_timesteps 1671.
number of affinization with epsilon = 3 is 14
average number of affinization = 19.059380032206118
Path 94 | total_timesteps 1688.
number of affinization with epsilon = 3 is 10
average number of affinization = 19.05755685248541
Path 95 | total_timesteps 1702.
number of affinization with epsilon = 3 is 13
average number of affinization = 19.056338028169016
Path 96 | total_timesteps 1720.
number of affinization with epsilon = 3 is 11
average number of affinization = 19.054717360692013
Path 97 | total_timesteps 1736.
number of affinization with epsilon = 3 is 14
average number of affinization = 19.053700724054707
Path 98 | total_timesteps 1751.
number of affinization with epsilon = 3 is 15
average number of affinization = 19.052885582143574
Path 99 | total_timesteps 1769.
number of affinization with epsilon = 3 is 10
average number of affinization = 19.051065540812225
Path 100 | total_timesteps 1780.
number of affinization with epsilon = 3 is 22
average number of affinization = 19.051658291457287
Path 101 | total_timesteps 1805.
number of affinization with epsilon = 3 is 5
average number of affinization = 19.048834405144696
Path 102 | total_timesteps 1813.
number of affinization with epsilon = 3 is 15
average number of affinization = 19.04802089612216
Path 103 | total_timesteps 1831.
number of affinization with epsilon = 3 is 26
average number of affinization = 19.049417436721576
Path 104 | total_timesteps 1862.
number of affinization with epsilon = 3 is 8
average number of affinization = 19.04719823257682
Path 105 | total_timesteps 1874.
number of affinization with epsilon = 3 is 4
average number of affinization = 19.044176706827308
Path 106 | total_timesteps 1882.
number of affinization with epsilon = 3 is 8
average number of affinization = 19.0419594458944
Path 107 | total_timesteps 1892.
number of affinization with epsilon = 3 is 13
average number of affinization = 19.04074668807708
Path 108 | total_timesteps 1906.
number of affinization with epsilon = 3 is 27
average number of affinization = 19.042343969496287
Path 109 | total_timesteps 1939.
number of affinization with epsilon = 3 is 12
average number of affinization = 19.040930979133226
Path 110 | total_timesteps 1953.
number of affinization with epsilon = 3 is 5
average number of affinization = 19.038114343029086
Path 111 | total_timesteps 1961.
number of affinization with epsilon = 3 is 21
average number of affinization = 19.038507821901323
Path 112 | total_timesteps 1986.
number of affinization with epsilon = 3 is 25
average number of affinization = 19.039703228393822
Path 113 | total_timesteps 2013.
number of affinization with epsilon = 3 is 34
average number of affinization = 19.04270248596632
Path 114 | total_timesteps 2049.
number of affinization with epsilon = 3 is 13
average number of affinization = 19.041491280817798
Path 115 | total_timesteps 2063.
number of affinization with epsilon = 3 is 11
average number of affinization = 19.03987975951904
Path 116 | total_timesteps 2076.
number of affinization with epsilon = 3 is 29
average number of affinization = 19.041875375676216
Path 117 | total_timesteps 2111.
number of affinization with epsilon = 3 is 13
average number of affinization = 19.040665064102566
Path 118 | total_timesteps 2128.
number of affinization with epsilon = 3 is 7
average number of affinization = 19.03825355497697
Path 119 | total_timesteps 2136.
number of affinization with epsilon = 3 is 9
average number of affinization = 19.03624349219063
Path 120 | total_timesteps 2147.
number of affinization with epsilon = 3 is 12
average number of affinization = 19.034834834834836
Path 121 | total_timesteps 2162.
number of affinization with epsilon = 3 is 24
average number of affinization = 19.035828662930346
Path 122 | total_timesteps 2188.
number of affinization with epsilon = 3 is 12
average number of affinization = 19.034420652391436
Path 123 | total_timesteps 2203.
number of affinization with epsilon = 3 is 17
average number of affinization = 19.034013605442176
Path 124 | total_timesteps 2224.
number of affinization with epsilon = 3 is 10
average number of affinization = 19.032206441288256
Path 125 | total_timesteps 2236.
number of affinization with epsilon = 3 is 29
average number of affinization = 19.0342
Path 126 | total_timesteps 2268.
number of affinization with epsilon = 3 is 18
average number of affinization = 19.033993201359728
Path 127 | total_timesteps 2289.
number of affinization with epsilon = 3 is 38
average number of affinization = 19.037784886045582
Path 128 | total_timesteps 2331.
number of affinization with epsilon = 3 is 16
average number of affinization = 19.03717769338397
Path 129 | total_timesteps 2350.
number of affinization with epsilon = 3 is 21
average number of affinization = 19.037569944044765
Path 130 | total_timesteps 2373.
number of affinization with epsilon = 3 is 24
average number of affinization = 19.038561438561437
Path 131 | total_timesteps 2400.
number of affinization with epsilon = 3 is 19
average number of affinization = 19.03855373551738
Path 132 | total_timesteps 2427.
number of affinization with epsilon = 3 is 9
average number of affinization = 19.03654883163571
Path 133 | total_timesteps 2439.
number of affinization with epsilon = 3 is 8
average number of affinization = 19.034345047923324
Path 134 | total_timesteps 2449.
number of affinization with epsilon = 3 is 9
average number of affinization = 19.032341784787384
Path 135 | total_timesteps 2459.
number of affinization with epsilon = 3 is 23
average number of affinization = 19.03313373253493
Path 136 | total_timesteps 2489.
number of affinization with epsilon = 3 is 5
average number of affinization = 19.03033326681301
Path 137 | total_timesteps 2497.
number of affinization with epsilon = 3 is 6
average number of affinization = 19.027733439744612
Path 138 | total_timesteps 2506.
number of affinization with epsilon = 3 is 8
average number of affinization = 19.025533612607223
Path 139 | total_timesteps 2516.
number of affinization with epsilon = 3 is 14
average number of affinization = 19.02453131232549
Path 140 | total_timesteps 2533.
number of affinization with epsilon = 3 is 10
average number of affinization = 19.02273180458624
Path 141 | total_timesteps 2545.
number of affinization with epsilon = 3 is 8
average number of affinization = 19.020534290271133
Path 142 | total_timesteps 2555.
number of affinization with epsilon = 3 is 18
average number of affinization = 19.020330875024914
Path 143 | total_timesteps 2578.
number of affinization with epsilon = 3 is 8
average number of affinization = 19.018134715025905
Path 144 | total_timesteps 2588.
number of affinization with epsilon = 3 is 5
average number of affinization = 19.01534170153417
Path 145 | total_timesteps 2596.
number of affinization with epsilon = 3 is 15
average number of affinization = 19.014541832669323
Path 146 | total_timesteps 2617.
number of affinization with epsilon = 3 is 15
average number of affinization = 19.01374228241386
Path 147 | total_timesteps 2635.
number of affinization with epsilon = 3 is 9
average number of affinization = 19.01174830744723
Path 148 | total_timesteps 2646.
number of affinization with epsilon = 3 is 6
average number of affinization = 19.00915787378061
Path 149 | total_timesteps 2655.
number of affinization with epsilon = 3 is 13
average number of affinization = 19.00796178343949
Path 150 | total_timesteps 2670.
number of affinization with epsilon = 3 is 25
average number of affinization = 19.00915422885572
Path 151 | total_timesteps 2697.
number of affinization with epsilon = 3 is 12
average number of affinization = 19.00775964982093
Path 152 | total_timesteps 2714.
number of affinization with epsilon = 3 is 26
average number of affinization = 19.00915058683111
Path 153 | total_timesteps 2745.
number of affinization with epsilon = 3 is 22
average number of affinization = 19.009745425616547
Path 154 | total_timesteps 2770.
number of affinization with epsilon = 3 is 12
average number of affinization = 19.00835156094651
Path 155 | total_timesteps 2783.
number of affinization with epsilon = 3 is 16
average number of affinization = 19.00775347912525
Path 156 | total_timesteps 2801.
number of affinization with epsilon = 3 is 24
average number of affinization = 19.008745776187638
Path 157 | total_timesteps 2829.
number of affinization with epsilon = 3 is 23
average number of affinization = 19.00953895071542
Path 158 | total_timesteps 2854.
number of affinization with epsilon = 3 is 16
average number of affinization = 19.0089409894695
Path 159 | total_timesteps 2873.
number of affinization with epsilon = 3 is 11
average number of affinization = 19.00735001986492
Path 160 | total_timesteps 2888.
number of affinization with epsilon = 3 is 26
average number of affinization = 19.00873882820258
Path 161 | total_timesteps 2916.
number of affinization with epsilon = 3 is 10
average number of affinization = 19.00694996028594
Path 162 | total_timesteps 2927.
number of affinization with epsilon = 3 is 27
average number of affinization = 19.00853682747667
Path 163 | total_timesteps 2960.
number of affinization with epsilon = 3 is 9
average number of affinization = 19.00655021834061
Path 164 | total_timesteps 2971.
number of affinization with epsilon = 3 is 11
average number of affinization = 19.004961301845604
Path 165 | total_timesteps 2983.
number of affinization with epsilon = 3 is 7
average number of affinization = 19.002579365079367
Path 166 | total_timesteps 2991.
number of affinization with epsilon = 3 is 9
average number of affinization = 19.00059512001587
Path 167 | total_timesteps 3004.
number of affinization with epsilon = 3 is 5
average number of affinization = 18.997818326061086
Path 168 | total_timesteps 3012.
number of affinization with epsilon = 3 is 18
average number of affinization = 18.99762046400952
Path 169 | total_timesteps 3037.
number of affinization with epsilon = 3 is 27
average number of affinization = 18.999206978588422
Path 170 | total_timesteps 3069.
number of affinization with epsilon = 3 is 31
average number of affinization = 19.001585728444002
Path 171 | total_timesteps 3106.
number of affinization with epsilon = 3 is 12
average number of affinization = 19.000198176773683
Path 172 | total_timesteps 3120.
number of affinization with epsilon = 3 is 10
average number of affinization = 18.99841489994056
Path 173 | total_timesteps 3132.
number of affinization with epsilon = 3 is 16
average number of affinization = 18.99782091917591
Path 174 | total_timesteps 3150.
number of affinization with epsilon = 3 is 8
average number of affinization = 18.995642701525053
Path 175 | total_timesteps 3159.
number of affinization with epsilon = 3 is 6
average number of affinization = 18.993069306930693
Path 176 | total_timesteps 3170.
number of affinization with epsilon = 3 is 21
average number of affinization = 18.993466640269254
Path 177 | total_timesteps 3194.
number of affinization with epsilon = 3 is 28
average number of affinization = 18.995249406175773
Path 178 | total_timesteps 3226.
number of affinization with epsilon = 3 is 13
average number of affinization = 18.99406293291114
Path 179 | total_timesteps 3240.
number of affinization with epsilon = 3 is 15
average number of affinization = 18.993272655322517
Path 180 | total_timesteps 3259.
number of affinization with epsilon = 3 is 19
average number of affinization = 18.993273986152325
Path 181 | total_timesteps 3285.
number of affinization with epsilon = 3 is 15
average number of affinization = 18.99248417721519
Path 182 | total_timesteps 3304.
number of affinization with epsilon = 3 is 30
average number of affinization = 18.99466086612616
Path 183 | total_timesteps 3335.
number of affinization with epsilon = 3 is 10
average number of affinization = 18.99288256227758
Path 184 | total_timesteps 3347.
number of affinization with epsilon = 3 is 9
average number of affinization = 18.990907293931606
Path 185 | total_timesteps 3358.
number of affinization with epsilon = 3 is 8
average number of affinization = 18.988735177865614
Path 186 | total_timesteps 3368.
number of affinization with epsilon = 3 is 9
average number of affinization = 18.986761509583086
Path 187 | total_timesteps 3383.
number of affinization with epsilon = 3 is 22
average number of affinization = 18.987356775977876
Path 188 | total_timesteps 3407.
number of affinization with epsilon = 3 is 20
average number of affinization = 18.98755678451511
Path 189 | total_timesteps 3434.
number of affinization with epsilon = 3 is 16
average number of affinization = 18.98696682464455
Path 190 | total_timesteps 3453.
number of affinization with epsilon = 3 is 21
average number of affinization = 18.98736426456071
Path 191 | total_timesteps 3480.
number of affinization with epsilon = 3 is 12
average number of affinization = 18.985984998026055
Path 192 | total_timesteps 3493.
number of affinization with epsilon = 3 is 11
average number of affinization = 18.984408920465757
Path 193 | total_timesteps 3506.
number of affinization with epsilon = 3 is 20
average number of affinization = 18.984609313338595
Path 194 | total_timesteps 3529.
number of affinization with epsilon = 3 is 16
average number of affinization = 18.984020516867233
Path 195 | total_timesteps 3547.
number of affinization with epsilon = 3 is 22
average number of affinization = 18.984615384615385
Path 196 | total_timesteps 3572.
number of affinization with epsilon = 3 is 12
average number of affinization = 18.983238020114374
Path 197 | total_timesteps 3586.
number of affinization with epsilon = 3 is 17
average number of affinization = 18.982847003154575
Path 198 | total_timesteps 3607.
number of affinization with epsilon = 3 is 22
average number of affinization = 18.983441750443525
Path 199 | total_timesteps 3635.
number of affinization with epsilon = 3 is 8
average number of affinization = 18.981277098935752
Path 200 | total_timesteps 3645.
number of affinization with epsilon = 3 is 10
average number of affinization = 18.97950738916256
Path 201 | total_timesteps 3656.
number of affinization with epsilon = 3 is 18
average number of affinization = 18.97931442080378
Path 202 | total_timesteps 3676.
number of affinization with epsilon = 3 is 17
average number of affinization = 18.978924561749064
Path 203 | total_timesteps 3697.
number of affinization with epsilon = 3 is 14
average number of affinization = 18.977944072469477
Path 204 | total_timesteps 3713.
number of affinization with epsilon = 3 is 22
average number of affinization = 18.978539082496553
Path 205 | total_timesteps 3740.
number of affinization with epsilon = 3 is 8
average number of affinization = 18.976377952755904
Path 206 | total_timesteps 3753.
number of affinization with epsilon = 3 is 22
average number of affinization = 18.97697303680378
Path 207 | total_timesteps 3780.
number of affinization with epsilon = 3 is 15
average number of affinization = 18.976190476190474
Path 208 | total_timesteps 3797.
number of affinization with epsilon = 3 is 8
average number of affinization = 18.97403108400551
Path 209 | total_timesteps 3809.
number of affinization with epsilon = 3 is 22
average number of affinization = 18.97462627852085
Path 210 | total_timesteps 3833.
number of affinization with epsilon = 3 is 20
average number of affinization = 18.974827925270404
Path 211 | total_timesteps 3855.
number of affinization with epsilon = 3 is 9
average number of affinization = 18.972866692882423
Path 212 | total_timesteps 3869.
number of affinization with epsilon = 3 is 8
average number of affinization = 18.970709652054257
Path 213 | total_timesteps 3880.
number of affinization with epsilon = 3 is 24
average number of affinization = 18.971698113207548
Path 214 | total_timesteps 3907.
number of affinization with epsilon = 3 is 30
average number of affinization = 18.973865199449794
Path 215 | total_timesteps 3941.
number of affinization with epsilon = 3 is 11
average number of affinization = 18.97229862475442
Path 216 | total_timesteps 3954.
number of affinization with epsilon = 3 is 12
average number of affinization = 18.970929090551955
Path 217 | total_timesteps 3969.
number of affinization with epsilon = 3 is 13
average number of affinization = 18.969756480754125
Path 218 | total_timesteps 3984.
number of affinization with epsilon = 3 is 13
average number of affinization = 18.968584331435302
Path 219 | total_timesteps 4000.
number of affinization with epsilon = 3 is 20
average number of affinization = 18.968786808009423
Path 220 | total_timesteps 4025.
number of affinization with epsilon = 3 is 23
average number of affinization = 18.969578017664375
Path 221 | total_timesteps 4055.
number of affinization with epsilon = 3 is 24
average number of affinization = 18.97056514913658
Path 222 | total_timesteps 4081.
number of affinization with epsilon = 3 is 19
average number of affinization = 18.970570924072984
Path 223 | total_timesteps 4102.
number of affinization with epsilon = 3 is 8
average number of affinization = 18.96841898783837
Path 224 | total_timesteps 4114.
number of affinization with epsilon = 3 is 11
average number of affinization = 18.96685624632281
Path 225 | total_timesteps 4128.
number of affinization with epsilon = 3 is 18
average number of affinization = 18.966666666666665
Path 226 | total_timesteps 4152.
number of affinization with epsilon = 3 is 7
average number of affinization = 18.96432072142717
Path 227 | total_timesteps 4160.
number of affinization with epsilon = 3 is 10
average number of affinization = 18.962563700509605
Path 228 | total_timesteps 4175.
number of affinization with epsilon = 3 is 19
average number of affinization = 18.962571036645112
Path 229 | total_timesteps 4197.
number of affinization with epsilon = 3 is 9
average number of affinization = 18.960619122257054
Path 230 | total_timesteps 4208.
number of affinization with epsilon = 3 is 13
average number of affinization = 18.95945151811949
Path 231 | total_timesteps 4224.
number of affinization with epsilon = 3 is 10
average number of affinization = 18.957696827262044
Path 232 | total_timesteps 4239.
number of affinization with epsilon = 3 is 10
average number of affinization = 18.955942823575484
Path 233 | total_timesteps 4251.
number of affinization with epsilon = 3 is 7
average number of affinization = 18.953602192638996
Path 234 | total_timesteps 4259.
number of affinization with epsilon = 3 is 21
average number of affinization = 18.954002740262283
Path 235 | total_timesteps 4282.
number of affinization with epsilon = 3 is 7
average number of affinization = 18.951663405088063
Path 236 | total_timesteps 4293.
number of affinization with epsilon = 3 is 14
average number of affinization = 18.950694580316963
Path 237 | total_timesteps 4309.
number of affinization with epsilon = 3 is 9
average number of affinization = 18.948748043818465
Path 238 | total_timesteps 4320.
number of affinization with epsilon = 3 is 18
average number of affinization = 18.948562487776258
Path 239 | total_timesteps 4340.
number of affinization with epsilon = 3 is 9
average number of affinization = 18.946617129448573
Path 240 | total_timesteps 4353.
number of affinization with epsilon = 3 is 6
average number of affinization = 18.944086021505377
Path 241 | total_timesteps 4361.
number of affinization with epsilon = 3 is 8
average number of affinization = 18.941946833463643
Path 242 | total_timesteps 4372.
number of affinization with epsilon = 3 is 6
average number of affinization = 18.93941762751612
Path 243 | total_timesteps 4380.
number of affinization with epsilon = 3 is 15
average number of affinization = 18.938647909339586
Path 244 | total_timesteps 4400.
number of affinization with epsilon = 3 is 24
average number of affinization = 18.93963664778277
Path 245 | total_timesteps 4426.
number of affinization with epsilon = 3 is 20
average number of affinization = 18.93984375
Path 246 | total_timesteps 4448.
number of affinization with epsilon = 3 is 5
average number of affinization = 18.93712165592658
Path 247 | total_timesteps 4455.
number of affinization with epsilon = 3 is 6
average number of affinization = 18.9345958609918
Path 248 | total_timesteps 4462.
number of affinization with epsilon = 3 is 17
average number of affinization = 18.93421823150498
Path 249 | total_timesteps 4483.
number of affinization with epsilon = 3 is 15
average number of affinization = 18.933450429352067
Path 250 | total_timesteps 4500.
number of affinization with epsilon = 3 is 8
average number of affinization = 18.93131707317073
Path 251 | total_timesteps 4510.
number of affinization with epsilon = 3 is 10
average number of affinization = 18.929574717128364
Path 252 | total_timesteps 4526.
number of affinization with epsilon = 3 is 9
average number of affinization = 18.92763799492881
Path 253 | total_timesteps 4536.
number of affinization with epsilon = 3 is 28
average number of affinization = 18.92940717628705
Path 254 | total_timesteps 4567.
number of affinization with epsilon = 3 is 10
average number of affinization = 18.92766621173718
Path 255 | total_timesteps 4579.
number of affinization with epsilon = 3 is 15
average number of affinization = 18.926900584795323
Path 256 | total_timesteps 4599.
number of affinization with epsilon = 3 is 8
average number of affinization = 18.924770999805105
Path 257 | total_timesteps 4608.
number of affinization with epsilon = 3 is 14
average number of affinization = 18.92381137957911
Path 258 | total_timesteps 4626.
number of affinization with epsilon = 3 is 11
average number of affinization = 18.92226767971946
Path 259 | total_timesteps 4642.
number of affinization with epsilon = 3 is 14
average number of affinization = 18.921308920919362
Path 260 | total_timesteps 4659.
number of affinization with epsilon = 3 is 24
average number of affinization = 18.92229795520935
Path 261 | total_timesteps 4687.
number of affinization with epsilon = 3 is 8
average number of affinization = 18.92017133956386
Path 262 | total_timesteps 4696.
number of affinization with epsilon = 3 is 12
average number of affinization = 18.918824216468757
Path 263 | total_timesteps 4711.
number of affinization with epsilon = 3 is 14
average number of affinization = 18.917866874270143
Path 264 | total_timesteps 4730.
number of affinization with epsilon = 3 is 9
average number of affinization = 18.915936952714535
Path 265 | total_timesteps 4743.
number of affinization with epsilon = 3 is 16
average number of affinization = 18.91536964980545
Path 266 | total_timesteps 4760.
number of affinization with epsilon = 3 is 11
average number of affinization = 18.91382999416456
Path 267 | total_timesteps 4773.
number of affinization with epsilon = 3 is 21
average number of affinization = 18.914235705950993
Path 268 | total_timesteps 4796.
number of affinization with epsilon = 3 is 7
average number of affinization = 18.911919113357964
Path 269 | total_timesteps 4807.
number of affinization with epsilon = 3 is 10
average number of affinization = 18.910186625194402
Path 270 | total_timesteps 4821.
number of affinization with epsilon = 3 is 25
average number of affinization = 18.91137026239067
Path 271 | total_timesteps 4849.
number of affinization with epsilon = 3 is 14
average number of affinization = 18.910415856976293
Path 272 | total_timesteps 4867.
number of affinization with epsilon = 3 is 11
average number of affinization = 18.90887895861667
Path 273 | total_timesteps 4881.
number of affinization with epsilon = 3 is 7
average number of affinization = 18.906565656565657
Path 274 | total_timesteps 4892.
number of affinization with epsilon = 3 is 33
average number of affinization = 18.9093027772383
Path 275 | total_timesteps 4927.
number of affinization with epsilon = 3 is 14
average number of affinization = 18.908349514563106
Path 276 | total_timesteps 4942.
number of affinization with epsilon = 3 is 16
average number of affinization = 18.907784896136672
Path 277 | total_timesteps 4961.
number of affinization with epsilon = 3 is 14
average number of affinization = 18.906832298136646
Path 278 | total_timesteps 4977.
number of affinization with epsilon = 3 is 12
average number of affinization = 18.905491946438968
Path 279 | total_timesteps 4994.
number of affinization with epsilon = 3 is 8
average number of affinization = 18.90337601862631
Path 280 | total_timesteps 5004.
number of affinization with epsilon = 3 is 14
average number of affinization = 18.902424830261882
Path 281 | total_timesteps 5020.
number of affinization with epsilon = 3 is 35
average number of affinization = 18.905546935609
Path 282 | total_timesteps 5062.
number of affinization with epsilon = 3 is 15
average number of affinization = 18.904789606360286
Path 283 | total_timesteps 5080.
number of affinization with epsilon = 3 is 14
average number of affinization = 18.903838697169444
Path 284 | total_timesteps 5095.
number of affinization with epsilon = 3 is 22
average number of affinization = 18.904438844737353
Path 285 | total_timesteps 5120.
number of affinization with epsilon = 3 is 10
average number of affinization = 18.902713178294572
Path 286 | total_timesteps 5131.
number of affinization with epsilon = 3 is 15
average number of affinization = 18.90195698508041
Path 287 | total_timesteps 5148.
number of affinization with epsilon = 3 is 9
average number of affinization = 18.900038744672607
Path 288 | total_timesteps 5158.
number of affinization with epsilon = 3 is 7
average number of affinization = 18.89773387565369
Path 289 | total_timesteps 5167.
number of affinization with epsilon = 3 is 18
average number of affinization = 18.897560030983733
Path 290 | total_timesteps 5190.
number of affinization with epsilon = 3 is 17
average number of affinization = 18.897192642787996
Path 291 | total_timesteps 5213.
number of affinization with epsilon = 3 is 8
average number of affinization = 18.89508323654665
Path 292 | total_timesteps 5225.
number of affinization with epsilon = 3 is 11
average number of affinization = 18.89355525449971
Path 293 | total_timesteps 5238.
number of affinization with epsilon = 3 is 9
average number of affinization = 18.891640866873065
Path 294 | total_timesteps 5249.
number of affinization with epsilon = 3 is 21
average number of affinization = 18.892048752176436
Path 295 | total_timesteps 5273.
number of affinization with epsilon = 3 is 7
average number of affinization = 18.889748549323016
Path 296 | total_timesteps 5283.
number of affinization with epsilon = 3 is 14
average number of affinization = 18.88880293947012
Path 297 | total_timesteps 5300.
number of affinization with epsilon = 3 is 15
average number of affinization = 18.888051044083525
Path 298 | total_timesteps 5317.
number of affinization with epsilon = 3 is 12
average number of affinization = 18.886719505122752
Path 299 | total_timesteps 5335.
number of affinization with epsilon = 3 is 13
average number of affinization = 18.885581754928488
Path 300 | total_timesteps 5353.
number of affinization with epsilon = 3 is 6
average number of affinization = 18.883091787439614
Path 301 | total_timesteps 5362.
number of affinization with epsilon = 3 is 12
average number of affinization = 18.88176197836167
Path 302 | total_timesteps 5375.
number of affinization with epsilon = 3 is 20
average number of affinization = 18.881977979524823
Path 303 | total_timesteps 5397.
number of affinization with epsilon = 3 is 11
average number of affinization = 18.88045577443028
Path 304 | total_timesteps 5410.
number of affinization with epsilon = 3 is 13
average number of affinization = 18.879320332110446
Path 305 | total_timesteps 5427.
number of affinization with epsilon = 3 is 10
average number of affinization = 18.87760617760618
Path 306 | total_timesteps 5439.
number of affinization with epsilon = 3 is 7
average number of affinization = 18.875313646014284
Path 307 | total_timesteps 5449.
number of affinization with epsilon = 3 is 12
average number of affinization = 18.873986877653415
Path 308 | total_timesteps 5463.
number of affinization with epsilon = 3 is 16
average number of affinization = 18.87343237507235
Path 309 | total_timesteps 5481.
number of affinization with epsilon = 3 is 9
average number of affinization = 18.87152777777778
Path 310 | total_timesteps 5492.
number of affinization with epsilon = 3 is 13
average number of affinization = 18.87039537126326
Path 311 | total_timesteps 5506.
number of affinization with epsilon = 3 is 11
average number of affinization = 18.86887774778249
Path 312 | total_timesteps 5524.
number of affinization with epsilon = 3 is 35
average number of affinization = 18.871987661461347
Path 313 | total_timesteps 5562.
number of affinization with epsilon = 3 is 13
average number of affinization = 18.870855821125673
Path 314 | total_timesteps 5581.
number of affinization with epsilon = 3 is 19
average number of affinization = 18.870880709192523
Path 315 | total_timesteps 5604.
number of affinization with epsilon = 3 is 12
average number of affinization = 18.86955684007707
Path 316 | total_timesteps 5619.
number of affinization with epsilon = 3 is 12
average number of affinization = 18.868233481024852
Path 317 | total_timesteps 5633.
number of affinization with epsilon = 3 is 13
average number of affinization = 18.867103235747305
Path 318 | total_timesteps 5649.
number of affinization with epsilon = 3 is 10
average number of affinization = 18.86539572501444
Path 319 | total_timesteps 5663.
number of affinization with epsilon = 3 is 6
average number of affinization = 18.862918752406625
Path 320 | total_timesteps 5672.
number of affinization with epsilon = 3 is 9
average number of affinization = 18.86102021174206
Path 321 | total_timesteps 5684.
number of affinization with epsilon = 3 is 16
average number of affinization = 18.86046959199384
Path 322 | total_timesteps 5706.
number of affinization with epsilon = 3 is 22
average number of affinization = 18.861073696363288
Path 323 | total_timesteps 5732.
number of affinization with epsilon = 3 is 10
average number of affinization = 18.859368988072337
Path 324 | total_timesteps 5746.
number of affinization with epsilon = 3 is 12
average number of affinization = 18.858049624927872
Path 325 | total_timesteps 5760.
number of affinization with epsilon = 3 is 6
average number of affinization = 18.855576923076924
Path 326 | total_timesteps 5768.
number of affinization with epsilon = 3 is 13
average number of affinization = 18.85445106710248
Path 327 | total_timesteps 5782.
number of affinization with epsilon = 3 is 22
average number of affinization = 18.85505574778931
Path 328 | total_timesteps 5807.
number of affinization with epsilon = 3 is 15
average number of affinization = 18.854314818374014
Path 329 | total_timesteps 5827.
number of affinization with epsilon = 3 is 12
average number of affinization = 18.852997694081477
Path 330 | total_timesteps 5840.
number of affinization with epsilon = 3 is 8
average number of affinization = 18.850912584053795
Path 331 | total_timesteps 5851.
number of affinization with epsilon = 3 is 10
average number of affinization = 18.849212447176335
Path 332 | total_timesteps 5863.
number of affinization with epsilon = 3 is 10
average number of affinization = 18.84751296331861
Path 333 | total_timesteps 5877.
number of affinization with epsilon = 3 is 11
average number of affinization = 18.84600614439324
Path 334 | total_timesteps 5892.
number of affinization with epsilon = 3 is 10
average number of affinization = 18.844307928585142
Path 335 | total_timesteps 5904.
number of affinization with epsilon = 3 is 10
average number of affinization = 18.842610364683303
Path 336 | total_timesteps 5917.
number of affinization with epsilon = 3 is 14
average number of affinization = 18.84168105929764
Path 337 | total_timesteps 5934.
number of affinization with epsilon = 3 is 10
average number of affinization = 18.83998465080583
Path 338 | total_timesteps 5945.
number of affinization with epsilon = 3 is 12
average number of affinization = 18.838672549395742
Path 339 | total_timesteps 5960.
number of affinization with epsilon = 3 is 7
average number of affinization = 18.836401994629842
Path 340 | total_timesteps 5968.
number of affinization with epsilon = 3 is 19
average number of affinization = 18.836433365292425
Path 341 | total_timesteps 5992.
number of affinization with epsilon = 3 is 7
average number of affinization = 18.834164110429448
Done generating on-policy rollouts.
Updating normalization.
Done updating normalization.
----------------------------
| AverageReturn | -6.68    |
| Iteration     | 19       |
| MaximumReturn | 19       |
| MinimumReturn | -18.5    |
| TotalSamples  | 84229    |
----------------------------
itr #20 | 
Fitting dynamics.
Fitting model 0 (0-based) in the ensemble of 2 models
Validation loss = 0.01531807892024517
Validation loss = 0.01522619929164648
Validation loss = 0.01534829568117857
Validation loss = 0.01551284920424223
Validation loss = 0.01503409817814827
Validation loss = 0.015293571166694164
Validation loss = 0.015041653998196125
Validation loss = 0.015190818347036839
Validation loss = 0.014896387234330177
Validation loss = 0.015242625027894974
Validation loss = 0.015019183978438377
Validation loss = 0.01516039576381445
Validation loss = 0.014687873423099518
Validation loss = 0.015082914382219315
Validation loss = 0.015294034034013748
Validation loss = 0.015133053064346313
Validation loss = 0.015280853025615215
Fitting model 1 (0-based) in the ensemble of 2 models
Validation loss = 0.015572485513985157
Validation loss = 0.015355104580521584
Validation loss = 0.015323096886277199
Validation loss = 0.015445883385837078
Validation loss = 0.015330205671489239
Validation loss = 0.015359388664364815
Validation loss = 0.015061340294778347
Validation loss = 0.01594645157456398
Validation loss = 0.015720009803771973
Validation loss = 0.015431282110512257
Validation loss = 0.015307697467505932
Done fitting dynamics.
Updating randomness.
Done updating randomness.
Training policy using TRPO.
Re-initialize init_std.
Obtaining samples for iteration 0...
Obtaining samples for iteration 1...
Obtaining samples for iteration 2...
Obtaining samples for iteration 3...
Obtaining samples for iteration 4...
Obtaining samples for iteration 5...
Obtaining samples for iteration 6...
Obtaining samples for iteration 7...
Obtaining samples for iteration 8...
Obtaining samples for iteration 9...
Obtaining samples for iteration 10...
Obtaining samples for iteration 11...
Obtaining samples for iteration 12...
Obtaining samples for iteration 13...
Obtaining samples for iteration 14...
Obtaining samples for iteration 15...
Obtaining samples for iteration 16...
Obtaining samples for iteration 17...
Obtaining samples for iteration 18...
Obtaining samples for iteration 19...
Done training policy.
Generating on-policy rollouts.
Path 0 | total_timesteps 0.
number of affinization with epsilon = 3 is 19
average number of affinization = 18.834195898025687
Path 1 | total_timesteps 23.
number of affinization with epsilon = 3 is 13
average number of affinization = 18.833077807589113
Path 2 | total_timesteps 39.
number of affinization with epsilon = 3 is 16
average number of affinization = 18.83253496838475
Path 3 | total_timesteps 58.
number of affinization with epsilon = 3 is 22
average number of affinization = 18.833141762452108
Path 4 | total_timesteps 85.
number of affinization with epsilon = 3 is 11
average number of affinization = 18.831641447998468
Path 5 | total_timesteps 101.
number of affinization with epsilon = 3 is 16
average number of affinization = 18.831099195710454
Path 6 | total_timesteps 123.
number of affinization with epsilon = 3 is 5
average number of affinization = 18.82845108175378
Path 7 | total_timesteps 130.
number of affinization with epsilon = 3 is 12
average number of affinization = 18.827143950995406
Path 8 | total_timesteps 143.
number of affinization with epsilon = 3 is 10
average number of affinization = 18.825454545454544
Path 9 | total_timesteps 156.
number of affinization with epsilon = 3 is 7
average number of affinization = 18.823191733639494
Path 10 | total_timesteps 166.
number of affinization with epsilon = 3 is 23
average number of affinization = 18.823990816912186
Path 11 | total_timesteps 191.
number of affinization with epsilon = 3 is 6
average number of affinization = 18.821537872991584
Path 12 | total_timesteps 201.
number of affinization with epsilon = 3 is 11
average number of affinization = 18.820042073054122
Path 13 | total_timesteps 216.
number of affinization with epsilon = 3 is 14
average number of affinization = 18.819120458891014
Path 14 | total_timesteps 231.
number of affinization with epsilon = 3 is 19
average number of affinization = 18.819155037277767
Path 15 | total_timesteps 251.
number of affinization with epsilon = 3 is 9
average number of affinization = 18.817278287461775
Path 16 | total_timesteps 262.
number of affinization with epsilon = 3 is 9
average number of affinization = 18.815402254920695
Path 17 | total_timesteps 276.
number of affinization with epsilon = 3 is 7
average number of affinization = 18.81314482231563
Path 18 | total_timesteps 284.
number of affinization with epsilon = 3 is 23
average number of affinization = 18.813944603629416
Path 19 | total_timesteps 309.
number of affinization with epsilon = 3 is 22
average number of affinization = 18.814553093964857
Path 20 | total_timesteps 332.
number of affinization with epsilon = 3 is 9
average number of affinization = 18.812679014703075
Path 21 | total_timesteps 343.
number of affinization with epsilon = 3 is 20
average number of affinization = 18.81290568919435
Path 22 | total_timesteps 368.
number of affinization with epsilon = 3 is 8
average number of affinization = 18.81084176369536
Path 23 | total_timesteps 377.
number of affinization with epsilon = 3 is 10
average number of affinization = 18.80916030534351
Path 24 | total_timesteps 391.
number of affinization with epsilon = 3 is 8
average number of affinization = 18.80709788208357
Path 25 | total_timesteps 401.
number of affinization with epsilon = 3 is 6
average number of affinization = 18.804654711942007
Path 26 | total_timesteps 410.
number of affinization with epsilon = 3 is 17
average number of affinization = 18.804310509250428
Path 27 | total_timesteps 430.
number of affinization with epsilon = 3 is 11
average number of affinization = 18.80282227307399
Path 28 | total_timesteps 443.
number of affinization with epsilon = 3 is 21
average number of affinization = 18.80324118207817
Path 29 | total_timesteps 469.
number of affinization with epsilon = 3 is 18
average number of affinization = 18.80308806709874
Path 30 | total_timesteps 489.
number of affinization with epsilon = 3 is 10
average number of affinization = 18.801410329712215
Path 31 | total_timesteps 500.
number of affinization with epsilon = 3 is 41
average number of affinization = 18.805640243902438
Path 32 | total_timesteps 547.
number of affinization with epsilon = 3 is 12
average number of affinization = 18.804343684511334
Path 33 | total_timesteps 562.
number of affinization with epsilon = 3 is 14
average number of affinization = 18.803428571428572
Path 34 | total_timesteps 581.
number of affinization with epsilon = 3 is 11
average number of affinization = 18.801942487145304
Path 35 | total_timesteps 595.
number of affinization with epsilon = 3 is 9
average number of affinization = 18.8000761614623
Path 36 | total_timesteps 606.
number of affinization with epsilon = 3 is 18
average number of affinization = 18.79992385303636
Path 37 | total_timesteps 628.
number of affinization with epsilon = 3 is 12
average number of affinization = 18.798629615531024
Path 38 | total_timesteps 641.
number of affinization with epsilon = 3 is 10
average number of affinization = 18.79695528068506
Path 39 | total_timesteps 657.
number of affinization with epsilon = 3 is 17
average number of affinization = 18.796613394216134
Path 40 | total_timesteps 678.
number of affinization with epsilon = 3 is 22
average number of affinization = 18.797222750618225
Path 41 | total_timesteps 705.
number of affinization with epsilon = 3 is 13
average number of affinization = 18.796120197793837
Path 42 | total_timesteps 719.
number of affinization with epsilon = 3 is 18
average number of affinization = 18.795968815364137
Path 43 | total_timesteps 739.
number of affinization with epsilon = 3 is 13
average number of affinization = 18.794866920152092
Path 44 | total_timesteps 757.
number of affinization with epsilon = 3 is 9
average number of affinization = 18.793005132104163
Path 45 | total_timesteps 769.
number of affinization with epsilon = 3 is 21
average number of affinization = 18.79342455340175
Path 46 | total_timesteps 793.
number of affinization with epsilon = 3 is 13
average number of affinization = 18.792323769713093
Path 47 | total_timesteps 811.
number of affinization with epsilon = 3 is 22
average number of affinization = 18.792933130699087
Path 48 | total_timesteps 837.
number of affinization with epsilon = 3 is 15
average number of affinization = 18.792212725546058
Path 49 | total_timesteps 856.
number of affinization with epsilon = 3 is 16
average number of affinization = 18.791682491454615
Path 50 | total_timesteps 877.
number of affinization with epsilon = 3 is 9
average number of affinization = 18.789823428896906
Path 51 | total_timesteps 888.
number of affinization with epsilon = 3 is 16
average number of affinization = 18.789293849658314
Path 52 | total_timesteps 907.
number of affinization with epsilon = 3 is 11
average number of affinization = 18.78781552476751
Path 53 | total_timesteps 919.
number of affinization with epsilon = 3 is 18
average number of affinization = 18.7876660341556
Path 54 | total_timesteps 942.
number of affinization with epsilon = 3 is 13
average number of affinization = 18.786568013659647
Path 55 | total_timesteps 960.
number of affinization with epsilon = 3 is 22
average number of affinization = 18.787177541729893
Path 56 | total_timesteps 990.
number of affinization with epsilon = 3 is 21
average number of affinization = 18.787597193248626
Path 57 | total_timesteps 1012.
number of affinization with epsilon = 3 is 25
average number of affinization = 18.78877512324611
Path 58 | total_timesteps 1039.
number of affinization with epsilon = 3 is 11
average number of affinization = 18.787298578199053
Path 59 | total_timesteps 1053.
number of affinization with epsilon = 3 is 19
average number of affinization = 18.787338893100834
Path 60 | total_timesteps 1075.
number of affinization with epsilon = 3 is 13
average number of affinization = 18.786242183058555
Path 61 | total_timesteps 1089.
number of affinization with epsilon = 3 is 7
average number of affinization = 18.784009094353923
Path 62 | total_timesteps 1099.
number of affinization with epsilon = 3 is 26
average number of affinization = 18.78537601818526
Path 63 | total_timesteps 1127.
number of affinization with epsilon = 3 is 9
average number of affinization = 18.78352272727273
Path 64 | total_timesteps 1138.
number of affinization with epsilon = 3 is 39
average number of affinization = 18.787350880515053
Path 65 | total_timesteps 1184.
number of affinization with epsilon = 3 is 6
average number of affinization = 18.78492995077622
Path 66 | total_timesteps 1192.
number of affinization with epsilon = 3 is 16
average number of affinization = 18.784402801438578
Path 67 | total_timesteps 1211.
number of affinization with epsilon = 3 is 8
average number of affinization = 18.782361847085543
Path 68 | total_timesteps 1220.
number of affinization with epsilon = 3 is 6
average number of affinization = 18.779943235572375
Path 69 | total_timesteps 1228.
number of affinization with epsilon = 3 is 11
average number of affinization = 18.77847143397654
Path 70 | total_timesteps 1240.
number of affinization with epsilon = 3 is 29
average number of affinization = 18.78040476640817
Path 71 | total_timesteps 1273.
number of affinization with epsilon = 3 is 7
average number of affinization = 18.778177004538577
Path 72 | total_timesteps 1285.
number of affinization with epsilon = 3 is 17
average number of affinization = 18.77784080166383
Path 73 | total_timesteps 1306.
number of affinization with epsilon = 3 is 8
average number of affinization = 18.775803402646503
Path 74 | total_timesteps 1318.
number of affinization with epsilon = 3 is 8
average number of affinization = 18.773766773766773
Path 75 | total_timesteps 1329.
number of affinization with epsilon = 3 is 19
average number of affinization = 18.773809523809526
Path 76 | total_timesteps 1352.
number of affinization with epsilon = 3 is 12
average number of affinization = 18.77252975628188
Path 77 | total_timesteps 1366.
number of affinization with epsilon = 3 is 10
average number of affinization = 18.77087268605969
Path 78 | total_timesteps 1377.
number of affinization with epsilon = 3 is 14
average number of affinization = 18.769971671388102
Path 79 | total_timesteps 1396.
number of affinization with epsilon = 3 is 17
average number of affinization = 18.76963746223565
Path 80 | total_timesteps 1416.
number of affinization with epsilon = 3 is 21
average number of affinization = 18.770058523692658
Path 81 | total_timesteps 1442.
number of affinization with epsilon = 3 is 16
average number of affinization = 18.769535673839183
Path 82 | total_timesteps 1462.
number of affinization with epsilon = 3 is 23
average number of affinization = 18.77033402528779
Path 83 | total_timesteps 1486.
number of affinization with epsilon = 3 is 12
average number of affinization = 18.769056603773585
Path 84 | total_timesteps 1499.
number of affinization with epsilon = 3 is 17
average number of affinization = 18.768722882475004
Path 85 | total_timesteps 1519.
number of affinization with epsilon = 3 is 10
average number of affinization = 18.76706903055451
Path 86 | total_timesteps 1532.
number of affinization with epsilon = 3 is 19
average number of affinization = 18.76711295493117
Path 87 | total_timesteps 1553.
number of affinization with epsilon = 3 is 22
average number of affinization = 18.767722473604827
Path 88 | total_timesteps 1579.
number of affinization with epsilon = 3 is 9
average number of affinization = 18.76588124410933
Path 89 | total_timesteps 1592.
number of affinization with epsilon = 3 is 21
average number of affinization = 18.76630229928383
Path 90 | total_timesteps 1618.
number of affinization with epsilon = 3 is 17
average number of affinization = 18.765969474279252
Path 91 | total_timesteps 1636.
number of affinization with epsilon = 3 is 8
average number of affinization = 18.763941220798795
Path 92 | total_timesteps 1650.
number of affinization with epsilon = 3 is 13
average number of affinization = 18.762855528348087
Path 93 | total_timesteps 1668.
number of affinization with epsilon = 3 is 12
average number of affinization = 18.761581920903954
Path 94 | total_timesteps 1682.
number of affinization with epsilon = 3 is 11
average number of affinization = 18.760120504613067
Path 95 | total_timesteps 1696.
number of affinization with epsilon = 3 is 22
average number of affinization = 18.76073042168675
Path 96 | total_timesteps 1724.
number of affinization with epsilon = 3 is 14
average number of affinization = 18.759834368530022
Path 97 | total_timesteps 1741.
number of affinization with epsilon = 3 is 11
average number of affinization = 18.758374106134738
Path 98 | total_timesteps 1755.
number of affinization with epsilon = 3 is 19
average number of affinization = 18.758419567262465
Path 99 | total_timesteps 1777.
number of affinization with epsilon = 3 is 25
average number of affinization = 18.759593679458238
Path 100 | total_timesteps 1810.
number of affinization with epsilon = 3 is 18
average number of affinization = 18.759450818130524
Path 101 | total_timesteps 1831.
number of affinization with epsilon = 3 is 10
average number of affinization = 18.757803685596087
Path 102 | total_timesteps 1843.
number of affinization with epsilon = 3 is 37
average number of affinization = 18.761233314532806
Path 103 | total_timesteps 1883.
number of affinization with epsilon = 3 is 7
average number of affinization = 18.759022556390978
Path 104 | total_timesteps 1893.
number of affinization with epsilon = 3 is 12
average number of affinization = 18.757752302198835
Path 105 | total_timesteps 1906.
number of affinization with epsilon = 3 is 14
average number of affinization = 18.75685832393837
Path 106 | total_timesteps 1925.
number of affinization with epsilon = 3 is 16
average number of affinization = 18.75634040954349
Path 107 | total_timesteps 1943.
number of affinization with epsilon = 3 is 8
average number of affinization = 18.754320060105183
Path 108 | total_timesteps 1954.
number of affinization with epsilon = 3 is 13
average number of affinization = 18.75323943661972
Path 109 | total_timesteps 1969.
number of affinization with epsilon = 3 is 24
average number of affinization = 18.754224558768307
Path 110 | total_timesteps 1996.
number of affinization with epsilon = 3 is 14
average number of affinization = 18.753332081847194
Path 111 | total_timesteps 2012.
number of affinization with epsilon = 3 is 13
average number of affinization = 18.75225225225225
Path 112 | total_timesteps 2027.
number of affinization with epsilon = 3 is 15
average number of affinization = 18.75154813285795
Path 113 | total_timesteps 2045.
number of affinization with epsilon = 3 is 16
average number of affinization = 18.751031894934332
Path 114 | total_timesteps 2066.
number of affinization with epsilon = 3 is 19
average number of affinization = 18.75107859688614
Path 115 | total_timesteps 2089.
number of affinization with epsilon = 3 is 9
average number of affinization = 18.74924981245311
Path 116 | total_timesteps 2101.
number of affinization with epsilon = 3 is 8
average number of affinization = 18.747234202137633
Path 117 | total_timesteps 2114.
number of affinization with epsilon = 3 is 16
average number of affinization = 18.746719160104988
Path 118 | total_timesteps 2132.
number of affinization with epsilon = 3 is 8
average number of affinization = 18.744704779756326
Path 119 | total_timesteps 2144.
number of affinization with epsilon = 3 is 31
average number of affinization = 18.747001499250374
Path 120 | total_timesteps 2181.
number of affinization with epsilon = 3 is 8
average number of affinization = 18.74498782087315
Path 121 | total_timesteps 2192.
number of affinization with epsilon = 3 is 8
average number of affinization = 18.742974896965155
Path 122 | total_timesteps 2202.
number of affinization with epsilon = 3 is 7
average number of affinization = 18.74077542610976
Path 123 | total_timesteps 2212.
number of affinization with epsilon = 3 is 14
average number of affinization = 18.73988764044944
Path 124 | total_timesteps 2227.
number of affinization with epsilon = 3 is 7
average number of affinization = 18.73768957124134
Path 125 | total_timesteps 2235.
number of affinization with epsilon = 3 is 19
average number of affinization = 18.737738674653688
Path 126 | total_timesteps 2258.
number of affinization with epsilon = 3 is 11
average number of affinization = 18.73629047351675
Path 127 | total_timesteps 2271.
number of affinization with epsilon = 3 is 22
average number of affinization = 18.73690119760479
Path 128 | total_timesteps 2295.
number of affinization with epsilon = 3 is 12
average number of affinization = 18.735640785781104
Path 129 | total_timesteps 2309.
number of affinization with epsilon = 3 is 16
average number of affinization = 18.735129068462403
Path 130 | total_timesteps 2328.
number of affinization with epsilon = 3 is 6
average number of affinization = 18.73274733495418
Path 131 | total_timesteps 2336.
number of affinization with epsilon = 3 is 55
average number of affinization = 18.73952879581152
Path 132 | total_timesteps 2396.
number of affinization with epsilon = 3 is 14
average number of affinization = 18.73864273696018
Path 133 | total_timesteps 2412.
number of affinization with epsilon = 3 is 9
average number of affinization = 18.736822429906542
Path 134 | total_timesteps 2422.
number of affinization with epsilon = 3 is 15
average number of affinization = 18.736124088955336
Path 135 | total_timesteps 2441.
number of affinization with epsilon = 3 is 18
average number of affinization = 18.7359865470852
Path 136 | total_timesteps 2460.
number of affinization with epsilon = 3 is 20
average number of affinization = 18.73622267887166
Path 137 | total_timesteps 2486.
number of affinization with epsilon = 3 is 11
average number of affinization = 18.734777736271948
Path 138 | total_timesteps 2502.
number of affinization with epsilon = 3 is 18
average number of affinization = 18.734640522875818
Path 139 | total_timesteps 2522.
number of affinization with epsilon = 3 is 12
average number of affinization = 18.733383121732636
Path 140 | total_timesteps 2538.
number of affinization with epsilon = 3 is 18
average number of affinization = 18.733246219899197
Path 141 | total_timesteps 2558.
number of affinization with epsilon = 3 is 12
average number of affinization = 18.731989548338934
Path 142 | total_timesteps 2572.
number of affinization with epsilon = 3 is 17
average number of affinization = 18.73166635566337
Path 143 | total_timesteps 2591.
number of affinization with epsilon = 3 is 11
average number of affinization = 18.730223880597016
Path 144 | total_timesteps 2603.
number of affinization with epsilon = 3 is 13
average number of affinization = 18.729155008393956
Path 145 | total_timesteps 2618.
number of affinization with epsilon = 3 is 14
average number of affinization = 18.728273032450577
Path 146 | total_timesteps 2634.
number of affinization with epsilon = 3 is 9
average number of affinization = 18.726459071415253
Path 147 | total_timesteps 2645.
number of affinization with epsilon = 3 is 11
average number of affinization = 18.725018642803878
Path 148 | total_timesteps 2658.
number of affinization with epsilon = 3 is 12
average number of affinization = 18.7237651444548
Path 149 | total_timesteps 2674.
number of affinization with epsilon = 3 is 9
average number of affinization = 18.72195303764443
Path 150 | total_timesteps 2688.
number of affinization with epsilon = 3 is 6
average number of affinization = 18.719582634618966
Path 151 | total_timesteps 2695.
number of affinization with epsilon = 3 is 13
average number of affinization = 18.718517138599104
Path 152 | total_timesteps 2711.
number of affinization with epsilon = 3 is 25
average number of affinization = 18.71968709256845
Path 153 | total_timesteps 2749.
number of affinization with epsilon = 3 is 13
average number of affinization = 18.718621973929235
Path 154 | total_timesteps 2764.
number of affinization with epsilon = 3 is 17
average number of affinization = 18.718301992180226
Path 155 | total_timesteps 2784.
number of affinization with epsilon = 3 is 20
average number of affinization = 18.718540580789277
Path 156 | total_timesteps 2806.
number of affinization with epsilon = 3 is 17
average number of affinization = 18.71822073329611
Path 157 | total_timesteps 2825.
number of affinization with epsilon = 3 is 33
average number of affinization = 18.720878302940083
Path 158 | total_timesteps 2863.
number of affinization with epsilon = 3 is 10
average number of affinization = 18.719255813953488
Path 159 | total_timesteps 2875.
number of affinization with epsilon = 3 is 8
average number of affinization = 18.717261904761905
Path 160 | total_timesteps 2886.
number of affinization with epsilon = 3 is 14
average number of affinization = 18.71638460107867
Path 161 | total_timesteps 2903.
number of affinization with epsilon = 3 is 9
average number of affinization = 18.71457791000372
Path 162 | total_timesteps 2915.
number of affinization with epsilon = 3 is 24
average number of affinization = 18.715560513106524
Path 163 | total_timesteps 2941.
number of affinization with epsilon = 3 is 14
average number of affinization = 18.71468401486989
Path 164 | total_timesteps 2957.
number of affinization with epsilon = 3 is 13
average number of affinization = 18.713622003345105
Path 165 | total_timesteps 2972.
number of affinization with epsilon = 3 is 16
average number of affinization = 18.713117800074322
Path 166 | total_timesteps 2991.
number of affinization with epsilon = 3 is 12
average number of affinization = 18.711870704068364
Path 167 | total_timesteps 3005.
number of affinization with epsilon = 3 is 9
average number of affinization = 18.710066864784547
Path 168 | total_timesteps 3017.
number of affinization with epsilon = 3 is 7
average number of affinization = 18.707892293407614
Path 169 | total_timesteps 3028.
number of affinization with epsilon = 3 is 25
average number of affinization = 18.709060527292984
Path 170 | total_timesteps 3061.
number of affinization with epsilon = 3 is 11
average number of affinization = 18.707629478373864
Path 171 | total_timesteps 3073.
number of affinization with epsilon = 3 is 18
average number of affinization = 18.707498144023756
Path 172 | total_timesteps 3097.
number of affinization with epsilon = 3 is 11
average number of affinization = 18.70606791612544
Path 173 | total_timesteps 3109.
number of affinization with epsilon = 3 is 15
average number of affinization = 18.705380333951762
Path 174 | total_timesteps 3128.
number of affinization with epsilon = 3 is 12
average number of affinization = 18.704136523836024
Path 175 | total_timesteps 3146.
number of affinization with epsilon = 3 is 11
average number of affinization = 18.70270771513353
Path 176 | total_timesteps 3159.
number of affinization with epsilon = 3 is 10
average number of affinization = 18.701094010754684
Path 177 | total_timesteps 3170.
number of affinization with epsilon = 3 is 10
average number of affinization = 18.699480904708935
Path 178 | total_timesteps 3182.
number of affinization with epsilon = 3 is 16
average number of affinization = 18.698980537534755
Path 179 | total_timesteps 3201.
number of affinization with epsilon = 3 is 9
average number of affinization = 18.697183098591548
Path 180 | total_timesteps 3213.
number of affinization with epsilon = 3 is 24
average number of affinization = 18.69816564758199
Path 181 | total_timesteps 3242.
number of affinization with epsilon = 3 is 8
average number of affinization = 18.69618377176732
Path 182 | total_timesteps 3251.
number of affinization with epsilon = 3 is 8
average number of affinization = 18.69420263011669
Path 183 | total_timesteps 3260.
number of affinization with epsilon = 3 is 9
average number of affinization = 18.69240740740741
Path 184 | total_timesteps 3272.
number of affinization with epsilon = 3 is 11
average number of affinization = 18.690983151268284
Path 185 | total_timesteps 3284.
number of affinization with epsilon = 3 is 7
average number of affinization = 18.688818955942242
Path 186 | total_timesteps 3298.
number of affinization with epsilon = 3 is 5
average number of affinization = 18.686285397001665
Path 187 | total_timesteps 3305.
number of affinization with epsilon = 3 is 18
average number of affinization = 18.686158401184308
Path 188 | total_timesteps 3324.
number of affinization with epsilon = 3 is 14
average number of affinization = 18.685291396854765
Path 189 | total_timesteps 3342.
number of affinization with epsilon = 3 is 6
average number of affinization = 18.682944876063633
Path 190 | total_timesteps 3352.
number of affinization with epsilon = 3 is 14
average number of affinization = 18.682078786757906
Path 191 | total_timesteps 3367.
number of affinization with epsilon = 3 is 7
average number of affinization = 18.679918639053255
Path 192 | total_timesteps 3379.
number of affinization with epsilon = 3 is 12
average number of affinization = 18.678683675355888
Path 193 | total_timesteps 3397.
number of affinization with epsilon = 3 is 8
average number of affinization = 18.676709796672828
Path 194 | total_timesteps 3409.
number of affinization with epsilon = 3 is 13
average number of affinization = 18.675660691184625
Path 195 | total_timesteps 3426.
number of affinization with epsilon = 3 is 16
average number of affinization = 18.675166297117517
Path 196 | total_timesteps 3444.
number of affinization with epsilon = 3 is 12
average number of affinization = 18.673933123960836
Path 197 | total_timesteps 3459.
number of affinization with epsilon = 3 is 18
average number of affinization = 18.673808644255633
Path 198 | total_timesteps 3480.
number of affinization with epsilon = 3 is 10
average number of affinization = 18.67220683287165
Path 199 | total_timesteps 3494.
number of affinization with epsilon = 3 is 8
average number of affinization = 18.67023633677991
Path 200 | total_timesteps 3503.
number of affinization with epsilon = 3 is 7
average number of affinization = 18.66808196418682
Path 201 | total_timesteps 3515.
number of affinization with epsilon = 3 is 11
average number of affinization = 18.666666666666668
Path 202 | total_timesteps 3529.
number of affinization with epsilon = 3 is 12
average number of affinization = 18.665436427385128
Path 203 | total_timesteps 3543.
number of affinization with epsilon = 3 is 8
average number of affinization = 18.663468634686346
Path 204 | total_timesteps 3556.
number of affinization with epsilon = 3 is 7
average number of affinization = 18.66131710016602
Path 205 | total_timesteps 3568.
number of affinization with epsilon = 3 is 11
average number of affinization = 18.6599040944301
Path 206 | total_timesteps 3581.
number of affinization with epsilon = 3 is 11
average number of affinization = 18.658491609810067
Path 207 | total_timesteps 3595.
number of affinization with epsilon = 3 is 14
average number of affinization = 18.657632743362832
Path 208 | total_timesteps 3610.
number of affinization with epsilon = 3 is 12
average number of affinization = 18.65640552995392
Path 209 | total_timesteps 3623.
number of affinization with epsilon = 3 is 15
average number of affinization = 18.655731662366385
Path 210 | total_timesteps 3640.
number of affinization with epsilon = 3 is 12
average number of affinization = 18.654505251520177
Path 211 | total_timesteps 3655.
number of affinization with epsilon = 3 is 13
average number of affinization = 18.65346352247605
Path 212 | total_timesteps 3672.
number of affinization with epsilon = 3 is 8
average number of affinization = 18.651501197273898
Path 213 | total_timesteps 3682.
number of affinization with epsilon = 3 is 11
average number of affinization = 18.650092081031307
Path 214 | total_timesteps 3696.
number of affinization with epsilon = 3 is 11
average number of affinization = 18.64868348370466
Path 215 | total_timesteps 3709.
number of affinization with epsilon = 3 is 9
average number of affinization = 18.646907216494846
Path 216 | total_timesteps 3721.
number of affinization with epsilon = 3 is 18
average number of affinization = 18.646788146512055
Path 217 | total_timesteps 3744.
number of affinization with epsilon = 3 is 11
average number of affinization = 18.645380934854618
Path 218 | total_timesteps 3757.
number of affinization with epsilon = 3 is 13
average number of affinization = 18.644342226310947
Path 219 | total_timesteps 3772.
number of affinization with epsilon = 3 is 25
average number of affinization = 18.64551140544518
Path 220 | total_timesteps 3803.
number of affinization with epsilon = 3 is 7
average number of affinization = 18.64336950524186
Path 221 | total_timesteps 3812.
number of affinization with epsilon = 3 is 20
average number of affinization = 18.643618977565282
Path 222 | total_timesteps 3837.
number of affinization with epsilon = 3 is 9
average number of affinization = 18.64184592756021
Path 223 | total_timesteps 3849.
number of affinization with epsilon = 3 is 9
average number of affinization = 18.640073529411765
Path 224 | total_timesteps 3860.
number of affinization with epsilon = 3 is 9
average number of affinization = 18.63830178276052
Path 225 | total_timesteps 3871.
number of affinization with epsilon = 3 is 8
average number of affinization = 18.636346931275266
Path 226 | total_timesteps 3881.
number of affinization with epsilon = 3 is 13
average number of affinization = 18.635311409149367
Path 227 | total_timesteps 3895.
number of affinization with epsilon = 3 is 8
average number of affinization = 18.63335782512858
Path 228 | total_timesteps 3907.
number of affinization with epsilon = 3 is 21
average number of affinization = 18.633792470156106
Path 229 | total_timesteps 3934.
number of affinization with epsilon = 3 is 19
average number of affinization = 18.63385971355123
Path 230 | total_timesteps 3956.
number of affinization with epsilon = 3 is 9
average number of affinization = 18.632091059298695
Path 231 | total_timesteps 3966.
number of affinization with epsilon = 3 is 9
average number of affinization = 18.630323054331864
Path 232 | total_timesteps 3978.
number of affinization with epsilon = 3 is 16
average number of affinization = 18.629840337676637
Path 233 | total_timesteps 3995.
number of affinization with epsilon = 3 is 9
average number of affinization = 18.628073394495413
Path 234 | total_timesteps 4007.
number of affinization with epsilon = 3 is 20
average number of affinization = 18.628325077967347
Path 235 | total_timesteps 4030.
number of affinization with epsilon = 3 is 8
average number of affinization = 18.626375641966252
Path 236 | total_timesteps 4040.
number of affinization with epsilon = 3 is 28
average number of affinization = 18.62809462681093
Path 237 | total_timesteps 4072.
number of affinization with epsilon = 3 is 12
average number of affinization = 18.626879354602128
Path 238 | total_timesteps 4088.
number of affinization with epsilon = 3 is 5
average number of affinization = 18.624381301558202
Path 239 | total_timesteps 4095.
number of affinization with epsilon = 3 is 9
average number of affinization = 18.622617302052785
Path 240 | total_timesteps 4106.
number of affinization with epsilon = 3 is 9
average number of affinization = 18.620853949056258
Path 241 | total_timesteps 4116.
number of affinization with epsilon = 3 is 4
average number of affinization = 18.6181751557347
Path 242 | total_timesteps 4122.
number of affinization with epsilon = 3 is 15
average number of affinization = 18.617512364901998
Path 243 | total_timesteps 4139.
number of affinization with epsilon = 3 is 18
average number of affinization = 18.617399267399268
Path 244 | total_timesteps 4163.
number of affinization with epsilon = 3 is 14
average number of affinization = 18.616553744735395
Path 245 | total_timesteps 4179.
number of affinization with epsilon = 3 is 20
average number of affinization = 18.616807030391797
Path 246 | total_timesteps 4207.
number of affinization with epsilon = 3 is 10
average number of affinization = 18.615229727256086
Path 247 | total_timesteps 4220.
number of affinization with epsilon = 3 is 19
average number of affinization = 18.615300146412885
Path 248 | total_timesteps 4242.
number of affinization with epsilon = 3 is 22
average number of affinization = 18.615919487648675
Path 249 | total_timesteps 4266.
number of affinization with epsilon = 3 is 17
average number of affinization = 18.615623856567876
Path 250 | total_timesteps 4285.
number of affinization with epsilon = 3 is 4
average number of affinization = 18.61295042985184
Path 251 | total_timesteps 4292.
number of affinization with epsilon = 3 is 10
average number of affinization = 18.611375274323336
Path 252 | total_timesteps 4303.
number of affinization with epsilon = 3 is 28
average number of affinization = 18.61309197293838
Path 253 | total_timesteps 4333.
number of affinization with epsilon = 3 is 18
average number of affinization = 18.612979890310786
Path 254 | total_timesteps 4357.
number of affinization with epsilon = 3 is 18
average number of affinization = 18.612867848656553
Path 255 | total_timesteps 4376.
number of affinization with epsilon = 3 is 9
average number of affinization = 18.61111111111111
Path 256 | total_timesteps 4388.
number of affinization with epsilon = 3 is 13
average number of affinization = 18.61008587611913
Path 257 | total_timesteps 4402.
number of affinization with epsilon = 3 is 11
average number of affinization = 18.608695652173914
Path 258 | total_timesteps 4415.
number of affinization with epsilon = 3 is 11
average number of affinization = 18.60730593607306
Path 259 | total_timesteps 4429.
number of affinization with epsilon = 3 is 13
average number of affinization = 18.60628195763331
Path 260 | total_timesteps 4444.
number of affinization with epsilon = 3 is 6
average number of affinization = 18.603980281175826
Path 261 | total_timesteps 4453.
number of affinization with epsilon = 3 is 21
average number of affinization = 18.604417670682732
Path 262 | total_timesteps 4477.
number of affinization with epsilon = 3 is 18
average number of affinization = 18.604307355356816
Path 263 | total_timesteps 4501.
number of affinization with epsilon = 3 is 12
average number of affinization = 18.603102189781023
Path 264 | total_timesteps 4517.
number of affinization with epsilon = 3 is 13
average number of affinization = 18.60207991242474
Path 265 | total_timesteps 4534.
number of affinization with epsilon = 3 is 18
average number of affinization = 18.60197008391098
Path 266 | total_timesteps 4558.
number of affinization with epsilon = 3 is 41
average number of affinization = 18.60605507933613
Path 267 | total_timesteps 4602.
number of affinization with epsilon = 3 is 13
average number of affinization = 18.60503282275711
Path 268 | total_timesteps 4616.
number of affinization with epsilon = 3 is 17
average number of affinization = 18.604740200546946
Path 269 | total_timesteps 4636.
number of affinization with epsilon = 3 is 8
average number of affinization = 18.602807145461174
Path 270 | total_timesteps 4648.
number of affinization with epsilon = 3 is 9
average number of affinization = 18.601057043921998
Path 271 | total_timesteps 4659.
number of affinization with epsilon = 3 is 9
average number of affinization = 18.599307580174926
Path 272 | total_timesteps 4670.
number of affinization with epsilon = 3 is 15
average number of affinization = 18.59865184915285
Path 273 | total_timesteps 4689.
number of affinization with epsilon = 3 is 16
average number of affinization = 18.598178506375227
Path 274 | total_timesteps 4709.
number of affinization with epsilon = 3 is 10
average number of affinization = 18.596612638863594
Path 275 | total_timesteps 4720.
number of affinization with epsilon = 3 is 14
average number of affinization = 18.59577567370721
Path 276 | total_timesteps 4738.
number of affinization with epsilon = 3 is 14
average number of affinization = 18.59493901328964
Path 277 | total_timesteps 4755.
number of affinization with epsilon = 3 is 14
average number of affinization = 18.594102657444484
Path 278 | total_timesteps 4770.
number of affinization with epsilon = 3 is 12
average number of affinization = 18.59290263876251
Path 279 | total_timesteps 4784.
number of affinization with epsilon = 3 is 18
average number of affinization = 18.592794759825328
Path 280 | total_timesteps 4803.
number of affinization with epsilon = 3 is 14
average number of affinization = 18.591959250500274
Path 281 | total_timesteps 4819.
number of affinization with epsilon = 3 is 13
average number of affinization = 18.59094216078574
Path 282 | total_timesteps 4833.
number of affinization with epsilon = 3 is 16
average number of affinization = 18.590470994726314
Path 283 | total_timesteps 4852.
number of affinization with epsilon = 3 is 9
average number of affinization = 18.588727272727272
Path 284 | total_timesteps 4863.
number of affinization with epsilon = 3 is 11
average number of affinization = 18.587347754953644
Path 285 | total_timesteps 4876.
number of affinization with epsilon = 3 is 14
average number of affinization = 18.58651399491094
Path 286 | total_timesteps 4891.
number of affinization with epsilon = 3 is 4
average number of affinization = 18.58386334726513
Path 287 | total_timesteps 4898.
number of affinization with epsilon = 3 is 12
average number of affinization = 18.58266715116279
Path 288 | total_timesteps 4912.
number of affinization with epsilon = 3 is 20
average number of affinization = 18.582924613987284
Path 289 | total_timesteps 4934.
number of affinization with epsilon = 3 is 7
average number of affinization = 18.580820922629858
Path 290 | total_timesteps 4942.
number of affinization with epsilon = 3 is 14
average number of affinization = 18.57998910477574
Path 291 | total_timesteps 4960.
number of affinization with epsilon = 3 is 14
average number of affinization = 18.57915758896151
Path 292 | total_timesteps 4976.
number of affinization with epsilon = 3 is 15
average number of affinization = 18.578507896169903
Path 293 | total_timesteps 4997.
number of affinization with epsilon = 3 is 10
average number of affinization = 18.57695099818512
Path 294 | total_timesteps 5008.
number of affinization with epsilon = 3 is 15
average number of affinization = 18.5763019415714
Path 295 | total_timesteps 5025.
number of affinization with epsilon = 3 is 14
average number of affinization = 18.57547169811321
Path 296 | total_timesteps 5042.
number of affinization with epsilon = 3 is 10
average number of affinization = 18.57391619807727
Path 297 | total_timesteps 5053.
number of affinization with epsilon = 3 is 12
average number of affinization = 18.57272397533551
Path 298 | total_timesteps 5068.
number of affinization with epsilon = 3 is 9
average number of affinization = 18.570988213961922
Path 299 | total_timesteps 5080.
number of affinization with epsilon = 3 is 10
average number of affinization = 18.569434372733866
Path 300 | total_timesteps 5098.
number of affinization with epsilon = 3 is 8
average number of affinization = 18.56751857893783
Path 301 | total_timesteps 5107.
number of affinization with epsilon = 3 is 9
average number of affinization = 18.565784704603118
Path 302 | total_timesteps 5120.
number of affinization with epsilon = 3 is 11
average number of affinization = 18.564413843087515
Path 303 | total_timesteps 5134.
number of affinization with epsilon = 3 is 10
average number of affinization = 18.56286231884058
Path 304 | total_timesteps 5145.
number of affinization with epsilon = 3 is 8
average number of affinization = 18.560949103423294
Path 305 | total_timesteps 5156.
number of affinization with epsilon = 3 is 13
average number of affinization = 18.559942049981892
Path 306 | total_timesteps 5170.
number of affinization with epsilon = 3 is 11
average number of affinization = 18.558573239181605
Path 307 | total_timesteps 5185.
number of affinization with epsilon = 3 is 12
average number of affinization = 18.557385952208545
Path 308 | total_timesteps 5202.
number of affinization with epsilon = 3 is 24
average number of affinization = 18.558371040723983
Path 309 | total_timesteps 5232.
number of affinization with epsilon = 3 is 9
average number of affinization = 18.556641331885633
Path 310 | total_timesteps 5243.
number of affinization with epsilon = 3 is 15
average number of affinization = 18.55599782884024
Path 311 | total_timesteps 5261.
number of affinization with epsilon = 3 is 9
average number of affinization = 18.554269175108537
Path 312 | total_timesteps 5274.
number of affinization with epsilon = 3 is 11
average number of affinization = 18.552902875746067
Path 313 | total_timesteps 5287.
number of affinization with epsilon = 3 is 7
average number of affinization = 18.550813743218807
Path 314 | total_timesteps 5296.
number of affinization with epsilon = 3 is 8
average number of affinization = 18.548906165250408
Path 315 | total_timesteps 5306.
number of affinization with epsilon = 3 is 8
average number of affinization = 18.5469992769342
Path 316 | total_timesteps 5315.
number of affinization with epsilon = 3 is 9
average number of affinization = 18.5452738116754
Path 317 | total_timesteps 5326.
number of affinization with epsilon = 3 is 17
average number of affinization = 18.54499457896639
Path 318 | total_timesteps 5348.
number of affinization with epsilon = 3 is 16
average number of affinization = 18.544534778681122
Path 319 | total_timesteps 5368.
number of affinization with epsilon = 3 is 21
average number of affinization = 18.54497832369942
Path 320 | total_timesteps 5391.
number of affinization with epsilon = 3 is 8
average number of affinization = 18.543073866714828
Path 321 | total_timesteps 5400.
number of affinization with epsilon = 3 is 9
average number of affinization = 18.54135066811123
Path 322 | total_timesteps 5410.
number of affinization with epsilon = 3 is 14
average number of affinization = 18.540530781729554
Path 323 | total_timesteps 5428.
number of affinization with epsilon = 3 is 8
average number of affinization = 18.538628158844766
Path 324 | total_timesteps 5439.
number of affinization with epsilon = 3 is 13
average number of affinization = 18.53762858689767
Path 325 | total_timesteps 5455.
number of affinization with epsilon = 3 is 15
average number of affinization = 18.536990256225188
Path 326 | total_timesteps 5474.
number of affinization with epsilon = 3 is 16
average number of affinization = 18.53653256359372
Path 327 | total_timesteps 5491.
number of affinization with epsilon = 3 is 13
average number of affinization = 18.53553391053391
Path 328 | total_timesteps 5510.
number of affinization with epsilon = 3 is 14
average number of affinization = 18.53471596032462
Path 329 | total_timesteps 5530.
number of affinization with epsilon = 3 is 38
average number of affinization = 18.538225748287054
Path 330 | total_timesteps 5575.
number of affinization with epsilon = 3 is 10
average number of affinization = 18.536686497205697
Path 331 | total_timesteps 5588.
number of affinization with epsilon = 3 is 8
average number of affinization = 18.534787310742608
Path 332 | total_timesteps 5598.
number of affinization with epsilon = 3 is 14
average number of affinization = 18.533970084699945
Path 333 | total_timesteps 5614.
number of affinization with epsilon = 3 is 12
average number of affinization = 18.532792792792794
Path 334 | total_timesteps 5628.
number of affinization with epsilon = 3 is 27
average number of affinization = 18.534318140875516
Path 335 | total_timesteps 5657.
number of affinization with epsilon = 3 is 12
average number of affinization = 18.53314121037464
Path 336 | total_timesteps 5672.
number of affinization with epsilon = 3 is 21
average number of affinization = 18.53358544930668
Path 337 | total_timesteps 5699.
number of affinization with epsilon = 3 is 11
average number of affinization = 18.532229024126757
Path 338 | total_timesteps 5715.
number of affinization with epsilon = 3 is 12
average number of affinization = 18.53105310531053
Path 339 | total_timesteps 5733.
number of affinization with epsilon = 3 is 30
average number of affinization = 18.533117350611953
Path 340 | total_timesteps 5767.
number of affinization with epsilon = 3 is 18
average number of affinization = 18.53302141443225
Path 341 | total_timesteps 5788.
number of affinization with epsilon = 3 is 9
average number of affinization = 18.531306225260884
Path 342 | total_timesteps 5802.
number of affinization with epsilon = 3 is 12
average number of affinization = 18.53013131858248
Path 343 | total_timesteps 5816.
number of affinization with epsilon = 3 is 22
average number of affinization = 18.530755395683453
Path 344 | total_timesteps 5842.
number of affinization with epsilon = 3 is 15
average number of affinization = 18.53012048192771
Path 345 | total_timesteps 5860.
number of affinization with epsilon = 3 is 15
average number of affinization = 18.529485796476088
Path 346 | total_timesteps 5877.
number of affinization with epsilon = 3 is 8
average number of affinization = 18.527593025346036
Path 347 | total_timesteps 5887.
number of affinization with epsilon = 3 is 8
average number of affinization = 18.52570093457944
Path 348 | total_timesteps 5899.
number of affinization with epsilon = 3 is 14
average number of affinization = 18.52488769092543
Path 349 | total_timesteps 5914.
number of affinization with epsilon = 3 is 23
average number of affinization = 18.525691699604742
Path 350 | total_timesteps 5942.
number of affinization with epsilon = 3 is 34
average number of affinization = 18.528471349021018
Path 351 | total_timesteps 5982.
number of affinization with epsilon = 3 is 11
average number of affinization = 18.527119252873565
Path 352 | total_timesteps 5994.
number of affinization with epsilon = 3 is 13
average number of affinization = 18.526126773208833
Done generating on-policy rollouts.
Updating normalization.
Done updating normalization.
----------------------------
| AverageReturn | -6.07    |
| Iteration     | 20       |
| MaximumReturn | 10.7     |
| MinimumReturn | -18.3    |
| TotalSamples  | 88236    |
----------------------------
itr #21 | 
Fitting dynamics.
Fitting model 0 (0-based) in the ensemble of 2 models
Validation loss = 0.015004164539277554
Validation loss = 0.015039151534438133
Validation loss = 0.014940963126718998
Validation loss = 0.014952247962355614
Validation loss = 0.01449275016784668
Validation loss = 0.014764650724828243
Validation loss = 0.015006650239229202
Validation loss = 0.014746210537850857
Validation loss = 0.014543755911290646
Fitting model 1 (0-based) in the ensemble of 2 models
Validation loss = 0.015587151050567627
Validation loss = 0.014557895250618458
Validation loss = 0.014807217754423618
Validation loss = 0.01440019253641367
Validation loss = 0.014782345853745937
Validation loss = 0.014437854290008545
Validation loss = 0.014815784059464931
Validation loss = 0.01407359167933464
Validation loss = 0.014576845802366734
Validation loss = 0.014945045113563538
Validation loss = 0.01457146741449833
Validation loss = 0.014591590501368046
Done fitting dynamics.
Updating randomness.
Done updating randomness.
Training policy using TRPO.
Re-initialize init_std.
Obtaining samples for iteration 0...
Obtaining samples for iteration 1...
Obtaining samples for iteration 2...
Obtaining samples for iteration 3...
Obtaining samples for iteration 4...
Obtaining samples for iteration 5...
Obtaining samples for iteration 6...
Obtaining samples for iteration 7...
Obtaining samples for iteration 8...
Obtaining samples for iteration 9...
Obtaining samples for iteration 10...
Obtaining samples for iteration 11...
Obtaining samples for iteration 12...
Obtaining samples for iteration 13...
Obtaining samples for iteration 14...
Obtaining samples for iteration 15...
Obtaining samples for iteration 16...
Obtaining samples for iteration 17...
Obtaining samples for iteration 18...
Obtaining samples for iteration 19...
Done training policy.
Generating on-policy rollouts.
Path 0 | total_timesteps 0.
number of affinization with epsilon = 3 is 8
average number of affinization = 18.524236983842012
Path 1 | total_timesteps 9.
number of affinization with epsilon = 3 is 18
average number of affinization = 18.524142882785856
Path 2 | total_timesteps 30.
number of affinization with epsilon = 3 is 16
average number of affinization = 18.523689877961235
Path 3 | total_timesteps 48.
number of affinization with epsilon = 3 is 18
average number of affinization = 18.52359590884622
Path 4 | total_timesteps 71.
number of affinization with epsilon = 3 is 10
average number of affinization = 18.522066738428418
Path 5 | total_timesteps 84.
number of affinization with epsilon = 3 is 12
average number of affinization = 18.520896860986547
Path 6 | total_timesteps 97.
number of affinization with epsilon = 3 is 11
average number of affinization = 18.51954806312769
Path 7 | total_timesteps 109.
number of affinization with epsilon = 3 is 10
average number of affinization = 18.518020441097363
Path 8 | total_timesteps 122.
number of affinization with epsilon = 3 is 18
average number of affinization = 18.51792757260667
Path 9 | total_timesteps 144.
number of affinization with epsilon = 3 is 6
average number of affinization = 18.51568381430364
Path 10 | total_timesteps 154.
number of affinization with epsilon = 3 is 21
average number of affinization = 18.516129032258064
Path 11 | total_timesteps 177.
number of affinization with epsilon = 3 is 15
average number of affinization = 18.515499014513527
Path 12 | total_timesteps 194.
number of affinization with epsilon = 3 is 13
average number of affinization = 18.5145109279828
Path 13 | total_timesteps 209.
number of affinization with epsilon = 3 is 11
average number of affinization = 18.51316496507254
Path 14 | total_timesteps 222.
number of affinization with epsilon = 3 is 8
average number of affinization = 18.51128223495702
Path 15 | total_timesteps 232.
number of affinization with epsilon = 3 is 8
average number of affinization = 18.50940017905103
Path 16 | total_timesteps 241.
number of affinization with epsilon = 3 is 13
average number of affinization = 18.50841389187254
Path 17 | total_timesteps 257.
number of affinization with epsilon = 3 is 16
average number of affinization = 18.507964918560944
Path 18 | total_timesteps 276.
number of affinization with epsilon = 3 is 7
average number of affinization = 18.505905511811022
Path 19 | total_timesteps 284.
number of affinization with epsilon = 3 is 8
average number of affinization = 18.50402576489533
Path 20 | total_timesteps 293.
number of affinization with epsilon = 3 is 27
average number of affinization = 18.505545617173524
Path 21 | total_timesteps 322.
number of affinization with epsilon = 3 is 23
average number of affinization = 18.50634949025219
Path 22 | total_timesteps 351.
number of affinization with epsilon = 3 is 17
average number of affinization = 18.50608011444921
Path 23 | total_timesteps 372.
number of affinization with epsilon = 3 is 6
average number of affinization = 18.50384409082782
Path 24 | total_timesteps 380.
number of affinization with epsilon = 3 is 12
average number of affinization = 18.50268144440472
Path 25 | total_timesteps 395.
number of affinization with epsilon = 3 is 23
average number of affinization = 18.50348525469169
Path 26 | total_timesteps 426.
number of affinization with epsilon = 3 is 12
average number of affinization = 18.502323087919944
Path 27 | total_timesteps 445.
number of affinization with epsilon = 3 is 23
average number of affinization = 18.503126675004467
Path 28 | total_timesteps 473.
number of affinization with epsilon = 3 is 19
average number of affinization = 18.5032154340836
Path 29 | total_timesteps 498.
number of affinization with epsilon = 3 is 10
average number of affinization = 18.501696731559207
Path 30 | total_timesteps 511.
number of affinization with epsilon = 3 is 8
average number of affinization = 18.49982142857143
Path 31 | total_timesteps 520.
number of affinization with epsilon = 3 is 9
average number of affinization = 18.49812533476165
Path 32 | total_timesteps 531.
number of affinization with epsilon = 3 is 9
average number of affinization = 18.496429846483398
Path 33 | total_timesteps 541.
number of affinization with epsilon = 3 is 20
average number of affinization = 18.496698197394252
Path 34 | total_timesteps 565.
number of affinization with epsilon = 3 is 26
average number of affinization = 18.49803711634547
Path 35 | total_timesteps 594.
number of affinization with epsilon = 3 is 16
average number of affinization = 18.497591436217665
Path 36 | total_timesteps 613.
number of affinization with epsilon = 3 is 12
average number of affinization = 18.496432393863717
Path 37 | total_timesteps 626.
number of affinization with epsilon = 3 is 21
average number of affinization = 18.496878901373282
Path 38 | total_timesteps 650.
number of affinization with epsilon = 3 is 18
average number of affinization = 18.49679029957204
Path 39 | total_timesteps 673.
number of affinization with epsilon = 3 is 10
average number of affinization = 18.49527545016937
Path 40 | total_timesteps 685.
number of affinization with epsilon = 3 is 10
average number of affinization = 18.493761140819963
Path 41 | total_timesteps 696.
number of affinization with epsilon = 3 is 9
average number of affinization = 18.492069149884156
Path 42 | total_timesteps 707.
number of affinization with epsilon = 3 is 11
average number of affinization = 18.490734141126158
Path 43 | total_timesteps 720.
number of affinization with epsilon = 3 is 5
average number of affinization = 18.488330660965616
Path 44 | total_timesteps 730.
number of affinization with epsilon = 3 is 9
average number of affinization = 18.486640541503384
Path 45 | total_timesteps 740.
number of affinization with epsilon = 3 is 8
average number of affinization = 18.484772929652717
Path 46 | total_timesteps 750.
number of affinization with epsilon = 3 is 17
average number of affinization = 18.48450854700855
Path 47 | total_timesteps 771.
number of affinization with epsilon = 3 is 10
average number of affinization = 18.482998041659247
Path 48 | total_timesteps 783.
number of affinization with epsilon = 3 is 10
average number of affinization = 18.481488074047704
Path 49 | total_timesteps 795.
number of affinization with epsilon = 3 is 17
average number of affinization = 18.481224417156078
Path 50 | total_timesteps 818.
number of affinization with epsilon = 3 is 12
average number of affinization = 18.480071174377223
Path 51 | total_timesteps 832.
number of affinization with epsilon = 3 is 8
average number of affinization = 18.478206724782066
Path 52 | total_timesteps 843.
number of affinization with epsilon = 3 is 14
average number of affinization = 18.47741017431519
Path 53 | total_timesteps 864.
number of affinization with epsilon = 3 is 3
average number of affinization = 18.474657656055488
Path 54 | total_timesteps 872.
number of affinization with epsilon = 3 is 5
average number of affinization = 18.47226173541963
Path 55 | total_timesteps 879.
number of affinization with epsilon = 3 is 8
average number of affinization = 18.4704
Path 56 | total_timesteps 889.
number of affinization with epsilon = 3 is 7
average number of affinization = 18.468361180234623
Path 57 | total_timesteps 899.
number of affinization with epsilon = 3 is 26
average number of affinization = 18.46969966234228
Path 58 | total_timesteps 928.
number of affinization with epsilon = 3 is 8
average number of affinization = 18.467839374555794
Path 59 | total_timesteps 941.
number of affinization with epsilon = 3 is 12
average number of affinization = 18.46669035352638
Path 60 | total_timesteps 957.
number of affinization with epsilon = 3 is 10
average number of affinization = 18.465186500888098
Path 61 | total_timesteps 968.
number of affinization with epsilon = 3 is 35
average number of affinization = 18.468122891138343
Path 62 | total_timesteps 1009.
number of affinization with epsilon = 3 is 15
average number of affinization = 18.467507102272727
Path 63 | total_timesteps 1028.
number of affinization with epsilon = 3 is 8
average number of affinization = 18.46564885496183
Path 64 | total_timesteps 1037.
number of affinization with epsilon = 3 is 24
average number of affinization = 18.466631167909124
Path 65 | total_timesteps 1064.
number of affinization with epsilon = 3 is 7
average number of affinization = 18.464596273291924
Path 66 | total_timesteps 1072.
number of affinization with epsilon = 3 is 9
average number of affinization = 18.46291696238467
Path 67 | total_timesteps 1085.
number of affinization with epsilon = 3 is 27
average number of affinization = 18.464431435160545
Path 68 | total_timesteps 1119.
number of affinization with epsilon = 3 is 9
average number of affinization = 18.462752749201844
Path 69 | total_timesteps 1131.
number of affinization with epsilon = 3 is 11
average number of affinization = 18.461429331441746
Path 70 | total_timesteps 1144.
number of affinization with epsilon = 3 is 11
average number of affinization = 18.460106382978722
Path 71 | total_timesteps 1160.
number of affinization with epsilon = 3 is 11
average number of affinization = 18.458783903563198
Path 72 | total_timesteps 1174.
number of affinization with epsilon = 3 is 15
average number of affinization = 18.458170861396667
Path 73 | total_timesteps 1191.
number of affinization with epsilon = 3 is 16
average number of affinization = 18.45773524720893
Path 74 | total_timesteps 1209.
number of affinization with epsilon = 3 is 9
average number of affinization = 18.456059532246634
Path 75 | total_timesteps 1220.
number of affinization with epsilon = 3 is 15
average number of affinization = 18.455447298494242
Path 76 | total_timesteps 1236.
number of affinization with epsilon = 3 is 9
average number of affinization = 18.453772582359193
Path 77 | total_timesteps 1246.
number of affinization with epsilon = 3 is 8
average number of affinization = 18.45192137418098
Path 78 | total_timesteps 1256.
number of affinization with epsilon = 3 is 14
average number of affinization = 18.45113314447592
Path 79 | total_timesteps 1277.
number of affinization with epsilon = 3 is 17
average number of affinization = 18.450876261285185
Path 80 | total_timesteps 1297.
number of affinization with epsilon = 3 is 9
average number of affinization = 18.44920353982301
Path 81 | total_timesteps 1309.
number of affinization with epsilon = 3 is 12
average number of affinization = 18.4480622898602
Path 82 | total_timesteps 1325.
number of affinization with epsilon = 3 is 11
average number of affinization = 18.44674451521585
Path 83 | total_timesteps 1337.
number of affinization with epsilon = 3 is 9
average number of affinization = 18.445073412347426
Path 84 | total_timesteps 1348.
number of affinization with epsilon = 3 is 20
average number of affinization = 18.445348425893172
Path 85 | total_timesteps 1372.
number of affinization with epsilon = 3 is 10
average number of affinization = 18.443854995579134
Path 86 | total_timesteps 1386.
number of affinization with epsilon = 3 is 5
average number of affinization = 18.441478076379067
Path 87 | total_timesteps 1392.
number of affinization with epsilon = 3 is 8
average number of affinization = 18.43963231394732
Path 88 | total_timesteps 1402.
number of affinization with epsilon = 3 is 15
average number of affinization = 18.4390243902439
Path 89 | total_timesteps 1418.
number of affinization with epsilon = 3 is 9
average number of affinization = 18.43735642339636
Path 90 | total_timesteps 1431.
number of affinization with epsilon = 3 is 15
average number of affinization = 18.436749116607775
Path 91 | total_timesteps 1449.
number of affinization with epsilon = 3 is 10
average number of affinization = 18.435258788199963
Path 92 | total_timesteps 1461.
number of affinization with epsilon = 3 is 14
average number of affinization = 18.434475450370893
Path 93 | total_timesteps 1476.
number of affinization with epsilon = 3 is 21
average number of affinization = 18.434928483136147
Path 94 | total_timesteps 1499.
number of affinization with epsilon = 3 is 10
average number of affinization = 18.433439265536723
Path 95 | total_timesteps 1513.
number of affinization with epsilon = 3 is 8
average number of affinization = 18.431597528684907
Path 96 | total_timesteps 1523.
number of affinization with epsilon = 3 is 13
average number of affinization = 18.430638898693964
Path 97 | total_timesteps 1538.
number of affinization with epsilon = 3 is 14
average number of affinization = 18.42985706723134
Path 98 | total_timesteps 1555.
number of affinization with epsilon = 3 is 9
average number of affinization = 18.42819336626676
Path 99 | total_timesteps 1566.
number of affinization with epsilon = 3 is 23
average number of affinization = 18.428999823602044
Path 100 | total_timesteps 1597.
number of affinization with epsilon = 3 is 9
average number of affinization = 18.427336860670195
Path 101 | total_timesteps 1607.
number of affinization with epsilon = 3 is 27
average number of affinization = 18.428848527596543
Path 102 | total_timesteps 1637.
number of affinization with epsilon = 3 is 6
average number of affinization = 18.426657263751764
Path 103 | total_timesteps 1647.
number of affinization with epsilon = 3 is 11
average number of affinization = 18.425348140313766
Path 104 | total_timesteps 1661.
number of affinization with epsilon = 3 is 15
average number of affinization = 18.424744448360943
Path 105 | total_timesteps 1677.
number of affinization with epsilon = 3 is 22
average number of affinization = 18.425374449339206
Path 106 | total_timesteps 1702.
number of affinization with epsilon = 3 is 9
average number of affinization = 18.42371388301621
Path 107 | total_timesteps 1712.
number of affinization with epsilon = 3 is 8
average number of affinization = 18.42187775233398
Path 108 | total_timesteps 1721.
number of affinization with epsilon = 3 is 18
average number of affinization = 18.42180345191969
Path 109 | total_timesteps 1744.
number of affinization with epsilon = 3 is 10
average number of affinization = 18.420320478957564
Path 110 | total_timesteps 1756.
number of affinization with epsilon = 3 is 17
average number of affinization = 18.42007042253521
Path 111 | total_timesteps 1777.
number of affinization with epsilon = 3 is 5
average number of affinization = 18.417708149973596
Path 112 | total_timesteps 1785.
number of affinization with epsilon = 3 is 12
average number of affinization = 18.416578669482575
Path 113 | total_timesteps 1799.
number of affinization with epsilon = 3 is 10
average number of affinization = 18.415097659686786
Path 114 | total_timesteps 1812.
number of affinization with epsilon = 3 is 9
average number of affinization = 18.413441238564392
Path 115 | total_timesteps 1825.
number of affinization with epsilon = 3 is 10
average number of affinization = 18.411961301671063
Path 116 | total_timesteps 1839.
number of affinization with epsilon = 3 is 18
average number of affinization = 18.41188884980654
Path 117 | total_timesteps 1859.
number of affinization with epsilon = 3 is 14
average number of affinization = 18.411113064884827
Path 118 | total_timesteps 1875.
number of affinization with epsilon = 3 is 7
average number of affinization = 18.40910689170183
Path 119 | total_timesteps 1884.
number of affinization with epsilon = 3 is 9
average number of affinization = 18.407452979433994
Path 120 | total_timesteps 1895.
number of affinization with epsilon = 3 is 26
average number of affinization = 18.40878734622144
Path 121 | total_timesteps 1925.
number of affinization with epsilon = 3 is 13
average number of affinization = 18.40783693551221
Path 122 | total_timesteps 1941.
number of affinization with epsilon = 3 is 13
average number of affinization = 18.40688685874912
Path 123 | total_timesteps 1957.
number of affinization with epsilon = 3 is 20
average number of affinization = 18.407166695942387
Path 124 | total_timesteps 1980.
number of affinization with epsilon = 3 is 9
average number of affinization = 18.405514576747454
Path 125 | total_timesteps 1991.
number of affinization with epsilon = 3 is 21
average number of affinization = 18.405970149253733
Path 126 | total_timesteps 2013.
number of affinization with epsilon = 3 is 10
average number of affinization = 18.40449438202247
Path 127 | total_timesteps 2024.
number of affinization with epsilon = 3 is 12
average number of affinization = 18.40337019483939
Path 128 | total_timesteps 2040.
number of affinization with epsilon = 3 is 5
average number of affinization = 18.4010179010179
Path 129 | total_timesteps 2047.
number of affinization with epsilon = 3 is 15
average number of affinization = 18.40042112651342
Path 130 | total_timesteps 2065.
number of affinization with epsilon = 3 is 11
average number of affinization = 18.399122807017545
Path 131 | total_timesteps 2080.
number of affinization with epsilon = 3 is 9
average number of affinization = 18.39747412734608
Path 132 | total_timesteps 2094.
number of affinization with epsilon = 3 is 18
average number of affinization = 18.397404419501928
Path 133 | total_timesteps 2115.
number of affinization with epsilon = 3 is 9
average number of affinization = 18.395756619323162
Path 134 | total_timesteps 2127.
number of affinization with epsilon = 3 is 12
average number of affinization = 18.394635343618514
Path 135 | total_timesteps 2141.
number of affinization with epsilon = 3 is 19
average number of affinization = 18.394741454864153
Path 136 | total_timesteps 2164.
number of affinization with epsilon = 3 is 9
average number of affinization = 18.393094987732212
Path 137 | total_timesteps 2177.
number of affinization with epsilon = 3 is 32
average number of affinization = 18.395479236025935
Path 138 | total_timesteps 2213.
number of affinization with epsilon = 3 is 23
average number of affinization = 18.396285914505956
Path 139 | total_timesteps 2240.
number of affinization with epsilon = 3 is 6
average number of affinization = 18.39411455596427
Path 140 | total_timesteps 2251.
number of affinization with epsilon = 3 is 14
average number of affinization = 18.39334500875657
Path 141 | total_timesteps 2266.
number of affinization with epsilon = 3 is 6
average number of affinization = 18.39117492558221
Path 142 | total_timesteps 2274.
number of affinization with epsilon = 3 is 9
average number of affinization = 18.38953081232493
Path 143 | total_timesteps 2285.
number of affinization with epsilon = 3 is 25
average number of affinization = 18.390687904778574
Path 144 | total_timesteps 2316.
number of affinization with epsilon = 3 is 19
average number of affinization = 18.390794539726986
Path 145 | total_timesteps 2339.
number of affinization with epsilon = 3 is 7
average number of affinization = 18.38880139982502
Path 146 | total_timesteps 2348.
number of affinization with epsilon = 3 is 17
average number of affinization = 18.38855843247026
Path 147 | total_timesteps 2370.
number of affinization with epsilon = 3 is 9
average number of affinization = 18.38691621479797
Path 148 | total_timesteps 2382.
number of affinization with epsilon = 3 is 6
average number of affinization = 18.38474991255684
Path 149 | total_timesteps 2392.
number of affinization with epsilon = 3 is 5
average number of affinization = 18.382409512152474
Path 150 | total_timesteps 2400.
number of affinization with epsilon = 3 is 11
average number of affinization = 18.38111888111888
Path 151 | total_timesteps 2414.
number of affinization with epsilon = 3 is 7
average number of affinization = 18.379129522810697
Path 152 | total_timesteps 2424.
number of affinization with epsilon = 3 is 7
average number of affinization = 18.377140859839216
Path 153 | total_timesteps 2433.
number of affinization with epsilon = 3 is 8
average number of affinization = 18.37532762537131
Path 154 | total_timesteps 2442.
number of affinization with epsilon = 3 is 27
average number of affinization = 18.37683438155136
Path 155 | total_timesteps 2470.
number of affinization with epsilon = 3 is 3
average number of affinization = 18.37414847161572
Path 156 | total_timesteps 2478.
number of affinization with epsilon = 3 is 15
average number of affinization = 18.373559203632553
Path 157 | total_timesteps 2494.
number of affinization with epsilon = 3 is 14
average number of affinization = 18.372795529945872
Path 158 | total_timesteps 2514.
number of affinization with epsilon = 3 is 9
average number of affinization = 18.371159217877096
Path 159 | total_timesteps 2524.
number of affinization with epsilon = 3 is 8
average number of affinization = 18.369348926514228
Path 160 | total_timesteps 2535.
number of affinization with epsilon = 3 is 10
average number of affinization = 18.367888307155322
Path 161 | total_timesteps 2549.
number of affinization with epsilon = 3 is 9
average number of affinization = 18.36625370790438
Path 162 | total_timesteps 2561.
number of affinization with epsilon = 3 is 10
average number of affinization = 18.364794138171668
Path 163 | total_timesteps 2573.
number of affinization with epsilon = 3 is 11
average number of affinization = 18.36350950636665
Path 164 | total_timesteps 2585.
number of affinization with epsilon = 3 is 17
average number of affinization = 18.36327171259156
Path 165 | total_timesteps 2604.
number of affinization with epsilon = 3 is 18
average number of affinization = 18.363208369659983
Path 166 | total_timesteps 2625.
number of affinization with epsilon = 3 is 8
average number of affinization = 18.361401673640167
Path 167 | total_timesteps 2635.
number of affinization with epsilon = 3 is 14
average number of affinization = 18.360641450235313
Path 168 | total_timesteps 2651.
number of affinization with epsilon = 3 is 12
average number of affinization = 18.35953293830603
Path 169 | total_timesteps 2668.
number of affinization with epsilon = 3 is 12
average number of affinization = 18.358424812685136
Path 170 | total_timesteps 2683.
number of affinization with epsilon = 3 is 13
average number of affinization = 18.357491289198606
Path 171 | total_timesteps 2699.
number of affinization with epsilon = 3 is 9
average number of affinization = 18.355861348197177
Path 172 | total_timesteps 2710.
number of affinization with epsilon = 3 is 14
average number of affinization = 18.355102751654474
Path 173 | total_timesteps 2729.
number of affinization with epsilon = 3 is 15
average number of affinization = 18.354518544314818
Path 174 | total_timesteps 2750.
number of affinization with epsilon = 3 is 10
average number of affinization = 18.35306406685237
Path 175 | total_timesteps 2763.
number of affinization with epsilon = 3 is 13
average number of affinization = 18.352132288946912
Path 176 | total_timesteps 2777.
number of affinization with epsilon = 3 is 10
average number of affinization = 18.350678733031675
Path 177 | total_timesteps 2789.
number of affinization with epsilon = 3 is 24
average number of affinization = 18.351661736558203
Path 178 | total_timesteps 2817.
number of affinization with epsilon = 3 is 19
average number of affinization = 18.3517745302714
Path 179 | total_timesteps 2838.
number of affinization with epsilon = 3 is 12
average number of affinization = 18.350669681683772
Path 180 | total_timesteps 2853.
number of affinization with epsilon = 3 is 14
average number of affinization = 18.34991304347826
Path 181 | total_timesteps 2869.
number of affinization with epsilon = 3 is 14
average number of affinization = 18.349156668405495
Path 182 | total_timesteps 2887.
number of affinization with epsilon = 3 is 6
average number of affinization = 18.347009735744088
Path 183 | total_timesteps 2895.
number of affinization with epsilon = 3 is 9
average number of affinization = 18.345385016513124
Path 184 | total_timesteps 2906.
number of affinization with epsilon = 3 is 9
average number of affinization = 18.343760862009038
Path 185 | total_timesteps 2921.
number of affinization with epsilon = 3 is 16
average number of affinization = 18.34335360556038
Path 186 | total_timesteps 2941.
number of affinization with epsilon = 3 is 18
average number of affinization = 18.343293954134815
Path 187 | total_timesteps 2964.
number of affinization with epsilon = 3 is 14
average number of affinization = 18.342539517109607
Path 188 | total_timesteps 2982.
number of affinization with epsilon = 3 is 10
average number of affinization = 18.341090656477945
Path 189 | total_timesteps 2993.
number of affinization with epsilon = 3 is 14
average number of affinization = 18.340336864038896
Path 190 | total_timesteps 3008.
number of affinization with epsilon = 3 is 16
average number of affinization = 18.339930555555554
Path 191 | total_timesteps 3026.
number of affinization with epsilon = 3 is 22
average number of affinization = 18.34056587398021
Path 192 | total_timesteps 3051.
number of affinization with epsilon = 3 is 13
average number of affinization = 18.33963901423117
Path 193 | total_timesteps 3068.
number of affinization with epsilon = 3 is 13
average number of affinization = 18.3387124761409
Path 194 | total_timesteps 3085.
number of affinization with epsilon = 3 is 11
average number of affinization = 18.33743927827897
Path 195 | total_timesteps 3098.
number of affinization with epsilon = 3 is 21
average number of affinization = 18.337901127493495
Path 196 | total_timesteps 3121.
number of affinization with epsilon = 3 is 9
average number of affinization = 18.336281651057927
Path 197 | total_timesteps 3132.
number of affinization with epsilon = 3 is 4
average number of affinization = 18.333795734350616
Path 198 | total_timesteps 3138.
number of affinization with epsilon = 3 is 12
average number of affinization = 18.332697642163662
Path 199 | total_timesteps 3152.
number of affinization with epsilon = 3 is 15
average number of affinization = 18.332119951464726
Path 200 | total_timesteps 3169.
number of affinization with epsilon = 3 is 18
average number of affinization = 18.33206239168111
Path 201 | total_timesteps 3189.
number of affinization with epsilon = 3 is 28
average number of affinization = 18.333737653786173
Path 202 | total_timesteps 3220.
number of affinization with epsilon = 3 is 7
average number of affinization = 18.331774081774082
Path 203 | total_timesteps 3229.
number of affinization with epsilon = 3 is 8
average number of affinization = 18.329984410185347
Path 204 | total_timesteps 3239.
number of affinization with epsilon = 3 is 10
average number of affinization = 18.328541738829234
Path 205 | total_timesteps 3251.
number of affinization with epsilon = 3 is 22
average number of affinization = 18.32917748917749
Path 206 | total_timesteps 3280.
number of affinization with epsilon = 3 is 16
average number of affinization = 18.328774238227147
Path 207 | total_timesteps 3302.
number of affinization with epsilon = 3 is 8
average number of affinization = 18.326986325082224
Path 208 | total_timesteps 3311.
number of affinization with epsilon = 3 is 19
average number of affinization = 18.327102803738317
Path 209 | total_timesteps 3334.
number of affinization with epsilon = 3 is 9
average number of affinization = 18.325488838899464
Path 210 | total_timesteps 3345.
number of affinization with epsilon = 3 is 33
average number of affinization = 18.3280276816609
Path 211 | total_timesteps 3381.
number of affinization with epsilon = 3 is 12
average number of affinization = 18.32693305656461
Path 212 | total_timesteps 3395.
number of affinization with epsilon = 3 is 9
average number of affinization = 18.32531995849187
Path 213 | total_timesteps 3406.
number of affinization with epsilon = 3 is 12
average number of affinization = 18.324226180183295
Path 214 | total_timesteps 3422.
number of affinization with epsilon = 3 is 27
average number of affinization = 18.32572614107884
Path 215 | total_timesteps 3454.
number of affinization with epsilon = 3 is 15
average number of affinization = 18.325151253241142
Path 216 | total_timesteps 3475.
number of affinization with epsilon = 3 is 11
average number of affinization = 18.32388524023505
Path 217 | total_timesteps 3487.
number of affinization with epsilon = 3 is 16
average number of affinization = 18.32348367029549
Path 218 | total_timesteps 3504.
number of affinization with epsilon = 3 is 8
average number of affinization = 18.321700069108502
Path 219 | total_timesteps 3516.
number of affinization with epsilon = 3 is 13
average number of affinization = 18.32078079115564
Path 220 | total_timesteps 3531.
number of affinization with epsilon = 3 is 7
average number of affinization = 18.318825561312607
Path 221 | total_timesteps 3539.
number of affinization with epsilon = 3 is 13
average number of affinization = 18.317907097219823
Path 222 | total_timesteps 3554.
number of affinization with epsilon = 3 is 13
average number of affinization = 18.316988950276244
Path 223 | total_timesteps 3572.
number of affinization with epsilon = 3 is 10
average number of affinization = 18.315553253927153
Path 224 | total_timesteps 3586.
number of affinization with epsilon = 3 is 10
average number of affinization = 18.314118053158438
Path 225 | total_timesteps 3599.
number of affinization with epsilon = 3 is 8
average number of affinization = 18.312338222605696
Path 226 | total_timesteps 3609.
number of affinization with epsilon = 3 is 10
average number of affinization = 18.31090407177364
Path 227 | total_timesteps 3620.
number of affinization with epsilon = 3 is 8
average number of affinization = 18.30912540969467
Path 228 | total_timesteps 3630.
number of affinization with epsilon = 3 is 9
average number of affinization = 18.307519834425666
Path 229 | total_timesteps 3642.
number of affinization with epsilon = 3 is 7
average number of affinization = 18.305569925849284
Path 230 | total_timesteps 3650.
number of affinization with epsilon = 3 is 9
average number of affinization = 18.30396551724138
Path 231 | total_timesteps 3661.
number of affinization with epsilon = 3 is 11
average number of affinization = 18.302706429925873
Path 232 | total_timesteps 3674.
number of affinization with epsilon = 3 is 8
average number of affinization = 18.300930713547054
Path 233 | total_timesteps 3685.
number of affinization with epsilon = 3 is 31
average number of affinization = 18.303119076339826
Path 234 | total_timesteps 3722.
number of affinization with epsilon = 3 is 8
average number of affinization = 18.3013439007581
Path 235 | total_timesteps 3733.
number of affinization with epsilon = 3 is 7
average number of affinization = 18.299397071490095
Path 236 | total_timesteps 3743.
number of affinization with epsilon = 3 is 11
average number of affinization = 18.29813985532208
Path 237 | total_timesteps 3755.
number of affinization with epsilon = 3 is 26
average number of affinization = 18.29946616152919
Path 238 | total_timesteps 3787.
number of affinization with epsilon = 3 is 8
average number of affinization = 18.297692837465565
Path 239 | total_timesteps 3796.
number of affinization with epsilon = 3 is 10
average number of affinization = 18.296264417283524
Path 240 | total_timesteps 3811.
number of affinization with epsilon = 3 is 7
average number of affinization = 18.29432013769363
Path 241 | total_timesteps 3820.
number of affinization with epsilon = 3 is 12
average number of affinization = 18.293236964377904
Path 242 | total_timesteps 3834.
number of affinization with epsilon = 3 is 13
average number of affinization = 18.292326221610463
Path 243 | total_timesteps 3849.
number of affinization with epsilon = 3 is 18
average number of affinization = 18.292275933253052
Path 244 | total_timesteps 3870.
number of affinization with epsilon = 3 is 20
average number of affinization = 18.292569659442723
Path 245 | total_timesteps 3894.
number of affinization with epsilon = 3 is 13
average number of affinization = 18.291659501289768
Path 246 | total_timesteps 3909.
number of affinization with epsilon = 3 is 8
average number of affinization = 18.289889958734527
Path 247 | total_timesteps 3918.
number of affinization with epsilon = 3 is 12
average number of affinization = 18.28880866425993
Path 248 | total_timesteps 3932.
number of affinization with epsilon = 3 is 15
average number of affinization = 18.288243382605707
Path 249 | total_timesteps 3949.
number of affinization with epsilon = 3 is 20
average number of affinization = 18.288537549407113
Path 250 | total_timesteps 3974.
number of affinization with epsilon = 3 is 10
average number of affinization = 18.287113402061856
Path 251 | total_timesteps 3987.
number of affinization with epsilon = 3 is 17
average number of affinization = 18.286892286548703
Path 252 | total_timesteps 4008.
number of affinization with epsilon = 3 is 16
average number of affinization = 18.286499484713158
Path 253 | total_timesteps 4027.
number of affinization with epsilon = 3 is 8
average number of affinization = 18.28473295552121
Path 254 | total_timesteps 4038.
number of affinization with epsilon = 3 is 40
average number of affinization = 18.28846153846154
Path 255 | total_timesteps 4081.
number of affinization with epsilon = 3 is 26
average number of affinization = 18.289785407725322
Path 256 | total_timesteps 4114.
number of affinization with epsilon = 3 is 28
average number of affinization = 18.291452111225542
Path 257 | total_timesteps 4147.
number of affinization with epsilon = 3 is 17
average number of affinization = 18.29123047880556
Path 258 | total_timesteps 4165.
number of affinization with epsilon = 3 is 8
average number of affinization = 18.289464653397392
Path 259 | total_timesteps 4175.
number of affinization with epsilon = 3 is 12
average number of affinization = 18.28838565791731
Path 260 | total_timesteps 4188.
number of affinization with epsilon = 3 is 20
average number of affinization = 18.288679245283017
Path 261 | total_timesteps 4210.
number of affinization with epsilon = 3 is 34
average number of affinization = 18.291373692334076
Path 262 | total_timesteps 4245.
number of affinization with epsilon = 3 is 8
average number of affinization = 18.28960905349794
Path 263 | total_timesteps 4258.
number of affinization with epsilon = 3 is 14
average number of affinization = 18.288873649922852
Path 264 | total_timesteps 4276.
number of affinization with epsilon = 3 is 12
average number of affinization = 18.28779568049366
Path 265 | total_timesteps 4290.
number of affinization with epsilon = 3 is 14
average number of affinization = 18.28706083976007
Path 266 | total_timesteps 4306.
number of affinization with epsilon = 3 is 12
average number of affinization = 18.28598355037697
Path 267 | total_timesteps 4319.
number of affinization with epsilon = 3 is 13
average number of affinization = 18.285077951002226
Path 268 | total_timesteps 4335.
number of affinization with epsilon = 3 is 16
average number of affinization = 18.284686536485097
Path 269 | total_timesteps 4353.
number of affinization with epsilon = 3 is 9
average number of affinization = 18.28309642061997
Path 270 | total_timesteps 4363.
number of affinization with epsilon = 3 is 12
average number of affinization = 18.282020547945205
Path 271 | total_timesteps 4378.
number of affinization with epsilon = 3 is 14
average number of affinization = 18.281287450778976
Path 272 | total_timesteps 4395.
number of affinization with epsilon = 3 is 14
average number of affinization = 18.28055460458747
Path 273 | total_timesteps 4414.
number of affinization with epsilon = 3 is 8
average number of affinization = 18.278795139483144
Path 274 | total_timesteps 4424.
number of affinization with epsilon = 3 is 8
average number of affinization = 18.277036276522928
Path 275 | total_timesteps 4435.
number of affinization with epsilon = 3 is 14
average number of affinization = 18.276304533789563
Path 276 | total_timesteps 4453.
number of affinization with epsilon = 3 is 8
average number of affinization = 18.27454669859733
Path 277 | total_timesteps 4462.
number of affinization with epsilon = 3 is 6
average number of affinization = 18.272447408927654
Path 278 | total_timesteps 4470.
number of affinization with epsilon = 3 is 16
average number of affinization = 18.272058823529413
Path 279 | total_timesteps 4488.
number of affinization with epsilon = 3 is 6
average number of affinization = 18.26996067703881
Path 280 | total_timesteps 4496.
number of affinization with epsilon = 3 is 9
average number of affinization = 18.268376068376067
Path 281 | total_timesteps 4507.
number of affinization with epsilon = 3 is 10
average number of affinization = 18.26696291232268
Path 282 | total_timesteps 4521.
number of affinization with epsilon = 3 is 7
average number of affinization = 18.265037593984964
Path 283 | total_timesteps 4532.
number of affinization with epsilon = 3 is 10
average number of affinization = 18.263625491201093
Path 284 | total_timesteps 4544.
number of affinization with epsilon = 3 is 6
average number of affinization = 18.261530577382985
Path 285 | total_timesteps 4552.
number of affinization with epsilon = 3 is 11
average number of affinization = 18.260290350128095
Path 286 | total_timesteps 4565.
number of affinization with epsilon = 3 is 13
average number of affinization = 18.25939207650273
Path 287 | total_timesteps 4580.
number of affinization with epsilon = 3 is 8
average number of affinization = 18.257640430254398
Path 288 | total_timesteps 4589.
number of affinization with epsilon = 3 is 19
average number of affinization = 18.25776715602595
Path 289 | total_timesteps 4612.
number of affinization with epsilon = 3 is 10
average number of affinization = 18.256357740228708
Path 290 | total_timesteps 4624.
number of affinization with epsilon = 3 is 9
average number of affinization = 18.254778156996586
Path 291 | total_timesteps 4634.
number of affinization with epsilon = 3 is 10
average number of affinization = 18.253369732127624
Path 292 | total_timesteps 4646.
number of affinization with epsilon = 3 is 10
average number of affinization = 18.25196178778574
Path 293 | total_timesteps 4659.
number of affinization with epsilon = 3 is 8
average number of affinization = 18.250213201432715
Path 294 | total_timesteps 4668.
number of affinization with epsilon = 3 is 16
average number of affinization = 18.24982946793997
Path 295 | total_timesteps 4688.
number of affinization with epsilon = 3 is 13
average number of affinization = 18.248934356351235
Path 296 | total_timesteps 4707.
number of affinization with epsilon = 3 is 6
average number of affinization = 18.246846232526423
Path 297 | total_timesteps 4714.
number of affinization with epsilon = 3 is 12
average number of affinization = 18.245781489688085
Path 298 | total_timesteps 4730.
number of affinization with epsilon = 3 is 9
average number of affinization = 18.24420586230402
Path 299 | total_timesteps 4740.
number of affinization with epsilon = 3 is 12
average number of affinization = 18.243141932186063
Path 300 | total_timesteps 4753.
number of affinization with epsilon = 3 is 14
average number of affinization = 18.242419080068142
Path 301 | total_timesteps 4771.
number of affinization with epsilon = 3 is 17
average number of affinization = 18.242207460398568
Path 302 | total_timesteps 4790.
number of affinization with epsilon = 3 is 17
average number of affinization = 18.24199591280654
Path 303 | total_timesteps 4811.
number of affinization with epsilon = 3 is 15
average number of affinization = 18.241443895794312
Path 304 | total_timesteps 4829.
number of affinization with epsilon = 3 is 17
average number of affinization = 18.241232550221316
Path 305 | total_timesteps 4852.
number of affinization with epsilon = 3 is 13
average number of affinization = 18.240340425531915
Path 306 | total_timesteps 4866.
number of affinization with epsilon = 3 is 8
average number of affinization = 18.23859768550034
Path 307 | total_timesteps 4878.
number of affinization with epsilon = 3 is 8
average number of affinization = 18.236855538540073
Path 308 | total_timesteps 4888.
number of affinization with epsilon = 3 is 10
average number of affinization = 18.23545423613474
Path 309 | total_timesteps 4902.
number of affinization with epsilon = 3 is 8
average number of affinization = 18.233713216533424
Path 310 | total_timesteps 4912.
number of affinization with epsilon = 3 is 16
average number of affinization = 18.233333333333334
Path 311 | total_timesteps 4929.
number of affinization with epsilon = 3 is 6
average number of affinization = 18.231253188233293
Path 312 | total_timesteps 4938.
number of affinization with epsilon = 3 is 10
average number of affinization = 18.229853791227473
Path 313 | total_timesteps 4953.
number of affinization with epsilon = 3 is 17
average number of affinization = 18.2296447390787
Path 314 | total_timesteps 4971.
number of affinization with epsilon = 3 is 13
average number of affinization = 18.228755948334467
Path 315 | total_timesteps 4989.
number of affinization with epsilon = 3 is 10
average number of affinization = 18.22735768903993
Path 316 | total_timesteps 5001.
number of affinization with epsilon = 3 is 20
average number of affinization = 18.22765885151206
Path 317 | total_timesteps 5024.
number of affinization with epsilon = 3 is 8
average number of affinization = 18.225921521997623
Path 318 | total_timesteps 5036.
number of affinization with epsilon = 3 is 17
average number of affinization = 18.22571331521739
Path 319 | total_timesteps 5061.
number of affinization with epsilon = 3 is 10
average number of affinization = 18.22431652232977
Path 320 | total_timesteps 5073.
number of affinization with epsilon = 3 is 11
average number of affinization = 18.22308998302207
Path 321 | total_timesteps 5087.
number of affinization with epsilon = 3 is 12
average number of affinization = 18.22203361059243
Path 322 | total_timesteps 5101.
number of affinization with epsilon = 3 is 12
average number of affinization = 18.220977596741346
Path 323 | total_timesteps 5115.
number of affinization with epsilon = 3 is 12
average number of affinization = 18.219921941286273
Path 324 | total_timesteps 5129.
number of affinization with epsilon = 3 is 12
average number of affinization = 18.21886664404479
Path 325 | total_timesteps 5147.
number of affinization with epsilon = 3 is 5
average number of affinization = 18.21662425784563
Path 326 | total_timesteps 5154.
number of affinization with epsilon = 3 is 14
average number of affinization = 18.21590909090909
Path 327 | total_timesteps 5171.
number of affinization with epsilon = 3 is 17
average number of affinization = 18.215702899779547
Path 328 | total_timesteps 5191.
number of affinization with epsilon = 3 is 10
average number of affinization = 18.21430993557138
Path 329 | total_timesteps 5203.
number of affinization with epsilon = 3 is 18
average number of affinization = 18.21427360569588
Path 330 | total_timesteps 5225.
number of affinization with epsilon = 3 is 24
average number of affinization = 18.215254237288136
Path 331 | total_timesteps 5254.
number of affinization with epsilon = 3 is 6
average number of affinization = 18.213184206066767
Path 332 | total_timesteps 5261.
number of affinization with epsilon = 3 is 9
average number of affinization = 18.21162317858353
Path 333 | total_timesteps 5272.
number of affinization with epsilon = 3 is 11
average number of affinization = 18.210401490767406
Path 334 | total_timesteps 5288.
number of affinization with epsilon = 3 is 14
average number of affinization = 18.209688346883468
Path 335 | total_timesteps 5306.
number of affinization with epsilon = 3 is 12
average number of affinization = 18.208636748518206
Path 336 | total_timesteps 5320.
number of affinization with epsilon = 3 is 8
average number of affinization = 18.206908228919744
Path 337 | total_timesteps 5330.
number of affinization with epsilon = 3 is 6
average number of affinization = 18.2048417132216
Path 338 | total_timesteps 5339.
number of affinization with epsilon = 3 is 13
average number of affinization = 18.203960731211914
Path 339 | total_timesteps 5353.
number of affinization with epsilon = 3 is 25
average number of affinization = 18.2051108478592
Path 340 | total_timesteps 5380.
number of affinization with epsilon = 3 is 9
average number of affinization = 18.203553299492384
Path 341 | total_timesteps 5391.
number of affinization with epsilon = 3 is 8
average number of affinization = 18.201827102013194
Path 342 | total_timesteps 5402.
number of affinization with epsilon = 3 is 7
average number of affinization = 18.199932341001354
Path 343 | total_timesteps 5410.
number of affinization with epsilon = 3 is 6
average number of affinization = 18.19786910197869
Path 344 | total_timesteps 5418.
number of affinization with epsilon = 3 is 5
average number of affinization = 18.1956374704092
Path 345 | total_timesteps 5426.
number of affinization with epsilon = 3 is 14
average number of affinization = 18.194928148774302
Path 346 | total_timesteps 5441.
number of affinization with epsilon = 3 is 25
average number of affinization = 18.19607843137255
Path 347 | total_timesteps 5468.
number of affinization with epsilon = 3 is 7
average number of affinization = 18.19418624302856
Path 348 | total_timesteps 5478.
number of affinization with epsilon = 3 is 30
average number of affinization = 18.196181142277798
Path 349 | total_timesteps 5510.
number of affinization with epsilon = 3 is 7
average number of affinization = 18.19428957594188
Path 350 | total_timesteps 5519.
number of affinization with epsilon = 3 is 11
average number of affinization = 18.193074324324325
Path 351 | total_timesteps 5532.
number of affinization with epsilon = 3 is 18
average number of affinization = 18.193041715926363
Path 352 | total_timesteps 5555.
number of affinization with epsilon = 3 is 15
average number of affinization = 18.192502532928064
Path 353 | total_timesteps 5573.
number of affinization with epsilon = 3 is 6
average number of affinization = 18.19044403174067
Path 354 | total_timesteps 5582.
number of affinization with epsilon = 3 is 11
average number of affinization = 18.189230249831194
Path 355 | total_timesteps 5594.
number of affinization with epsilon = 3 is 16
average number of affinization = 18.18886075949367
Path 356 | total_timesteps 5614.
number of affinization with epsilon = 3 is 4
average number of affinization = 18.18646641916976
Path 357 | total_timesteps 5622.
number of affinization with epsilon = 3 is 14
average number of affinization = 18.18576008098532
Path 358 | total_timesteps 5638.
number of affinization with epsilon = 3 is 13
average number of affinization = 18.184885290148447
Path 359 | total_timesteps 5657.
number of affinization with epsilon = 3 is 18
average number of affinization = 18.18485410693203
Path 360 | total_timesteps 5678.
number of affinization with epsilon = 3 is 8
average number of affinization = 18.183136593591904
Path 361 | total_timesteps 5687.
number of affinization with epsilon = 3 is 11
average number of affinization = 18.18192547631091
Path 362 | total_timesteps 5701.
number of affinization with epsilon = 3 is 15
average number of affinization = 18.181389076196897
Path 363 | total_timesteps 5718.
number of affinization with epsilon = 3 is 33
average number of affinization = 18.183886735209843
Path 364 | total_timesteps 5758.
number of affinization with epsilon = 3 is 9
average number of affinization = 18.182339063026625
Path 365 | total_timesteps 5768.
number of affinization with epsilon = 3 is 12
average number of affinization = 18.181297388374052
Path 366 | total_timesteps 5782.
number of affinization with epsilon = 3 is 8
average number of affinization = 18.179582210242586
Path 367 | total_timesteps 5793.
number of affinization with epsilon = 3 is 8
average number of affinization = 18.17786760990399
Path 368 | total_timesteps 5803.
number of affinization with epsilon = 3 is 13
average number of affinization = 18.176995621421355
Path 369 | total_timesteps 5818.
number of affinization with epsilon = 3 is 11
average number of affinization = 18.175787169557164
Path 370 | total_timesteps 5831.
number of affinization with epsilon = 3 is 14
average number of affinization = 18.175084175084177
Path 371 | total_timesteps 5846.
number of affinization with epsilon = 3 is 32
average number of affinization = 18.177411210233966
Path 372 | total_timesteps 5883.
number of affinization with epsilon = 3 is 11
average number of affinization = 18.176203298552675
Path 373 | total_timesteps 5897.
number of affinization with epsilon = 3 is 9
average number of affinization = 18.174659262998485
Path 374 | total_timesteps 5908.
number of affinization with epsilon = 3 is 11
average number of affinization = 18.173452220726784
Path 375 | total_timesteps 5921.
number of affinization with epsilon = 3 is 13
average number of affinization = 18.172582001682084
Path 376 | total_timesteps 5935.
number of affinization with epsilon = 3 is 11
average number of affinization = 18.171375714766228
Path 377 | total_timesteps 5950.
number of affinization with epsilon = 3 is 5
average number of affinization = 18.16916092147301
Path 378 | total_timesteps 5956.
number of affinization with epsilon = 3 is 8
average number of affinization = 18.167451244115668
Path 379 | total_timesteps 5966.
number of affinization with epsilon = 3 is 10
average number of affinization = 18.166078332492855
Path 380 | total_timesteps 5977.
number of affinization with epsilon = 3 is 11
average number of affinization = 18.16487394957983
Path 381 | total_timesteps 5990.
number of affinization with epsilon = 3 is 8
average number of affinization = 18.16316585447824
Path 382 | total_timesteps 5999.
number of affinization with epsilon = 3 is 6
average number of affinization = 18.161122311827956
Done generating on-policy rollouts.
Updating normalization.
Done updating normalization.
----------------------------
| AverageReturn | -6.13    |
| Iteration     | 21       |
| MaximumReturn | 6.14     |
| MinimumReturn | -20.2    |
| TotalSamples  | 92240    |
----------------------------
itr #22 | 
Fitting dynamics.
Fitting model 0 (0-based) in the ensemble of 2 models
Validation loss = 0.014966714195907116
Validation loss = 0.014259641990065575
Validation loss = 0.014291160739958286
Validation loss = 0.01435442827641964
Validation loss = 0.014943160116672516
Validation loss = 0.014691382646560669
Fitting model 1 (0-based) in the ensemble of 2 models
Validation loss = 0.014476947486400604
Validation loss = 0.01425749622285366
Validation loss = 0.01437219325453043
Validation loss = 0.014579283073544502
Validation loss = 0.014065749943256378
Validation loss = 0.014212660491466522
Validation loss = 0.014243192970752716
Validation loss = 0.014155549928545952
Validation loss = 0.014347562566399574
Done fitting dynamics.
Updating randomness.
Done updating randomness.
Training policy using TRPO.
Re-initialize init_std.
Obtaining samples for iteration 0...
Obtaining samples for iteration 1...
Obtaining samples for iteration 2...
Obtaining samples for iteration 3...
Obtaining samples for iteration 4...
Obtaining samples for iteration 5...
Obtaining samples for iteration 6...
Obtaining samples for iteration 7...
Obtaining samples for iteration 8...
Obtaining samples for iteration 9...
Obtaining samples for iteration 10...
Obtaining samples for iteration 11...
Obtaining samples for iteration 12...
Obtaining samples for iteration 13...
Obtaining samples for iteration 14...
Obtaining samples for iteration 15...
Obtaining samples for iteration 16...
Obtaining samples for iteration 17...
Obtaining samples for iteration 18...
Obtaining samples for iteration 19...
Done training policy.
Generating on-policy rollouts.
Path 0 | total_timesteps 0.
number of affinization with epsilon = 3 is 14
average number of affinization = 18.160423315975137
Path 1 | total_timesteps 18.
number of affinization with epsilon = 3 is 7
average number of affinization = 18.15854887470608
Path 2 | total_timesteps 29.
number of affinization with epsilon = 3 is 12
average number of affinization = 18.157514693534846
Path 3 | total_timesteps 44.
number of affinization with epsilon = 3 is 15
average number of affinization = 18.15698455339154
Path 4 | total_timesteps 62.
number of affinization with epsilon = 3 is 7
average number of affinization = 18.155111633372503
Path 5 | total_timesteps 70.
number of affinization with epsilon = 3 is 23
average number of affinization = 18.15592480698221
Path 6 | total_timesteps 95.
number of affinization with epsilon = 3 is 15
average number of affinization = 18.155395200537004
Path 7 | total_timesteps 113.
number of affinization with epsilon = 3 is 10
average number of affinization = 18.154026845637585
Path 8 | total_timesteps 124.
number of affinization with epsilon = 3 is 24
average number of affinization = 18.155007549068948
Path 9 | total_timesteps 151.
number of affinization with epsilon = 3 is 8
average number of affinization = 18.15330426031533
Path 10 | total_timesteps 165.
number of affinization with epsilon = 3 is 4
average number of affinization = 18.150930739560625
Path 11 | total_timesteps 172.
number of affinization with epsilon = 3 is 21
average number of affinization = 18.151408450704224
Path 12 | total_timesteps 196.
number of affinization with epsilon = 3 is 7
average number of affinization = 18.14953897736798
Path 13 | total_timesteps 207.
number of affinization with epsilon = 3 is 12
average number of affinization = 18.14850821320818
Path 14 | total_timesteps 221.
number of affinization with epsilon = 3 is 13
average number of affinization = 18.1476453829395
Path 15 | total_timesteps 237.
number of affinization with epsilon = 3 is 11
average number of affinization = 18.146447721179623
Path 16 | total_timesteps 252.
number of affinization with epsilon = 3 is 13
average number of affinization = 18.145585525213605
Path 17 | total_timesteps 266.
number of affinization with epsilon = 3 is 15
average number of affinization = 18.145058626465662
Path 18 | total_timesteps 287.
number of affinization with epsilon = 3 is 12
average number of affinization = 18.144029475799698
Path 19 | total_timesteps 302.
number of affinization with epsilon = 3 is 22
average number of affinization = 18.144675150703282
Path 20 | total_timesteps 327.
number of affinization with epsilon = 3 is 20
average number of affinization = 18.14498576929516
Path 21 | total_timesteps 351.
number of affinization with epsilon = 3 is 10
average number of affinization = 18.143622363575492
Path 22 | total_timesteps 363.
number of affinization with epsilon = 3 is 8
average number of affinization = 18.141924686192468
Path 23 | total_timesteps 374.
number of affinization with epsilon = 3 is 13
average number of affinization = 18.141064257028113
Path 24 | total_timesteps 391.
number of affinization with epsilon = 3 is 11
average number of affinization = 18.13986949974904
Path 25 | total_timesteps 404.
number of affinization with epsilon = 3 is 21
average number of affinization = 18.14034794245567
Path 26 | total_timesteps 432.
number of affinization with epsilon = 3 is 8
average number of affinization = 18.13865194848637
Path 27 | total_timesteps 442.
number of affinization with epsilon = 3 is 23
average number of affinization = 18.139464882943145
Path 28 | total_timesteps 470.
number of affinization with epsilon = 3 is 16
average number of affinization = 18.139107172713594
Path 29 | total_timesteps 487.
number of affinization with epsilon = 3 is 11
average number of affinization = 18.13791374122367
Path 30 | total_timesteps 502.
number of affinization with epsilon = 3 is 9
average number of affinization = 18.13638642821327
Path 31 | total_timesteps 513.
number of affinization with epsilon = 3 is 8
average number of affinization = 18.134692513368982
Path 32 | total_timesteps 523.
number of affinization with epsilon = 3 is 10
average number of affinization = 18.133333333333333
Path 33 | total_timesteps 534.
number of affinization with epsilon = 3 is 9
average number of affinization = 18.13180755095222
Path 34 | total_timesteps 544.
number of affinization with epsilon = 3 is 11
average number of affinization = 18.130616335393352
Path 35 | total_timesteps 558.
number of affinization with epsilon = 3 is 9
average number of affinization = 18.129091516366067
Path 36 | total_timesteps 570.
number of affinization with epsilon = 3 is 22
average number of affinization = 18.129737852730006
Path 37 | total_timesteps 594.
number of affinization with epsilon = 3 is 14
average number of affinization = 18.129048414023373
Path 38 | total_timesteps 610.
number of affinization with epsilon = 3 is 9
average number of affinization = 18.127524620263728
Path 39 | total_timesteps 622.
number of affinization with epsilon = 3 is 10
average number of affinization = 18.126168224299064
Path 40 | total_timesteps 633.
number of affinization with epsilon = 3 is 6
average number of affinization = 18.12414483564158
Path 41 | total_timesteps 643.
number of affinization with epsilon = 3 is 12
average number of affinization = 18.123123123123122
Path 42 | total_timesteps 660.
number of affinization with epsilon = 3 is 6
average number of affinization = 18.121100917431193
Path 43 | total_timesteps 669.
number of affinization with epsilon = 3 is 11
average number of affinization = 18.11991327551701
Path 44 | total_timesteps 683.
number of affinization with epsilon = 3 is 11
average number of affinization = 18.118726029681508
Path 45 | total_timesteps 698.
number of affinization with epsilon = 3 is 9
average number of affinization = 18.117205735245083
Path 46 | total_timesteps 710.
number of affinization with epsilon = 3 is 18
average number of affinization = 18.117186197699617
Path 47 | total_timesteps 732.
number of affinization with epsilon = 3 is 8
average number of affinization = 18.1155
Path 48 | total_timesteps 741.
number of affinization with epsilon = 3 is 4
average number of affinization = 18.11314780869855
Path 49 | total_timesteps 749.
number of affinization with epsilon = 3 is 6
average number of affinization = 18.111129623458847
Path 50 | total_timesteps 758.
number of affinization with epsilon = 3 is 15
average number of affinization = 18.110611360986173
Path 51 | total_timesteps 776.
number of affinization with epsilon = 3 is 7
average number of affinization = 18.108760826115923
Path 52 | total_timesteps 786.
number of affinization with epsilon = 3 is 8
average number of affinization = 18.10707743547044
Path 53 | total_timesteps 797.
number of affinization with epsilon = 3 is 16
average number of affinization = 18.106726606726607
Path 54 | total_timesteps 816.
number of affinization with epsilon = 3 is 22
average number of affinization = 18.10737472948227
Path 55 | total_timesteps 843.
number of affinization with epsilon = 3 is 10
average number of affinization = 18.10602529960053
Path 56 | total_timesteps 859.
number of affinization with epsilon = 3 is 14
average number of affinization = 18.10534198701947
Path 57 | total_timesteps 875.
number of affinization with epsilon = 3 is 14
average number of affinization = 18.104658901830284
Path 58 | total_timesteps 890.
number of affinization with epsilon = 3 is 15
average number of affinization = 18.10414240558975
Path 59 | total_timesteps 911.
number of affinization with epsilon = 3 is 11
average number of affinization = 18.102960745176315
Path 60 | total_timesteps 925.
number of affinization with epsilon = 3 is 9
average number of affinization = 18.10144686512556
Path 61 | total_timesteps 935.
number of affinization with epsilon = 3 is 18
average number of affinization = 18.101429996674426
Path 62 | total_timesteps 956.
number of affinization with epsilon = 3 is 22
average number of affinization = 18.10207813798836
Path 63 | total_timesteps 979.
number of affinization with epsilon = 3 is 9
average number of affinization = 18.10056515957447
Path 64 | total_timesteps 990.
number of affinization with epsilon = 3 is 13
average number of affinization = 18.099717467176333
Path 65 | total_timesteps 1008.
number of affinization with epsilon = 3 is 8
average number of affinization = 18.098039215686274
Path 66 | total_timesteps 1017.
number of affinization with epsilon = 3 is 9
average number of affinization = 18.09652766240239
Path 67 | total_timesteps 1028.
number of affinization with epsilon = 3 is 4
average number of affinization = 18.094186046511627
Path 68 | total_timesteps 1038.
number of affinization with epsilon = 3 is 15
average number of affinization = 18.093672147483808
Path 69 | total_timesteps 1056.
number of affinization with epsilon = 3 is 12
average number of affinization = 18.092660245765526
Path 70 | total_timesteps 1069.
number of affinization with epsilon = 3 is 13
average number of affinization = 18.09181471027727
Path 71 | total_timesteps 1083.
number of affinization with epsilon = 3 is 19
average number of affinization = 18.091965471447544
Path 72 | total_timesteps 1104.
number of affinization with epsilon = 3 is 9
average number of affinization = 18.09045643153527
Path 73 | total_timesteps 1115.
number of affinization with epsilon = 3 is 13
average number of affinization = 18.089611682708263
Path 74 | total_timesteps 1129.
number of affinization with epsilon = 3 is 11
average number of affinization = 18.08843537414966
Path 75 | total_timesteps 1141.
number of affinization with epsilon = 3 is 9
average number of affinization = 18.086927670869276
Path 76 | total_timesteps 1153.
number of affinization with epsilon = 3 is 11
average number of affinization = 18.085752197711063
Path 77 | total_timesteps 1165.
number of affinization with epsilon = 3 is 12
average number of affinization = 18.08474295190713
Path 78 | total_timesteps 1180.
number of affinization with epsilon = 3 is 18
average number of affinization = 18.08472890067982
Path 79 | total_timesteps 1200.
number of affinization with epsilon = 3 is 8
average number of affinization = 18.08305702917772
Path 80 | total_timesteps 1209.
number of affinization with epsilon = 3 is 13
average number of affinization = 18.08221448698823
Path 81 | total_timesteps 1226.
number of affinization with epsilon = 3 is 12
average number of affinization = 18.081206496519723
Path 82 | total_timesteps 1243.
number of affinization with epsilon = 3 is 10
average number of affinization = 18.07986743993372
Path 83 | total_timesteps 1256.
number of affinization with epsilon = 3 is 11
average number of affinization = 18.078694499668654
Path 84 | total_timesteps 1269.
number of affinization with epsilon = 3 is 10
average number of affinization = 18.077356302799405
Path 85 | total_timesteps 1282.
number of affinization with epsilon = 3 is 12
average number of affinization = 18.07634978469692
Path 86 | total_timesteps 1299.
number of affinization with epsilon = 3 is 19
average number of affinization = 18.07650273224044
Path 87 | total_timesteps 1324.
number of affinization with epsilon = 3 is 11
average number of affinization = 18.075331125827816
Path 88 | total_timesteps 1336.
number of affinization with epsilon = 3 is 8
average number of affinization = 18.073663300778016
Path 89 | total_timesteps 1347.
number of affinization with epsilon = 3 is 6
average number of affinization = 18.07166501158557
Path 90 | total_timesteps 1354.
number of affinization with epsilon = 3 is 17
average number of affinization = 18.07148767168625
Path 91 | total_timesteps 1374.
number of affinization with epsilon = 3 is 6
average number of affinization = 18.069490403706155
Path 92 | total_timesteps 1383.
number of affinization with epsilon = 3 is 14
average number of affinization = 18.068817204301077
Path 93 | total_timesteps 1402.
number of affinization with epsilon = 3 is 10
average number of affinization = 18.067482633145882
Path 94 | total_timesteps 1415.
number of affinization with epsilon = 3 is 23
average number of affinization = 18.068298329750288
Path 95 | total_timesteps 1443.
number of affinization with epsilon = 3 is 20
average number of affinization = 18.068617724867725
Path 96 | total_timesteps 1470.
number of affinization with epsilon = 3 is 11
average number of affinization = 18.067449165151263
Path 97 | total_timesteps 1482.
number of affinization with epsilon = 3 is 5
average number of affinization = 18.065289256198348
Path 98 | total_timesteps 1489.
number of affinization with epsilon = 3 is 15
average number of affinization = 18.06478268054867
Path 99 | total_timesteps 1506.
number of affinization with epsilon = 3 is 12
average number of affinization = 18.06378056840714
Path 100 | total_timesteps 1520.
number of affinization with epsilon = 3 is 12
average number of affinization = 18.06277878737816
Path 101 | total_timesteps 1533.
number of affinization with epsilon = 3 is 21
average number of affinization = 18.063263957713907
Path 102 | total_timesteps 1558.
number of affinization with epsilon = 3 is 24
average number of affinization = 18.064244426094138
Path 103 | total_timesteps 1592.
number of affinization with epsilon = 3 is 9
average number of affinization = 18.062747688243064
Path 104 | total_timesteps 1603.
number of affinization with epsilon = 3 is 18
average number of affinization = 18.062737328710583
Path 105 | total_timesteps 1624.
number of affinization with epsilon = 3 is 22
average number of affinization = 18.063387256520304
Path 106 | total_timesteps 1651.
number of affinization with epsilon = 3 is 11
average number of affinization = 18.062221488694505
Path 107 | total_timesteps 1665.
number of affinization with epsilon = 3 is 12
average number of affinization = 18.06122112211221
Path 108 | total_timesteps 1682.
number of affinization with epsilon = 3 is 10
average number of affinization = 18.05989110707804
Path 109 | total_timesteps 1694.
number of affinization with epsilon = 3 is 28
average number of affinization = 18.061530847904983
Path 110 | total_timesteps 1725.
number of affinization with epsilon = 3 is 13
average number of affinization = 18.060696025070097
Path 111 | total_timesteps 1740.
number of affinization with epsilon = 3 is 18
average number of affinization = 18.060686015831134
Path 112 | total_timesteps 1760.
number of affinization with epsilon = 3 is 7
average number of affinization = 18.05886232481451
Path 113 | total_timesteps 1769.
number of affinization with epsilon = 3 is 8
average number of affinization = 18.05720408836136
Path 114 | total_timesteps 1780.
number of affinization with epsilon = 3 is 18
average number of affinization = 18.057194659634085
Path 115 | total_timesteps 1804.
number of affinization with epsilon = 3 is 8
average number of affinization = 18.055537244561634
Path 116 | total_timesteps 1814.
number of affinization with epsilon = 3 is 8
average number of affinization = 18.053880375679682
Path 117 | total_timesteps 1824.
number of affinization with epsilon = 3 is 6
average number of affinization = 18.05189456342669
Path 118 | total_timesteps 1833.
number of affinization with epsilon = 3 is 12
average number of affinization = 18.050897710426618
Path 119 | total_timesteps 1848.
number of affinization with epsilon = 3 is 7
average number of affinization = 18.049077733860344
Path 120 | total_timesteps 1858.
number of affinization with epsilon = 3 is 18
average number of affinization = 18.049069652560515
Path 121 | total_timesteps 1881.
number of affinization with epsilon = 3 is 21
average number of affinization = 18.04955548238393
Path 122 | total_timesteps 1906.
number of affinization with epsilon = 3 is 21
average number of affinization = 18.050041152263375
Path 123 | total_timesteps 1928.
number of affinization with epsilon = 3 is 24
average number of affinization = 18.051020408163264
Path 124 | total_timesteps 1957.
number of affinization with epsilon = 3 is 13
average number of affinization = 18.05018923811091
Path 125 | total_timesteps 1971.
number of affinization with epsilon = 3 is 15
average number of affinization = 18.04968739717012
Path 126 | total_timesteps 1988.
number of affinization with epsilon = 3 is 13
average number of affinization = 18.04885671985524
Path 127 | total_timesteps 2003.
number of affinization with epsilon = 3 is 7
average number of affinization = 18.04703947368421
Path 128 | total_timesteps 2014.
number of affinization with epsilon = 3 is 4
average number of affinization = 18.044729485282026
Path 129 | total_timesteps 2020.
number of affinization with epsilon = 3 is 12
average number of affinization = 18.043735613285104
Path 130 | total_timesteps 2038.
number of affinization with epsilon = 3 is 6
average number of affinization = 18.041755712641788
Path 131 | total_timesteps 2046.
number of affinization with epsilon = 3 is 11
average number of affinization = 18.04059829059829
Path 132 | total_timesteps 2060.
number of affinization with epsilon = 3 is 11
average number of affinization = 18.039441248972885
Path 133 | total_timesteps 2073.
number of affinization with epsilon = 3 is 10
average number of affinization = 18.03812027604338
Path 134 | total_timesteps 2084.
number of affinization with epsilon = 3 is 6
average number of affinization = 18.036142598981435
Path 135 | total_timesteps 2092.
number of affinization with epsilon = 3 is 11
average number of affinization = 18.03498685939553
Path 136 | total_timesteps 2104.
number of affinization with epsilon = 3 is 15
average number of affinization = 18.03448842174413
Path 137 | total_timesteps 2122.
number of affinization with epsilon = 3 is 9
average number of affinization = 18.033004926108376
Path 138 | total_timesteps 2132.
number of affinization with epsilon = 3 is 8
average number of affinization = 18.03135774092924
Path 139 | total_timesteps 2144.
number of affinization with epsilon = 3 is 8
average number of affinization = 18.029711096520025
Path 140 | total_timesteps 2156.
number of affinization with epsilon = 3 is 8
average number of affinization = 18.028064992614475
Path 141 | total_timesteps 2166.
number of affinization with epsilon = 3 is 14
average number of affinization = 18.0274040039383
Path 142 | total_timesteps 2183.
number of affinization with epsilon = 3 is 10
average number of affinization = 18.026086956521738
Path 143 | total_timesteps 2196.
number of affinization with epsilon = 3 is 18
average number of affinization = 18.026082677165356
Path 144 | total_timesteps 2216.
number of affinization with epsilon = 3 is 23
average number of affinization = 18.026898474659667
Path 145 | total_timesteps 2246.
number of affinization with epsilon = 3 is 16
average number of affinization = 18.02656608724172
Path 146 | total_timesteps 2266.
number of affinization with epsilon = 3 is 5
average number of affinization = 18.024430234464667
Path 147 | total_timesteps 2273.
number of affinization with epsilon = 3 is 12
average number of affinization = 18.02344262295082
Path 148 | total_timesteps 2289.
number of affinization with epsilon = 3 is 12
average number of affinization = 18.02245533519095
Path 149 | total_timesteps 2306.
number of affinization with epsilon = 3 is 8
average number of affinization = 18.020812848246475
Path 150 | total_timesteps 2315.
number of affinization with epsilon = 3 is 17
average number of affinization = 18.020645584138947
Path 151 | total_timesteps 2334.
number of affinization with epsilon = 3 is 8
average number of affinization = 18.01900393184797
Path 152 | total_timesteps 2343.
number of affinization with epsilon = 3 is 10
average number of affinization = 18.017690417690417
Path 153 | total_timesteps 2356.
number of affinization with epsilon = 3 is 10
average number of affinization = 18.016377333770063
Path 154 | total_timesteps 2370.
number of affinization with epsilon = 3 is 6
average number of affinization = 18.014409693794008
Path 155 | total_timesteps 2379.
number of affinization with epsilon = 3 is 22
average number of affinization = 18.015062213490506
Path 156 | total_timesteps 2404.
number of affinization with epsilon = 3 is 19
average number of affinization = 18.01522344082501
Path 157 | total_timesteps 2426.
number of affinization with epsilon = 3 is 14
average number of affinization = 18.01456628477905
Path 158 | total_timesteps 2442.
number of affinization with epsilon = 3 is 4
average number of affinization = 18.01227295041728
Path 159 | total_timesteps 2450.
number of affinization with epsilon = 3 is 6
average number of affinization = 18.010307591623036
Path 160 | total_timesteps 2457.
number of affinization with epsilon = 3 is 9
average number of affinization = 18.008833633240634
Path 161 | total_timesteps 2468.
number of affinization with epsilon = 3 is 7
average number of affinization = 18.00703303892705
Path 162 | total_timesteps 2479.
number of affinization with epsilon = 3 is 22
average number of affinization = 18.007686017988554
Path 163 | total_timesteps 2503.
number of affinization with epsilon = 3 is 16
average number of affinization = 18.007357750163507
Path 164 | total_timesteps 2522.
number of affinization with epsilon = 3 is 15
average number of affinization = 18.006866110838647
Path 165 | total_timesteps 2538.
number of affinization with epsilon = 3 is 18
average number of affinization = 18.006864988558352
Path 166 | total_timesteps 2559.
number of affinization with epsilon = 3 is 20
average number of affinization = 18.00719071743749
Path 167 | total_timesteps 2584.
number of affinization with epsilon = 3 is 10
average number of affinization = 18.00588235294118
Path 168 | total_timesteps 2596.
number of affinization with epsilon = 3 is 18
average number of affinization = 18.005881391929424
Path 169 | total_timesteps 2618.
number of affinization with epsilon = 3 is 12
average number of affinization = 18.004900359359688
Path 170 | total_timesteps 2633.
number of affinization with epsilon = 3 is 7
average number of affinization = 18.003103054058467
Path 171 | total_timesteps 2644.
number of affinization with epsilon = 3 is 22
average number of affinization = 18.003755715218812
Path 172 | total_timesteps 2672.
number of affinization with epsilon = 3 is 6
average number of affinization = 18.001795918367346
Path 173 | total_timesteps 2681.
number of affinization with epsilon = 3 is 15
average number of affinization = 18.001305909239306
Path 174 | total_timesteps 2699.
number of affinization with epsilon = 3 is 27
average number of affinization = 18.00277460421087
Path 175 | total_timesteps 2727.
number of affinization with epsilon = 3 is 10
average number of affinization = 18.00146866840731
Path 176 | total_timesteps 2741.
number of affinization with epsilon = 3 is 25
average number of affinization = 18.002610540055475
Path 177 | total_timesteps 2769.
number of affinization with epsilon = 3 is 7
average number of affinization = 18.000815660685156
Path 178 | total_timesteps 2778.
number of affinization with epsilon = 3 is 17
average number of affinization = 18.00065242211711
Path 179 | total_timesteps 2797.
number of affinization with epsilon = 3 is 13
average number of affinization = 17.999836921069797
Path 180 | total_timesteps 2811.
number of affinization with epsilon = 3 is 7
average number of affinization = 17.998043371922385
Path 181 | total_timesteps 2821.
number of affinization with epsilon = 3 is 6
average number of affinization = 17.996087381806326
Path 182 | total_timesteps 2829.
number of affinization with epsilon = 3 is 11
average number of affinization = 17.994947025264874
Path 183 | total_timesteps 2844.
number of affinization with epsilon = 3 is 15
average number of affinization = 17.994458930899608
Path 184 | total_timesteps 2864.
number of affinization with epsilon = 3 is 3
average number of affinization = 17.992015642822224
Path 185 | total_timesteps 2871.
number of affinization with epsilon = 3 is 11
average number of affinization = 17.990876507005538
Path 186 | total_timesteps 2885.
number of affinization with epsilon = 3 is 19
average number of affinization = 17.991040886137807
Path 187 | total_timesteps 2906.
number of affinization with epsilon = 3 is 9
average number of affinization = 17.98957654723127
Path 188 | total_timesteps 2917.
number of affinization with epsilon = 3 is 12
average number of affinization = 17.98860120501547
Path 189 | total_timesteps 2931.
number of affinization with epsilon = 3 is 7
average number of affinization = 17.986812113318138
Path 190 | total_timesteps 2941.
number of affinization with epsilon = 3 is 25
average number of affinization = 17.987953768517013
Path 191 | total_timesteps 2969.
number of affinization with epsilon = 3 is 9
average number of affinization = 17.986490885416668
Path 192 | total_timesteps 2982.
number of affinization with epsilon = 3 is 12
average number of affinization = 17.98551668022783
Path 193 | total_timesteps 2995.
number of affinization with epsilon = 3 is 9
average number of affinization = 17.984054669703873
Path 194 | total_timesteps 3005.
number of affinization with epsilon = 3 is 13
average number of affinization = 17.983243858792907
Path 195 | total_timesteps 3020.
number of affinization with epsilon = 3 is 9
average number of affinization = 17.98178269355888
Path 196 | total_timesteps 3035.
number of affinization with epsilon = 3 is 4
average number of affinization = 17.979508863229793
Path 197 | total_timesteps 3042.
number of affinization with epsilon = 3 is 9
average number of affinization = 17.978048780487804
Path 198 | total_timesteps 3052.
number of affinization with epsilon = 3 is 15
average number of affinization = 17.977564623638433
Path 199 | total_timesteps 3069.
number of affinization with epsilon = 3 is 12
average number of affinization = 17.976592977893368
Path 200 | total_timesteps 3083.
number of affinization with epsilon = 3 is 7
average number of affinization = 17.974809036242483
Path 201 | total_timesteps 3091.
number of affinization with epsilon = 3 is 24
average number of affinization = 17.97578810529737
Path 202 | total_timesteps 3116.
number of affinization with epsilon = 3 is 8
average number of affinization = 17.97416734362307
Path 203 | total_timesteps 3126.
number of affinization with epsilon = 3 is 7
average number of affinization = 17.972384665367123
Path 204 | total_timesteps 3134.
number of affinization with epsilon = 3 is 10
average number of affinization = 17.97108981646906
Path 205 | total_timesteps 3145.
number of affinization with epsilon = 3 is 8
average number of affinization = 17.969470607340046
Path 206 | total_timesteps 3154.
number of affinization with epsilon = 3 is 5
average number of affinization = 17.96736483195324
Path 207 | total_timesteps 3160.
number of affinization with epsilon = 3 is 8
average number of affinization = 17.965746753246755
Path 208 | total_timesteps 3171.
number of affinization with epsilon = 3 is 11
average number of affinization = 17.96461613374452
Path 209 | total_timesteps 3186.
number of affinization with epsilon = 3 is 8
average number of affinization = 17.962999026290166
Path 210 | total_timesteps 3198.
number of affinization with epsilon = 3 is 11
average number of affinization = 17.96186921953594
Path 211 | total_timesteps 3210.
number of affinization with epsilon = 3 is 10
average number of affinization = 17.96057754704737
Path 212 | total_timesteps 3224.
number of affinization with epsilon = 3 is 14
average number of affinization = 17.95993511759935
Path 213 | total_timesteps 3241.
number of affinization with epsilon = 3 is 15
average number of affinization = 17.959455076224458
Path 214 | total_timesteps 3258.
number of affinization with epsilon = 3 is 8
average number of affinization = 17.957840116750447
Path 215 | total_timesteps 3270.
number of affinization with epsilon = 3 is 11
average number of affinization = 17.95671206225681
Path 216 | total_timesteps 3283.
number of affinization with epsilon = 3 is 7
average number of affinization = 17.954935970173448
Path 217 | total_timesteps 3293.
number of affinization with epsilon = 3 is 19
average number of affinization = 17.955105348460293
Path 218 | total_timesteps 3314.
number of affinization with epsilon = 3 is 6
average number of affinization = 17.953168044077135
Path 219 | total_timesteps 3321.
number of affinization with epsilon = 3 is 19
average number of affinization = 17.953337653920933
Path 220 | total_timesteps 3346.
number of affinization with epsilon = 3 is 9
average number of affinization = 17.951887250931478
Path 221 | total_timesteps 3358.
number of affinization with epsilon = 3 is 15
average number of affinization = 17.951409135082603
Path 222 | total_timesteps 3377.
number of affinization with epsilon = 3 is 10
average number of affinization = 17.950121457489878
Path 223 | total_timesteps 3388.
number of affinization with epsilon = 3 is 16
average number of affinization = 17.949805699481864
Path 224 | total_timesteps 3407.
number of affinization with epsilon = 3 is 13
average number of affinization = 17.94900437105391
Path 225 | total_timesteps 3421.
number of affinization with epsilon = 3 is 16
average number of affinization = 17.948688896082874
Path 226 | total_timesteps 3439.
number of affinization with epsilon = 3 is 15
average number of affinization = 17.94821168473863
Path 227 | total_timesteps 3460.
number of affinization with epsilon = 3 is 16
average number of affinization = 17.94789644012945
Path 228 | total_timesteps 3479.
number of affinization with epsilon = 3 is 7
average number of affinization = 17.946125222455912
Path 229 | total_timesteps 3488.
number of affinization with epsilon = 3 is 34
average number of affinization = 17.94872209640893
Path 230 | total_timesteps 3526.
number of affinization with epsilon = 3 is 20
average number of affinization = 17.9490538573508
Path 231 | total_timesteps 3550.
number of affinization with epsilon = 3 is 19
average number of affinization = 17.94922380336352
Path 232 | total_timesteps 3571.
number of affinization with epsilon = 3 is 11
average number of affinization = 17.94810024252223
Path 233 | total_timesteps 3584.
number of affinization with epsilon = 3 is 4
average number of affinization = 17.945845457484644
Path 234 | total_timesteps 3591.
number of affinization with epsilon = 3 is 20
average number of affinization = 17.946177468886376
Path 235 | total_timesteps 3613.
number of affinization with epsilon = 3 is 13
average number of affinization = 17.945378151260503
Path 236 | total_timesteps 3628.
number of affinization with epsilon = 3 is 10
average number of affinization = 17.944094360963
Path 237 | total_timesteps 3639.
number of affinization with epsilon = 3 is 9
average number of affinization = 17.94264943457189
Path 238 | total_timesteps 3651.
number of affinization with epsilon = 3 is 10
average number of affinization = 17.941366499757713
Path 239 | total_timesteps 3663.
number of affinization with epsilon = 3 is 7
average number of affinization = 17.939599483204134
Path 240 | total_timesteps 3671.
number of affinization with epsilon = 3 is 15
average number of affinization = 17.93912481834329
Path 241 | total_timesteps 3690.
number of affinization with epsilon = 3 is 15
average number of affinization = 17.938650306748468
Path 242 | total_timesteps 3708.
number of affinization with epsilon = 3 is 22
average number of affinization = 17.939305891848264
Path 243 | total_timesteps 3734.
number of affinization with epsilon = 3 is 12
average number of affinization = 17.938347320852163
Path 244 | total_timesteps 3748.
number of affinization with epsilon = 3 is 20
average number of affinization = 17.938680006454735
Path 245 | total_timesteps 3771.
number of affinization with epsilon = 3 is 9
average number of affinization = 17.937237818651177
Path 246 | total_timesteps 3783.
number of affinization with epsilon = 3 is 26
average number of affinization = 17.93853847394741
Path 247 | total_timesteps 3817.
number of affinization with epsilon = 3 is 27
average number of affinization = 17.94
Path 248 | total_timesteps 3847.
number of affinization with epsilon = 3 is 8
average number of affinization = 17.938397032736656
Path 249 | total_timesteps 3856.
number of affinization with epsilon = 3 is 6
average number of affinization = 17.93647210577233
Path 250 | total_timesteps 3865.
number of affinization with epsilon = 3 is 21
average number of affinization = 17.936965984201194
Path 251 | total_timesteps 3889.
number of affinization with epsilon = 3 is 9
average number of affinization = 17.93552546744036
Path 252 | total_timesteps 3904.
number of affinization with epsilon = 3 is 11
average number of affinization = 17.934407735697018
Path 253 | total_timesteps 3916.
number of affinization with epsilon = 3 is 10
average number of affinization = 17.933129229777634
Path 254 | total_timesteps 3927.
number of affinization with epsilon = 3 is 11
average number of affinization = 17.932012244240372
Path 255 | total_timesteps 3943.
number of affinization with epsilon = 3 is 7
average number of affinization = 17.930251288659793
Path 256 | total_timesteps 3952.
number of affinization with epsilon = 3 is 13
average number of affinization = 17.92945723949106
Path 257 | total_timesteps 3967.
number of affinization with epsilon = 3 is 9
average number of affinization = 17.9280193236715
Path 258 | total_timesteps 3978.
number of affinization with epsilon = 3 is 15
average number of affinization = 17.927547898889067
Path 259 | total_timesteps 3996.
number of affinization with epsilon = 3 is 15
average number of affinization = 17.927076625885384
Path 260 | total_timesteps 4015.
number of affinization with epsilon = 3 is 22
average number of affinization = 17.92773217447288
Path 261 | total_timesteps 4042.
number of affinization with epsilon = 3 is 12
average number of affinization = 17.926778242677823
Path 262 | total_timesteps 4057.
number of affinization with epsilon = 3 is 14
average number of affinization = 17.92614641995173
Path 263 | total_timesteps 4072.
number of affinization with epsilon = 3 is 21
average number of affinization = 17.92664092664093
Path 264 | total_timesteps 4098.
number of affinization with epsilon = 3 is 8
average number of affinization = 17.925044233553162
Path 265 | total_timesteps 4108.
number of affinization with epsilon = 3 is 13
average number of affinization = 17.924252171116116
Path 266 | total_timesteps 4123.
number of affinization with epsilon = 3 is 6
average number of affinization = 17.922334780511335
Path 267 | total_timesteps 4130.
number of affinization with epsilon = 3 is 8
average number of affinization = 17.92073954983923
Path 268 | total_timesteps 4139.
number of affinization with epsilon = 3 is 10
average number of affinization = 17.919466323742164
Path 269 | total_timesteps 4151.
number of affinization with epsilon = 3 is 8
average number of affinization = 17.91787206685953
Path 270 | total_timesteps 4161.
number of affinization with epsilon = 3 is 9
average number of affinization = 17.916439016551504
Path 271 | total_timesteps 4171.
number of affinization with epsilon = 3 is 11
average number of affinization = 17.915327763496144
Path 272 | total_timesteps 4184.
number of affinization with epsilon = 3 is 10
average number of affinization = 17.9140562248996
Path 273 | total_timesteps 4196.
number of affinization with epsilon = 3 is 10
average number of affinization = 17.912785094763894
Path 274 | total_timesteps 4208.
number of affinization with epsilon = 3 is 8
average number of affinization = 17.91119319094267
Path 275 | total_timesteps 4219.
number of affinization with epsilon = 3 is 11
average number of affinization = 17.910083493898522
Path 276 | total_timesteps 4234.
number of affinization with epsilon = 3 is 13
average number of affinization = 17.909295231979453
Path 277 | total_timesteps 4251.
number of affinization with epsilon = 3 is 12
average number of affinization = 17.908346709470305
Path 278 | total_timesteps 4264.
number of affinization with epsilon = 3 is 14
average number of affinization = 17.90771946718023
Path 279 | total_timesteps 4280.
number of affinization with epsilon = 3 is 18
average number of affinization = 17.907734274711167
Path 280 | total_timesteps 4301.
number of affinization with epsilon = 3 is 11
average number of affinization = 17.906626022781968
Path 281 | total_timesteps 4320.
number of affinization with epsilon = 3 is 19
average number of affinization = 17.90680141161373
Path 282 | total_timesteps 4342.
number of affinization with epsilon = 3 is 9
average number of affinization = 17.905372894947874
Path 283 | total_timesteps 4354.
number of affinization with epsilon = 3 is 9
average number of affinization = 17.90394483643361
Path 284 | total_timesteps 4368.
number of affinization with epsilon = 3 is 7
average number of affinization = 17.902196568863236
Path 285 | total_timesteps 4377.
number of affinization with epsilon = 3 is 15
average number of affinization = 17.901731324142354
Path 286 | total_timesteps 4395.
number of affinization with epsilon = 3 is 11
average number of affinization = 17.90062510017631
Path 287 | total_timesteps 4408.
number of affinization with epsilon = 3 is 12
average number of affinization = 17.899679487179487
Path 288 | total_timesteps 4421.
number of affinization with epsilon = 3 is 13
average number of affinization = 17.898894407947445
Path 289 | total_timesteps 4439.
number of affinization with epsilon = 3 is 18
average number of affinization = 17.898910605575136
Path 290 | total_timesteps 4459.
number of affinization with epsilon = 3 is 10
average number of affinization = 17.897645362806344
Path 291 | total_timesteps 4475.
number of affinization with epsilon = 3 is 17
average number of affinization = 17.897501601537478
Path 292 | total_timesteps 4496.
number of affinization with epsilon = 3 is 8
average number of affinization = 17.89591673338671
Path 293 | total_timesteps 4506.
number of affinization with epsilon = 3 is 8
average number of affinization = 17.89433237271854
Path 294 | total_timesteps 4517.
number of affinization with epsilon = 3 is 10
average number of affinization = 17.89306867296302
Path 295 | total_timesteps 4530.
number of affinization with epsilon = 3 is 9
average number of affinization = 17.89164532650448
Path 296 | total_timesteps 4540.
number of affinization with epsilon = 3 is 8
average number of affinization = 17.890062409985596
Path 297 | total_timesteps 4550.
number of affinization with epsilon = 3 is 13
average number of affinization = 17.88928
Path 298 | total_timesteps 4570.
number of affinization with epsilon = 3 is 11
average number of affinization = 17.888177891537353
Path 299 | total_timesteps 4588.
number of affinization with epsilon = 3 is 13
average number of affinization = 17.887396033269354
Path 300 | total_timesteps 4603.
number of affinization with epsilon = 3 is 10
average number of affinization = 17.886134655365424
Path 301 | total_timesteps 4616.
number of affinization with epsilon = 3 is 15
average number of affinization = 17.88567316917173
Path 302 | total_timesteps 4632.
number of affinization with epsilon = 3 is 13
average number of affinization = 17.884892086330936
Path 303 | total_timesteps 4646.
number of affinization with epsilon = 3 is 12
average number of affinization = 17.883951406649615
Path 304 | total_timesteps 4659.
number of affinization with epsilon = 3 is 9
average number of affinization = 17.882531564647596
Path 305 | total_timesteps 4669.
number of affinization with epsilon = 3 is 8
average number of affinization = 17.88095238095238
Path 306 | total_timesteps 4678.
number of affinization with epsilon = 3 is 7
average number of affinization = 17.879213931938008
Path 307 | total_timesteps 4686.
number of affinization with epsilon = 3 is 7
average number of affinization = 17.877476038338656
Path 308 | total_timesteps 4695.
number of affinization with epsilon = 3 is 12
average number of affinization = 17.876537294361924
Path 309 | total_timesteps 4708.
number of affinization with epsilon = 3 is 16
average number of affinization = 17.876237623762375
Path 310 | total_timesteps 4726.
number of affinization with epsilon = 3 is 18
average number of affinization = 17.87625738463995
Path 311 | total_timesteps 4750.
number of affinization with epsilon = 3 is 12
average number of affinization = 17.875319284802043
Path 312 | total_timesteps 4763.
number of affinization with epsilon = 3 is 16
average number of affinization = 17.875019952114926
Path 313 | total_timesteps 4784.
number of affinization with epsilon = 3 is 15
average number of affinization = 17.87456112352378
Path 314 | total_timesteps 4800.
number of affinization with epsilon = 3 is 11
average number of affinization = 17.87346417743737
Path 315 | total_timesteps 4814.
number of affinization with epsilon = 3 is 6
average number of affinization = 17.871569878749202
Path 316 | total_timesteps 4825.
number of affinization with epsilon = 3 is 8
average number of affinization = 17.869995214547775
Path 317 | total_timesteps 4834.
number of affinization with epsilon = 3 is 6
average number of affinization = 17.868102073365232
Path 318 | total_timesteps 4843.
number of affinization with epsilon = 3 is 17
average number of affinization = 17.867963642162334
Path 319 | total_timesteps 4865.
number of affinization with epsilon = 3 is 7
average number of affinization = 17.86623086734694
Path 320 | total_timesteps 4876.
number of affinization with epsilon = 3 is 17
average number of affinization = 17.866092778574846
Path 321 | total_timesteps 4896.
number of affinization with epsilon = 3 is 11
average number of affinization = 17.8649984061205
Path 322 | total_timesteps 4911.
number of affinization with epsilon = 3 is 12
average number of affinization = 17.86406374501992
Path 323 | total_timesteps 4926.
number of affinization with epsilon = 3 is 4
average number of affinization = 17.86185468451243
Path 324 | total_timesteps 4934.
number of affinization with epsilon = 3 is 19
average number of affinization = 17.86203600446073
Path 325 | total_timesteps 4958.
number of affinization with epsilon = 3 is 8
average number of affinization = 17.86046511627907
Path 326 | total_timesteps 4967.
number of affinization with epsilon = 3 is 26
average number of affinization = 17.86176142697882
Path 327 | total_timesteps 4998.
number of affinization with epsilon = 3 is 7
average number of affinization = 17.860031847133758
Path 328 | total_timesteps 5008.
number of affinization with epsilon = 3 is 25
average number of affinization = 17.86116860372552
Path 329 | total_timesteps 5038.
number of affinization with epsilon = 3 is 10
average number of affinization = 17.859917223814072
Path 330 | total_timesteps 5049.
number of affinization with epsilon = 3 is 8
average number of affinization = 17.858347922966736
Path 331 | total_timesteps 5060.
number of affinization with epsilon = 3 is 13
average number of affinization = 17.857574793125398
Path 332 | total_timesteps 5078.
number of affinization with epsilon = 3 is 10
average number of affinization = 17.856324582338903
Path 333 | total_timesteps 5091.
number of affinization with epsilon = 3 is 11
average number of affinization = 17.85523385300668
Path 334 | total_timesteps 5107.
number of affinization with epsilon = 3 is 12
average number of affinization = 17.854302529028153
Path 335 | total_timesteps 5121.
number of affinization with epsilon = 3 is 10
average number of affinization = 17.853053435114504
Path 336 | total_timesteps 5135.
number of affinization with epsilon = 3 is 16
average number of affinization = 17.852758785180473
Path 337 | total_timesteps 5153.
number of affinization with epsilon = 3 is 11
average number of affinization = 17.851669316375197
Path 338 | total_timesteps 5166.
number of affinization with epsilon = 3 is 8
average number of affinization = 17.850103322206326
Path 339 | total_timesteps 5178.
number of affinization with epsilon = 3 is 18
average number of affinization = 17.85012714558169
Path 340 | total_timesteps 5201.
number of affinization with epsilon = 3 is 11
average number of affinization = 17.849038614333388
Path 341 | total_timesteps 5215.
number of affinization with epsilon = 3 is 14
average number of affinization = 17.84842707340324
Path 342 | total_timesteps 5232.
number of affinization with epsilon = 3 is 20
average number of affinization = 17.84876886417792
Path 343 | total_timesteps 5255.
number of affinization with epsilon = 3 is 11
average number of affinization = 17.847681067344347
Path 344 | total_timesteps 5267.
number of affinization with epsilon = 3 is 15
average number of affinization = 17.847228839129745
Path 345 | total_timesteps 5285.
number of affinization with epsilon = 3 is 13
average number of affinization = 17.84645919339473
Path 346 | total_timesteps 5299.
number of affinization with epsilon = 3 is 8
average number of affinization = 17.844896015240515
Path 347 | total_timesteps 5308.
number of affinization with epsilon = 3 is 26
average number of affinization = 17.846190476190475
Path 348 | total_timesteps 5336.
number of affinization with epsilon = 3 is 15
average number of affinization = 17.84573877162355
Path 349 | total_timesteps 5352.
number of affinization with epsilon = 3 is 9
average number of affinization = 17.84433513170422
Path 350 | total_timesteps 5362.
number of affinization with epsilon = 3 is 17
average number of affinization = 17.844201174044105
Path 351 | total_timesteps 5383.
number of affinization with epsilon = 3 is 16
average number of affinization = 17.843908629441625
Path 352 | total_timesteps 5402.
number of affinization with epsilon = 3 is 10
average number of affinization = 17.842664551942903
Path 353 | total_timesteps 5419.
number of affinization with epsilon = 3 is 14
average number of affinization = 17.842055185537582
Path 354 | total_timesteps 5436.
number of affinization with epsilon = 3 is 11
average number of affinization = 17.840970350404312
Path 355 | total_timesteps 5450.
number of affinization with epsilon = 3 is 14
average number of affinization = 17.84036144578313
Path 356 | total_timesteps 5466.
number of affinization with epsilon = 3 is 17
average number of affinization = 17.840228245363765
Path 357 | total_timesteps 5485.
number of affinization with epsilon = 3 is 8
average number of affinization = 17.838668779714737
Path 358 | total_timesteps 5495.
number of affinization with epsilon = 3 is 17
average number of affinization = 17.83853588971637
Path 359 | total_timesteps 5517.
number of affinization with epsilon = 3 is 10
average number of affinization = 17.837294043092523
Path 360 | total_timesteps 5529.
number of affinization with epsilon = 3 is 19
average number of affinization = 17.837478219546966
Path 361 | total_timesteps 5550.
number of affinization with epsilon = 3 is 12
average number of affinization = 17.836553690212227
Path 362 | total_timesteps 5565.
number of affinization with epsilon = 3 is 23
average number of affinization = 17.837371338083926
Path 363 | total_timesteps 5592.
number of affinization with epsilon = 3 is 8
average number of affinization = 17.83581380620646
Path 364 | total_timesteps 5604.
number of affinization with epsilon = 3 is 12
average number of affinization = 17.834889979420613
Path 365 | total_timesteps 5619.
number of affinization with epsilon = 3 is 13
average number of affinization = 17.834124723013613
Path 366 | total_timesteps 5635.
number of affinization with epsilon = 3 is 13
average number of affinization = 17.833359708814687
Path 367 | total_timesteps 5651.
number of affinization with epsilon = 3 is 8
average number of affinization = 17.831803797468353
Path 368 | total_timesteps 5661.
number of affinization with epsilon = 3 is 13
average number of affinization = 17.831039392501186
Path 369 | total_timesteps 5681.
number of affinization with epsilon = 3 is 15
average number of affinization = 17.830591584941473
Path 370 | total_timesteps 5699.
number of affinization with epsilon = 3 is 15
average number of affinization = 17.83014391902578
Path 371 | total_timesteps 5715.
number of affinization with epsilon = 3 is 13
average number of affinization = 17.829380139152434
Path 372 | total_timesteps 5731.
number of affinization with epsilon = 3 is 28
average number of affinization = 17.83098814229249
Path 373 | total_timesteps 5763.
number of affinization with epsilon = 3 is 7
average number of affinization = 17.829276003793865
Path 374 | total_timesteps 5773.
number of affinization with epsilon = 3 is 7
average number of affinization = 17.827564406511776
Path 375 | total_timesteps 5783.
number of affinization with epsilon = 3 is 6
average number of affinization = 17.82569532237674
Path 376 | total_timesteps 5792.
number of affinization with epsilon = 3 is 15
average number of affinization = 17.82524885447938
Path 377 | total_timesteps 5808.
number of affinization with epsilon = 3 is 15
average number of affinization = 17.82480252764613
Path 378 | total_timesteps 5826.
number of affinization with epsilon = 3 is 14
average number of affinization = 17.824198388880113
Path 379 | total_timesteps 5842.
number of affinization with epsilon = 3 is 8
average number of affinization = 17.8226468730259
Path 380 | total_timesteps 5852.
number of affinization with epsilon = 3 is 12
average number of affinization = 17.821727459339964
Path 381 | total_timesteps 5867.
number of affinization with epsilon = 3 is 10
average number of affinization = 17.820492579728448
Path 382 | total_timesteps 5879.
number of affinization with epsilon = 3 is 12
average number of affinization = 17.819573796369376
Path 383 | total_timesteps 5892.
number of affinization with epsilon = 3 is 9
average number of affinization = 17.818181818181817
Path 384 | total_timesteps 5902.
number of affinization with epsilon = 3 is 13
average number of affinization = 17.817421492819946
Path 385 | total_timesteps 5921.
number of affinization with epsilon = 3 is 9
average number of affinization = 17.81603029346797
Path 386 | total_timesteps 5932.
number of affinization with epsilon = 3 is 20
average number of affinization = 17.816374822527212
Path 387 | total_timesteps 5955.
number of affinization with epsilon = 3 is 25
average number of affinization = 17.81750788643533
Path 388 | total_timesteps 5984.
number of affinization with epsilon = 3 is 18
average number of affinization = 17.817536666140988
Done generating on-policy rollouts.
Updating normalization.
Done updating normalization.
----------------------------
| AverageReturn | -6.19    |
| Iteration     | 22       |
| MaximumReturn | 11.8     |
| MinimumReturn | -20.6    |
| TotalSamples  | 96245    |
----------------------------
itr #23 | 
Fitting dynamics.
Fitting model 0 (0-based) in the ensemble of 2 models
Validation loss = 0.01414449792355299
Validation loss = 0.01420475821942091
Validation loss = 0.014151271432638168
Validation loss = 0.014205309562385082
Validation loss = 0.014045794494450092
Validation loss = 0.014142599888145924
Validation loss = 0.014383834786713123
Validation loss = 0.014231505803763866
Validation loss = 0.014230877161026001
Fitting model 1 (0-based) in the ensemble of 2 models
Validation loss = 0.014529933221638203
Validation loss = 0.0141456825658679
Validation loss = 0.013830591924488544
Validation loss = 0.014659687876701355
Validation loss = 0.014344560913741589
Validation loss = 0.014376376755535603
Validation loss = 0.013859313912689686
Done fitting dynamics.
Updating randomness.
Done updating randomness.
Training policy using TRPO.
Re-initialize init_std.
Obtaining samples for iteration 0...
Obtaining samples for iteration 1...
Obtaining samples for iteration 2...
Obtaining samples for iteration 3...
Obtaining samples for iteration 4...
Obtaining samples for iteration 5...
Obtaining samples for iteration 6...
Obtaining samples for iteration 7...
Obtaining samples for iteration 8...
Obtaining samples for iteration 9...
Obtaining samples for iteration 10...
Obtaining samples for iteration 11...
Obtaining samples for iteration 12...
Obtaining samples for iteration 13...
Obtaining samples for iteration 14...
Obtaining samples for iteration 15...
Obtaining samples for iteration 16...
Obtaining samples for iteration 17...
Obtaining samples for iteration 18...
Obtaining samples for iteration 19...
Done training policy.
Generating on-policy rollouts.
Path 0 | total_timesteps 0.
number of affinization with epsilon = 3 is 8
average number of affinization = 17.815988647114477
Path 1 | total_timesteps 11.
number of affinization with epsilon = 3 is 12
average number of affinization = 17.815071732618634
Path 2 | total_timesteps 25.
number of affinization with epsilon = 3 is 6
average number of affinization = 17.813209331651954
Path 3 | total_timesteps 33.
number of affinization with epsilon = 3 is 7
average number of affinization = 17.81150512214342
Path 4 | total_timesteps 43.
number of affinization with epsilon = 3 is 13
average number of affinization = 17.810746927198235
Path 5 | total_timesteps 62.
number of affinization with epsilon = 3 is 12
average number of affinization = 17.809831416417204
Path 6 | total_timesteps 79.
number of affinization with epsilon = 3 is 10
average number of affinization = 17.8086011342155
Path 7 | total_timesteps 92.
number of affinization with epsilon = 3 is 10
average number of affinization = 17.807371239565285
Path 8 | total_timesteps 104.
number of affinization with epsilon = 3 is 10
average number of affinization = 17.806141732283464
Path 9 | total_timesteps 115.
number of affinization with epsilon = 3 is 11
average number of affinization = 17.805070067705874
Path 10 | total_timesteps 127.
number of affinization with epsilon = 3 is 8
average number of affinization = 17.80352644836272
Path 11 | total_timesteps 140.
number of affinization with epsilon = 3 is 9
average number of affinization = 17.80214072091925
Path 12 | total_timesteps 151.
number of affinization with epsilon = 3 is 11
average number of affinization = 17.801070192005035
Path 13 | total_timesteps 165.
number of affinization with epsilon = 3 is 13
average number of affinization = 17.800314712824548
Path 14 | total_timesteps 180.
number of affinization with epsilon = 3 is 13
average number of affinization = 17.79955947136564
Path 15 | total_timesteps 194.
number of affinization with epsilon = 3 is 25
average number of affinization = 17.8006921503854
Path 16 | total_timesteps 226.
number of affinization with epsilon = 3 is 22
average number of affinization = 17.801352626612143
Path 17 | total_timesteps 252.
number of affinization with epsilon = 3 is 6
average number of affinization = 17.799496776222675
Path 18 | total_timesteps 260.
number of affinization with epsilon = 3 is 13
average number of affinization = 17.79874213836478
Path 19 | total_timesteps 274.
number of affinization with epsilon = 3 is 8
average number of affinization = 17.79720169784625
Path 20 | total_timesteps 286.
number of affinization with epsilon = 3 is 12
average number of affinization = 17.796290474693492
Path 21 | total_timesteps 301.
number of affinization with epsilon = 3 is 7
average number of affinization = 17.794593745088793
Path 22 | total_timesteps 310.
number of affinization with epsilon = 3 is 22
average number of affinization = 17.795254556882465
Path 23 | total_timesteps 338.
number of affinization with epsilon = 3 is 14
average number of affinization = 17.79465828750982
Path 24 | total_timesteps 354.
number of affinization with epsilon = 3 is 10
average number of affinization = 17.79343386742067
Path 25 | total_timesteps 368.
number of affinization with epsilon = 3 is 18
average number of affinization = 17.793466310664364
Path 26 | total_timesteps 388.
number of affinization with epsilon = 3 is 7
average number of affinization = 17.79177135678392
Path 27 | total_timesteps 396.
number of affinization with epsilon = 3 is 11
average number of affinization = 17.790704977233474
Path 28 | total_timesteps 414.
number of affinization with epsilon = 3 is 20
average number of affinization = 17.79105180533752
Path 29 | total_timesteps 436.
number of affinization with epsilon = 3 is 6
average number of affinization = 17.789201067336368
Path 30 | total_timesteps 445.
number of affinization with epsilon = 3 is 23
average number of affinization = 17.790018832391713
Path 31 | total_timesteps 473.
number of affinization with epsilon = 3 is 12
average number of affinization = 17.789110309116584
Path 32 | total_timesteps 487.
number of affinization with epsilon = 3 is 20
average number of affinization = 17.78945716975212
Path 33 | total_timesteps 513.
number of affinization with epsilon = 3 is 8
average number of affinization = 17.78792156862745
Path 34 | total_timesteps 522.
number of affinization with epsilon = 3 is 27
average number of affinization = 17.789366373902133
Path 35 | total_timesteps 551.
number of affinization with epsilon = 3 is 8
average number of affinization = 17.78783126862161
Path 36 | total_timesteps 561.
number of affinization with epsilon = 3 is 11
average number of affinization = 17.786767011602382
Path 37 | total_timesteps 580.
number of affinization with epsilon = 3 is 7
average number of affinization = 17.78507603072582
Path 38 | total_timesteps 590.
number of affinization with epsilon = 3 is 15
average number of affinization = 17.7846394984326
Path 39 | total_timesteps 608.
number of affinization with epsilon = 3 is 21
average number of affinization = 17.78514339445228
Path 40 | total_timesteps 632.
number of affinization with epsilon = 3 is 20
average number of affinization = 17.785490441867754
Path 41 | total_timesteps 656.
number of affinization with epsilon = 3 is 19
average number of affinization = 17.785680714397618
Path 42 | total_timesteps 681.
number of affinization with epsilon = 3 is 10
average number of affinization = 17.784461152882205
Path 43 | total_timesteps 692.
number of affinization with epsilon = 3 is 8
average number of affinization = 17.782928739232577
Path 44 | total_timesteps 701.
number of affinization with epsilon = 3 is 13
average number of affinization = 17.782179768243033
Path 45 | total_timesteps 718.
number of affinization with epsilon = 3 is 6
average number of affinization = 17.78033505558165
Path 46 | total_timesteps 725.
number of affinization with epsilon = 3 is 7
average number of affinization = 17.77864746399499
Path 47 | total_timesteps 735.
number of affinization with epsilon = 3 is 18
average number of affinization = 17.77868210987635
Path 48 | total_timesteps 755.
number of affinization with epsilon = 3 is 10
average number of affinization = 17.777464788732395
Path 49 | total_timesteps 766.
number of affinization with epsilon = 3 is 6
average number of affinization = 17.775621968393054
Path 50 | total_timesteps 774.
number of affinization with epsilon = 3 is 9
average number of affinization = 17.774249061326657
Path 51 | total_timesteps 785.
number of affinization with epsilon = 3 is 15
average number of affinization = 17.773815110276864
Path 52 | total_timesteps 803.
number of affinization with epsilon = 3 is 8
average number of affinization = 17.7722865186112
Path 53 | total_timesteps 813.
number of affinization with epsilon = 3 is 8
average number of affinization = 17.77075840500391
Path 54 | total_timesteps 825.
number of affinization with epsilon = 3 is 19
average number of affinization = 17.770950594121327
Path 55 | total_timesteps 846.
number of affinization with epsilon = 3 is 21
average number of affinization = 17.771455369704547
Path 56 | total_timesteps 873.
number of affinization with epsilon = 3 is 15
average number of affinization = 17.771022194435762
Path 57 | total_timesteps 892.
number of affinization with epsilon = 3 is 11
average number of affinization = 17.76996405688389
Path 58 | total_timesteps 906.
number of affinization with epsilon = 3 is 7
average number of affinization = 17.76828125
Path 59 | total_timesteps 916.
number of affinization with epsilon = 3 is 12
average number of affinization = 17.767380096859867
Path 60 | total_timesteps 933.
number of affinization with epsilon = 3 is 19
average number of affinization = 17.767572633552014
Path 61 | total_timesteps 957.
number of affinization with epsilon = 3 is 19
average number of affinization = 17.767765110104637
Path 62 | total_timesteps 981.
number of affinization with epsilon = 3 is 14
average number of affinization = 17.767176764522173
Path 63 | total_timesteps 997.
number of affinization with epsilon = 3 is 8
average number of affinization = 17.765651834504293
Path 64 | total_timesteps 1008.
number of affinization with epsilon = 3 is 18
average number of affinization = 17.76568841710896
Path 65 | total_timesteps 1032.
number of affinization with epsilon = 3 is 12
average number of affinization = 17.764788512564383
Path 66 | total_timesteps 1045.
number of affinization with epsilon = 3 is 7
average number of affinization = 17.76310861423221
Path 67 | total_timesteps 1054.
number of affinization with epsilon = 3 is 15
average number of affinization = 17.76267748478702
Path 68 | total_timesteps 1077.
number of affinization with epsilon = 3 is 14
average number of affinization = 17.762090483619346
Path 69 | total_timesteps 1094.
number of affinization with epsilon = 3 is 9
average number of affinization = 17.7607237560443
Path 70 | total_timesteps 1104.
number of affinization with epsilon = 3 is 7
average number of affinization = 17.759045539613226
Path 71 | total_timesteps 1113.
number of affinization with epsilon = 3 is 11
average number of affinization = 17.757991579603928
Path 72 | total_timesteps 1127.
number of affinization with epsilon = 3 is 5
average number of affinization = 17.756002494543186
Path 73 | total_timesteps 1135.
number of affinization with epsilon = 3 is 17
average number of affinization = 17.755884645362432
Path 74 | total_timesteps 1156.
number of affinization with epsilon = 3 is 5
average number of affinization = 17.75389650872818
Path 75 | total_timesteps 1165.
number of affinization with epsilon = 3 is 20
average number of affinization = 17.754246532647656
Path 76 | total_timesteps 1190.
number of affinization with epsilon = 3 is 8
average number of affinization = 17.752726706138983
Path 77 | total_timesteps 1204.
number of affinization with epsilon = 3 is 5
average number of affinization = 17.75073999065275
Path 78 | total_timesteps 1212.
number of affinization with epsilon = 3 is 18
average number of affinization = 17.75077881619938
Path 79 | total_timesteps 1235.
number of affinization with epsilon = 3 is 12
average number of affinization = 17.7498831957639
Path 80 | total_timesteps 1249.
number of affinization with epsilon = 3 is 11
average number of affinization = 17.7488321395204
Path 81 | total_timesteps 1262.
number of affinization with epsilon = 3 is 28
average number of affinization = 17.750428148840104
Path 82 | total_timesteps 1292.
number of affinization with epsilon = 3 is 33
average number of affinization = 17.75280199252802
Path 83 | total_timesteps 1333.
number of affinization with epsilon = 3 is 20
average number of affinization = 17.753151750972762
Path 84 | total_timesteps 1359.
number of affinization with epsilon = 3 is 13
average number of affinization = 17.75241207594149
Path 85 | total_timesteps 1373.
number of affinization with epsilon = 3 is 17
average number of affinization = 17.752295005445777
Path 86 | total_timesteps 1393.
number of affinization with epsilon = 3 is 26
average number of affinization = 17.75357809583074
Path 87 | total_timesteps 1425.
number of affinization with epsilon = 3 is 10
average number of affinization = 17.752372064084618
Path 88 | total_timesteps 1438.
number of affinization with epsilon = 3 is 6
average number of affinization = 17.75054432348367
Path 89 | total_timesteps 1447.
number of affinization with epsilon = 3 is 10
average number of affinization = 17.74933913854766
Path 90 | total_timesteps 1460.
number of affinization with epsilon = 3 is 39
average number of affinization = 17.75264303482587
Path 91 | total_timesteps 1504.
number of affinization with epsilon = 3 is 7
average number of affinization = 17.750971552930203
Path 92 | total_timesteps 1513.
number of affinization with epsilon = 3 is 18
average number of affinization = 17.751010258004353
Path 93 | total_timesteps 1533.
number of affinization with epsilon = 3 is 13
average number of affinization = 17.75027195027195
Path 94 | total_timesteps 1549.
number of affinization with epsilon = 3 is 12
average number of affinization = 17.749378495960222
Path 95 | total_timesteps 1562.
number of affinization with epsilon = 3 is 12
average number of affinization = 17.748485319248097
Path 96 | total_timesteps 1578.
number of affinization with epsilon = 3 is 28
average number of affinization = 17.750077663870766
Path 97 | total_timesteps 1611.
number of affinization with epsilon = 3 is 12
average number of affinization = 17.749184656002484
Path 98 | total_timesteps 1625.
number of affinization with epsilon = 3 is 10
average number of affinization = 17.747981366459626
Path 99 | total_timesteps 1636.
number of affinization with epsilon = 3 is 14
average number of affinization = 17.747399472131658
Path 100 | total_timesteps 1653.
number of affinization with epsilon = 3 is 17
average number of affinization = 17.747283452343993
Path 101 | total_timesteps 1672.
number of affinization with epsilon = 3 is 17
average number of affinization = 17.74716746857054
Path 102 | total_timesteps 1691.
number of affinization with epsilon = 3 is 11
average number of affinization = 17.746120422098077
Path 103 | total_timesteps 1707.
number of affinization with epsilon = 3 is 12
average number of affinization = 17.745228859581072
Path 104 | total_timesteps 1724.
number of affinization with epsilon = 3 is 22
average number of affinization = 17.745888923363324
Path 105 | total_timesteps 1748.
number of affinization with epsilon = 3 is 23
average number of affinization = 17.746703893283698
Path 106 | total_timesteps 1775.
number of affinization with epsilon = 3 is 18
average number of affinization = 17.74674317617866
Path 107 | total_timesteps 1796.
number of affinization with epsilon = 3 is 15
average number of affinization = 17.74631725848969
Path 108 | total_timesteps 1815.
number of affinization with epsilon = 3 is 15
average number of affinization = 17.745891472868216
Path 109 | total_timesteps 1831.
number of affinization with epsilon = 3 is 14
average number of affinization = 17.74531080452643
Path 110 | total_timesteps 1847.
number of affinization with epsilon = 3 is 23
average number of affinization = 17.74612523248605
Path 111 | total_timesteps 1872.
number of affinization with epsilon = 3 is 10
average number of affinization = 17.74492484115915
Path 112 | total_timesteps 1884.
number of affinization with epsilon = 3 is 19
average number of affinization = 17.745119305856832
Path 113 | total_timesteps 1907.
number of affinization with epsilon = 3 is 19
average number of affinization = 17.745313710302092
Path 114 | total_timesteps 1931.
number of affinization with epsilon = 3 is 14
average number of affinization = 17.74473358116481
Path 115 | total_timesteps 1946.
number of affinization with epsilon = 3 is 10
average number of affinization = 17.743534148985596
Path 116 | total_timesteps 1958.
number of affinization with epsilon = 3 is 8
average number of affinization = 17.74202539485909
Path 117 | total_timesteps 1967.
number of affinization with epsilon = 3 is 26
average number of affinization = 17.74330391701502
Path 118 | total_timesteps 1995.
number of affinization with epsilon = 3 is 21
average number of affinization = 17.743808049535605
Path 119 | total_timesteps 2020.
number of affinization with epsilon = 3 is 32
average number of affinization = 17.74601454883145
Path 120 | total_timesteps 2054.
number of affinization with epsilon = 3 is 23
average number of affinization = 17.746827607551843
Path 121 | total_timesteps 2082.
number of affinization with epsilon = 3 is 6
average number of affinization = 17.745010057248955
Path 122 | total_timesteps 2092.
number of affinization with epsilon = 3 is 19
average number of affinization = 17.745204207920793
Path 123 | total_timesteps 2114.
number of affinization with epsilon = 3 is 7
average number of affinization = 17.74354215003867
Path 124 | total_timesteps 2123.
number of affinization with epsilon = 3 is 20
average number of affinization = 17.743891122796164
Path 125 | total_timesteps 2146.
number of affinization with epsilon = 3 is 9
average number of affinization = 17.742539044379157
Path 126 | total_timesteps 2156.
number of affinization with epsilon = 3 is 15
average number of affinization = 17.742115027829314
Path 127 | total_timesteps 2174.
number of affinization with epsilon = 3 is 16
average number of affinization = 17.741845725769053
Path 128 | total_timesteps 2192.
number of affinization with epsilon = 3 is 7
average number of affinization = 17.74018547140649
Path 129 | total_timesteps 2204.
number of affinization with epsilon = 3 is 17
average number of affinization = 17.740071086385413
Path 130 | total_timesteps 2223.
number of affinization with epsilon = 3 is 14
average number of affinization = 17.739493201483313
Path 131 | total_timesteps 2239.
number of affinization with epsilon = 3 is 16
average number of affinization = 17.739224470879037
Path 132 | total_timesteps 2257.
number of affinization with epsilon = 3 is 22
average number of affinization = 17.739882607352488
Path 133 | total_timesteps 2282.
number of affinization with epsilon = 3 is 8
average number of affinization = 17.73837837837838
Path 134 | total_timesteps 2292.
number of affinization with epsilon = 3 is 23
average number of affinization = 17.739190858554664
Path 135 | total_timesteps 2321.
number of affinization with epsilon = 3 is 29
average number of affinization = 17.7409294426432
Path 136 | total_timesteps 2354.
number of affinization with epsilon = 3 is 19
average number of affinization = 17.7411238036431
Path 137 | total_timesteps 2377.
number of affinization with epsilon = 3 is 12
average number of affinization = 17.7402376910017
Path 138 | total_timesteps 2390.
number of affinization with epsilon = 3 is 9
average number of affinization = 17.738888888888887
Path 139 | total_timesteps 2402.
number of affinization with epsilon = 3 is 8
average number of affinization = 17.737386205832433
Path 140 | total_timesteps 2414.
number of affinization with epsilon = 3 is 18
average number of affinization = 17.737426720148104
Path 141 | total_timesteps 2434.
number of affinization with epsilon = 3 is 8
average number of affinization = 17.735924726207003
Path 142 | total_timesteps 2445.
number of affinization with epsilon = 3 is 15
average number of affinization = 17.73550277606416
Path 143 | total_timesteps 2464.
number of affinization with epsilon = 3 is 13
average number of affinization = 17.734772552043175
Path 144 | total_timesteps 2479.
number of affinization with epsilon = 3 is 12
average number of affinization = 17.733888374961456
Path 145 | total_timesteps 2497.
number of affinization with epsilon = 3 is 11
average number of affinization = 17.73285031601665
Path 146 | total_timesteps 2512.
number of affinization with epsilon = 3 is 8
average number of affinization = 17.731350184956842
Path 147 | total_timesteps 2521.
number of affinization with epsilon = 3 is 8
average number of affinization = 17.729850516258285
Path 148 | total_timesteps 2531.
number of affinization with epsilon = 3 is 9
average number of affinization = 17.728505392912172
Path 149 | total_timesteps 2541.
number of affinization with epsilon = 3 is 21
average number of affinization = 17.729009397627483
Path 150 | total_timesteps 2567.
number of affinization with epsilon = 3 is 12
average number of affinization = 17.728126925446702
Path 151 | total_timesteps 2583.
number of affinization with epsilon = 3 is 12
average number of affinization = 17.727244725088557
Path 152 | total_timesteps 2597.
number of affinization with epsilon = 3 is 8
average number of affinization = 17.725746843239914
Path 153 | total_timesteps 2608.
number of affinization with epsilon = 3 is 8
average number of affinization = 17.724249422632795
Path 154 | total_timesteps 2620.
number of affinization with epsilon = 3 is 8
average number of affinization = 17.72275246305419
Path 155 | total_timesteps 2629.
number of affinization with epsilon = 3 is 4
average number of affinization = 17.720640295521008
Path 156 | total_timesteps 2638.
number of affinization with epsilon = 3 is 12
average number of affinization = 17.71975992613112
Path 157 | total_timesteps 2652.
number of affinization with epsilon = 3 is 14
average number of affinization = 17.71918756731805
Path 158 | total_timesteps 2670.
number of affinization with epsilon = 3 is 25
average number of affinization = 17.720307692307692
Path 159 | total_timesteps 2701.
number of affinization with epsilon = 3 is 19
average number of affinization = 17.72050453776342
Path 160 | total_timesteps 2726.
number of affinization with epsilon = 3 is 9
average number of affinization = 17.719163334358658
Path 161 | total_timesteps 2736.
number of affinization with epsilon = 3 is 19
average number of affinization = 17.719360295248347
Path 162 | total_timesteps 2756.
number of affinization with epsilon = 3 is 9
average number of affinization = 17.718019680196804
Path 163 | total_timesteps 2767.
number of affinization with epsilon = 3 is 19
average number of affinization = 17.718216756341278
Path 164 | total_timesteps 2788.
number of affinization with epsilon = 3 is 16
average number of affinization = 17.717952659083924
Path 165 | total_timesteps 2808.
number of affinization with epsilon = 3 is 8
average number of affinization = 17.716459197787
Path 166 | total_timesteps 2818.
number of affinization with epsilon = 3 is 18
average number of affinization = 17.716502765826675
Path 167 | total_timesteps 2839.
number of affinization with epsilon = 3 is 27
average number of affinization = 17.717929021355047
Path 168 | total_timesteps 2872.
number of affinization with epsilon = 3 is 11
average number of affinization = 17.71689708141321
Path 169 | total_timesteps 2886.
number of affinization with epsilon = 3 is 13
average number of affinization = 17.71617263093227
Path 170 | total_timesteps 2902.
number of affinization with epsilon = 3 is 12
average number of affinization = 17.715294840294842
Path 171 | total_timesteps 2918.
number of affinization with epsilon = 3 is 18
average number of affinization = 17.71533855366191
Path 172 | total_timesteps 2938.
number of affinization with epsilon = 3 is 22
average number of affinization = 17.71599631562788
Path 173 | total_timesteps 2965.
number of affinization with epsilon = 3 is 9
average number of affinization = 17.714658480429776
Path 174 | total_timesteps 2976.
number of affinization with epsilon = 3 is 11
average number of affinization = 17.71362799263352
Path 175 | total_timesteps 2988.
number of affinization with epsilon = 3 is 8
average number of affinization = 17.712137486573578
Path 176 | total_timesteps 2998.
number of affinization with epsilon = 3 is 16
average number of affinization = 17.71187480822338
Path 177 | total_timesteps 3017.
number of affinization with epsilon = 3 is 6
average number of affinization = 17.7100782328578
Path 178 | total_timesteps 3027.
number of affinization with epsilon = 3 is 14
average number of affinization = 17.709509202453987
Path 179 | total_timesteps 3044.
number of affinization with epsilon = 3 is 5
average number of affinization = 17.707560190154883
Path 180 | total_timesteps 3053.
number of affinization with epsilon = 3 is 8
average number of affinization = 17.706071757129713
Path 181 | total_timesteps 3065.
number of affinization with epsilon = 3 is 20
average number of affinization = 17.706423424804537
Path 182 | total_timesteps 3089.
number of affinization with epsilon = 3 is 12
average number of affinization = 17.70554874310239
Path 183 | total_timesteps 3103.
number of affinization with epsilon = 3 is 6
average number of affinization = 17.70375478927203
Path 184 | total_timesteps 3113.
number of affinization with epsilon = 3 is 35
average number of affinization = 17.706405148636225
Path 185 | total_timesteps 3154.
number of affinization with epsilon = 3 is 25
average number of affinization = 17.70752259843726
Path 186 | total_timesteps 3185.
number of affinization with epsilon = 3 is 6
average number of affinization = 17.705729166666668
Path 187 | total_timesteps 3194.
number of affinization with epsilon = 3 is 7
average number of affinization = 17.70408944708225
Path 188 | total_timesteps 3202.
number of affinization with epsilon = 3 is 5
average number of affinization = 17.702143950995406
Path 189 | total_timesteps 3211.
number of affinization with epsilon = 3 is 21
average number of affinization = 17.702648905221253
Path 190 | total_timesteps 3234.
number of affinization with epsilon = 3 is 10
average number of affinization = 17.701469687691365
Path 191 | total_timesteps 3247.
number of affinization with epsilon = 3 is 8
average number of affinization = 17.699984693096585
Path 192 | total_timesteps 3258.
number of affinization with epsilon = 3 is 17
average number of affinization = 17.699877563513926
Path 193 | total_timesteps 3277.
number of affinization with epsilon = 3 is 12
average number of affinization = 17.69900535577659
Path 194 | total_timesteps 3293.
number of affinization with epsilon = 3 is 10
average number of affinization = 17.697827417380662
Path 195 | total_timesteps 3306.
number of affinization with epsilon = 3 is 7
average number of affinization = 17.696190913262964
Path 196 | total_timesteps 3314.
number of affinization with epsilon = 3 is 8
average number of affinization = 17.694707861731416
Path 197 | total_timesteps 3328.
number of affinization with epsilon = 3 is 9
average number of affinization = 17.693378192384156
Path 198 | total_timesteps 3340.
number of affinization with epsilon = 3 is 18
average number of affinization = 17.6934250764526
Path 199 | total_timesteps 3361.
number of affinization with epsilon = 3 is 13
average number of affinization = 17.692707537073844
Path 200 | total_timesteps 3376.
number of affinization with epsilon = 3 is 12
average number of affinization = 17.69183735860593
Path 201 | total_timesteps 3391.
number of affinization with epsilon = 3 is 20
average number of affinization = 17.692190126853127
Path 202 | total_timesteps 3416.
number of affinization with epsilon = 3 is 7
average number of affinization = 17.690556234718827
Path 203 | total_timesteps 3425.
number of affinization with epsilon = 3 is 25
average number of affinization = 17.691673032849504
Path 204 | total_timesteps 3452.
number of affinization with epsilon = 3 is 13
average number of affinization = 17.690956309196455
Path 205 | total_timesteps 3467.
number of affinization with epsilon = 3 is 11
average number of affinization = 17.68993432106308
Path 206 | total_timesteps 3482.
number of affinization with epsilon = 3 is 13
average number of affinization = 17.689218081857057
Path 207 | total_timesteps 3497.
number of affinization with epsilon = 3 is 14
average number of affinization = 17.688654756451367
Path 208 | total_timesteps 3516.
number of affinization with epsilon = 3 is 10
average number of affinization = 17.687480916030534
Path 209 | total_timesteps 3527.
number of affinization with epsilon = 3 is 9
average number of affinization = 17.686154785528927
Path 210 | total_timesteps 3538.
number of affinization with epsilon = 3 is 11
average number of affinization = 17.68513431013431
Path 211 | total_timesteps 3552.
number of affinization with epsilon = 3 is 11
average number of affinization = 17.684114146192584
Path 212 | total_timesteps 3565.
number of affinization with epsilon = 3 is 8
average number of affinization = 17.68263655782728
Path 213 | total_timesteps 3574.
number of affinization with epsilon = 3 is 5
average number of affinization = 17.680701754385964
Path 214 | total_timesteps 3581.
number of affinization with epsilon = 3 is 17
average number of affinization = 17.680597925564367
Path 215 | total_timesteps 3602.
number of affinization with epsilon = 3 is 36
average number of affinization = 17.683391795028214
Path 216 | total_timesteps 3640.
number of affinization with epsilon = 3 is 7
average number of affinization = 17.68176273254041
Path 217 | total_timesteps 3649.
number of affinization with epsilon = 3 is 9
average number of affinization = 17.680439091324896
Path 218 | total_timesteps 3660.
number of affinization with epsilon = 3 is 18
average number of affinization = 17.680487804878048
Path 219 | total_timesteps 3680.
number of affinization with epsilon = 3 is 8
average number of affinization = 17.679012345679013
Path 220 | total_timesteps 3690.
number of affinization with epsilon = 3 is 8
average number of affinization = 17.677537336177995
Path 221 | total_timesteps 3700.
number of affinization with epsilon = 3 is 35
average number of affinization = 17.680176748438214
Path 222 | total_timesteps 3742.
number of affinization with epsilon = 3 is 16
average number of affinization = 17.67992078001219
Path 223 | total_timesteps 3762.
number of affinization with epsilon = 3 is 11
average number of affinization = 17.67890327494288
Path 224 | total_timesteps 3775.
number of affinization with epsilon = 3 is 8
average number of affinization = 17.677429180627474
Path 225 | total_timesteps 3785.
number of affinization with epsilon = 3 is 22
average number of affinization = 17.678087406730622
Path 226 | total_timesteps 3810.
number of affinization with epsilon = 3 is 14
average number of affinization = 17.677527405602923
Path 227 | total_timesteps 3827.
number of affinization with epsilon = 3 is 8
average number of affinization = 17.67605419394124
Path 228 | total_timesteps 3837.
number of affinization with epsilon = 3 is 4
average number of affinization = 17.673972602739727
Path 229 | total_timesteps 3844.
number of affinization with epsilon = 3 is 54
average number of affinization = 17.67950083701111
Path 230 | total_timesteps 3904.
number of affinization with epsilon = 3 is 8
average number of affinization = 17.67802799756543
Path 231 | total_timesteps 3914.
number of affinization with epsilon = 3 is 8
average number of affinization = 17.676555606268067
Path 232 | total_timesteps 3925.
number of affinization with epsilon = 3 is 18
average number of affinization = 17.676604806814726
Path 233 | total_timesteps 3945.
number of affinization with epsilon = 3 is 20
average number of affinization = 17.676958174904943
Path 234 | total_timesteps 3967.
number of affinization with epsilon = 3 is 9
average number of affinization = 17.675638686131386
Path 235 | total_timesteps 3978.
number of affinization with epsilon = 3 is 21
average number of affinization = 17.676144138665045
Path 236 | total_timesteps 4001.
number of affinization with epsilon = 3 is 18
average number of affinization = 17.676193371845546
Path 237 | total_timesteps 4023.
number of affinization with epsilon = 3 is 12
average number of affinization = 17.67533059735522
Path 238 | total_timesteps 4037.
number of affinization with epsilon = 3 is 12
average number of affinization = 17.674468085106383
Path 239 | total_timesteps 4053.
number of affinization with epsilon = 3 is 7
average number of affinization = 17.67284607202553
Path 240 | total_timesteps 4064.
number of affinization with epsilon = 3 is 11
average number of affinization = 17.6718322698268
Path 241 | total_timesteps 4077.
number of affinization with epsilon = 3 is 16
average number of affinization = 17.671578307762417
Path 242 | total_timesteps 4095.
number of affinization with epsilon = 3 is 11
average number of affinization = 17.670565006075336
Path 243 | total_timesteps 4109.
number of affinization with epsilon = 3 is 14
average number of affinization = 17.670007593014425
Path 244 | total_timesteps 4130.
number of affinization with epsilon = 3 is 16
average number of affinization = 17.669754023686608
Path 245 | total_timesteps 4148.
number of affinization with epsilon = 3 is 13
average number of affinization = 17.669045088811295
Path 246 | total_timesteps 4163.
number of affinization with epsilon = 3 is 12
average number of affinization = 17.668184578020643
Path 247 | total_timesteps 4180.
number of affinization with epsilon = 3 is 12
average number of affinization = 17.667324328426165
Path 248 | total_timesteps 4195.
number of affinization with epsilon = 3 is 12
average number of affinization = 17.666464339908952
Path 249 | total_timesteps 4212.
number of affinization with epsilon = 3 is 11
average number of affinization = 17.665452890304962
Path 250 | total_timesteps 4226.
number of affinization with epsilon = 3 is 11
average number of affinization = 17.664441747572816
Path 251 | total_timesteps 4241.
number of affinization with epsilon = 3 is 8
average number of affinization = 17.662975883512818
Path 252 | total_timesteps 4251.
number of affinization with epsilon = 3 is 5
average number of affinization = 17.66105550500455
Path 253 | total_timesteps 4260.
number of affinization with epsilon = 3 is 13
average number of affinization = 17.66034874905231
Path 254 | total_timesteps 4275.
number of affinization with epsilon = 3 is 20
average number of affinization = 17.660703456640388
Path 255 | total_timesteps 4298.
number of affinization with epsilon = 3 is 11
average number of affinization = 17.659693800212217
Path 256 | total_timesteps 4314.
number of affinization with epsilon = 3 is 14
average number of affinization = 17.659139133070628
Path 257 | total_timesteps 4332.
number of affinization with epsilon = 3 is 15
average number of affinization = 17.658736172147297
Path 258 | total_timesteps 4348.
number of affinization with epsilon = 3 is 9
average number of affinization = 17.65742424242424
Path 259 | total_timesteps 4360.
number of affinization with epsilon = 3 is 9
average number of affinization = 17.656112710195426
Path 260 | total_timesteps 4371.
number of affinization with epsilon = 3 is 15
average number of affinization = 17.65571039079067
Path 261 | total_timesteps 4387.
number of affinization with epsilon = 3 is 11
average number of affinization = 17.654702407996364
Path 262 | total_timesteps 4400.
number of affinization with epsilon = 3 is 10
average number of affinization = 17.653543307086615
Path 263 | total_timesteps 4414.
number of affinization with epsilon = 3 is 6
average number of affinization = 17.651778955336866
Path 264 | total_timesteps 4424.
number of affinization with epsilon = 3 is 11
average number of affinization = 17.650772025431426
Path 265 | total_timesteps 4438.
number of affinization with epsilon = 3 is 16
average number of affinization = 17.650522173452398
Path 266 | total_timesteps 4455.
number of affinization with epsilon = 3 is 10
average number of affinization = 17.64936440677966
Path 267 | total_timesteps 4467.
number of affinization with epsilon = 3 is 17
average number of affinization = 17.649266152216676
Path 268 | total_timesteps 4487.
number of affinization with epsilon = 3 is 16
average number of affinization = 17.649016641452345
Path 269 | total_timesteps 4506.
number of affinization with epsilon = 3 is 7
average number of affinization = 17.647405838753592
Path 270 | total_timesteps 4516.
number of affinization with epsilon = 3 is 13
average number of affinization = 17.64670296430732
Path 271 | total_timesteps 4530.
number of affinization with epsilon = 3 is 8
average number of affinization = 17.645244215938302
Path 272 | total_timesteps 4541.
number of affinization with epsilon = 3 is 18
average number of affinization = 17.645297853039008
Path 273 | total_timesteps 4560.
number of affinization with epsilon = 3 is 18
average number of affinization = 17.645351473922904
Path 274 | total_timesteps 4580.
number of affinization with epsilon = 3 is 21
average number of affinization = 17.64585852478839
Path 275 | total_timesteps 4609.
number of affinization with epsilon = 3 is 9
average number of affinization = 17.644551911742482
Path 276 | total_timesteps 4620.
number of affinization with epsilon = 3 is 16
average number of affinization = 17.64430341492898
Path 277 | total_timesteps 4640.
number of affinization with epsilon = 3 is 8
average number of affinization = 17.6428463514126
Path 278 | total_timesteps 4652.
number of affinization with epsilon = 3 is 9
average number of affinization = 17.64154078549849
Path 279 | total_timesteps 4668.
number of affinization with epsilon = 3 is 12
average number of affinization = 17.64068871771636
Path 280 | total_timesteps 4684.
number of affinization with epsilon = 3 is 10
average number of affinization = 17.63953488372093
Path 281 | total_timesteps 4695.
number of affinization with epsilon = 3 is 38
average number of affinization = 17.642609089536464
Path 282 | total_timesteps 4738.
number of affinization with epsilon = 3 is 21
average number of affinization = 17.643115942028984
Path 283 | total_timesteps 4761.
number of affinization with epsilon = 3 is 11
average number of affinization = 17.64211320754717
Path 284 | total_timesteps 4778.
number of affinization with epsilon = 3 is 15
average number of affinization = 17.64171445819499
Path 285 | total_timesteps 4795.
number of affinization with epsilon = 3 is 18
average number of affinization = 17.641768522710127
Path 286 | total_timesteps 4817.
number of affinization with epsilon = 3 is 6
average number of affinization = 17.640012070006033
Path 287 | total_timesteps 4826.
number of affinization with epsilon = 3 is 14
average number of affinization = 17.639462965756525
Path 288 | total_timesteps 4846.
number of affinization with epsilon = 3 is 7
average number of affinization = 17.63785822021116
Path 289 | total_timesteps 4855.
number of affinization with epsilon = 3 is 11
average number of affinization = 17.636857185944805
Path 290 | total_timesteps 4869.
number of affinization with epsilon = 3 is 12
average number of affinization = 17.636007237635706
Path 291 | total_timesteps 4882.
number of affinization with epsilon = 3 is 9
average number of affinization = 17.634705261570932
Path 292 | total_timesteps 4893.
number of affinization with epsilon = 3 is 7
average number of affinization = 17.633102200783842
Path 293 | total_timesteps 4901.
number of affinization with epsilon = 3 is 16
average number of affinization = 17.632856066314996
Path 294 | total_timesteps 4920.
number of affinization with epsilon = 3 is 15
average number of affinization = 17.63245931283906
Path 295 | total_timesteps 4939.
number of affinization with epsilon = 3 is 8
average number of affinization = 17.631007985535632
Path 296 | total_timesteps 4948.
number of affinization with epsilon = 3 is 14
average number of affinization = 17.63046098222356
Path 297 | total_timesteps 4966.
number of affinization with epsilon = 3 is 12
average number of affinization = 17.629612893508057
Path 298 | total_timesteps 4982.
number of affinization with epsilon = 3 is 11
average number of affinization = 17.628614457831326
Path 299 | total_timesteps 4995.
number of affinization with epsilon = 3 is 8
average number of affinization = 17.62716458364704
Path 300 | total_timesteps 5005.
number of affinization with epsilon = 3 is 11
average number of affinization = 17.626166817223726
Path 301 | total_timesteps 5018.
number of affinization with epsilon = 3 is 9
average number of affinization = 17.624868282402527
Path 302 | total_timesteps 5029.
number of affinization with epsilon = 3 is 11
average number of affinization = 17.623871161950632
Path 303 | total_timesteps 5043.
number of affinization with epsilon = 3 is 12
average number of affinization = 17.623024830699773
Path 304 | total_timesteps 5057.
number of affinization with epsilon = 3 is 11
average number of affinization = 17.622028287691844
Path 305 | total_timesteps 5073.
number of affinization with epsilon = 3 is 17
average number of affinization = 17.621934707386792
Path 306 | total_timesteps 5093.
number of affinization with epsilon = 3 is 11
average number of affinization = 17.620938628158846
Path 307 | total_timesteps 5107.
number of affinization with epsilon = 3 is 20
average number of affinization = 17.621296435554218
Path 308 | total_timesteps 5132.
number of affinization with epsilon = 3 is 9
average number of affinization = 17.62
Path 309 | total_timesteps 5142.
number of affinization with epsilon = 3 is 12
average number of affinization = 17.619155014283567
Path 310 | total_timesteps 5155.
number of affinization with epsilon = 3 is 19
average number of affinization = 17.61936259771497
Path 311 | total_timesteps 5178.
number of affinization with epsilon = 3 is 9
average number of affinization = 17.618067037426727
Path 312 | total_timesteps 5189.
number of affinization with epsilon = 3 is 6
average number of affinization = 17.616321009918845
Path 313 | total_timesteps 5197.
number of affinization with epsilon = 3 is 26
average number of affinization = 17.617580766341096
Path 314 | total_timesteps 5227.
number of affinization with epsilon = 3 is 9
average number of affinization = 17.616286057692307
Path 315 | total_timesteps 5238.
number of affinization with epsilon = 3 is 10
average number of affinization = 17.615141955835963
Path 316 | total_timesteps 5249.
number of affinization with epsilon = 3 is 19
average number of affinization = 17.615349954941422
Path 317 | total_timesteps 5273.
number of affinization with epsilon = 3 is 7
average number of affinization = 17.613755819192072
Path 318 | total_timesteps 5282.
number of affinization with epsilon = 3 is 7
average number of affinization = 17.61216216216216
Path 319 | total_timesteps 5291.
number of affinization with epsilon = 3 is 18
average number of affinization = 17.61222038732923
Path 320 | total_timesteps 5312.
number of affinization with epsilon = 3 is 15
average number of affinization = 17.61182827979586
Path 321 | total_timesteps 5328.
number of affinization with epsilon = 3 is 15
average number of affinization = 17.611436289959478
Path 322 | total_timesteps 5346.
number of affinization with epsilon = 3 is 18
average number of affinization = 17.611494597839137
Path 323 | total_timesteps 5368.
number of affinization with epsilon = 3 is 24
average number of affinization = 17.61245311327832
Path 324 | total_timesteps 5393.
number of affinization with epsilon = 3 is 8
average number of affinization = 17.611011101110112
Path 325 | total_timesteps 5405.
number of affinization with epsilon = 3 is 8
average number of affinization = 17.609569521523923
Path 326 | total_timesteps 5415.
number of affinization with epsilon = 3 is 20
average number of affinization = 17.60992801439712
Path 327 | total_timesteps 5438.
number of affinization with epsilon = 3 is 11
average number of affinization = 17.608936872094766
Path 328 | total_timesteps 5450.
number of affinization with epsilon = 3 is 9
average number of affinization = 17.607646176911544
Path 329 | total_timesteps 5461.
number of affinization with epsilon = 3 is 10
average number of affinization = 17.60650577124869
Path 330 | total_timesteps 5474.
number of affinization with epsilon = 3 is 13
average number of affinization = 17.605815347721823
Path 331 | total_timesteps 5489.
number of affinization with epsilon = 3 is 8
average number of affinization = 17.6043758429492
Path 332 | total_timesteps 5500.
number of affinization with epsilon = 3 is 10
average number of affinization = 17.603236439916092
Path 333 | total_timesteps 5513.
number of affinization with epsilon = 3 is 10
average number of affinization = 17.602097378277154
Path 334 | total_timesteps 5525.
number of affinization with epsilon = 3 is 11
average number of affinization = 17.601108448172557
Path 335 | total_timesteps 5538.
number of affinization with epsilon = 3 is 32
average number of affinization = 17.603264939344015
Path 336 | total_timesteps 5575.
number of affinization with epsilon = 3 is 8
average number of affinization = 17.601826894279725
Path 337 | total_timesteps 5585.
number of affinization with epsilon = 3 is 19
average number of affinization = 17.602036232969006
Path 338 | total_timesteps 5608.
number of affinization with epsilon = 3 is 11
average number of affinization = 17.601047904191617
Path 339 | total_timesteps 5622.
number of affinization with epsilon = 3 is 9
average number of affinization = 17.59976051489298
Path 340 | total_timesteps 5637.
number of affinization with epsilon = 3 is 11
average number of affinization = 17.59877282250823
Path 341 | total_timesteps 5651.
number of affinization with epsilon = 3 is 23
average number of affinization = 17.59958102648511
Path 342 | total_timesteps 5681.
number of affinization with epsilon = 3 is 18
average number of affinization = 17.59964093357271
Path 343 | total_timesteps 5702.
number of affinization with epsilon = 3 is 7
average number of affinization = 17.59805534779357
Path 344 | total_timesteps 5710.
number of affinization with epsilon = 3 is 8
average number of affinization = 17.59661980257254
Path 345 | total_timesteps 5724.
number of affinization with epsilon = 3 is 22
average number of affinization = 17.597278301181397
Path 346 | total_timesteps 5753.
number of affinization with epsilon = 3 is 11
average number of affinization = 17.596291866028707
Path 347 | total_timesteps 5765.
number of affinization with epsilon = 3 is 9
average number of affinization = 17.595006727462998
Path 348 | total_timesteps 5775.
number of affinization with epsilon = 3 is 9
average number of affinization = 17.59372197309417
Path 349 | total_timesteps 5785.
number of affinization with epsilon = 3 is 12
average number of affinization = 17.592885966223285
Path 350 | total_timesteps 5798.
number of affinization with epsilon = 3 is 11
average number of affinization = 17.591900777047222
Path 351 | total_timesteps 5812.
number of affinization with epsilon = 3 is 19
average number of affinization = 17.59211116091439
Path 352 | total_timesteps 5832.
number of affinization with epsilon = 3 is 8
average number of affinization = 17.590678219300866
Path 353 | total_timesteps 5842.
number of affinization with epsilon = 3 is 10
average number of affinization = 17.58954443614638
Path 354 | total_timesteps 5854.
number of affinization with epsilon = 3 is 20
average number of affinization = 17.589904420549583
Path 355 | total_timesteps 5876.
number of affinization with epsilon = 3 is 13
average number of affinization = 17.589219053307453
Path 356 | total_timesteps 5893.
number of affinization with epsilon = 3 is 7
average number of affinization = 17.58763810092565
Path 357 | total_timesteps 5904.
number of affinization with epsilon = 3 is 14
average number of affinization = 17.587102552619793
Path 358 | total_timesteps 5920.
number of affinization with epsilon = 3 is 6
average number of affinization = 17.585373134328357
Path 359 | total_timesteps 5929.
number of affinization with epsilon = 3 is 12
average number of affinization = 17.584539620952096
Path 360 | total_timesteps 5946.
number of affinization with epsilon = 3 is 7
average number of affinization = 17.58296031035512
Path 361 | total_timesteps 5956.
number of affinization with epsilon = 3 is 5
average number of affinization = 17.581083097120693
Path 362 | total_timesteps 5965.
number of affinization with epsilon = 3 is 10
average number of affinization = 17.579952267303103
Path 363 | total_timesteps 5981.
number of affinization with epsilon = 3 is 19
average number of affinization = 17.580164056674125
Done generating on-policy rollouts.
Updating normalization.
Done updating normalization.
----------------------------
| AverageReturn | -6.03    |
| Iteration     | 23       |
| MaximumReturn | 38.3     |
| MinimumReturn | -18.7    |
| TotalSamples  | 100248   |
----------------------------
itr #24 | 
Fitting dynamics.
Fitting model 0 (0-based) in the ensemble of 2 models
Validation loss = 0.013951419852674007
Validation loss = 0.013983475044369698
Validation loss = 0.013707884587347507
Validation loss = 0.014435133896768093
Validation loss = 0.014090338721871376
Validation loss = 0.013803361915051937
Validation loss = 0.01434850599616766
Fitting model 1 (0-based) in the ensemble of 2 models
Validation loss = 0.014240876771509647
Validation loss = 0.013420318253338337
Validation loss = 0.013765211217105389
Validation loss = 0.01385162677615881
Validation loss = 0.013729721307754517
Validation loss = 0.013483244925737381
Done fitting dynamics.
Updating randomness.
Done updating randomness.
Training policy using TRPO.
Re-initialize init_std.
Obtaining samples for iteration 0...
Obtaining samples for iteration 1...
Obtaining samples for iteration 2...
Obtaining samples for iteration 3...
Obtaining samples for iteration 4...
Obtaining samples for iteration 5...
Obtaining samples for iteration 6...
Obtaining samples for iteration 7...
Obtaining samples for iteration 8...
Obtaining samples for iteration 9...
Obtaining samples for iteration 10...
Obtaining samples for iteration 11...
Obtaining samples for iteration 12...
Obtaining samples for iteration 13...
Obtaining samples for iteration 14...
Obtaining samples for iteration 15...
Obtaining samples for iteration 16...
Obtaining samples for iteration 17...
Obtaining samples for iteration 18...
Obtaining samples for iteration 19...
Done training policy.
Generating on-policy rollouts.
Path 0 | total_timesteps 0.
number of affinization with epsilon = 3 is 11
average number of affinization = 17.57918282135401
Path 1 | total_timesteps 14.
number of affinization with epsilon = 3 is 8
average number of affinization = 17.57775458476219
Path 2 | total_timesteps 26.
number of affinization with epsilon = 3 is 8
average number of affinization = 17.576326774001192
Path 3 | total_timesteps 37.
number of affinization with epsilon = 3 is 7
average number of affinization = 17.574750335370396
Path 4 | total_timesteps 46.
number of affinization with epsilon = 3 is 18
average number of affinization = 17.574813710879283
Path 5 | total_timesteps 66.
number of affinization with epsilon = 3 is 24
average number of affinization = 17.575771122038443
Path 6 | total_timesteps 93.
number of affinization with epsilon = 3 is 18
average number of affinization = 17.575834326579262
Path 7 | total_timesteps 115.
number of affinization with epsilon = 3 is 14
average number of affinization = 17.57530165350812
Path 8 | total_timesteps 130.
number of affinization with epsilon = 3 is 12
average number of affinization = 17.57447125409592
Path 9 | total_timesteps 143.
number of affinization with epsilon = 3 is 8
average number of affinization = 17.573045420699927
Path 10 | total_timesteps 153.
number of affinization with epsilon = 3 is 28
average number of affinization = 17.57459797498511
Path 11 | total_timesteps 185.
number of affinization with epsilon = 3 is 23
average number of affinization = 17.575405687062677
Path 12 | total_timesteps 213.
number of affinization with epsilon = 3 is 10
average number of affinization = 17.574278058946113
Path 13 | total_timesteps 224.
number of affinization with epsilon = 3 is 9
average number of affinization = 17.573001934811728
Path 14 | total_timesteps 236.
number of affinization with epsilon = 3 is 10
average number of affinization = 17.571875
Path 15 | total_timesteps 250.
number of affinization with epsilon = 3 is 12
average number of affinization = 17.571045975301296
Path 16 | total_timesteps 265.
number of affinization with epsilon = 3 is 10
average number of affinization = 17.569919666765845
Path 17 | total_timesteps 277.
number of affinization with epsilon = 3 is 25
average number of affinization = 17.571024840101146
Path 18 | total_timesteps 306.
number of affinization with epsilon = 3 is 7
average number of affinization = 17.56945270672219
Path 19 | total_timesteps 314.
number of affinization with epsilon = 3 is 9
average number of affinization = 17.56817843866171
Path 20 | total_timesteps 328.
number of affinization with epsilon = 3 is 15
average number of affinization = 17.56779661016949
Path 21 | total_timesteps 347.
number of affinization with epsilon = 3 is 9
average number of affinization = 17.566522967147318
Path 22 | total_timesteps 358.
number of affinization with epsilon = 3 is 25
average number of affinization = 17.567627824019024
Path 23 | total_timesteps 389.
number of affinization with epsilon = 3 is 7
average number of affinization = 17.566057363649875
Path 24 | total_timesteps 398.
number of affinization with epsilon = 3 is 10
average number of affinization = 17.564933135215455
Path 25 | total_timesteps 412.
number of affinization with epsilon = 3 is 15
average number of affinization = 17.564552072500373
Path 26 | total_timesteps 430.
number of affinization with epsilon = 3 is 19
average number of affinization = 17.564765300059417
Path 27 | total_timesteps 451.
number of affinization with epsilon = 3 is 17
average number of affinization = 17.564681419872272
Path 28 | total_timesteps 470.
number of affinization with epsilon = 3 is 19
average number of affinization = 17.564894564894566
Path 29 | total_timesteps 493.
number of affinization with epsilon = 3 is 15
average number of affinization = 17.564513734224203
Path 30 | total_timesteps 511.
number of affinization with epsilon = 3 is 13
average number of affinization = 17.563836104513065
Path 31 | total_timesteps 526.
number of affinization with epsilon = 3 is 28
average number of affinization = 17.565385186284697
Path 32 | total_timesteps 557.
number of affinization with epsilon = 3 is 10
average number of affinization = 17.564262392401307
Path 33 | total_timesteps 568.
number of affinization with epsilon = 3 is 22
average number of affinization = 17.56492061136667
Path 34 | total_timesteps 592.
number of affinization with epsilon = 3 is 6
average number of affinization = 17.56320474777448
Path 35 | total_timesteps 600.
number of affinization with epsilon = 3 is 11
average number of affinization = 17.562231122978787
Path 36 | total_timesteps 614.
number of affinization with epsilon = 3 is 9
average number of affinization = 17.560961139127855
Path 37 | total_timesteps 630.
number of affinization with epsilon = 3 is 7
average number of affinization = 17.55939492807356
Path 38 | total_timesteps 638.
number of affinization with epsilon = 3 is 16
average number of affinization = 17.559163701067614
Path 39 | total_timesteps 659.
number of affinization with epsilon = 3 is 10
average number of affinization = 17.55804299481097
Path 40 | total_timesteps 671.
number of affinization with epsilon = 3 is 13
average number of affinization = 17.55736732878743
Path 41 | total_timesteps 686.
number of affinization with epsilon = 3 is 12
average number of affinization = 17.556543649029198
Path 42 | total_timesteps 703.
number of affinization with epsilon = 3 is 7
average number of affinization = 17.554979253112034
Path 43 | total_timesteps 715.
number of affinization with epsilon = 3 is 8
average number of affinization = 17.553563490887537
Path 44 | total_timesteps 724.
number of affinization with epsilon = 3 is 9
average number of affinization = 17.552296296296298
Path 45 | total_timesteps 735.
number of affinization with epsilon = 3 is 14
average number of affinization = 17.55177010813213
Path 46 | total_timesteps 755.
number of affinization with epsilon = 3 is 9
average number of affinization = 17.55050355450237
Path 47 | total_timesteps 766.
number of affinization with epsilon = 3 is 15
average number of affinization = 17.55012586998371
Path 48 | total_timesteps 782.
number of affinization with epsilon = 3 is 13
average number of affinization = 17.549452176488007
Path 49 | total_timesteps 798.
number of affinization with epsilon = 3 is 12
average number of affinization = 17.54863064396743
Path 50 | total_timesteps 813.
number of affinization with epsilon = 3 is 8
average number of affinization = 17.547217288336295
Path 51 | total_timesteps 823.
number of affinization with epsilon = 3 is 21
average number of affinization = 17.547728281781858
Path 52 | total_timesteps 848.
number of affinization with epsilon = 3 is 10
average number of affinization = 17.546611423498078
Path 53 | total_timesteps 860.
number of affinization with epsilon = 3 is 11
average number of affinization = 17.545642846574935
Path 54 | total_timesteps 873.
number of affinization with epsilon = 3 is 17
average number of affinization = 17.545562130177515
Path 55 | total_timesteps 894.
number of affinization with epsilon = 3 is 10
average number of affinization = 17.544446087856826
Path 56 | total_timesteps 907.
number of affinization with epsilon = 3 is 27
average number of affinization = 17.54584442472641
Path 57 | total_timesteps 936.
number of affinization with epsilon = 3 is 4
average number of affinization = 17.543841490462814
Path 58 | total_timesteps 946.
number of affinization with epsilon = 3 is 12
average number of affinization = 17.543021880544057
Path 59 | total_timesteps 961.
number of affinization with epsilon = 3 is 14
average number of affinization = 17.54249815225425
Path 60 | total_timesteps 979.
number of affinization with epsilon = 3 is 9
average number of affinization = 17.54123558971327
Path 61 | total_timesteps 989.
number of affinization with epsilon = 3 is 6
average number of affinization = 17.539530072410226
Path 62 | total_timesteps 1000.
number of affinization with epsilon = 3 is 19
average number of affinization = 17.53974586288416
Path 63 | total_timesteps 1021.
number of affinization with epsilon = 3 is 7
average number of affinization = 17.538188801890975
Path 64 | total_timesteps 1030.
number of affinization with epsilon = 3 is 14
average number of affinization = 17.537666174298376
Path 65 | total_timesteps 1046.
number of affinization with epsilon = 3 is 11
average number of affinization = 17.53670063506129
Path 66 | total_timesteps 1060.
number of affinization with epsilon = 3 is 21
average number of affinization = 17.537212049616066
Path 67 | total_timesteps 1085.
number of affinization with epsilon = 3 is 18
average number of affinization = 17.537280377971356
Path 68 | total_timesteps 1104.
number of affinization with epsilon = 3 is 8
average number of affinization = 17.535872453498673
Path 69 | total_timesteps 1117.
number of affinization with epsilon = 3 is 14
average number of affinization = 17.535350553505534
Path 70 | total_timesteps 1133.
number of affinization with epsilon = 3 is 14
average number of affinization = 17.53482880755608
Path 71 | total_timesteps 1153.
number of affinization with epsilon = 3 is 24
average number of affinization = 17.53578279474694
Path 72 | total_timesteps 1179.
number of affinization with epsilon = 3 is 11
average number of affinization = 17.534818530539983
Path 73 | total_timesteps 1192.
number of affinization with epsilon = 3 is 14
average number of affinization = 17.53429709396666
Path 74 | total_timesteps 1209.
number of affinization with epsilon = 3 is 26
average number of affinization = 17.535545722713863
Path 75 | total_timesteps 1237.
number of affinization with epsilon = 3 is 16
average number of affinization = 17.535319274443296
Path 76 | total_timesteps 1254.
number of affinization with epsilon = 3 is 13
average number of affinization = 17.53465054556178
Path 77 | total_timesteps 1270.
number of affinization with epsilon = 3 is 10
average number of affinization = 17.533539731682147
Path 78 | total_timesteps 1281.
number of affinization with epsilon = 3 is 13
average number of affinization = 17.53287146226415
Path 79 | total_timesteps 1297.
number of affinization with epsilon = 3 is 12
average number of affinization = 17.532056005895356
Path 80 | total_timesteps 1311.
number of affinization with epsilon = 3 is 9
average number of affinization = 17.530798703212497
Path 81 | total_timesteps 1321.
number of affinization with epsilon = 3 is 15
average number of affinization = 17.530425814056283
Path 82 | total_timesteps 1338.
number of affinization with epsilon = 3 is 7
average number of affinization = 17.528874484384207
Path 83 | total_timesteps 1347.
number of affinization with epsilon = 3 is 11
average number of affinization = 17.52791280011784
Path 84 | total_timesteps 1360.
number of affinization with epsilon = 3 is 25
average number of affinization = 17.529013254786452
Path 85 | total_timesteps 1389.
number of affinization with epsilon = 3 is 11
average number of affinization = 17.52805183330879
Path 86 | total_timesteps 1401.
number of affinization with epsilon = 3 is 13
average number of affinization = 17.5273851590106
Path 87 | total_timesteps 1416.
number of affinization with epsilon = 3 is 15
average number of affinization = 17.52701310172236
Path 88 | total_timesteps 1433.
number of affinization with epsilon = 3 is 5
average number of affinization = 17.525169267000294
Path 89 | total_timesteps 1440.
number of affinization with epsilon = 3 is 14
average number of affinization = 17.524650478292862
Path 90 | total_timesteps 1457.
number of affinization with epsilon = 3 is 11
average number of affinization = 17.523690406121247
Path 91 | total_timesteps 1470.
number of affinization with epsilon = 3 is 11
average number of affinization = 17.522730616448435
Path 92 | total_timesteps 1483.
number of affinization with epsilon = 3 is 45
average number of affinization = 17.52677258017064
Path 93 | total_timesteps 1532.
number of affinization with epsilon = 3 is 30
average number of affinization = 17.528607148110016
Path 94 | total_timesteps 1565.
number of affinization with epsilon = 3 is 18
average number of affinization = 17.528676470588234
Path 95 | total_timesteps 1585.
number of affinization with epsilon = 3 is 9
average number of affinization = 17.527422437876783
Path 96 | total_timesteps 1597.
number of affinization with epsilon = 3 is 15
average number of affinization = 17.527050867391942
Path 97 | total_timesteps 1613.
number of affinization with epsilon = 3 is 15
average number of affinization = 17.52667940614435
Path 98 | total_timesteps 1633.
number of affinization with epsilon = 3 is 6
average number of affinization = 17.52498530276308
Path 99 | total_timesteps 1641.
number of affinization with epsilon = 3 is 16
average number of affinization = 17.524761204996327
Path 100 | total_timesteps 1661.
number of affinization with epsilon = 3 is 12
average number of affinization = 17.523949456362033
Path 101 | total_timesteps 1677.
number of affinization with epsilon = 3 is 24
average number of affinization = 17.52490083737329
Path 102 | total_timesteps 1703.
number of affinization with epsilon = 3 is 17
average number of affinization = 17.52482373678026
Path 103 | total_timesteps 1724.
number of affinization with epsilon = 3 is 17
average number of affinization = 17.524746658833898
Path 104 | total_timesteps 1744.
number of affinization with epsilon = 3 is 6
average number of affinization = 17.523054331864905
Path 105 | total_timesteps 1752.
number of affinization with epsilon = 3 is 15
average number of affinization = 17.522683893701366
Path 106 | total_timesteps 1768.
number of affinization with epsilon = 3 is 13
average number of affinization = 17.522019964768056
Path 107 | total_timesteps 1785.
number of affinization with epsilon = 3 is 10
average number of affinization = 17.52091589608102
Path 108 | total_timesteps 1797.
number of affinization with epsilon = 3 is 12
average number of affinization = 17.520105664807748
Path 109 | total_timesteps 1812.
number of affinization with epsilon = 3 is 25
average number of affinization = 17.521203228173146
Path 110 | total_timesteps 1838.
number of affinization with epsilon = 3 is 11
average number of affinization = 17.52024647887324
Path 111 | total_timesteps 1850.
number of affinization with epsilon = 3 is 18
average number of affinization = 17.52031685492152
Path 112 | total_timesteps 1869.
number of affinization with epsilon = 3 is 23
average number of affinization = 17.521120563215018
Path 113 | total_timesteps 1895.
number of affinization with epsilon = 3 is 7
average number of affinization = 17.519577650681917
Path 114 | total_timesteps 1905.
number of affinization with epsilon = 3 is 11
average number of affinization = 17.518621700879766
Path 115 | total_timesteps 1917.
number of affinization with epsilon = 3 is 22
average number of affinization = 17.519278698138102
Path 116 | total_timesteps 1942.
number of affinization with epsilon = 3 is 19
average number of affinization = 17.5194957490472
Path 117 | total_timesteps 1965.
number of affinization with epsilon = 3 is 12
average number of affinization = 17.518686794665104
Path 118 | total_timesteps 1979.
number of affinization with epsilon = 3 is 38
average number of affinization = 17.52168815943728
Path 119 | total_timesteps 2024.
number of affinization with epsilon = 3 is 4
average number of affinization = 17.51970695970696
Path 120 | total_timesteps 2033.
number of affinization with epsilon = 3 is 28
average number of affinization = 17.52124230881922
Path 121 | total_timesteps 2063.
number of affinization with epsilon = 3 is 9
average number of affinization = 17.519994140911088
Path 122 | total_timesteps 2074.
number of affinization with epsilon = 3 is 7
average number of affinization = 17.518453427065026
Path 123 | total_timesteps 2082.
number of affinization with epsilon = 3 is 6
average number of affinization = 17.51676673012154
Path 124 | total_timesteps 2093.
number of affinization with epsilon = 3 is 8
average number of affinization = 17.51537335285505
Path 125 | total_timesteps 2103.
number of affinization with epsilon = 3 is 16
average number of affinization = 17.515151515151516
Path 126 | total_timesteps 2122.
number of affinization with epsilon = 3 is 16
average number of affinization = 17.51492974238876
Path 127 | total_timesteps 2141.
number of affinization with epsilon = 3 is 7
average number of affinization = 17.51339089711693
Path 128 | total_timesteps 2150.
number of affinization with epsilon = 3 is 7
average number of affinization = 17.51185250219491
Path 129 | total_timesteps 2160.
number of affinization with epsilon = 3 is 10
average number of affinization = 17.510753474762254
Path 130 | total_timesteps 2173.
number of affinization with epsilon = 3 is 10
average number of affinization = 17.509654768870686
Path 131 | total_timesteps 2185.
number of affinization with epsilon = 3 is 16
average number of affinization = 17.50943396226415
Path 132 | total_timesteps 2204.
number of affinization with epsilon = 3 is 14
average number of affinization = 17.50892073705762
Path 133 | total_timesteps 2219.
number of affinization with epsilon = 3 is 23
average number of affinization = 17.509723643807575
Path 134 | total_timesteps 2243.
number of affinization with epsilon = 3 is 8
average number of affinization = 17.508333333333333
Path 135 | total_timesteps 2252.
number of affinization with epsilon = 3 is 14
average number of affinization = 17.507820494079812
Path 136 | total_timesteps 2268.
number of affinization with epsilon = 3 is 12
average number of affinization = 17.50701549254604
Path 137 | total_timesteps 2281.
number of affinization with epsilon = 3 is 10
average number of affinization = 17.505918456817184
Path 138 | total_timesteps 2294.
number of affinization with epsilon = 3 is 16
average number of affinization = 17.505698421975453
Path 139 | total_timesteps 2315.
number of affinization with epsilon = 3 is 10
average number of affinization = 17.504601899196494
Path 140 | total_timesteps 2327.
number of affinization with epsilon = 3 is 10
average number of affinization = 17.50350569675723
Path 141 | total_timesteps 2341.
number of affinization with epsilon = 3 is 10
average number of affinization = 17.502409814517307
Path 142 | total_timesteps 2352.
number of affinization with epsilon = 3 is 15
average number of affinization = 17.502044392523363
Path 143 | total_timesteps 2371.
number of affinization with epsilon = 3 is 7
average number of affinization = 17.50051102350708
Path 144 | total_timesteps 2381.
number of affinization with epsilon = 3 is 20
average number of affinization = 17.50087591240876
Path 145 | total_timesteps 2404.
number of affinization with epsilon = 3 is 18
average number of affinization = 17.500948766603415
Path 146 | total_timesteps 2425.
number of affinization with epsilon = 3 is 23
average number of affinization = 17.501751313485112
Path 147 | total_timesteps 2451.
number of affinization with epsilon = 3 is 5
average number of affinization = 17.49992703925288
Path 148 | total_timesteps 2458.
number of affinization with epsilon = 3 is 14
average number of affinization = 17.49941639918296
Path 149 | total_timesteps 2477.
number of affinization with epsilon = 3 is 11
average number of affinization = 17.498468271334794
Path 150 | total_timesteps 2489.
number of affinization with epsilon = 3 is 11
average number of affinization = 17.49752042007001
Path 151 | total_timesteps 2502.
number of affinization with epsilon = 3 is 29
average number of affinization = 17.49919789995625
Path 152 | total_timesteps 2539.
number of affinization with epsilon = 3 is 18
average number of affinization = 17.499270924467776
Path 153 | total_timesteps 2562.
number of affinization with epsilon = 3 is 9
average number of affinization = 17.498031783058757
Path 154 | total_timesteps 2573.
number of affinization with epsilon = 3 is 9
average number of affinization = 17.496793002915453
Path 155 | total_timesteps 2585.
number of affinization with epsilon = 3 is 11
average number of affinization = 17.4958460865763
Path 156 | total_timesteps 2599.
number of affinization with epsilon = 3 is 14
average number of affinization = 17.495336636549112
Path 157 | total_timesteps 2614.
number of affinization with epsilon = 3 is 13
average number of affinization = 17.49468162611103
Path 158 | total_timesteps 2632.
number of affinization with epsilon = 3 is 9
average number of affinization = 17.493444055944057
Path 159 | total_timesteps 2643.
number of affinization with epsilon = 3 is 9
average number of affinization = 17.492206846321924
Path 160 | total_timesteps 2657.
number of affinization with epsilon = 3 is 10
average number of affinization = 17.49111564229537
Path 161 | total_timesteps 2671.
number of affinization with epsilon = 3 is 25
average number of affinization = 17.492209116062327
Path 162 | total_timesteps 2697.
number of affinization with epsilon = 3 is 15
average number of affinization = 17.491846243447874
Path 163 | total_timesteps 2714.
number of affinization with epsilon = 3 is 20
average number of affinization = 17.492211384481003
Path 164 | total_timesteps 2737.
number of affinization with epsilon = 3 is 8
average number of affinization = 17.490829694323143
Path 165 | total_timesteps 2748.
number of affinization with epsilon = 3 is 20
average number of affinization = 17.491194877019357
Path 166 | total_timesteps 2773.
number of affinization with epsilon = 3 is 22
average number of affinization = 17.4918509895227
Path 167 | total_timesteps 2800.
number of affinization with epsilon = 3 is 12
average number of affinization = 17.49105194238324
Path 168 | total_timesteps 2816.
number of affinization with epsilon = 3 is 7
average number of affinization = 17.489525749199885
Path 169 | total_timesteps 2825.
number of affinization with epsilon = 3 is 13
average number of affinization = 17.488872727272728
Path 170 | total_timesteps 2840.
number of affinization with epsilon = 3 is 10
average number of affinization = 17.487783595113438
Path 171 | total_timesteps 2852.
number of affinization with epsilon = 3 is 16
average number of affinization = 17.487567253162716
Path 172 | total_timesteps 2871.
number of affinization with epsilon = 3 is 9
average number of affinization = 17.486333236405933
Path 173 | total_timesteps 2885.
number of affinization with epsilon = 3 is 6
average number of affinization = 17.4846634685274
Path 174 | total_timesteps 2893.
number of affinization with epsilon = 3 is 13
average number of affinization = 17.484011627906977
Path 175 | total_timesteps 2908.
number of affinization with epsilon = 3 is 20
average number of affinization = 17.484377270745533
Path 176 | total_timesteps 2932.
number of affinization with epsilon = 3 is 9
average number of affinization = 17.48314443475734
Path 177 | total_timesteps 2944.
number of affinization with epsilon = 3 is 10
average number of affinization = 17.482057242481478
Path 178 | total_timesteps 2957.
number of affinization with epsilon = 3 is 17
average number of affinization = 17.481987216734456
Path 179 | total_timesteps 2979.
number of affinization with epsilon = 3 is 7
average number of affinization = 17.480464778503993
Path 180 | total_timesteps 2987.
number of affinization with epsilon = 3 is 12
average number of affinization = 17.479668893406913
Path 181 | total_timesteps 3001.
number of affinization with epsilon = 3 is 24
average number of affinization = 17.48061565267896
Path 182 | total_timesteps 3028.
number of affinization with epsilon = 3 is 10
average number of affinization = 17.47952961672474
Path 183 | total_timesteps 3039.
number of affinization with epsilon = 3 is 10
average number of affinization = 17.478443896066192
Path 184 | total_timesteps 3050.
number of affinization with epsilon = 3 is 11
average number of affinization = 17.477503628447025
Path 185 | total_timesteps 3064.
number of affinization with epsilon = 3 is 5
average number of affinization = 17.47569293281091
Path 186 | total_timesteps 3074.
number of affinization with epsilon = 3 is 7
average number of affinization = 17.47417295414974
Path 187 | total_timesteps 3084.
number of affinization with epsilon = 3 is 16
average number of affinization = 17.473959088930798
Path 188 | total_timesteps 3104.
number of affinization with epsilon = 3 is 13
average number of affinization = 17.473310124746156
Path 189 | total_timesteps 3118.
number of affinization with epsilon = 3 is 21
average number of affinization = 17.47382160986222
Path 190 | total_timesteps 3144.
number of affinization with epsilon = 3 is 8
average number of affinization = 17.472447795823665
Path 191 | total_timesteps 3153.
number of affinization with epsilon = 3 is 14
average number of affinization = 17.471944323618963
Path 192 | total_timesteps 3172.
number of affinization with epsilon = 3 is 12
average number of affinization = 17.471151058277762
Path 193 | total_timesteps 3187.
number of affinization with epsilon = 3 is 7
average number of affinization = 17.469633280185533
Path 194 | total_timesteps 3197.
number of affinization with epsilon = 3 is 18
average number of affinization = 17.469710144927536
Path 195 | total_timesteps 3219.
number of affinization with epsilon = 3 is 18
average number of affinization = 17.46978698739313
Path 196 | total_timesteps 3240.
number of affinization with epsilon = 3 is 17
average number of affinization = 17.46971892205158
Path 197 | total_timesteps 3259.
number of affinization with epsilon = 3 is 18
average number of affinization = 17.469795740982182
Path 198 | total_timesteps 3279.
number of affinization with epsilon = 3 is 9
average number of affinization = 17.468568945538816
Path 199 | total_timesteps 3292.
number of affinization with epsilon = 3 is 11
average number of affinization = 17.467632150615497
Path 200 | total_timesteps 3305.
number of affinization with epsilon = 3 is 10
average number of affinization = 17.466550825369243
Path 201 | total_timesteps 3318.
number of affinization with epsilon = 3 is 8
average number of affinization = 17.465180251918344
Path 202 | total_timesteps 3328.
number of affinization with epsilon = 3 is 16
average number of affinization = 17.46496815286624
Path 203 | total_timesteps 3345.
number of affinization with epsilon = 3 is 7
average number of affinization = 17.46345346649298
Path 204 | total_timesteps 3356.
number of affinization with epsilon = 3 is 15
average number of affinization = 17.463096960926194
Path 205 | total_timesteps 3373.
number of affinization with epsilon = 3 is 13
average number of affinization = 17.462451164809725
Path 206 | total_timesteps 3388.
number of affinization with epsilon = 3 is 27
average number of affinization = 17.46383101851852
Path 207 | total_timesteps 3419.
number of affinization with epsilon = 3 is 12
average number of affinization = 17.463040648054392
Path 208 | total_timesteps 3434.
number of affinization with epsilon = 3 is 13
average number of affinization = 17.462395140295055
Path 209 | total_timesteps 3450.
number of affinization with epsilon = 3 is 25
average number of affinization = 17.46348517715112
Path 210 | total_timesteps 3479.
number of affinization with epsilon = 3 is 9
average number of affinization = 17.462261422787737
Path 211 | total_timesteps 3490.
number of affinization with epsilon = 3 is 10
average number of affinization = 17.461182593609948
Path 212 | total_timesteps 3502.
number of affinization with epsilon = 3 is 33
average number of affinization = 17.463428736629083
Path 213 | total_timesteps 3541.
number of affinization with epsilon = 3 is 30
average number of affinization = 17.46524064171123
Path 214 | total_timesteps 3578.
number of affinization with epsilon = 3 is 13
average number of affinization = 17.464595375722542
Path 215 | total_timesteps 3594.
number of affinization with epsilon = 3 is 33
average number of affinization = 17.466840052015606
Path 216 | total_timesteps 3632.
number of affinization with epsilon = 3 is 28
average number of affinization = 17.468361745160358
Path 217 | total_timesteps 3663.
number of affinization with epsilon = 3 is 20
average number of affinization = 17.46872743030478
Path 218 | total_timesteps 3686.
number of affinization with epsilon = 3 is 11
average number of affinization = 17.46779318313114
Path 219 | total_timesteps 3701.
number of affinization with epsilon = 3 is 12
average number of affinization = 17.467003610108303
Path 220 | total_timesteps 3718.
number of affinization with epsilon = 3 is 15
average number of affinization = 17.46664741553566
Path 221 | total_timesteps 3738.
number of affinization with epsilon = 3 is 10
average number of affinization = 17.465569510610653
Path 222 | total_timesteps 3750.
number of affinization with epsilon = 3 is 12
average number of affinization = 17.464780600461893
Path 223 | total_timesteps 3763.
number of affinization with epsilon = 3 is 8
average number of affinization = 17.463414634146343
Path 224 | total_timesteps 3772.
number of affinization with epsilon = 3 is 27
average number of affinization = 17.464790764790767
Path 225 | total_timesteps 3806.
number of affinization with epsilon = 3 is 8
average number of affinization = 17.463425191170106
Path 226 | total_timesteps 3816.
number of affinization with epsilon = 3 is 4
average number of affinization = 17.461482977495674
Path 227 | total_timesteps 3824.
number of affinization with epsilon = 3 is 13
average number of affinization = 17.460839463435743
Path 228 | total_timesteps 3839.
number of affinization with epsilon = 3 is 14
average number of affinization = 17.46034035188924
Path 229 | total_timesteps 3857.
number of affinization with epsilon = 3 is 5
average number of affinization = 17.458543619322278
Path 230 | total_timesteps 3867.
number of affinization with epsilon = 3 is 7
average number of affinization = 17.45703575547866
Path 231 | total_timesteps 3876.
number of affinization with epsilon = 3 is 8
average number of affinization = 17.455672480899523
Path 232 | total_timesteps 3885.
number of affinization with epsilon = 3 is 32
average number of affinization = 17.457768809455175
Path 233 | total_timesteps 3925.
number of affinization with epsilon = 3 is 22
average number of affinization = 17.458423403948697
Path 234 | total_timesteps 3952.
number of affinization with epsilon = 3 is 21
average number of affinization = 17.45893371757925
Path 235 | total_timesteps 3975.
number of affinization with epsilon = 3 is 16
average number of affinization = 17.458723526869328
Path 236 | total_timesteps 3993.
number of affinization with epsilon = 3 is 10
average number of affinization = 17.457649092480555
Path 237 | total_timesteps 4008.
number of affinization with epsilon = 3 is 7
average number of affinization = 17.456142877718566
Path 238 | total_timesteps 4019.
number of affinization with epsilon = 3 is 22
average number of affinization = 17.456797235023043
Path 239 | total_timesteps 4044.
number of affinization with epsilon = 3 is 13
average number of affinization = 17.456155507559394
Path 240 | total_timesteps 4063.
number of affinization with epsilon = 3 is 7
average number of affinization = 17.454650158364526
Path 241 | total_timesteps 4073.
number of affinization with epsilon = 3 is 5
average number of affinization = 17.452857348495755
Path 242 | total_timesteps 4080.
number of affinization with epsilon = 3 is 22
average number of affinization = 17.453511801957397
Path 243 | total_timesteps 4106.
number of affinization with epsilon = 3 is 8
average number of affinization = 17.45215138868902
Path 244 | total_timesteps 4117.
number of affinization with epsilon = 3 is 26
average number of affinization = 17.45338129496403
Path 245 | total_timesteps 4146.
number of affinization with epsilon = 3 is 25
average number of affinization = 17.45446698316789
Path 246 | total_timesteps 4174.
number of affinization with epsilon = 3 is 12
average number of affinization = 17.453682393555813
Path 247 | total_timesteps 4189.
number of affinization with epsilon = 3 is 10
average number of affinization = 17.452610384006903
Path 248 | total_timesteps 4202.
number of affinization with epsilon = 3 is 13
average number of affinization = 17.45197008915732
Path 249 | total_timesteps 4218.
number of affinization with epsilon = 3 is 6
average number of affinization = 17.450323508267434
Path 250 | total_timesteps 4229.
number of affinization with epsilon = 3 is 9
average number of affinization = 17.449108683151238
Path 251 | total_timesteps 4242.
number of affinization with epsilon = 3 is 11
average number of affinization = 17.448181687508985
Path 252 | total_timesteps 4254.
number of affinization with epsilon = 3 is 13
average number of affinization = 17.447542397240586
Path 253 | total_timesteps 4269.
number of affinization with epsilon = 3 is 19
average number of affinization = 17.447765483546487
Path 254 | total_timesteps 4293.
number of affinization with epsilon = 3 is 23
average number of affinization = 17.448563218390806
Path 255 | total_timesteps 4320.
number of affinization with epsilon = 3 is 29
average number of affinization = 17.45022266915673
Path 256 | total_timesteps 4355.
number of affinization with epsilon = 3 is 11
average number of affinization = 17.449296179258834
Path 257 | total_timesteps 4369.
number of affinization with epsilon = 3 is 8
average number of affinization = 17.44793910670688
Path 258 | total_timesteps 4378.
number of affinization with epsilon = 3 is 15
average number of affinization = 17.44758759333716
Path 259 | total_timesteps 4395.
number of affinization with epsilon = 3 is 39
average number of affinization = 17.450681981335247
Path 260 | total_timesteps 4438.
number of affinization with epsilon = 3 is 16
average number of affinization = 17.450473729543496
Path 261 | total_timesteps 4456.
number of affinization with epsilon = 3 is 16
average number of affinization = 17.45026553753409
Path 262 | total_timesteps 4475.
number of affinization with epsilon = 3 is 16
average number of affinization = 17.450057405281285
Path 263 | total_timesteps 4492.
number of affinization with epsilon = 3 is 21
average number of affinization = 17.450566795810015
Path 264 | total_timesteps 4519.
number of affinization with epsilon = 3 is 18
average number of affinization = 17.4506456241033
Path 265 | total_timesteps 4541.
number of affinization with epsilon = 3 is 11
average number of affinization = 17.44972026968871
Path 266 | total_timesteps 4555.
number of affinization with epsilon = 3 is 17
average number of affinization = 17.449655765920827
Path 267 | total_timesteps 4576.
number of affinization with epsilon = 3 is 8
average number of affinization = 17.448300587982217
Path 268 | total_timesteps 4585.
number of affinization with epsilon = 3 is 9
average number of affinization = 17.44708918841411
Path 269 | total_timesteps 4596.
number of affinization with epsilon = 3 is 15
average number of affinization = 17.44673835125448
Path 270 | total_timesteps 4614.
number of affinization with epsilon = 3 is 14
average number of affinization = 17.446244266055047
Path 271 | total_timesteps 4630.
number of affinization with epsilon = 3 is 29
average number of affinization = 17.44790024365773
Path 272 | total_timesteps 4661.
number of affinization with epsilon = 3 is 14
average number of affinization = 17.447406133562627
Path 273 | total_timesteps 4676.
number of affinization with epsilon = 3 is 16
average number of affinization = 17.447198739074366
Path 274 | total_timesteps 4698.
number of affinization with epsilon = 3 is 15
average number of affinization = 17.446848137535817
Path 275 | total_timesteps 4715.
number of affinization with epsilon = 3 is 15
average number of affinization = 17.44649763644177
Path 276 | total_timesteps 4733.
number of affinization with epsilon = 3 is 20
average number of affinization = 17.446863362933257
Path 277 | total_timesteps 4759.
number of affinization with epsilon = 3 is 10
average number of affinization = 17.445796935414577
Path 278 | total_timesteps 4772.
number of affinization with epsilon = 3 is 15
average number of affinization = 17.44544673539519
Path 279 | total_timesteps 4790.
number of affinization with epsilon = 3 is 16
average number of affinization = 17.44523979957051
Path 280 | total_timesteps 4807.
number of affinization with epsilon = 3 is 12
average number of affinization = 17.444460349269967
Path 281 | total_timesteps 4822.
number of affinization with epsilon = 3 is 13
average number of affinization = 17.443824245026477
Path 282 | total_timesteps 4837.
number of affinization with epsilon = 3 is 9
average number of affinization = 17.442615912993702
Path 283 | total_timesteps 4848.
number of affinization with epsilon = 3 is 10
average number of affinization = 17.441551008728002
Path 284 | total_timesteps 4859.
number of affinization with epsilon = 3 is 7
average number of affinization = 17.44005722460658
Path 285 | total_timesteps 4870.
number of affinization with epsilon = 3 is 10
average number of affinization = 17.438992990988414
Path 286 | total_timesteps 4883.
number of affinization with epsilon = 3 is 8
average number of affinization = 17.437643020594965
Path 287 | total_timesteps 4892.
number of affinization with epsilon = 3 is 16
average number of affinization = 17.43743743743744
Path 288 | total_timesteps 4911.
number of affinization with epsilon = 3 is 11
average number of affinization = 17.43651701458393
Path 289 | total_timesteps 4927.
number of affinization with epsilon = 3 is 7
average number of affinization = 17.435025017869908
Path 290 | total_timesteps 4938.
number of affinization with epsilon = 3 is 8
average number of affinization = 17.433676386506576
Path 291 | total_timesteps 4948.
number of affinization with epsilon = 3 is 9
average number of affinization = 17.432471059025296
Path 292 | total_timesteps 4963.
number of affinization with epsilon = 3 is 19
average number of affinization = 17.432695055730207
Path 293 | total_timesteps 4986.
number of affinization with epsilon = 3 is 6
average number of affinization = 17.431061580225748
Path 294 | total_timesteps 4994.
number of affinization with epsilon = 3 is 14
average number of affinization = 17.43057142857143
Path 295 | total_timesteps 5011.
number of affinization with epsilon = 3 is 4
average number of affinization = 17.42865304956435
Path 296 | total_timesteps 5018.
number of affinization with epsilon = 3 is 9
average number of affinization = 17.427449300199942
Path 297 | total_timesteps 5029.
number of affinization with epsilon = 3 is 22
average number of affinization = 17.42810224189633
Path 298 | total_timesteps 5055.
number of affinization with epsilon = 3 is 8
average number of affinization = 17.426756139348942
Path 299 | total_timesteps 5066.
number of affinization with epsilon = 3 is 15
average number of affinization = 17.42640970735189
Path 300 | total_timesteps 5086.
number of affinization with epsilon = 3 is 20
average number of affinization = 17.42677704824436
Path 301 | total_timesteps 5110.
number of affinization with epsilon = 3 is 11
average number of affinization = 17.425859854431284
Path 302 | total_timesteps 5125.
number of affinization with epsilon = 3 is 7
average number of affinization = 17.42437214611872
Path 303 | total_timesteps 5134.
number of affinization with epsilon = 3 is 25
average number of affinization = 17.425452989014126
Path 304 | total_timesteps 5164.
number of affinization with epsilon = 3 is 15
average number of affinization = 17.425106990014264
Path 305 | total_timesteps 5184.
number of affinization with epsilon = 3 is 9
average number of affinization = 17.423905291684495
Path 306 | total_timesteps 5194.
number of affinization with epsilon = 3 is 9
average number of affinization = 17.422703936109528
Path 307 | total_timesteps 5206.
number of affinization with epsilon = 3 is 9
average number of affinization = 17.421502923142736
Path 308 | total_timesteps 5219.
number of affinization with epsilon = 3 is 12
average number of affinization = 17.42072996863416
Path 309 | total_timesteps 5234.
number of affinization with epsilon = 3 is 8
average number of affinization = 17.419387027797576
Path 310 | total_timesteps 5244.
number of affinization with epsilon = 3 is 10
average number of affinization = 17.41832953249715
Path 311 | total_timesteps 5258.
number of affinization with epsilon = 3 is 11
average number of affinization = 17.417414849650847
Path 312 | total_timesteps 5274.
number of affinization with epsilon = 3 is 6
average number of affinization = 17.415787973781704
Path 313 | total_timesteps 5283.
number of affinization with epsilon = 3 is 15
average number of affinization = 17.41544379541245
Path 314 | total_timesteps 5299.
number of affinization with epsilon = 3 is 6
average number of affinization = 17.413817663817664
Path 315 | total_timesteps 5308.
number of affinization with epsilon = 3 is 13
average number of affinization = 17.413189004415326
Path 316 | total_timesteps 5322.
number of affinization with epsilon = 3 is 15
average number of affinization = 17.412845343207064
Path 317 | total_timesteps 5338.
number of affinization with epsilon = 3 is 12
average number of affinization = 17.41207461198918
Path 318 | total_timesteps 5358.
number of affinization with epsilon = 3 is 10
average number of affinization = 17.41101936218679
Path 319 | total_timesteps 5370.
number of affinization with epsilon = 3 is 7
average number of affinization = 17.409537366548044
Path 320 | total_timesteps 5379.
number of affinization with epsilon = 3 is 19
average number of affinization = 17.409763734699688
Path 321 | total_timesteps 5402.
number of affinization with epsilon = 3 is 8
average number of affinization = 17.408424647787108
Path 322 | total_timesteps 5412.
number of affinization with epsilon = 3 is 11
average number of affinization = 17.40751280591918
Path 323 | total_timesteps 5424.
number of affinization with epsilon = 3 is 10
average number of affinization = 17.40645895575473
Path 324 | total_timesteps 5436.
number of affinization with epsilon = 3 is 10
average number of affinization = 17.405405405405407
Path 325 | total_timesteps 5447.
number of affinization with epsilon = 3 is 7
average number of affinization = 17.403925472905705
Path 326 | total_timesteps 5456.
number of affinization with epsilon = 3 is 9
average number of affinization = 17.40273037542662
Path 327 | total_timesteps 5468.
number of affinization with epsilon = 3 is 10
average number of affinization = 17.40167780463529
Path 328 | total_timesteps 5480.
number of affinization with epsilon = 3 is 10
average number of affinization = 17.40062553312482
Path 329 | total_timesteps 5492.
number of affinization with epsilon = 3 is 35
average number of affinization = 17.403127221037668
Path 330 | total_timesteps 5532.
number of affinization with epsilon = 3 is 26
average number of affinization = 17.404349061967025
Path 331 | total_timesteps 5560.
number of affinization with epsilon = 3 is 8
average number of affinization = 17.403012647434988
Path 332 | total_timesteps 5571.
number of affinization with epsilon = 3 is 7
average number of affinization = 17.40153452685422
Path 333 | total_timesteps 5580.
number of affinization with epsilon = 3 is 13
average number of affinization = 17.400909220059667
Path 334 | total_timesteps 5595.
number of affinization with epsilon = 3 is 10
average number of affinization = 17.399857954545453
Path 335 | total_timesteps 5607.
number of affinization with epsilon = 3 is 7
average number of affinization = 17.398380911802303
Path 336 | total_timesteps 5616.
number of affinization with epsilon = 3 is 21
average number of affinization = 17.398892360124965
Path 337 | total_timesteps 5640.
number of affinization with epsilon = 3 is 16
average number of affinization = 17.398693738463724
Path 338 | total_timesteps 5661.
number of affinization with epsilon = 3 is 9
average number of affinization = 17.397501419647927
Path 339 | total_timesteps 5675.
number of affinization with epsilon = 3 is 18
average number of affinization = 17.397586941092975
Path 340 | total_timesteps 5696.
number of affinization with epsilon = 3 is 9
average number of affinization = 17.396395117797333
Path 341 | total_timesteps 5710.
number of affinization with epsilon = 3 is 8
average number of affinization = 17.395061728395063
Path 342 | total_timesteps 5721.
number of affinization with epsilon = 3 is 13
average number of affinization = 17.394438138479
Path 343 | total_timesteps 5737.
number of affinization with epsilon = 3 is 12
average number of affinization = 17.39367286139878
Path 344 | total_timesteps 5751.
number of affinization with epsilon = 3 is 10
average number of affinization = 17.392624113475176
Path 345 | total_timesteps 5765.
number of affinization with epsilon = 3 is 11
average number of affinization = 17.391717486881294
Path 346 | total_timesteps 5780.
number of affinization with epsilon = 3 is 10
average number of affinization = 17.390669313669882
Path 347 | total_timesteps 5794.
number of affinization with epsilon = 3 is 10
average number of affinization = 17.389621437686092
Path 348 | total_timesteps 5806.
number of affinization with epsilon = 3 is 7
average number of affinization = 17.388148568188264
Path 349 | total_timesteps 5817.
number of affinization with epsilon = 3 is 9
average number of affinization = 17.386959603118356
Path 350 | total_timesteps 5830.
number of affinization with epsilon = 3 is 7
average number of affinization = 17.385487528344672
Path 351 | total_timesteps 5838.
number of affinization with epsilon = 3 is 18
average number of affinization = 17.385574606773417
Path 352 | total_timesteps 5861.
number of affinization with epsilon = 3 is 24
average number of affinization = 17.3865117597053
Path 353 | total_timesteps 5892.
number of affinization with epsilon = 3 is 19
average number of affinization = 17.386740331491712
Path 354 | total_timesteps 5914.
number of affinization with epsilon = 3 is 6
average number of affinization = 17.385127478753542
Path 355 | total_timesteps 5922.
number of affinization with epsilon = 3 is 10
average number of affinization = 17.384081574847755
Path 356 | total_timesteps 5934.
number of affinization with epsilon = 3 is 9
average number of affinization = 17.382894364202777
Path 357 | total_timesteps 5946.
number of affinization with epsilon = 3 is 10
average number of affinization = 17.381849072632026
Path 358 | total_timesteps 5958.
number of affinization with epsilon = 3 is 12
average number of affinization = 17.381087202718007
Path 359 | total_timesteps 5972.
number of affinization with epsilon = 3 is 20
average number of affinization = 17.38145789101203
Path 360 | total_timesteps 5994.
number of affinization with epsilon = 3 is 8
average number of affinization = 17.380130200962356
Done generating on-policy rollouts.
Updating normalization.
Done updating normalization.
----------------------------
| AverageReturn | -5.86    |
| Iteration     | 24       |
| MaximumReturn | 10.4     |
| MinimumReturn | -17.6    |
| TotalSamples  | 104251   |
----------------------------
itr #25 | 
Fitting dynamics.
Fitting model 0 (0-based) in the ensemble of 2 models
Validation loss = 0.013979950919747353
Validation loss = 0.014230098575353622
Validation loss = 0.013794665224850178
Validation loss = 0.013558485545217991
Validation loss = 0.013452202081680298
Validation loss = 0.013783098198473454
Validation loss = 0.013376974500715733
Validation loss = 0.013608921319246292
Validation loss = 0.01353953406214714
Validation loss = 0.013529857620596886
Validation loss = 0.013682376593351364
Fitting model 1 (0-based) in the ensemble of 2 models
Validation loss = 0.01393059454858303
Validation loss = 0.013879870064556599
Validation loss = 0.013267113827168941
Validation loss = 0.013270593248307705
Validation loss = 0.013285179622471333
Validation loss = 0.013115175999701023
Validation loss = 0.013395742513239384
Validation loss = 0.013746963813900948
Validation loss = 0.013648644089698792
Validation loss = 0.013385942205786705
Done fitting dynamics.
Updating randomness.
Done updating randomness.
Training policy using TRPO.
Re-initialize init_std.
Obtaining samples for iteration 0...
Obtaining samples for iteration 1...
Obtaining samples for iteration 2...
Obtaining samples for iteration 3...
Obtaining samples for iteration 4...
Obtaining samples for iteration 5...
Obtaining samples for iteration 6...
Obtaining samples for iteration 7...
Obtaining samples for iteration 8...
Obtaining samples for iteration 9...
Obtaining samples for iteration 10...
Obtaining samples for iteration 11...
Obtaining samples for iteration 12...
Obtaining samples for iteration 13...
Obtaining samples for iteration 14...
Obtaining samples for iteration 15...
Obtaining samples for iteration 16...
Obtaining samples for iteration 17...
Obtaining samples for iteration 18...
Obtaining samples for iteration 19...
Done training policy.
Generating on-policy rollouts.
Path 0 | total_timesteps 0.
number of affinization with epsilon = 3 is 5
average number of affinization = 17.37837837837838
Path 1 | total_timesteps 11.
number of affinization with epsilon = 3 is 10
average number of affinization = 17.377334465195247
Path 2 | total_timesteps 24.
number of affinization with epsilon = 3 is 8
average number of affinization = 17.376007921912574
Path 3 | total_timesteps 35.
number of affinization with epsilon = 3 is 8
average number of affinization = 17.374681753889675
Path 4 | total_timesteps 48.
number of affinization with epsilon = 3 is 20
average number of affinization = 17.375053033517183
Path 5 | total_timesteps 72.
number of affinization with epsilon = 3 is 23
average number of affinization = 17.375848416289593
Path 6 | total_timesteps 98.
number of affinization with epsilon = 3 is 11
average number of affinization = 17.374946981478864
Path 7 | total_timesteps 110.
number of affinization with epsilon = 3 is 14
average number of affinization = 17.374469889737064
Path 8 | total_timesteps 129.
number of affinization with epsilon = 3 is 20
average number of affinization = 17.374840989399292
Path 9 | total_timesteps 151.
number of affinization with epsilon = 3 is 9
average number of affinization = 17.37365743357829
Path 10 | total_timesteps 161.
number of affinization with epsilon = 3 is 13
average number of affinization = 17.373039423484528
Path 11 | total_timesteps 179.
number of affinization with epsilon = 3 is 5
average number of affinization = 17.371291325233116
Path 12 | total_timesteps 186.
number of affinization with epsilon = 3 is 22
average number of affinization = 17.371945189998588
Path 13 | total_timesteps 211.
number of affinization with epsilon = 3 is 7
average number of affinization = 17.3704802259887
Path 14 | total_timesteps 219.
number of affinization with epsilon = 3 is 24
average number of affinization = 17.371416466600763
Path 15 | total_timesteps 244.
number of affinization with epsilon = 3 is 26
average number of affinization = 17.372634848912735
Path 16 | total_timesteps 273.
number of affinization with epsilon = 3 is 16
average number of affinization = 17.372441056049695
Path 17 | total_timesteps 293.
number of affinization with epsilon = 3 is 22
average number of affinization = 17.37309429700734
Path 18 | total_timesteps 317.
number of affinization with epsilon = 3 is 17
average number of affinization = 17.37304163726182
Path 19 | total_timesteps 342.
number of affinization with epsilon = 3 is 15
average number of affinization = 17.372706745695737
Path 20 | total_timesteps 360.
number of affinization with epsilon = 3 is 18
average number of affinization = 17.372795258924793
Path 21 | total_timesteps 380.
number of affinization with epsilon = 3 is 8
average number of affinization = 17.37147291196388
Path 22 | total_timesteps 391.
number of affinization with epsilon = 3 is 18
average number of affinization = 17.371561574269997
Path 23 | total_timesteps 413.
number of affinization with epsilon = 3 is 14
average number of affinization = 17.371086036671368
Path 24 | total_timesteps 431.
number of affinization with epsilon = 3 is 11
average number of affinization = 17.37018756169793
Path 25 | total_timesteps 445.
number of affinization with epsilon = 3 is 16
average number of affinization = 17.369994359842075
Path 26 | total_timesteps 466.
number of affinization with epsilon = 3 is 20
average number of affinization = 17.37036514873819
Path 27 | total_timesteps 489.
number of affinization with epsilon = 3 is 13
average number of affinization = 17.36974908373273
Path 28 | total_timesteps 507.
number of affinization with epsilon = 3 is 17
average number of affinization = 17.36969696969697
Path 29 | total_timesteps 525.
number of affinization with epsilon = 3 is 6
average number of affinization = 17.368094701240135
Path 30 | total_timesteps 533.
number of affinization with epsilon = 3 is 10
average number of affinization = 17.36705650274764
Path 31 | total_timesteps 546.
number of affinization with epsilon = 3 is 10
average number of affinization = 17.36601859678783
Path 32 | total_timesteps 560.
number of affinization with epsilon = 3 is 14
average number of affinization = 17.36554444287928
Path 33 | total_timesteps 576.
number of affinization with epsilon = 3 is 18
average number of affinization = 17.3656338028169
Path 34 | total_timesteps 596.
number of affinization with epsilon = 3 is 7
average number of affinization = 17.36417405999155
Path 35 | total_timesteps 604.
number of affinization with epsilon = 3 is 21
average number of affinization = 17.364686003942552
Path 36 | total_timesteps 627.
number of affinization with epsilon = 3 is 11
average number of affinization = 17.363789947909336
Path 37 | total_timesteps 640.
number of affinization with epsilon = 3 is 10
average number of affinization = 17.36275337837838
Path 38 | total_timesteps 651.
number of affinization with epsilon = 3 is 9
average number of affinization = 17.3615763546798
Path 39 | total_timesteps 661.
number of affinization with epsilon = 3 is 10
average number of affinization = 17.360540388404164
Path 40 | total_timesteps 674.
number of affinization with epsilon = 3 is 26
average number of affinization = 17.361756015196285
Path 41 | total_timesteps 705.
number of affinization with epsilon = 3 is 24
average number of affinization = 17.362689926842993
Path 42 | total_timesteps 733.
number of affinization with epsilon = 3 is 8
average number of affinization = 17.361372907581938
Path 43 | total_timesteps 743.
number of affinization with epsilon = 3 is 15
average number of affinization = 17.361040787623065
Path 44 | total_timesteps 765.
number of affinization with epsilon = 3 is 12
average number of affinization = 17.36028687948249
Path 45 | total_timesteps 781.
number of affinization with epsilon = 3 is 31
average number of affinization = 17.362204724409448
Path 46 | total_timesteps 817.
number of affinization with epsilon = 3 is 12
average number of affinization = 17.36145086461409
Path 47 | total_timesteps 831.
number of affinization with epsilon = 3 is 10
average number of affinization = 17.360416080967106
Path 48 | total_timesteps 844.
number of affinization with epsilon = 3 is 15
average number of affinization = 17.360084328882643
Path 49 | total_timesteps 864.
number of affinization with epsilon = 3 is 18
average number of affinization = 17.36017425519955
Path 50 | total_timesteps 887.
number of affinization with epsilon = 3 is 10
average number of affinization = 17.359140087115357
Path 51 | total_timesteps 903.
number of affinization with epsilon = 3 is 18
average number of affinization = 17.359230120820456
Path 52 | total_timesteps 925.
number of affinization with epsilon = 3 is 5
average number of affinization = 17.3574940300604
Path 53 | total_timesteps 934.
number of affinization with epsilon = 3 is 8
average number of affinization = 17.3561797752809
Path 54 | total_timesteps 943.
number of affinization with epsilon = 3 is 7
average number of affinization = 17.354725459907318
Path 55 | total_timesteps 953.
number of affinization with epsilon = 3 is 7
average number of affinization = 17.35327155293457
Path 56 | total_timesteps 963.
number of affinization with epsilon = 3 is 17
average number of affinization = 17.353221957040574
Path 57 | total_timesteps 982.
number of affinization with epsilon = 3 is 18
average number of affinization = 17.353312745648513
Path 58 | total_timesteps 1006.
number of affinization with epsilon = 3 is 8
average number of affinization = 17.352
Path 59 | total_timesteps 1017.
number of affinization with epsilon = 3 is 21
average number of affinization = 17.352511928150435
Path 60 | total_timesteps 1040.
number of affinization with epsilon = 3 is 2
average number of affinization = 17.350357794303353
Path 61 | total_timesteps 1048.
number of affinization with epsilon = 3 is 22
average number of affinization = 17.3510101010101
Path 62 | total_timesteps 1076.
number of affinization with epsilon = 3 is 14
average number of affinization = 17.350540047692522
Path 63 | total_timesteps 1091.
number of affinization with epsilon = 3 is 13
average number of affinization = 17.34992987377279
Path 64 | total_timesteps 1109.
number of affinization with epsilon = 3 is 9
average number of affinization = 17.348758939840135
Path 65 | total_timesteps 1120.
number of affinization with epsilon = 3 is 10
average number of affinization = 17.347728547392038
Path 66 | total_timesteps 1131.
number of affinization with epsilon = 3 is 6
average number of affinization = 17.34613766998458
Path 67 | total_timesteps 1139.
number of affinization with epsilon = 3 is 25
average number of affinization = 17.34721054107093
Path 68 | total_timesteps 1165.
number of affinization with epsilon = 3 is 5
average number of affinization = 17.345480028030835
Path 69 | total_timesteps 1172.
number of affinization with epsilon = 3 is 30
average number of affinization = 17.3472533632287
Path 70 | total_timesteps 1210.
number of affinization with epsilon = 3 is 11
average number of affinization = 17.346364018495166
Path 71 | total_timesteps 1223.
number of affinization with epsilon = 3 is 16
average number of affinization = 17.346175399271505
Path 72 | total_timesteps 1242.
number of affinization with epsilon = 3 is 11
average number of affinization = 17.34528645468553
Path 73 | total_timesteps 1255.
number of affinization with epsilon = 3 is 25
average number of affinization = 17.346358543417367
Path 74 | total_timesteps 1284.
number of affinization with epsilon = 3 is 25
average number of affinization = 17.34743033188629
Path 75 | total_timesteps 1313.
number of affinization with epsilon = 3 is 17
average number of affinization = 17.347381685802297
Path 76 | total_timesteps 1334.
number of affinization with epsilon = 3 is 23
average number of affinization = 17.34817303653927
Path 77 | total_timesteps 1359.
number of affinization with epsilon = 3 is 8
average number of affinization = 17.346864501679732
Path 78 | total_timesteps 1369.
number of affinization with epsilon = 3 is 16
average number of affinization = 17.34667599720084
Path 79 | total_timesteps 1386.
number of affinization with epsilon = 3 is 7
average number of affinization = 17.34522809963616
Path 80 | total_timesteps 1396.
number of affinization with epsilon = 3 is 18
average number of affinization = 17.34531971456555
Path 81 | total_timesteps 1416.
number of affinization with epsilon = 3 is 8
average number of affinization = 17.344012311135984
Path 82 | total_timesteps 1427.
number of affinization with epsilon = 3 is 11
average number of affinization = 17.343124912575185
Path 83 | total_timesteps 1439.
number of affinization with epsilon = 3 is 8
average number of affinization = 17.341818181818184
Path 84 | total_timesteps 1449.
number of affinization with epsilon = 3 is 25
average number of affinization = 17.34288910641868
Path 85 | total_timesteps 1480.
number of affinization with epsilon = 3 is 15
average number of affinization = 17.342561521252797
Path 86 | total_timesteps 1496.
number of affinization with epsilon = 3 is 12
average number of affinization = 17.341814623235006
Path 87 | total_timesteps 1509.
number of affinization with epsilon = 3 is 8
average number of affinization = 17.340508806262232
Path 88 | total_timesteps 1519.
number of affinization with epsilon = 3 is 12
average number of affinization = 17.339762403913348
Path 89 | total_timesteps 1532.
number of affinization with epsilon = 3 is 16
average number of affinization = 17.339575181665737
Path 90 | total_timesteps 1552.
number of affinization with epsilon = 3 is 5
average number of affinization = 17.337851054911276
Path 91 | total_timesteps 1561.
number of affinization with epsilon = 3 is 11
average number of affinization = 17.33696563285834
Path 92 | total_timesteps 1573.
number of affinization with epsilon = 3 is 8
average number of affinization = 17.335661405224194
Path 93 | total_timesteps 1583.
number of affinization with epsilon = 3 is 12
average number of affinization = 17.33491620111732
Path 94 | total_timesteps 1597.
number of affinization with epsilon = 3 is 10
average number of affinization = 17.333891914537077
Path 95 | total_timesteps 1610.
number of affinization with epsilon = 3 is 39
average number of affinization = 17.33691706227311
Path 96 | total_timesteps 1651.
number of affinization with epsilon = 3 is 6
average number of affinization = 17.33533435711294
Path 97 | total_timesteps 1661.
number of affinization with epsilon = 3 is 15
average number of affinization = 17.33500837520938
Path 98 | total_timesteps 1679.
number of affinization with epsilon = 3 is 9
average number of affinization = 17.333845080251223
Path 99 | total_timesteps 1693.
number of affinization with epsilon = 3 is 13
average number of affinization = 17.333240301423388
Path 100 | total_timesteps 1710.
number of affinization with epsilon = 3 is 6
average number of affinization = 17.331658992604996
Path 101 | total_timesteps 1720.
number of affinization with epsilon = 3 is 12
average number of affinization = 17.330915178571427
Path 102 | total_timesteps 1735.
number of affinization with epsilon = 3 is 9
average number of affinization = 17.329753103640677
Path 103 | total_timesteps 1746.
number of affinization with epsilon = 3 is 17
average number of affinization = 17.329707112970713
Path 104 | total_timesteps 1765.
number of affinization with epsilon = 3 is 13
average number of affinization = 17.3291033328685
Path 105 | total_timesteps 1779.
number of affinization with epsilon = 3 is 11
average number of affinization = 17.328220858895705
Path 106 | total_timesteps 1795.
number of affinization with epsilon = 3 is 10
average number of affinization = 17.327199219294577
Path 107 | total_timesteps 1807.
number of affinization with epsilon = 3 is 9
average number of affinization = 17.326038472260944
Path 108 | total_timesteps 1820.
number of affinization with epsilon = 3 is 12
average number of affinization = 17.325296167247387
Path 109 | total_timesteps 1834.
number of affinization with epsilon = 3 is 8
average number of affinization = 17.323996655518396
Path 110 | total_timesteps 1844.
number of affinization with epsilon = 3 is 9
average number of affinization = 17.322836839905253
Path 111 | total_timesteps 1857.
number of affinization with epsilon = 3 is 14
average number of affinization = 17.322373920312064
Path 112 | total_timesteps 1874.
number of affinization with epsilon = 3 is 8
average number of affinization = 17.321075358685054
Path 113 | total_timesteps 1884.
number of affinization with epsilon = 3 is 10
average number of affinization = 17.320055710306406
Path 114 | total_timesteps 1896.
number of affinization with epsilon = 3 is 8
average number of affinization = 17.318757833170867
Path 115 | total_timesteps 1907.
number of affinization with epsilon = 3 is 11
average number of affinization = 17.317878028404344
Path 116 | total_timesteps 1920.
number of affinization with epsilon = 3 is 9
average number of affinization = 17.316720033412224
Path 117 | total_timesteps 1932.
number of affinization with epsilon = 3 is 13
average number of affinization = 17.316119153674833
Path 118 | total_timesteps 1947.
number of affinization with epsilon = 3 is 11
average number of affinization = 17.315240083507305
Path 119 | total_timesteps 1961.
number of affinization with epsilon = 3 is 10
average number of affinization = 17.31422209852491
Path 120 | total_timesteps 1975.
number of affinization with epsilon = 3 is 22
average number of affinization = 17.314874078196745
Path 121 | total_timesteps 1999.
number of affinization with epsilon = 3 is 11
average number of affinization = 17.313995548135782
Path 122 | total_timesteps 2011.
number of affinization with epsilon = 3 is 14
average number of affinization = 17.313534566699122
Path 123 | total_timesteps 2026.
number of affinization with epsilon = 3 is 14
average number of affinization = 17.313073713490958
Path 124 | total_timesteps 2042.
number of affinization with epsilon = 3 is 15
average number of affinization = 17.31275205117508
Path 125 | total_timesteps 2060.
number of affinization with epsilon = 3 is 10
average number of affinization = 17.31173526140156
Path 126 | total_timesteps 2074.
number of affinization with epsilon = 3 is 28
average number of affinization = 17.3132211872654
Path 127 | total_timesteps 2104.
number of affinization with epsilon = 3 is 18
average number of affinization = 17.313316652766193
Path 128 | total_timesteps 2126.
number of affinization with epsilon = 3 is 12
average number of affinization = 17.312578179291176
Path 129 | total_timesteps 2141.
number of affinization with epsilon = 3 is 9
average number of affinization = 17.311423012784882
Path 130 | total_timesteps 2153.
number of affinization with epsilon = 3 is 10
average number of affinization = 17.31040711407531
Path 131 | total_timesteps 2164.
number of affinization with epsilon = 3 is 17
average number of affinization = 17.31036398999722
Path 132 | total_timesteps 2187.
number of affinization with epsilon = 3 is 6
average number of affinization = 17.3087928879011
Path 133 | total_timesteps 2195.
number of affinization with epsilon = 3 is 16
average number of affinization = 17.308611111111112
Path 134 | total_timesteps 2213.
number of affinization with epsilon = 3 is 11
average number of affinization = 17.307735036800445
Path 135 | total_timesteps 2228.
number of affinization with epsilon = 3 is 25
average number of affinization = 17.308803110247155
Path 136 | total_timesteps 2254.
number of affinization with epsilon = 3 is 8
average number of affinization = 17.307510759405805
Path 137 | total_timesteps 2263.
number of affinization with epsilon = 3 is 10
average number of affinization = 17.306496390893948
Path 138 | total_timesteps 2277.
number of affinization with epsilon = 3 is 17
average number of affinization = 17.30645385149202
Path 139 | total_timesteps 2296.
number of affinization with epsilon = 3 is 10
average number of affinization = 17.305439911185122
Path 140 | total_timesteps 2309.
number of affinization with epsilon = 3 is 17
average number of affinization = 17.305397530178993
Path 141 | total_timesteps 2331.
number of affinization with epsilon = 3 is 11
average number of affinization = 17.304522752497224
Path 142 | total_timesteps 2345.
number of affinization with epsilon = 3 is 11
average number of affinization = 17.303648217505895
Path 143 | total_timesteps 2358.
number of affinization with epsilon = 3 is 13
average number of affinization = 17.303051317614425
Path 144 | total_timesteps 2373.
number of affinization with epsilon = 3 is 14
average number of affinization = 17.302593260296767
Path 145 | total_timesteps 2389.
number of affinization with epsilon = 3 is 7
average number of affinization = 17.30116472545757
Path 146 | total_timesteps 2399.
number of affinization with epsilon = 3 is 11
average number of affinization = 17.300291140995427
Path 147 | total_timesteps 2414.
number of affinization with epsilon = 3 is 11
average number of affinization = 17.2994177987247
Path 148 | total_timesteps 2430.
number of affinization with epsilon = 3 is 8
average number of affinization = 17.298128898128898
Path 149 | total_timesteps 2440.
number of affinization with epsilon = 3 is 14
average number of affinization = 17.297671840354766
Path 150 | total_timesteps 2458.
number of affinization with epsilon = 3 is 8
average number of affinization = 17.296383538866564
Path 151 | total_timesteps 2469.
number of affinization with epsilon = 3 is 13
average number of affinization = 17.295788307010252
Path 152 | total_timesteps 2485.
number of affinization with epsilon = 3 is 15
average number of affinization = 17.295470286743317
Path 153 | total_timesteps 2502.
number of affinization with epsilon = 3 is 13
average number of affinization = 17.294875346260387
Path 154 | total_timesteps 2518.
number of affinization with epsilon = 3 is 18
average number of affinization = 17.294972995429998
Path 155 | total_timesteps 2540.
number of affinization with epsilon = 3 is 10
average number of affinization = 17.293962891165883
Path 156 | total_timesteps 2551.
number of affinization with epsilon = 3 is 14
average number of affinization = 17.293506853108127
Path 157 | total_timesteps 2567.
number of affinization with epsilon = 3 is 12
average number of affinization = 17.29277408637874
Path 158 | total_timesteps 2581.
number of affinization with epsilon = 3 is 10
average number of affinization = 17.291764705882354
Path 159 | total_timesteps 2594.
number of affinization with epsilon = 3 is 14
average number of affinization = 17.29130916136175
Path 160 | total_timesteps 2612.
number of affinization with epsilon = 3 is 15
average number of affinization = 17.290992112909922
Path 161 | total_timesteps 2637.
number of affinization with epsilon = 3 is 12
average number of affinization = 17.290260099612617
Path 162 | total_timesteps 2651.
number of affinization with epsilon = 3 is 9
average number of affinization = 17.28911329367824
Path 163 | total_timesteps 2662.
number of affinization with epsilon = 3 is 6
average number of affinization = 17.287551867219918
Path 164 | total_timesteps 2671.
number of affinization with epsilon = 3 is 10
average number of affinization = 17.286544046466602
Path 165 | total_timesteps 2684.
number of affinization with epsilon = 3 is 13
average number of affinization = 17.28595132743363
Path 166 | total_timesteps 2701.
number of affinization with epsilon = 3 is 9
average number of affinization = 17.284805751417117
Path 167 | total_timesteps 2713.
number of affinization with epsilon = 3 is 21
average number of affinization = 17.285319325407798
Path 168 | total_timesteps 2737.
number of affinization with epsilon = 3 is 8
average number of affinization = 17.284035936420178
Path 169 | total_timesteps 2746.
number of affinization with epsilon = 3 is 17
average number of affinization = 17.283996683250415
Path 170 | total_timesteps 2769.
number of affinization with epsilon = 3 is 11
average number of affinization = 17.283128368108333
Path 171 | total_timesteps 2784.
number of affinization with epsilon = 3 is 15
average number of affinization = 17.282812931749103
Path 172 | total_timesteps 2801.
number of affinization with epsilon = 3 is 9
average number of affinization = 17.281668738776073
Path 173 | total_timesteps 2811.
number of affinization with epsilon = 3 is 8
average number of affinization = 17.28038674033149
Path 174 | total_timesteps 2820.
number of affinization with epsilon = 3 is 3
average number of affinization = 17.278414583621046
Path 175 | total_timesteps 2826.
number of affinization with epsilon = 3 is 12
average number of affinization = 17.277685722176194
Path 176 | total_timesteps 2840.
number of affinization with epsilon = 3 is 10
average number of affinization = 17.276680933314925
Path 177 | total_timesteps 2854.
number of affinization with epsilon = 3 is 7
average number of affinization = 17.275262286029818
Path 178 | total_timesteps 2867.
number of affinization with epsilon = 3 is 11
average number of affinization = 17.2743961352657
Path 179 | total_timesteps 2884.
number of affinization with epsilon = 3 is 8
average number of affinization = 17.273116202042505
Path 180 | total_timesteps 2894.
number of affinization with epsilon = 3 is 5
average number of affinization = 17.271422657651442
Path 181 | total_timesteps 2902.
number of affinization with epsilon = 3 is 11
average number of affinization = 17.270557395143488
Path 182 | total_timesteps 2916.
number of affinization with epsilon = 3 is 17
average number of affinization = 17.270520071734033
Path 183 | total_timesteps 2939.
number of affinization with epsilon = 3 is 18
average number of affinization = 17.27062068965517
Path 184 | total_timesteps 2962.
number of affinization with epsilon = 3 is 27
average number of affinization = 17.271962487932697
Path 185 | total_timesteps 2994.
number of affinization with epsilon = 3 is 12
average number of affinization = 17.27123552123552
Path 186 | total_timesteps 3007.
number of affinization with epsilon = 3 is 12
average number of affinization = 17.27050875499793
Path 187 | total_timesteps 3022.
number of affinization with epsilon = 3 is 15
average number of affinization = 17.270195754066723
Path 188 | total_timesteps 3038.
number of affinization with epsilon = 3 is 13
average number of affinization = 17.26960716747071
Path 189 | total_timesteps 3055.
number of affinization with epsilon = 3 is 18
average number of affinization = 17.26970782800441
Path 190 | total_timesteps 3075.
number of affinization with epsilon = 3 is 13
average number of affinization = 17.269119470855724
Path 191 | total_timesteps 3091.
number of affinization with epsilon = 3 is 11
average number of affinization = 17.268255717828602
Path 192 | total_timesteps 3104.
number of affinization with epsilon = 3 is 12
average number of affinization = 17.267529962804794
Path 193 | total_timesteps 3118.
number of affinization with epsilon = 3 is 14
average number of affinization = 17.267079889807164
Path 194 | total_timesteps 3133.
number of affinization with epsilon = 3 is 13
average number of affinization = 17.26649221870266
Path 195 | total_timesteps 3150.
number of affinization with epsilon = 3 is 10
average number of affinization = 17.265491600110163
Path 196 | total_timesteps 3162.
number of affinization with epsilon = 3 is 9
average number of affinization = 17.264353572903758
Path 197 | total_timesteps 3173.
number of affinization with epsilon = 3 is 8
average number of affinization = 17.263078193832598
Path 198 | total_timesteps 3183.
number of affinization with epsilon = 3 is 22
average number of affinization = 17.263730213351685
Path 199 | total_timesteps 3208.
number of affinization with epsilon = 3 is 11
average number of affinization = 17.262868153041563
Path 200 | total_timesteps 3221.
number of affinization with epsilon = 3 is 14
average number of affinization = 17.26241915508463
Path 201 | total_timesteps 3237.
number of affinization with epsilon = 3 is 7
average number of affinization = 17.261007154650525
Path 202 | total_timesteps 3245.
number of affinization with epsilon = 3 is 6
average number of affinization = 17.259457972210758
Path 203 | total_timesteps 3252.
number of affinization with epsilon = 3 is 16
average number of affinization = 17.259284731774414
Path 204 | total_timesteps 3272.
number of affinization with epsilon = 3 is 9
average number of affinization = 17.258148810342455
Path 205 | total_timesteps 3284.
number of affinization with epsilon = 3 is 24
average number of affinization = 17.25907590759076
Path 206 | total_timesteps 3311.
number of affinization with epsilon = 3 is 5
average number of affinization = 17.257390347861953
Path 207 | total_timesteps 3319.
number of affinization with epsilon = 3 is 10
average number of affinization = 17.256392631289525
Path 208 | total_timesteps 3332.
number of affinization with epsilon = 3 is 11
average number of affinization = 17.25553264604811
Path 209 | total_timesteps 3346.
number of affinization with epsilon = 3 is 18
average number of affinization = 17.25563496426608
Path 210 | total_timesteps 3367.
number of affinization with epsilon = 3 is 14
average number of affinization = 17.255187577298337
Path 211 | total_timesteps 3384.
number of affinization with epsilon = 3 is 15
average number of affinization = 17.2548777136576
Path 212 | total_timesteps 3401.
number of affinization with epsilon = 3 is 9
average number of affinization = 17.253743646105235
Path 213 | total_timesteps 3411.
number of affinization with epsilon = 3 is 15
average number of affinization = 17.253434065934066
Path 214 | total_timesteps 3427.
number of affinization with epsilon = 3 is 11
average number of affinization = 17.252575195714876
Path 215 | total_timesteps 3440.
number of affinization with epsilon = 3 is 7
average number of affinization = 17.25116726174128
Path 216 | total_timesteps 3452.
number of affinization with epsilon = 3 is 11
average number of affinization = 17.250308938624194
Path 217 | total_timesteps 3465.
number of affinization with epsilon = 3 is 8
average number of affinization = 17.249038989566174
Path 218 | total_timesteps 3474.
number of affinization with epsilon = 3 is 11
average number of affinization = 17.24818119423473
Path 219 | total_timesteps 3489.
number of affinization with epsilon = 3 is 13
average number of affinization = 17.247598133406534
Path 220 | total_timesteps 3504.
number of affinization with epsilon = 3 is 6
average number of affinization = 17.246054617812543
Path 221 | total_timesteps 3512.
number of affinization with epsilon = 3 is 14
average number of affinization = 17.245609220636663
Path 222 | total_timesteps 3530.
number of affinization with epsilon = 3 is 12
average number of affinization = 17.24488955961037
Path 223 | total_timesteps 3547.
number of affinization with epsilon = 3 is 13
average number of affinization = 17.244307270233197
Path 224 | total_timesteps 3563.
number of affinization with epsilon = 3 is 8
average number of affinization = 17.243039363598957
Path 225 | total_timesteps 3572.
number of affinization with epsilon = 3 is 9
average number of affinization = 17.24190894130554
Path 226 | total_timesteps 3583.
number of affinization with epsilon = 3 is 10
average number of affinization = 17.2409159467983
Path 227 | total_timesteps 3595.
number of affinization with epsilon = 3 is 13
average number of affinization = 17.24033452152454
Path 228 | total_timesteps 3610.
number of affinization with epsilon = 3 is 12
average number of affinization = 17.239616175462647
Path 229 | total_timesteps 3625.
number of affinization with epsilon = 3 is 9
average number of affinization = 17.238486842105264
Path 230 | total_timesteps 3635.
number of affinization with epsilon = 3 is 7
average number of affinization = 17.237083733040976
Path 231 | total_timesteps 3646.
number of affinization with epsilon = 3 is 11
average number of affinization = 17.236229103864073
Path 232 | total_timesteps 3658.
number of affinization with epsilon = 3 is 14
average number of affinization = 17.23578572407179
Path 233 | total_timesteps 3675.
number of affinization with epsilon = 3 is 11
average number of affinization = 17.234931506849314
Path 234 | total_timesteps 3687.
number of affinization with epsilon = 3 is 12
average number of affinization = 17.234214491165595
Path 235 | total_timesteps 3703.
number of affinization with epsilon = 3 is 10
average number of affinization = 17.23322377430841
Path 236 | total_timesteps 3716.
number of affinization with epsilon = 3 is 7
average number of affinization = 17.23182253868273
Path 237 | total_timesteps 3726.
number of affinization with epsilon = 3 is 20
average number of affinization = 17.232201533406354
Path 238 | total_timesteps 3749.
number of affinization with epsilon = 3 is 14
average number of affinization = 17.23175906913073
Path 239 | total_timesteps 3769.
number of affinization with epsilon = 3 is 14
average number of affinization = 17.231316725978647
Path 240 | total_timesteps 3785.
number of affinization with epsilon = 3 is 16
average number of affinization = 17.23114821404133
Path 241 | total_timesteps 3803.
number of affinization with epsilon = 3 is 11
average number of affinization = 17.230295566502463
Path 242 | total_timesteps 3818.
number of affinization with epsilon = 3 is 9
average number of affinization = 17.229169517033792
Path 243 | total_timesteps 3832.
number of affinization with epsilon = 3 is 9
average number of affinization = 17.228043775649795
Path 244 | total_timesteps 3843.
number of affinization with epsilon = 3 is 19
average number of affinization = 17.228286144166326
Path 245 | total_timesteps 3866.
number of affinization with epsilon = 3 is 12
average number of affinization = 17.227571115973742
Path 246 | total_timesteps 3880.
number of affinization with epsilon = 3 is 8
average number of affinization = 17.226309312183783
Path 247 | total_timesteps 3889.
number of affinization with epsilon = 3 is 12
average number of affinization = 17.225594749794915
Path 248 | total_timesteps 3906.
number of affinization with epsilon = 3 is 18
average number of affinization = 17.2257006151743
Path 249 | total_timesteps 3926.
number of affinization with epsilon = 3 is 5
average number of affinization = 17.224029524330234
Path 250 | total_timesteps 3933.
number of affinization with epsilon = 3 is 23
average number of affinization = 17.224818914855817
Path 251 | total_timesteps 3960.
number of affinization with epsilon = 3 is 11
average number of affinization = 17.223968297349003
Path 252 | total_timesteps 3973.
number of affinization with epsilon = 3 is 7
average number of affinization = 17.22257138953409
Path 253 | total_timesteps 3982.
number of affinization with epsilon = 3 is 12
average number of affinization = 17.221857923497268
Path 254 | total_timesteps 3996.
number of affinization with epsilon = 3 is 11
average number of affinization = 17.221008059008334
Path 255 | total_timesteps 4008.
number of affinization with epsilon = 3 is 7
average number of affinization = 17.219612127833926
Path 256 | total_timesteps 4018.
number of affinization with epsilon = 3 is 13
average number of affinization = 17.219035914242795
Path 257 | total_timesteps 4033.
number of affinization with epsilon = 3 is 6
average number of affinization = 17.217504096122337
Path 258 | total_timesteps 4043.
number of affinization with epsilon = 3 is 15
average number of affinization = 17.217201365187712
Path 259 | total_timesteps 4063.
number of affinization with epsilon = 3 is 20
average number of affinization = 17.217581217581216
Path 260 | total_timesteps 4086.
number of affinization with epsilon = 3 is 8
average number of affinization = 17.216323188207998
Path 261 | total_timesteps 4095.
number of affinization with epsilon = 3 is 9
average number of affinization = 17.215201965065503
Path 262 | total_timesteps 4106.
number of affinization with epsilon = 3 is 28
average number of affinization = 17.216673488879792
Path 263 | total_timesteps 4136.
number of affinization with epsilon = 3 is 8
average number of affinization = 17.215416098226466
Path 264 | total_timesteps 4146.
number of affinization with epsilon = 3 is 13
average number of affinization = 17.21484108580003
Path 265 | total_timesteps 4160.
number of affinization with epsilon = 3 is 18
average number of affinization = 17.21494817239498
Path 266 | total_timesteps 4181.
number of affinization with epsilon = 3 is 17
average number of affinization = 17.21491885994818
Path 267 | total_timesteps 4199.
number of affinization with epsilon = 3 is 7
average number of affinization = 17.213526043086993
Path 268 | total_timesteps 4208.
number of affinization with epsilon = 3 is 6
average number of affinization = 17.211997273346967
Path 269 | total_timesteps 4215.
number of affinization with epsilon = 3 is 8
average number of affinization = 17.210741548527807
Path 270 | total_timesteps 4227.
number of affinization with epsilon = 3 is 10
average number of affinization = 17.209758756985146
Path 271 | total_timesteps 4238.
number of affinization with epsilon = 3 is 24
average number of affinization = 17.210684110111746
Path 272 | total_timesteps 4267.
number of affinization with epsilon = 3 is 8
average number of affinization = 17.209429077531
Path 273 | total_timesteps 4278.
number of affinization with epsilon = 3 is 19
average number of affinization = 17.20967302452316
Path 274 | total_timesteps 4302.
number of affinization with epsilon = 3 is 22
average number of affinization = 17.210325568723608
Path 275 | total_timesteps 4327.
number of affinization with epsilon = 3 is 9
average number of affinization = 17.20920730046309
Path 276 | total_timesteps 4337.
number of affinization with epsilon = 3 is 10
average number of affinization = 17.208225520904264
Path 277 | total_timesteps 4348.
number of affinization with epsilon = 3 is 5
average number of affinization = 17.206563180827885
Path 278 | total_timesteps 4357.
number of affinization with epsilon = 3 is 25
average number of affinization = 17.207624234172908
Path 279 | total_timesteps 4383.
number of affinization with epsilon = 3 is 8
average number of affinization = 17.206370814048462
Path 280 | total_timesteps 4395.
number of affinization with epsilon = 3 is 14
average number of affinization = 17.205934394991154
Path 281 | total_timesteps 4412.
number of affinization with epsilon = 3 is 6
average number of affinization = 17.204409363091997
Path 282 | total_timesteps 4421.
number of affinization with epsilon = 3 is 14
average number of affinization = 17.203973329704723
Path 283 | total_timesteps 4439.
number of affinization with epsilon = 3 is 12
average number of affinization = 17.20326530612245
Path 284 | total_timesteps 4453.
number of affinization with epsilon = 3 is 6
average number of affinization = 17.201741259692557
Path 285 | total_timesteps 4461.
number of affinization with epsilon = 3 is 13
average number of affinization = 17.201169749727963
Path 286 | total_timesteps 4476.
number of affinization with epsilon = 3 is 12
average number of affinization = 17.20046239630083
Path 287 | total_timesteps 4489.
number of affinization with epsilon = 3 is 19
average number of affinization = 17.200707098177862
Path 288 | total_timesteps 4511.
number of affinization with epsilon = 3 is 6
average number of affinization = 17.199184228416044
Path 289 | total_timesteps 4520.
number of affinization with epsilon = 3 is 6
average number of affinization = 17.197661772702556
Path 290 | total_timesteps 4529.
number of affinization with epsilon = 3 is 26
average number of affinization = 17.1988582302569
Path 291 | total_timesteps 4563.
number of affinization with epsilon = 3 is 11
average number of affinization = 17.198015765153574
Path 292 | total_timesteps 4577.
number of affinization with epsilon = 3 is 16
average number of affinization = 17.197852969153416
Path 293 | total_timesteps 4595.
number of affinization with epsilon = 3 is 8
average number of affinization = 17.196603260869566
Path 294 | total_timesteps 4606.
number of affinization with epsilon = 3 is 25
average number of affinization = 17.19766336095639
Path 295 | total_timesteps 4636.
number of affinization with epsilon = 3 is 10
average number of affinization = 17.19668568323825
Path 296 | total_timesteps 4649.
number of affinization with epsilon = 3 is 14
average number of affinization = 17.19625152790982
Path 297 | total_timesteps 4668.
number of affinization with epsilon = 3 is 11
average number of affinization = 17.19541010320478
Path 298 | total_timesteps 4682.
number of affinization with epsilon = 3 is 8
average number of affinization = 17.194161575016974
Path 299 | total_timesteps 4692.
number of affinization with epsilon = 3 is 16
average number of affinization = 17.19399945696443
Path 300 | total_timesteps 4710.
number of affinization with epsilon = 3 is 14
average number of affinization = 17.193565901995385
Path 301 | total_timesteps 4725.
number of affinization with epsilon = 3 is 25
average number of affinization = 17.194625407166125
Path 302 | total_timesteps 4751.
number of affinization with epsilon = 3 is 17
average number of affinization = 17.19459899579319
Path 303 | total_timesteps 4771.
number of affinization with epsilon = 3 is 7
average number of affinization = 17.193215739484398
Path 304 | total_timesteps 4780.
number of affinization with epsilon = 3 is 9
average number of affinization = 17.192104192104193
Path 305 | total_timesteps 4792.
number of affinization with epsilon = 3 is 8
average number of affinization = 17.190857297883884
Path 306 | total_timesteps 4802.
number of affinization with epsilon = 3 is 13
average number of affinization = 17.19028889190289
Path 307 | total_timesteps 4817.
number of affinization with epsilon = 3 is 27
average number of affinization = 17.191619202603743
Path 308 | total_timesteps 4846.
number of affinization with epsilon = 3 is 14
average number of affinization = 17.191186440677967
Path 309 | total_timesteps 4863.
number of affinization with epsilon = 3 is 12
average number of affinization = 17.190482646420826
Path 310 | total_timesteps 4878.
number of affinization with epsilon = 3 is 9
average number of affinization = 17.189372373593603
Path 311 | total_timesteps 4889.
number of affinization with epsilon = 3 is 15
average number of affinization = 17.189075630252102
Path 312 | total_timesteps 4906.
number of affinization with epsilon = 3 is 12
average number of affinization = 17.18837240818539
Path 313 | total_timesteps 4920.
number of affinization with epsilon = 3 is 14
average number of affinization = 17.187940379403795
Path 314 | total_timesteps 4937.
number of affinization with epsilon = 3 is 19
average number of affinization = 17.188185882671725
Path 315 | total_timesteps 4960.
number of affinization with epsilon = 3 is 6
average number of affinization = 17.186670279057164
Path 316 | total_timesteps 4970.
number of affinization with epsilon = 3 is 7
average number of affinization = 17.18529053230394
Path 317 | total_timesteps 4980.
number of affinization with epsilon = 3 is 16
average number of affinization = 17.185130010834236
Path 318 | total_timesteps 5000.
number of affinization with epsilon = 3 is 23
average number of affinization = 17.18591740013541
Path 319 | total_timesteps 5028.
number of affinization with epsilon = 3 is 9
average number of affinization = 17.18480909829407
Path 320 | total_timesteps 5043.
number of affinization with epsilon = 3 is 5
average number of affinization = 17.18315960471098
Path 321 | total_timesteps 5052.
number of affinization with epsilon = 3 is 26
average number of affinization = 17.184353004872765
Path 322 | total_timesteps 5080.
number of affinization with epsilon = 3 is 10
average number of affinization = 17.18338070104209
Path 323 | total_timesteps 5092.
number of affinization with epsilon = 3 is 6
average number of affinization = 17.18186738836265
Path 324 | total_timesteps 5102.
number of affinization with epsilon = 3 is 12
average number of affinization = 17.18116628331755
Path 325 | total_timesteps 5117.
number of affinization with epsilon = 3 is 45
average number of affinization = 17.184929653679653
Path 326 | total_timesteps 5171.
number of affinization with epsilon = 3 is 17
average number of affinization = 17.184904639523875
Path 327 | total_timesteps 5196.
number of affinization with epsilon = 3 is 19
average number of affinization = 17.185150121720312
Path 328 | total_timesteps 5220.
number of affinization with epsilon = 3 is 8
average number of affinization = 17.183908045977013
Path 329 | total_timesteps 5233.
number of affinization with epsilon = 3 is 8
average number of affinization = 17.18266630611141
Path 330 | total_timesteps 5242.
number of affinization with epsilon = 3 is 6
average number of affinization = 17.181154522103554
Path 331 | total_timesteps 5250.
number of affinization with epsilon = 3 is 7
average number of affinization = 17.17977831846445
Path 332 | total_timesteps 5258.
number of affinization with epsilon = 3 is 5
average number of affinization = 17.178132180024328
Path 333 | total_timesteps 5266.
number of affinization with epsilon = 3 is 12
average number of affinization = 17.177432432432433
Path 334 | total_timesteps 5285.
number of affinization with epsilon = 3 is 11
average number of affinization = 17.176597757059856
Path 335 | total_timesteps 5299.
number of affinization with epsilon = 3 is 18
average number of affinization = 17.176708997568223
Path 336 | total_timesteps 5319.
number of affinization with epsilon = 3 is 19
average number of affinization = 17.176955288396595
Path 337 | total_timesteps 5340.
number of affinization with epsilon = 3 is 11
average number of affinization = 17.176121015667206
Path 338 | total_timesteps 5353.
number of affinization with epsilon = 3 is 20
average number of affinization = 17.176502363268064
Path 339 | total_timesteps 5378.
number of affinization with epsilon = 3 is 9
average number of affinization = 17.17539832568188
Path 340 | total_timesteps 5390.
number of affinization with epsilon = 3 is 21
average number of affinization = 17.17591467530714
Path 341 | total_timesteps 5413.
number of affinization with epsilon = 3 is 10
average number of affinization = 17.174946004319654
Path 342 | total_timesteps 5424.
number of affinization with epsilon = 3 is 8
average number of affinization = 17.173707652854635
Path 343 | total_timesteps 5433.
number of affinization with epsilon = 3 is 8
average number of affinization = 17.17246963562753
Path 344 | total_timesteps 5443.
number of affinization with epsilon = 3 is 16
average number of affinization = 17.172311428956956
Path 345 | total_timesteps 5461.
number of affinization with epsilon = 3 is 10
average number of affinization = 17.171343766864545
Path 346 | total_timesteps 5473.
number of affinization with epsilon = 3 is 10
average number of affinization = 17.170376365843786
Path 347 | total_timesteps 5484.
number of affinization with epsilon = 3 is 8
average number of affinization = 17.16913946587537
Path 348 | total_timesteps 5494.
number of affinization with epsilon = 3 is 23
average number of affinization = 17.169925826028322
Path 349 | total_timesteps 5523.
number of affinization with epsilon = 3 is 21
average number of affinization = 17.170442286947143
Path 350 | total_timesteps 5548.
number of affinization with epsilon = 3 is 12
average number of affinization = 17.16974517999191
Path 351 | total_timesteps 5563.
number of affinization with epsilon = 3 is 11
average number of affinization = 17.16891345376112
Path 352 | total_timesteps 5577.
number of affinization with epsilon = 3 is 14
average number of affinization = 17.168486318910904
Path 353 | total_timesteps 5592.
number of affinization with epsilon = 3 is 4
average number of affinization = 17.166711590296497
Path 354 | total_timesteps 5600.
number of affinization with epsilon = 3 is 18
average number of affinization = 17.166823878183532
Path 355 | total_timesteps 5622.
number of affinization with epsilon = 3 is 11
average number of affinization = 17.16599299380221
Path 356 | total_timesteps 5636.
number of affinization with epsilon = 3 is 8
average number of affinization = 17.16475818402263
Path 357 | total_timesteps 5647.
number of affinization with epsilon = 3 is 13
average number of affinization = 17.16419719827586
Path 358 | total_timesteps 5664.
number of affinization with epsilon = 3 is 10
average number of affinization = 17.16323232323232
Path 359 | total_timesteps 5676.
number of affinization with epsilon = 3 is 12
average number of affinization = 17.162537032049556
Path 360 | total_timesteps 5691.
number of affinization with epsilon = 3 is 10
average number of affinization = 17.16157264036623
Path 361 | total_timesteps 5703.
number of affinization with epsilon = 3 is 13
average number of affinization = 17.16101238556812
Path 362 | total_timesteps 5718.
number of affinization with epsilon = 3 is 8
average number of affinization = 17.15977924350518
Path 363 | total_timesteps 5728.
number of affinization with epsilon = 3 is 36
average number of affinization = 17.162314939434726
Path 364 | total_timesteps 5768.
number of affinization with epsilon = 3 is 5
average number of affinization = 17.160678239806217
Path 365 | total_timesteps 5776.
number of affinization with epsilon = 3 is 10
average number of affinization = 17.15971474703983
Path 366 | total_timesteps 5789.
number of affinization with epsilon = 3 is 9
average number of affinization = 17.158616978339836
Path 367 | total_timesteps 5799.
number of affinization with epsilon = 3 is 10
average number of affinization = 17.1576540220608
Path 368 | total_timesteps 5811.
number of affinization with epsilon = 3 is 10
average number of affinization = 17.156691324815064
Path 369 | total_timesteps 5823.
number of affinization with epsilon = 3 is 8
average number of affinization = 17.155459924690692
Path 370 | total_timesteps 5835.
number of affinization with epsilon = 3 is 7
average number of affinization = 17.15409439290036
Path 371 | total_timesteps 5845.
number of affinization with epsilon = 3 is 9
average number of affinization = 17.152998117773596
Path 372 | total_timesteps 5857.
number of affinization with epsilon = 3 is 8
average number of affinization = 17.151767710713806
Path 373 | total_timesteps 5870.
number of affinization with epsilon = 3 is 21
average number of affinization = 17.15228494623656
Path 374 | total_timesteps 5893.
number of affinization with epsilon = 3 is 8
average number of affinization = 17.151054965730413
Path 375 | total_timesteps 5905.
number of affinization with epsilon = 3 is 23
average number of affinization = 17.151840902983068
Path 376 | total_timesteps 5932.
number of affinization with epsilon = 3 is 9
average number of affinization = 17.15074566706973
Path 377 | total_timesteps 5944.
number of affinization with epsilon = 3 is 16
average number of affinization = 17.15059108006448
Path 378 | total_timesteps 5964.
number of affinization with epsilon = 3 is 10
average number of affinization = 17.149630624580254
Path 379 | total_timesteps 5976.
number of affinization with epsilon = 3 is 10
average number of affinization = 17.14867042707494
Path 380 | total_timesteps 5989.
number of affinization with epsilon = 3 is 7
average number of affinization = 17.147307640660667
Path 381 | total_timesteps 5998.
number of affinization with epsilon = 3 is 15
average number of affinization = 17.14701933404941
Done generating on-policy rollouts.
Updating normalization.
Done updating normalization.
----------------------------
| AverageReturn | -5.92    |
| Iteration     | 25       |
| MaximumReturn | 8.53     |
| MinimumReturn | -19.2    |
| TotalSamples  | 108260   |
----------------------------
itr #26 | 
Fitting dynamics.
Fitting model 0 (0-based) in the ensemble of 2 models
Validation loss = 0.013785574585199356
Validation loss = 0.013180794194340706
Validation loss = 0.013290186412632465
Validation loss = 0.013187541626393795
Validation loss = 0.013294003903865814
Validation loss = 0.013446220196783543
Fitting model 1 (0-based) in the ensemble of 2 models
Validation loss = 0.01280931755900383
Validation loss = 0.013735145330429077
Validation loss = 0.013109803199768066
Validation loss = 0.01314145140349865
Validation loss = 0.012799889780580997
Validation loss = 0.01301622949540615
Validation loss = 0.01269551645964384
Validation loss = 0.013396196067333221
Validation loss = 0.013049576431512833
Validation loss = 0.012911616824567318
Validation loss = 0.013206617906689644
Done fitting dynamics.
Updating randomness.
Done updating randomness.
Training policy using TRPO.
Re-initialize init_std.
Obtaining samples for iteration 0...
Obtaining samples for iteration 1...
Obtaining samples for iteration 2...
Obtaining samples for iteration 3...
Obtaining samples for iteration 4...
Obtaining samples for iteration 5...
Obtaining samples for iteration 6...
Obtaining samples for iteration 7...
Obtaining samples for iteration 8...
Obtaining samples for iteration 9...
Obtaining samples for iteration 10...
Obtaining samples for iteration 11...
Obtaining samples for iteration 12...
Obtaining samples for iteration 13...
Obtaining samples for iteration 14...
Obtaining samples for iteration 15...
Obtaining samples for iteration 16...
Obtaining samples for iteration 17...
Obtaining samples for iteration 18...
Obtaining samples for iteration 19...
Done training policy.
Generating on-policy rollouts.
Path 0 | total_timesteps 0.
number of affinization with epsilon = 3 is 8
average number of affinization = 17.145791381393476
Path 1 | total_timesteps 11.
number of affinization with epsilon = 3 is 33
average number of affinization = 17.14791946308725
Path 2 | total_timesteps 49.
number of affinization with epsilon = 3 is 9
average number of affinization = 17.14682592940545
Path 3 | total_timesteps 61.
number of affinization with epsilon = 3 is 14
average number of affinization = 17.146403650026837
Path 4 | total_timesteps 76.
number of affinization with epsilon = 3 is 11
average number of affinization = 17.145578961492017
Path 5 | total_timesteps 91.
number of affinization with epsilon = 3 is 11
average number of affinization = 17.144754494231286
Path 6 | total_timesteps 104.
number of affinization with epsilon = 3 is 8
average number of affinization = 17.143527833668678
Path 7 | total_timesteps 116.
number of affinization with epsilon = 3 is 8
average number of affinization = 17.142301502145923
Path 8 | total_timesteps 128.
number of affinization with epsilon = 3 is 6
average number of affinization = 17.14080729515891
Path 9 | total_timesteps 135.
number of affinization with epsilon = 3 is 7
average number of affinization = 17.13944757307589
Path 10 | total_timesteps 144.
number of affinization with epsilon = 3 is 13
average number of affinization = 17.138892612950798
Path 11 | total_timesteps 160.
number of affinization with epsilon = 3 is 14
average number of affinization = 17.13847184986595
Path 12 | total_timesteps 176.
number of affinization with epsilon = 3 is 12
average number of affinization = 17.137783138989413
Path 13 | total_timesteps 193.
number of affinization with epsilon = 3 is 12
average number of affinization = 17.13709461270437
Path 14 | total_timesteps 209.
number of affinization with epsilon = 3 is 17
average number of affinization = 17.137076242797804
Path 15 | total_timesteps 231.
number of affinization with epsilon = 3 is 8
average number of affinization = 17.135852090032156
Path 16 | total_timesteps 242.
number of affinization with epsilon = 3 is 9
average number of affinization = 17.13476222371065
Path 17 | total_timesteps 252.
number of affinization with epsilon = 3 is 23
average number of affinization = 17.135547816769353
Path 18 | total_timesteps 280.
number of affinization with epsilon = 3 is 10
average number of affinization = 17.134592205705104
Path 19 | total_timesteps 294.
number of affinization with epsilon = 3 is 14
average number of affinization = 17.13417246920193
Path 20 | total_timesteps 310.
number of affinization with epsilon = 3 is 7
average number of affinization = 17.13281563797028
Path 21 | total_timesteps 318.
number of affinization with epsilon = 3 is 15
average number of affinization = 17.132530120481928
Path 22 | total_timesteps 343.
number of affinization with epsilon = 3 is 14
average number of affinization = 17.13211082853701
Path 23 | total_timesteps 358.
number of affinization with epsilon = 3 is 11
average number of affinization = 17.131290149892934
Path 24 | total_timesteps 372.
number of affinization with epsilon = 3 is 7
average number of affinization = 17.12993443061689
Path 25 | total_timesteps 380.
number of affinization with epsilon = 3 is 11
average number of affinization = 17.12911426277763
Path 26 | total_timesteps 393.
number of affinization with epsilon = 3 is 7
average number of affinization = 17.127759197324416
Path 27 | total_timesteps 403.
number of affinization with epsilon = 3 is 6
average number of affinization = 17.126270733012305
Path 28 | total_timesteps 412.
number of affinization with epsilon = 3 is 13
average number of affinization = 17.125718871205027
Path 29 | total_timesteps 428.
number of affinization with epsilon = 3 is 15
average number of affinization = 17.125434608184005
Path 30 | total_timesteps 445.
number of affinization with epsilon = 3 is 12
average number of affinization = 17.124749298034498
Path 31 | total_timesteps 460.
number of affinization with epsilon = 3 is 17
average number of affinization = 17.124732620320856
Path 32 | total_timesteps 481.
number of affinization with epsilon = 3 is 12
average number of affinization = 17.12404758722096
Path 33 | total_timesteps 494.
number of affinization with epsilon = 3 is 7
average number of affinization = 17.122694466720127
Path 34 | total_timesteps 503.
number of affinization with epsilon = 3 is 8
average number of affinization = 17.121475344113325
Path 35 | total_timesteps 513.
number of affinization with epsilon = 3 is 8
average number of affinization = 17.120256547300908
Path 36 | total_timesteps 525.
number of affinization with epsilon = 3 is 11
average number of affinization = 17.11943887775551
Path 37 | total_timesteps 540.
number of affinization with epsilon = 3 is 15
average number of affinization = 17.11915575741384
Path 38 | total_timesteps 558.
number of affinization with epsilon = 3 is 11
average number of affinization = 17.118338453319087
Path 39 | total_timesteps 571.
number of affinization with epsilon = 3 is 8
average number of affinization = 17.117120726495727
Path 40 | total_timesteps 580.
number of affinization with epsilon = 3 is 7
average number of affinization = 17.11576979570036
Path 41 | total_timesteps 588.
number of affinization with epsilon = 3 is 13
average number of affinization = 17.115220293724967
Path 42 | total_timesteps 603.
number of affinization with epsilon = 3 is 18
average number of affinization = 17.115338406087304
Path 43 | total_timesteps 625.
number of affinization with epsilon = 3 is 6
average number of affinization = 17.113854778430326
Path 44 | total_timesteps 636.
number of affinization with epsilon = 3 is 18
average number of affinization = 17.113973041505407
Path 45 | total_timesteps 656.
number of affinization with epsilon = 3 is 19
average number of affinization = 17.114224713103816
Path 46 | total_timesteps 680.
number of affinization with epsilon = 3 is 8
average number of affinization = 17.1130086724483
Path 47 | total_timesteps 694.
number of affinization with epsilon = 3 is 9
average number of affinization = 17.11192636072572
Path 48 | total_timesteps 704.
number of affinization with epsilon = 3 is 14
average number of affinization = 17.111511271175136
Path 49 | total_timesteps 722.
number of affinization with epsilon = 3 is 29
average number of affinization = 17.113096825820218
Path 50 | total_timesteps 753.
number of affinization with epsilon = 3 is 31
average number of affinization = 17.11494865982131
Path 51 | total_timesteps 786.
number of affinization with epsilon = 3 is 11
average number of affinization = 17.114133333333335
Path 52 | total_timesteps 800.
number of affinization with epsilon = 3 is 14
average number of affinization = 17.113718170910545
Path 53 | total_timesteps 818.
number of affinization with epsilon = 3 is 13
average number of affinization = 17.113169821380964
Path 54 | total_timesteps 834.
number of affinization with epsilon = 3 is 16
average number of affinization = 17.113021458083434
Path 55 | total_timesteps 853.
number of affinization with epsilon = 3 is 11
average number of affinization = 17.11220682302772
Path 56 | total_timesteps 866.
number of affinization with epsilon = 3 is 23
average number of affinization = 17.11299133910726
Path 57 | total_timesteps 893.
number of affinization with epsilon = 3 is 30
average number of affinization = 17.114708233413268
Path 58 | total_timesteps 927.
number of affinization with epsilon = 3 is 23
average number of affinization = 17.115492207273213
Path 59 | total_timesteps 954.
number of affinization with epsilon = 3 is 14
average number of affinization = 17.115077250932337
Path 60 | total_timesteps 970.
number of affinization with epsilon = 3 is 10
average number of affinization = 17.11412971101345
Path 61 | total_timesteps 983.
number of affinization with epsilon = 3 is 6
average number of affinization = 17.11264980026631
Path 62 | total_timesteps 995.
number of affinization with epsilon = 3 is 12
average number of affinization = 17.111969111969113
Path 63 | total_timesteps 1010.
number of affinization with epsilon = 3 is 10
average number of affinization = 17.111022364217252
Path 64 | total_timesteps 1023.
number of affinization with epsilon = 3 is 7
average number of affinization = 17.109676560628245
Path 65 | total_timesteps 1034.
number of affinization with epsilon = 3 is 10
average number of affinization = 17.108730369976044
Path 66 | total_timesteps 1048.
number of affinization with epsilon = 3 is 6
average number of affinization = 17.107252162341982
Path 67 | total_timesteps 1057.
number of affinization with epsilon = 3 is 24
average number of affinization = 17.108169238956894
Path 68 | total_timesteps 1085.
number of affinization with epsilon = 3 is 13
average number of affinization = 17.107622721830516
Path 69 | total_timesteps 1101.
number of affinization with epsilon = 3 is 17
average number of affinization = 17.10760840649109
Path 70 | total_timesteps 1126.
number of affinization with epsilon = 3 is 5
average number of affinization = 17.10599813805027
Path 71 | total_timesteps 1136.
number of affinization with epsilon = 3 is 10
average number of affinization = 17.10505319148936
Path 72 | total_timesteps 1149.
number of affinization with epsilon = 3 is 10
average number of affinization = 17.10410849621061
Path 73 | total_timesteps 1161.
number of affinization with epsilon = 3 is 9
average number of affinization = 17.103031108747672
Path 74 | total_timesteps 1173.
number of affinization with epsilon = 3 is 9
average number of affinization = 17.10195400770969
Path 75 | total_timesteps 1185.
number of affinization with epsilon = 3 is 8
average number of affinization = 17.10074428495481
Path 76 | total_timesteps 1196.
number of affinization with epsilon = 3 is 11
average number of affinization = 17.099933554817277
Path 77 | total_timesteps 1209.
number of affinization with epsilon = 3 is 10
average number of affinization = 17.09899016741961
Path 78 | total_timesteps 1220.
number of affinization with epsilon = 3 is 11
average number of affinization = 17.098179885744653
Path 79 | total_timesteps 1234.
number of affinization with epsilon = 3 is 15
average number of affinization = 17.09790116896918
Path 80 | total_timesteps 1251.
number of affinization with epsilon = 3 is 4
average number of affinization = 17.096161508832513
Path 81 | total_timesteps 1258.
number of affinization with epsilon = 3 is 26
average number of affinization = 17.09734395750332
Path 82 | total_timesteps 1293.
number of affinization with epsilon = 3 is 8
average number of affinization = 17.09613597131855
Path 83 | total_timesteps 1303.
number of affinization with epsilon = 3 is 25
average number of affinization = 17.097185342538502
Path 84 | total_timesteps 1332.
number of affinization with epsilon = 3 is 22
average number of affinization = 17.09783618744192
Path 85 | total_timesteps 1359.
number of affinization with epsilon = 3 is 9
average number of affinization = 17.096761348553226
Path 86 | total_timesteps 1371.
number of affinization with epsilon = 3 is 21
average number of affinization = 17.097279362972795
Path 87 | total_timesteps 1401.
number of affinization with epsilon = 3 is 11
average number of affinization = 17.096470276008493
Path 88 | total_timesteps 1413.
number of affinization with epsilon = 3 is 14
average number of affinization = 17.09605944009553
Path 89 | total_timesteps 1430.
number of affinization with epsilon = 3 is 13
average number of affinization = 17.095516052003184
Path 90 | total_timesteps 1447.
number of affinization with epsilon = 3 is 13
average number of affinization = 17.09497280806473
Path 91 | total_timesteps 1461.
number of affinization with epsilon = 3 is 14
average number of affinization = 17.094562334217507
Path 92 | total_timesteps 1477.
number of affinization with epsilon = 3 is 7
average number of affinization = 17.09322371038324
Path 93 | total_timesteps 1486.
number of affinization with epsilon = 3 is 23
average number of affinization = 17.094006894722884
Path 94 | total_timesteps 1516.
number of affinization with epsilon = 3 is 15
average number of affinization = 17.0937292854302
Path 95 | total_timesteps 1535.
number of affinization with epsilon = 3 is 31
average number of affinization = 17.095572640509015
Path 96 | total_timesteps 1572.
number of affinization with epsilon = 3 is 16
average number of affinization = 17.095427435387673
Path 97 | total_timesteps 1595.
number of affinization with epsilon = 3 is 13
average number of affinization = 17.094884707129605
Path 98 | total_timesteps 1611.
number of affinization with epsilon = 3 is 16
average number of affinization = 17.094739631641712
Path 99 | total_timesteps 1631.
number of affinization with epsilon = 3 is 11
average number of affinization = 17.093932167461578
Path 100 | total_timesteps 1644.
number of affinization with epsilon = 3 is 13
average number of affinization = 17.09338985296066
Path 101 | total_timesteps 1663.
number of affinization with epsilon = 3 is 8
average number of affinization = 17.092185430463577
Path 102 | total_timesteps 1674.
number of affinization with epsilon = 3 is 24
average number of affinization = 17.093100251622303
Path 103 | total_timesteps 1702.
number of affinization with epsilon = 3 is 14
average number of affinization = 17.0926906779661
Path 104 | total_timesteps 1721.
number of affinization with epsilon = 3 is 17
average number of affinization = 17.09267840593142
Path 105 | total_timesteps 1743.
number of affinization with epsilon = 3 is 7
average number of affinization = 17.091342335186656
Path 106 | total_timesteps 1753.
number of affinization with epsilon = 3 is 10
average number of affinization = 17.090403706154863
Path 107 | total_timesteps 1765.
number of affinization with epsilon = 3 is 10
average number of affinization = 17.089465325569083
Path 108 | total_timesteps 1777.
number of affinization with epsilon = 3 is 14
average number of affinization = 17.089056503903667
Path 109 | total_timesteps 1793.
number of affinization with epsilon = 3 is 11
average number of affinization = 17.088250860015876
Path 110 | total_timesteps 1808.
number of affinization with epsilon = 3 is 14
average number of affinization = 17.08784230718349
Path 111 | total_timesteps 1825.
number of affinization with epsilon = 3 is 12
average number of affinization = 17.087169312169312
Path 112 | total_timesteps 1839.
number of affinization with epsilon = 3 is 13
average number of affinization = 17.086628752810476
Path 113 | total_timesteps 1854.
number of affinization with epsilon = 3 is 8
average number of affinization = 17.08542713567839
Path 114 | total_timesteps 1865.
number of affinization with epsilon = 3 is 18
average number of affinization = 17.08554806293799
Path 115 | total_timesteps 1886.
number of affinization with epsilon = 3 is 8
average number of affinization = 17.084346906398732
Path 116 | total_timesteps 1898.
number of affinization with epsilon = 3 is 25
average number of affinization = 17.085393258426965
Path 117 | total_timesteps 1929.
number of affinization with epsilon = 3 is 20
average number of affinization = 17.0857784826857
Path 118 | total_timesteps 1951.
number of affinization with epsilon = 3 is 8
average number of affinization = 17.08457777190432
Path 119 | total_timesteps 1962.
number of affinization with epsilon = 3 is 11
average number of affinization = 17.08377378435518
Path 120 | total_timesteps 1977.
number of affinization with epsilon = 3 is 21
average number of affinization = 17.084291187739463
Path 121 | total_timesteps 2004.
number of affinization with epsilon = 3 is 21
average number of affinization = 17.084808454425364
Path 122 | total_timesteps 2029.
number of affinization with epsilon = 3 is 7
average number of affinization = 17.083476423193765
Path 123 | total_timesteps 2038.
number of affinization with epsilon = 3 is 24
average number of affinization = 17.084389857369256
Path 124 | total_timesteps 2065.
number of affinization with epsilon = 3 is 20
average number of affinization = 17.08477485804833
Path 125 | total_timesteps 2089.
number of affinization with epsilon = 3 is 10
average number of affinization = 17.083839450752574
Path 126 | total_timesteps 2100.
number of affinization with epsilon = 3 is 8
average number of affinization = 17.082640264026402
Path 127 | total_timesteps 2114.
number of affinization with epsilon = 3 is 6
average number of affinization = 17.081177402323124
Path 128 | total_timesteps 2123.
number of affinization with epsilon = 3 is 19
average number of affinization = 17.08143064537416
Path 129 | total_timesteps 2143.
number of affinization with epsilon = 3 is 11
average number of affinization = 17.080628134072313
Path 130 | total_timesteps 2158.
number of affinization with epsilon = 3 is 12
average number of affinization = 17.079957778070984
Path 131 | total_timesteps 2172.
number of affinization with epsilon = 3 is 10
average number of affinization = 17.079023746701846
Path 132 | total_timesteps 2184.
number of affinization with epsilon = 3 is 23
average number of affinization = 17.079804775095635
Path 133 | total_timesteps 2210.
number of affinization with epsilon = 3 is 9
average number of affinization = 17.078739118965974
Path 134 | total_timesteps 2222.
number of affinization with epsilon = 3 is 12
average number of affinization = 17.078069365686403
Path 135 | total_timesteps 2237.
number of affinization with epsilon = 3 is 7
average number of affinization = 17.076740506329113
Path 136 | total_timesteps 2247.
number of affinization with epsilon = 3 is 14
average number of affinization = 17.076334871456822
Path 137 | total_timesteps 2265.
number of affinization with epsilon = 3 is 14
average number of affinization = 17.07592934352755
Path 138 | total_timesteps 2282.
number of affinization with epsilon = 3 is 6
average number of affinization = 17.074469487280876
Path 139 | total_timesteps 2291.
number of affinization with epsilon = 3 is 16
average number of affinization = 17.074327886136004
Path 140 | total_timesteps 2309.
number of affinization with epsilon = 3 is 20
average number of affinization = 17.074713400975096
Path 141 | total_timesteps 2335.
number of affinization with epsilon = 3 is 6
average number of affinization = 17.073254281949936
Path 142 | total_timesteps 2345.
number of affinization with epsilon = 3 is 5
average number of affinization = 17.071663812409433
Path 143 | total_timesteps 2353.
number of affinization with epsilon = 3 is 14
average number of affinization = 17.071259220231823
Path 144 | total_timesteps 2369.
number of affinization with epsilon = 3 is 12
average number of affinization = 17.070591334123534
Path 145 | total_timesteps 2385.
number of affinization with epsilon = 3 is 5
average number of affinization = 17.069001843560706
Path 146 | total_timesteps 2393.
number of affinization with epsilon = 3 is 17
average number of affinization = 17.06899275839368
Path 147 | total_timesteps 2418.
number of affinization with epsilon = 3 is 12
average number of affinization = 17.068325434439178
Path 148 | total_timesteps 2434.
number of affinization with epsilon = 3 is 9
average number of affinization = 17.06726339344478
Path 149 | total_timesteps 2446.
number of affinization with epsilon = 3 is 9
average number of affinization = 17.066201632008422
Path 150 | total_timesteps 2457.
number of affinization with epsilon = 3 is 12
average number of affinization = 17.065534938807737
Path 151 | total_timesteps 2472.
number of affinization with epsilon = 3 is 12
average number of affinization = 17.064868421052633
Path 152 | total_timesteps 2488.
number of affinization with epsilon = 3 is 10
average number of affinization = 17.063938955400605
Path 153 | total_timesteps 2504.
number of affinization with epsilon = 3 is 13
average number of affinization = 17.063404367271772
Path 154 | total_timesteps 2519.
number of affinization with epsilon = 3 is 8
average number of affinization = 17.06221228462449
Path 155 | total_timesteps 2530.
number of affinization with epsilon = 3 is 29
average number of affinization = 17.06378221988427
Path 156 | total_timesteps 2564.
number of affinization with epsilon = 3 is 5
average number of affinization = 17.062195923734386
Path 157 | total_timesteps 2574.
number of affinization with epsilon = 3 is 17
average number of affinization = 17.06218774651591
Path 158 | total_timesteps 2595.
number of affinization with epsilon = 3 is 13
average number of affinization = 17.061653739976336
Path 159 | total_timesteps 2613.
number of affinization with epsilon = 3 is 14
average number of affinization = 17.06125131440589
Path 160 | total_timesteps 2630.
number of affinization with epsilon = 3 is 14
average number of affinization = 17.060848994611643
Path 161 | total_timesteps 2646.
number of affinization with epsilon = 3 is 7
average number of affinization = 17.05952693823916
Path 162 | total_timesteps 2657.
number of affinization with epsilon = 3 is 9
average number of affinization = 17.058468006832218
Path 163 | total_timesteps 2669.
number of affinization with epsilon = 3 is 9
average number of affinization = 17.05740935365213
Path 164 | total_timesteps 2681.
number of affinization with epsilon = 3 is 8
average number of affinization = 17.05621962432681
Path 165 | total_timesteps 2693.
number of affinization with epsilon = 3 is 7
average number of affinization = 17.054898870501706
Path 166 | total_timesteps 2702.
number of affinization with epsilon = 3 is 9
average number of affinization = 17.053841103086015
Path 167 | total_timesteps 2714.
number of affinization with epsilon = 3 is 8
average number of affinization = 17.05265231092437
Path 168 | total_timesteps 2725.
number of affinization with epsilon = 3 is 11
average number of affinization = 17.051857686753316
Path 169 | total_timesteps 2737.
number of affinization with epsilon = 3 is 11
average number of affinization = 17.05106327119979
Path 170 | total_timesteps 2749.
number of affinization with epsilon = 3 is 7
average number of affinization = 17.04974406090038
Path 171 | total_timesteps 2757.
number of affinization with epsilon = 3 is 23
average number of affinization = 17.0505249343832
Path 172 | total_timesteps 2783.
number of affinization with epsilon = 3 is 10
average number of affinization = 17.049599790053797
Path 173 | total_timesteps 2794.
number of affinization with epsilon = 3 is 15
average number of affinization = 17.04933088428234
Path 174 | total_timesteps 2810.
number of affinization with epsilon = 3 is 9
average number of affinization = 17.048274957365866
Path 175 | total_timesteps 2825.
number of affinization with epsilon = 3 is 4
average number of affinization = 17.04656348373557
Path 176 | total_timesteps 2834.
number of affinization with epsilon = 3 is 20
average number of affinization = 17.04695081967213
Path 177 | total_timesteps 2858.
number of affinization with epsilon = 3 is 25
average number of affinization = 17.047993705743508
Path 178 | total_timesteps 2891.
number of affinization with epsilon = 3 is 13
average number of affinization = 17.04746296053494
Path 179 | total_timesteps 2907.
number of affinization with epsilon = 3 is 22
average number of affinization = 17.048112218143682
Path 180 | total_timesteps 2931.
number of affinization with epsilon = 3 is 5
average number of affinization = 17.046532966312753
Path 181 | total_timesteps 2938.
number of affinization with epsilon = 3 is 9
average number of affinization = 17.045478374836172
Path 182 | total_timesteps 2949.
number of affinization with epsilon = 3 is 13
average number of affinization = 17.044948237452495
Path 183 | total_timesteps 2965.
number of affinization with epsilon = 3 is 19
average number of affinization = 17.045204402515722
Path 184 | total_timesteps 2989.
number of affinization with epsilon = 3 is 24
average number of affinization = 17.04611555089742
Path 185 | total_timesteps 3018.
number of affinization with epsilon = 3 is 14
average number of affinization = 17.04571653130731
Path 186 | total_timesteps 3034.
number of affinization with epsilon = 3 is 13
average number of affinization = 17.045186640471513
Path 187 | total_timesteps 3053.
number of affinization with epsilon = 3 is 5
average number of affinization = 17.043609219486644
Path 188 | total_timesteps 3060.
number of affinization with epsilon = 3 is 24
average number of affinization = 17.044520099515516
Path 189 | total_timesteps 3090.
number of affinization with epsilon = 3 is 6
average number of affinization = 17.04307410316837
Path 190 | total_timesteps 3099.
number of affinization with epsilon = 3 is 21
average number of affinization = 17.043592093205916
Path 191 | total_timesteps 3123.
number of affinization with epsilon = 3 is 7
average number of affinization = 17.042277486910994
Path 192 | total_timesteps 3133.
number of affinization with epsilon = 3 is 19
average number of affinization = 17.042533699777515
Path 193 | total_timesteps 3154.
number of affinization with epsilon = 3 is 14
average number of affinization = 17.0421355666056
Path 194 | total_timesteps 3173.
number of affinization with epsilon = 3 is 15
average number of affinization = 17.041868376292033
Path 195 | total_timesteps 3191.
number of affinization with epsilon = 3 is 6
average number of affinization = 17.04042386185243
Path 196 | total_timesteps 3200.
number of affinization with epsilon = 3 is 10
average number of affinization = 17.039502943100064
Path 197 | total_timesteps 3213.
number of affinization with epsilon = 3 is 4
average number of affinization = 17.03779754119801
Path 198 | total_timesteps 3221.
number of affinization with epsilon = 3 is 10
average number of affinization = 17.036877206747743
Path 199 | total_timesteps 3232.
number of affinization with epsilon = 3 is 11
average number of affinization = 17.036087866108787
Path 200 | total_timesteps 3246.
number of affinization with epsilon = 3 is 15
average number of affinization = 17.035821676036083
Path 201 | total_timesteps 3265.
number of affinization with epsilon = 3 is 14
average number of affinization = 17.035424836601308
Path 202 | total_timesteps 3284.
number of affinization with epsilon = 3 is 10
average number of affinization = 17.034505293425696
Path 203 | total_timesteps 3296.
number of affinization with epsilon = 3 is 14
average number of affinization = 17.034108729743856
Path 204 | total_timesteps 3312.
number of affinization with epsilon = 3 is 21
average number of affinization = 17.034626943682216
Path 205 | total_timesteps 3336.
number of affinization with epsilon = 3 is 18
average number of affinization = 17.034753070290044
Path 206 | total_timesteps 3356.
number of affinization with epsilon = 3 is 14
average number of affinization = 17.03435662965382
Path 207 | total_timesteps 3373.
number of affinization with epsilon = 3 is 18
average number of affinization = 17.03448275862069
Path 208 | total_timesteps 3399.
number of affinization with epsilon = 3 is 7
average number of affinization = 17.033172260676505
Path 209 | total_timesteps 3409.
number of affinization with epsilon = 3 is 12
average number of affinization = 17.03251501697571
Path 210 | total_timesteps 3423.
number of affinization with epsilon = 3 is 12
average number of affinization = 17.03185794490142
Path 211 | total_timesteps 3437.
number of affinization with epsilon = 3 is 12
average number of affinization = 17.031201044386425
Path 212 | total_timesteps 3451.
number of affinization with epsilon = 3 is 11
average number of affinization = 17.03041378410129
Path 213 | total_timesteps 3463.
number of affinization with epsilon = 3 is 9
average number of affinization = 17.029365700861394
Path 214 | total_timesteps 3475.
number of affinization with epsilon = 3 is 15
average number of affinization = 17.029100874331203
Path 215 | total_timesteps 3494.
number of affinization with epsilon = 3 is 21
average number of affinization = 17.029618997912316
Path 216 | total_timesteps 3526.
number of affinization with epsilon = 3 is 17
average number of affinization = 17.02961513372472
Path 217 | total_timesteps 3548.
number of affinization with epsilon = 3 is 15
average number of affinization = 17.029350378293763
Path 218 | total_timesteps 3567.
number of affinization with epsilon = 3 is 11
average number of affinization = 17.028563975479326
Path 219 | total_timesteps 3581.
number of affinization with epsilon = 3 is 5
average number of affinization = 17.02699530516432
Path 220 | total_timesteps 3590.
number of affinization with epsilon = 3 is 13
average number of affinization = 17.0264702047203
Path 221 | total_timesteps 3606.
number of affinization with epsilon = 3 is 19
average number of affinization = 17.026727509778357
Path 222 | total_timesteps 3631.
number of affinization with epsilon = 3 is 11
average number of affinization = 17.025941858949288
Path 223 | total_timesteps 3647.
number of affinization with epsilon = 3 is 7
average number of affinization = 17.02463503649635
Path 224 | total_timesteps 3656.
number of affinization with epsilon = 3 is 17
average number of affinization = 17.024631825882967
Path 225 | total_timesteps 3677.
number of affinization with epsilon = 3 is 10
average number of affinization = 17.02371644513943
Path 226 | total_timesteps 3690.
number of affinization with epsilon = 3 is 23
average number of affinization = 17.024495114006516
Path 227 | total_timesteps 3719.
number of affinization with epsilon = 3 is 16
average number of affinization = 17.024361646690984
Path 228 | total_timesteps 3738.
number of affinization with epsilon = 3 is 29
average number of affinization = 17.025921583952066
Path 229 | total_timesteps 3769.
number of affinization with epsilon = 3 is 28
average number of affinization = 17.027350872623078
Path 230 | total_timesteps 3804.
number of affinization with epsilon = 3 is 9
average number of affinization = 17.026305508529756
Path 231 | total_timesteps 3814.
number of affinization with epsilon = 3 is 7
average number of affinization = 17.025
Path 232 | total_timesteps 3824.
number of affinization with epsilon = 3 is 10
average number of affinization = 17.024085405546153
Path 233 | total_timesteps 3839.
number of affinization with epsilon = 3 is 12
average number of affinization = 17.02343139807342
Path 234 | total_timesteps 3853.
number of affinization with epsilon = 3 is 18
average number of affinization = 17.023558505792007
Path 235 | total_timesteps 3872.
number of affinization with epsilon = 3 is 13
average number of affinization = 17.023034877667882
Path 236 | total_timesteps 3887.
number of affinization with epsilon = 3 is 10
average number of affinization = 17.022121014964217
Path 237 | total_timesteps 3900.
number of affinization with epsilon = 3 is 13
average number of affinization = 17.0215977101223
Path 238 | total_timesteps 3915.
number of affinization with epsilon = 3 is 16
average number of affinization = 17.021464810719397
Path 239 | total_timesteps 3933.
number of affinization with epsilon = 3 is 15
average number of affinization = 17.021201873048906
Path 240 | total_timesteps 3951.
number of affinization with epsilon = 3 is 15
average number of affinization = 17.020939003771623
Path 241 | total_timesteps 3968.
number of affinization with epsilon = 3 is 12
average number of affinization = 17.02028608582575
Path 242 | total_timesteps 3982.
number of affinization with epsilon = 3 is 13
average number of affinization = 17.01976335977116
Path 243 | total_timesteps 3996.
number of affinization with epsilon = 3 is 12
average number of affinization = 17.01911076443058
Path 244 | total_timesteps 4011.
number of affinization with epsilon = 3 is 13
average number of affinization = 17.018588327050566
Path 245 | total_timesteps 4025.
number of affinization with epsilon = 3 is 9
average number of affinization = 17.017546139849234
Path 246 | total_timesteps 4037.
number of affinization with epsilon = 3 is 18
average number of affinization = 17.017673814165043
Path 247 | total_timesteps 4059.
number of affinization with epsilon = 3 is 12
average number of affinization = 17.01702182952183
Path 248 | total_timesteps 4073.
number of affinization with epsilon = 3 is 13
average number of affinization = 17.016499935039626
Path 249 | total_timesteps 4088.
number of affinization with epsilon = 3 is 12
average number of affinization = 17.015848272278514
Path 250 | total_timesteps 4105.
number of affinization with epsilon = 3 is 9
average number of affinization = 17.014807117807507
Path 251 | total_timesteps 4115.
number of affinization with epsilon = 3 is 13
average number of affinization = 17.014285714285716
Path 252 | total_timesteps 4129.
number of affinization with epsilon = 3 is 9
average number of affinization = 17.013245033112582
Path 253 | total_timesteps 4140.
number of affinization with epsilon = 3 is 5
average number of affinization = 17.011685276551546
Path 254 | total_timesteps 4148.
number of affinization with epsilon = 3 is 9
average number of affinization = 17.0106452031676
Path 255 | total_timesteps 4160.
number of affinization with epsilon = 3 is 15
average number of affinization = 17.010384215991692
Path 256 | total_timesteps 4178.
number of affinization with epsilon = 3 is 16
average number of affinization = 17.010253082414017
Path 257 | total_timesteps 4198.
number of affinization with epsilon = 3 is 11
average number of affinization = 17.00947313781469
Path 258 | total_timesteps 4210.
number of affinization with epsilon = 3 is 25
average number of affinization = 17.010509926041262
Path 259 | total_timesteps 4237.
number of affinization with epsilon = 3 is 14
average number of affinization = 17.010119356512714
Path 260 | total_timesteps 4254.
number of affinization with epsilon = 3 is 13
average number of affinization = 17.00959916980153
Path 261 | total_timesteps 4269.
number of affinization with epsilon = 3 is 14
average number of affinization = 17.009208819714658
Path 262 | total_timesteps 4285.
number of affinization with epsilon = 3 is 14
average number of affinization = 17.00881857087278
Path 263 | total_timesteps 4302.
number of affinization with epsilon = 3 is 13
average number of affinization = 17.008298755186722
Path 264 | total_timesteps 4319.
number of affinization with epsilon = 3 is 19
average number of affinization = 17.008556981719174
Path 265 | total_timesteps 4340.
number of affinization with epsilon = 3 is 8
average number of affinization = 17.007389162561577
Path 266 | total_timesteps 4350.
number of affinization with epsilon = 3 is 19
average number of affinization = 17.007647440051848
Path 267 | total_timesteps 4372.
number of affinization with epsilon = 3 is 8
average number of affinization = 17.006480041472265
Path 268 | total_timesteps 4386.
number of affinization with epsilon = 3 is 10
average number of affinization = 17.005572113515615
Path 269 | total_timesteps 4399.
number of affinization with epsilon = 3 is 20
average number of affinization = 17.005960093288415
Path 270 | total_timesteps 4422.
number of affinization with epsilon = 3 is 7
average number of affinization = 17.004663816556548
Path 271 | total_timesteps 4432.
number of affinization with epsilon = 3 is 23
average number of affinization = 17.00544041450777
Path 272 | total_timesteps 4457.
number of affinization with epsilon = 3 is 12
average number of affinization = 17.00479212537236
Path 273 | total_timesteps 4472.
number of affinization with epsilon = 3 is 14
average number of affinization = 17.004403004403006
Path 274 | total_timesteps 4490.
number of affinization with epsilon = 3 is 7
average number of affinization = 17.003107600673314
Path 275 | total_timesteps 4499.
number of affinization with epsilon = 3 is 9
average number of affinization = 17.002071465561887
Path 276 | total_timesteps 4510.
number of affinization with epsilon = 3 is 9
average number of affinization = 17.001035598705503
Path 277 | total_timesteps 4523.
number of affinization with epsilon = 3 is 10
average number of affinization = 17.000129433083096
Path 278 | total_timesteps 4535.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.99883525300893
Path 279 | total_timesteps 4543.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.997670807453417
Path 280 | total_timesteps 4552.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.99689481174796
Path 281 | total_timesteps 4571.
number of affinization with epsilon = 3 is 17
average number of affinization = 16.996895213454074
Path 282 | total_timesteps 4591.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.996119518820333
Path 283 | total_timesteps 4604.
number of affinization with epsilon = 3 is 15
average number of affinization = 16.995861355406106
Path 284 | total_timesteps 4623.
number of affinization with epsilon = 3 is 17
average number of affinization = 16.995861890598732
Path 285 | total_timesteps 4644.
number of affinization with epsilon = 3 is 19
average number of affinization = 16.99612102404965
Path 286 | total_timesteps 4665.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.994828700711054
Path 287 | total_timesteps 4673.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.993795243019648
Path 288 | total_timesteps 4685.
number of affinization with epsilon = 3 is 14
average number of affinization = 16.99340829778984
Path 289 | total_timesteps 4701.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.992246058413027
Path 290 | total_timesteps 4711.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.990954903734334
Path 291 | total_timesteps 4721.
number of affinization with epsilon = 3 is 20
average number of affinization = 16.991343669250647
Path 292 | total_timesteps 4743.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.99018214700943
Path 293 | total_timesteps 4755.
number of affinization with epsilon = 3 is 27
average number of affinization = 16.991475071041073
Path 294 | total_timesteps 4786.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.990701278574196
Path 295 | total_timesteps 4800.
number of affinization with epsilon = 3 is 6
average number of affinization = 16.98928202479339
Path 296 | total_timesteps 4812.
number of affinization with epsilon = 3 is 6
average number of affinization = 16.987863137508068
Path 297 | total_timesteps 4822.
number of affinization with epsilon = 3 is 13
average number of affinization = 16.987348308804545
Path 298 | total_timesteps 4839.
number of affinization with epsilon = 3 is 29
average number of affinization = 16.98889892861753
Path 299 | total_timesteps 4871.
number of affinization with epsilon = 3 is 27
average number of affinization = 16.990191017036654
Path 300 | total_timesteps 4905.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.98941798941799
Path 301 | total_timesteps 4921.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.988387096774193
Path 302 | total_timesteps 4933.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.987098438911108
Path 303 | total_timesteps 4941.
number of affinization with epsilon = 3 is 6
average number of affinization = 16.985681114551085
Path 304 | total_timesteps 4952.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.984651102798917
Path 305 | total_timesteps 4965.
number of affinization with epsilon = 3 is 15
average number of affinization = 16.984395150889863
Path 306 | total_timesteps 4987.
number of affinization with epsilon = 3 is 6
average number of affinization = 16.982978723404255
Path 307 | total_timesteps 4994.
number of affinization with epsilon = 3 is 21
average number of affinization = 16.983496647756574
Path 308 | total_timesteps 5018.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.98233853293799
Path 309 | total_timesteps 5028.
number of affinization with epsilon = 3 is 6
average number of affinization = 16.98092291827791
Path 310 | total_timesteps 5037.
number of affinization with epsilon = 3 is 13
average number of affinization = 16.98040984662972
Path 311 | total_timesteps 5053.
number of affinization with epsilon = 3 is 15
average number of affinization = 16.980154639175257
Path 312 | total_timesteps 5069.
number of affinization with epsilon = 3 is 16
average number of affinization = 16.980028346862518
Path 313 | total_timesteps 5087.
number of affinization with epsilon = 3 is 22
average number of affinization = 16.980675083741303
Path 314 | total_timesteps 5114.
number of affinization with epsilon = 3 is 22
average number of affinization = 16.981321653999743
Path 315 | total_timesteps 5142.
number of affinization with epsilon = 3 is 14
average number of affinization = 16.980937660999484
Path 316 | total_timesteps 5160.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.97965228589826
Path 317 | total_timesteps 5169.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.978882307494207
Path 318 | total_timesteps 5183.
number of affinization with epsilon = 3 is 14
average number of affinization = 16.978498776876528
Path 319 | total_timesteps 5200.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.97747167868177
Path 320 | total_timesteps 5214.
number of affinization with epsilon = 3 is 21
average number of affinization = 16.977989445231046
Path 321 | total_timesteps 5238.
number of affinization with epsilon = 3 is 13
average number of affinization = 16.97747747747748
Path 322 | total_timesteps 5257.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.97632222365204
Path 323 | total_timesteps 5267.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.975553268142047
Path 324 | total_timesteps 5283.
number of affinization with epsilon = 3 is 14
average number of affinization = 16.97517046185514
Path 325 | total_timesteps 5301.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.974144584512477
Path 326 | total_timesteps 5313.
number of affinization with epsilon = 3 is 13
average number of affinization = 16.97363344051447
Path 327 | total_timesteps 5328.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.972350823045268
Path 328 | total_timesteps 5336.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.97132570399897
Path 329 | total_timesteps 5349.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.97042941630239
Path 330 | total_timesteps 5360.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.969404807815916
Path 331 | total_timesteps 5371.
number of affinization with epsilon = 3 is 20
average number of affinization = 16.96979434447301
Path 332 | total_timesteps 5394.
number of affinization with epsilon = 3 is 19
average number of affinization = 16.970055262819688
Path 333 | total_timesteps 5419.
number of affinization with epsilon = 3 is 12
average number of affinization = 16.96941660241583
Path 334 | total_timesteps 5435.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.968264165488886
Path 335 | total_timesteps 5447.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.96736896197328
Path 336 | total_timesteps 5459.
number of affinization with epsilon = 3 is 13
average number of affinization = 16.966859344894026
Path 337 | total_timesteps 5473.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.96583611610583
Path 338 | total_timesteps 5484.
number of affinization with epsilon = 3 is 14
average number of affinization = 16.96545524592269
Path 339 | total_timesteps 5501.
number of affinization with epsilon = 3 is 12
average number of affinization = 16.9648176682075
Path 340 | total_timesteps 5515.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.964051868019002
Path 341 | total_timesteps 5529.
number of affinization with epsilon = 3 is 16
average number of affinization = 16.96392811296534
Path 342 | total_timesteps 5547.
number of affinization with epsilon = 3 is 13
average number of affinization = 16.96341932999615
Path 343 | total_timesteps 5569.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.962268993839835
Path 344 | total_timesteps 5581.
number of affinization with epsilon = 3 is 13
average number of affinization = 16.96176055434364
Path 345 | total_timesteps 5598.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.960995637670003
Path 346 | total_timesteps 5610.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.960230917254652
Path 347 | total_timesteps 5624.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.95895330938943
Path 348 | total_timesteps 5633.
number of affinization with epsilon = 3 is 36
average number of affinization = 16.961395408490446
Path 349 | total_timesteps 5675.
number of affinization with epsilon = 3 is 12
average number of affinization = 16.960759169017695
Path 350 | total_timesteps 5689.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.95961020643672
Path 351 | total_timesteps 5700.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.95871794871795
Path 352 | total_timesteps 5712.
number of affinization with epsilon = 3 is 17
average number of affinization = 16.95872324061018
Path 353 | total_timesteps 5732.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.957831325301203
Path 354 | total_timesteps 5744.
number of affinization with epsilon = 3 is 16
average number of affinization = 16.957708573625528
Path 355 | total_timesteps 5764.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.956945156330086
Path 356 | total_timesteps 5777.
number of affinization with epsilon = 3 is 13
average number of affinization = 16.95643818065343
Path 357 | total_timesteps 5796.
number of affinization with epsilon = 3 is 14
average number of affinization = 16.95605944145529
Path 358 | total_timesteps 5814.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.955040348405277
Path 359 | total_timesteps 5824.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.954021516393443
Path 360 | total_timesteps 5836.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.953131002689204
Path 361 | total_timesteps 5851.
number of affinization with epsilon = 3 is 15
average number of affinization = 16.952880921895005
Path 362 | total_timesteps 5875.
number of affinization with epsilon = 3 is 12
average number of affinization = 16.952246831391626
Path 363 | total_timesteps 5890.
number of affinization with epsilon = 3 is 26
average number of affinization = 16.953405017921146
Path 364 | total_timesteps 5924.
number of affinization with epsilon = 3 is 29
average number of affinization = 16.95494688339946
Path 365 | total_timesteps 5957.
number of affinization with epsilon = 3 is 14
average number of affinization = 16.95456872280522
Path 366 | total_timesteps 5976.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.95355086372361
Path 367 | total_timesteps 5987.
number of affinization with epsilon = 3 is 5
average number of affinization = 16.952021494370523
Path 368 | total_timesteps 5996.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.95126007419726
Done generating on-policy rollouts.
Updating normalization.
Done updating normalization.
----------------------------
| AverageReturn | -6.16    |
| Iteration     | 26       |
| MaximumReturn | 9        |
| MinimumReturn | -20.7    |
| TotalSamples  | 112266   |
----------------------------
itr #27 | 
Fitting dynamics.
Fitting model 0 (0-based) in the ensemble of 2 models
Validation loss = 0.01447952352464199
Validation loss = 0.012959778308868408
Validation loss = 0.012999454513192177
Validation loss = 0.013304491527378559
Validation loss = 0.013192875310778618
Validation loss = 0.013168863020837307
Fitting model 1 (0-based) in the ensemble of 2 models
Validation loss = 0.012734274379909039
Validation loss = 0.012592626735568047
Validation loss = 0.01315087080001831
Validation loss = 0.013064549304544926
Validation loss = 0.012858033180236816
Validation loss = 0.012661720626056194
Done fitting dynamics.
Updating randomness.
Done updating randomness.
Training policy using TRPO.
Re-initialize init_std.
Obtaining samples for iteration 0...
Obtaining samples for iteration 1...
Obtaining samples for iteration 2...
Obtaining samples for iteration 3...
Obtaining samples for iteration 4...
Obtaining samples for iteration 5...
Obtaining samples for iteration 6...
Obtaining samples for iteration 7...
Obtaining samples for iteration 8...
Obtaining samples for iteration 9...
Obtaining samples for iteration 10...
Obtaining samples for iteration 11...
Obtaining samples for iteration 12...
Obtaining samples for iteration 13...
Obtaining samples for iteration 14...
Obtaining samples for iteration 15...
Obtaining samples for iteration 16...
Obtaining samples for iteration 17...
Obtaining samples for iteration 18...
Obtaining samples for iteration 19...
Done training policy.
Generating on-policy rollouts.
Path 0 | total_timesteps 0.
number of affinization with epsilon = 3 is 30
average number of affinization = 16.952929137886926
Path 1 | total_timesteps 34.
number of affinization with epsilon = 3 is 21
average number of affinization = 16.95344673231871
Path 2 | total_timesteps 58.
number of affinization with epsilon = 3 is 15
average number of affinization = 16.95319693094629
Path 3 | total_timesteps 76.
number of affinization with epsilon = 3 is 20
average number of affinization = 16.953586497890296
Path 4 | total_timesteps 98.
number of affinization with epsilon = 3 is 15
average number of affinization = 16.953336742521095
Path 5 | total_timesteps 115.
number of affinization with epsilon = 3 is 16
average number of affinization = 16.953214879202353
Path 6 | total_timesteps 134.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.95207055214724
Path 7 | total_timesteps 144.
number of affinization with epsilon = 3 is 6
average number of affinization = 16.95067092651757
Path 8 | total_timesteps 153.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.949654996166625
Path 9 | total_timesteps 163.
number of affinization with epsilon = 3 is 20
average number of affinization = 16.950044717005238
Path 10 | total_timesteps 186.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.948773633111905
Path 11 | total_timesteps 196.
number of affinization with epsilon = 3 is 16
average number of affinization = 16.948652446033975
Path 12 | total_timesteps 216.
number of affinization with epsilon = 3 is 18
average number of affinization = 16.948786717752235
Path 13 | total_timesteps 237.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.94764397905759
Path 14 | total_timesteps 247.
number of affinization with epsilon = 3 is 12
average number of affinization = 16.947012257405515
Path 15 | total_timesteps 263.
number of affinization with epsilon = 3 is 4
average number of affinization = 16.945359376994766
Path 16 | total_timesteps 270.
number of affinization with epsilon = 3 is 26
average number of affinization = 16.94651519019658
Path 17 | total_timesteps 300.
number of affinization with epsilon = 3 is 15
average number of affinization = 16.946266751754944
Path 18 | total_timesteps 318.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.945252679938744
Path 19 | total_timesteps 328.
number of affinization with epsilon = 3 is 13
average number of affinization = 16.94474926630088
Path 20 | total_timesteps 346.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.943735646848687
Path 21 | total_timesteps 357.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.942594718714123
Path 22 | total_timesteps 368.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.94170918367347
Path 23 | total_timesteps 380.
number of affinization with epsilon = 3 is 22
average number of affinization = 16.942354291544447
Path 24 | total_timesteps 406.
number of affinization with epsilon = 3 is 5
average number of affinization = 16.94083142055598
Path 25 | total_timesteps 414.
number of affinization with epsilon = 3 is 14
average number of affinization = 16.940456457988013
Path 26 | total_timesteps 431.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.939444161142273
Path 27 | total_timesteps 443.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.938304652644998
Path 28 | total_timesteps 453.
number of affinization with epsilon = 3 is 16
average number of affinization = 16.938185062452206
Path 29 | total_timesteps 472.
number of affinization with epsilon = 3 is 4
average number of affinization = 16.936536255893973
Path 30 | total_timesteps 481.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.93527013251784
Path 31 | total_timesteps 489.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.934131736526947
Path 32 | total_timesteps 499.
number of affinization with epsilon = 3 is 14
average number of affinization = 16.93375796178344
Path 33 | total_timesteps 516.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.932874793019998
Path 34 | total_timesteps 529.
number of affinization with epsilon = 3 is 16
average number of affinization = 16.93275598573612
Path 35 | total_timesteps 548.
number of affinization with epsilon = 3 is 13
average number of affinization = 16.932255189099706
Path 36 | total_timesteps 566.
number of affinization with epsilon = 3 is 17
average number of affinization = 16.932263814616757
Path 37 | total_timesteps 585.
number of affinization with epsilon = 3 is 17
average number of affinization = 16.93227243793762
Path 38 | total_timesteps 606.
number of affinization with epsilon = 3 is 5
average number of affinization = 16.930753564154784
Path 39 | total_timesteps 612.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.929616902125492
Path 40 | total_timesteps 622.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.928735047085773
Path 41 | total_timesteps 634.
number of affinization with epsilon = 3 is 6
average number of affinization = 16.927344445858253
Path 42 | total_timesteps 642.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.92608142493639
Path 43 | total_timesteps 653.
number of affinization with epsilon = 3 is 14
average number of affinization = 16.925709197303142
Path 44 | total_timesteps 669.
number of affinization with epsilon = 3 is 18
average number of affinization = 16.925845840752988
Path 45 | total_timesteps 691.
number of affinization with epsilon = 3 is 13
average number of affinization = 16.925346559837212
Path 46 | total_timesteps 705.
number of affinization with epsilon = 3 is 16
average number of affinization = 16.92522889114954
Path 47 | total_timesteps 725.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.92396694214876
Path 48 | total_timesteps 735.
number of affinization with epsilon = 3 is 21
average number of affinization = 16.924485125858123
Path 49 | total_timesteps 760.
number of affinization with epsilon = 3 is 6
average number of affinization = 16.923096478962755
Path 50 | total_timesteps 770.
number of affinization with epsilon = 3 is 20
average number of affinization = 16.923487544483987
Path 51 | total_timesteps 796.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.922353539204472
Path 52 | total_timesteps 809.
number of affinization with epsilon = 3 is 18
average number of affinization = 16.92249047013977
Path 53 | total_timesteps 831.
number of affinization with epsilon = 3 is 13
average number of affinization = 16.921992122983102
Path 54 | total_timesteps 848.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.92111280487805
Path 55 | total_timesteps 861.
number of affinization with epsilon = 3 is 6
average number of affinization = 16.919725644608153
Path 56 | total_timesteps 871.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.918846837693675
Path 57 | total_timesteps 885.
number of affinization with epsilon = 3 is 12
average number of affinization = 16.918222222222223
Path 58 | total_timesteps 901.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.917089893346876
Path 59 | total_timesteps 913.
number of affinization with epsilon = 3 is 15
average number of affinization = 16.91684651517075
Path 60 | total_timesteps 930.
number of affinization with epsilon = 3 is 17
average number of affinization = 16.91685707032242
Path 61 | total_timesteps 954.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.915979185175782
Path 62 | total_timesteps 967.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.91484771573604
Path 63 | total_timesteps 976.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.913970308336506
Path 64 | total_timesteps 988.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.91271250951535
Path 65 | total_timesteps 997.
number of affinization with epsilon = 3 is 19
average number of affinization = 16.912977292908792
Path 66 | total_timesteps 1023.
number of affinization with epsilon = 3 is 12
average number of affinization = 16.912354134956875
Path 67 | total_timesteps 1040.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.91160431198478
Path 68 | total_timesteps 1053.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.91085467917829
Path 69 | total_timesteps 1065.
number of affinization with epsilon = 3 is 15
average number of affinization = 16.91061240015215
Path 70 | total_timesteps 1083.
number of affinization with epsilon = 3 is 18
average number of affinization = 16.91075050709939
Path 71 | total_timesteps 1105.
number of affinization with epsilon = 3 is 6
average number of affinization = 16.909367473697554
Path 72 | total_timesteps 1113.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.90811153358682
Path 73 | total_timesteps 1121.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.906982638448866
Path 74 | total_timesteps 1133.
number of affinization with epsilon = 3 is 30
average number of affinization = 16.90864166244298
Path 75 | total_timesteps 1166.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.907766375269226
Path 76 | total_timesteps 1178.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.906764631365593
Path 77 | total_timesteps 1191.
number of affinization with epsilon = 3 is 13
average number of affinization = 16.906269791006967
Path 78 | total_timesteps 1208.
number of affinization with epsilon = 3 is 15
average number of affinization = 16.906028368794328
Path 79 | total_timesteps 1226.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.905153855894643
Path 80 | total_timesteps 1238.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.90402633578121
Path 81 | total_timesteps 1247.
number of affinization with epsilon = 3 is 24
average number of affinization = 16.90492467400937
Path 82 | total_timesteps 1274.
number of affinization with epsilon = 3 is 12
average number of affinization = 16.904303797468355
Path 83 | total_timesteps 1289.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.903303379319073
Path 84 | total_timesteps 1299.
number of affinization with epsilon = 3 is 15
average number of affinization = 16.90306251581878
Path 85 | total_timesteps 1318.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.901809439453373
Path 86 | total_timesteps 1328.
number of affinization with epsilon = 3 is 14
average number of affinization = 16.901442307692307
Path 87 | total_timesteps 1346.
number of affinization with epsilon = 3 is 16
average number of affinization = 16.901328273244783
Path 88 | total_timesteps 1363.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.900328864153806
Path 89 | total_timesteps 1374.
number of affinization with epsilon = 3 is 13
average number of affinization = 16.899835588718858
Path 90 | total_timesteps 1391.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.899089529590288
Path 91 | total_timesteps 1405.
number of affinization with epsilon = 3 is 21
average number of affinization = 16.89960804147174
Path 92 | total_timesteps 1430.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.89873577749684
Path 93 | total_timesteps 1442.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.897484515231955
Path 94 | total_timesteps 1450.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.89648634984833
Path 95 | total_timesteps 1460.
number of affinization with epsilon = 3 is 6
average number of affinization = 16.895109313787437
Path 96 | total_timesteps 1471.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.894111700783423
Path 97 | total_timesteps 1483.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.893367024636767
Path 98 | total_timesteps 1495.
number of affinization with epsilon = 3 is 12
average number of affinization = 16.892748863062153
Path 99 | total_timesteps 1509.
number of affinization with epsilon = 3 is 6
average number of affinization = 16.89137299482127
Path 100 | total_timesteps 1516.
number of affinization with epsilon = 3 is 21
average number of affinization = 16.89189189189189
Path 101 | total_timesteps 1540.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.890769036494508
Path 102 | total_timesteps 1549.
number of affinization with epsilon = 3 is 17
average number of affinization = 16.890782828282827
Path 103 | total_timesteps 1573.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.88953414972857
Path 104 | total_timesteps 1581.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.888664478667003
Path 105 | total_timesteps 1595.
number of affinization with epsilon = 3 is 14
average number of affinization = 16.888299886406664
Path 106 | total_timesteps 1610.
number of affinization with epsilon = 3 is 5
average number of affinization = 16.886799596163552
Path 107 | total_timesteps 1618.
number of affinization with epsilon = 3 is 33
average number of affinization = 16.888832807570978
Path 108 | total_timesteps 1659.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.887837496845822
Path 109 | total_timesteps 1670.
number of affinization with epsilon = 3 is 14
average number of affinization = 16.887473192885075
Path 110 | total_timesteps 1686.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.88673057517659
Path 111 | total_timesteps 1701.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.885988144784967
Path 112 | total_timesteps 1719.
number of affinization with epsilon = 3 is 14
average number of affinization = 16.88562421185372
Path 113 | total_timesteps 1737.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.884377758164167
Path 114 | total_timesteps 1745.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.883509833585478
Path 115 | total_timesteps 1757.
number of affinization with epsilon = 3 is 13
average number of affinization = 16.883020294970375
Path 116 | total_timesteps 1773.
number of affinization with epsilon = 3 is 19
average number of affinization = 16.88328711872952
Path 117 | total_timesteps 1795.
number of affinization with epsilon = 3 is 15
average number of affinization = 16.883049779458098
Path 118 | total_timesteps 1816.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.881930443548388
Path 119 | total_timesteps 1829.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.88081138969384
Path 120 | total_timesteps 1840.
number of affinization with epsilon = 3 is 18
average number of affinization = 16.88095238095238
Path 121 | total_timesteps 1860.
number of affinization with epsilon = 3 is 14
average number of affinization = 16.8805894948986
Path 122 | total_timesteps 1875.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.879722921914357
Path 123 | total_timesteps 1887.
number of affinization with epsilon = 3 is 12
average number of affinization = 16.87910842463166
Path 124 | total_timesteps 1902.
number of affinization with epsilon = 3 is 16
average number of affinization = 16.878997733568372
Path 125 | total_timesteps 1921.
number of affinization with epsilon = 3 is 6
average number of affinization = 16.877628100214025
Path 126 | total_timesteps 1929.
number of affinization with epsilon = 3 is 22
average number of affinization = 16.87827291037261
Path 127 | total_timesteps 1954.
number of affinization with epsilon = 3 is 13
average number of affinization = 16.877784770295783
Path 128 | total_timesteps 1972.
number of affinization with epsilon = 3 is 22
average number of affinization = 16.878429398439465
Path 129 | total_timesteps 2001.
number of affinization with epsilon = 3 is 13
average number of affinization = 16.87794136152007
Path 130 | total_timesteps 2015.
number of affinization with epsilon = 3 is 22
average number of affinization = 16.878585807750376
Path 131 | total_timesteps 2042.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.87734306202038
Path 132 | total_timesteps 2052.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.87622641509434
Path 133 | total_timesteps 2062.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.874984278707082
Path 134 | total_timesteps 2071.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.873993963782695
Path 135 | total_timesteps 2081.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.872878159185213
Path 136 | total_timesteps 2091.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.872014080965553
Path 137 | total_timesteps 2103.
number of affinization with epsilon = 3 is 17
average number of affinization = 16.872030169704587
Path 138 | total_timesteps 2123.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.871292106586225
Path 139 | total_timesteps 2135.
number of affinization with epsilon = 3 is 18
average number of affinization = 16.871433957521678
Path 140 | total_timesteps 2156.
number of affinization with epsilon = 3 is 17
average number of affinization = 16.871450113093744
Path 141 | total_timesteps 2177.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.870461113205177
Path 142 | total_timesteps 2187.
number of affinization with epsilon = 3 is 12
average number of affinization = 16.869849246231155
Path 143 | total_timesteps 2204.
number of affinization with epsilon = 3 is 28
average number of affinization = 16.871247330737344
Path 144 | total_timesteps 2237.
number of affinization with epsilon = 3 is 15
average number of affinization = 16.87101230846521
Path 145 | total_timesteps 2257.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.869772698731634
Path 146 | total_timesteps 2268.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.868533400301356
Path 147 | total_timesteps 2276.
number of affinization with epsilon = 3 is 19
average number of affinization = 16.868801004394225
Path 148 | total_timesteps 2296.
number of affinization with epsilon = 3 is 6
average number of affinization = 16.867436605573687
Path 149 | total_timesteps 2304.
number of affinization with epsilon = 3 is 16
average number of affinization = 16.867327726873352
Path 150 | total_timesteps 2322.
number of affinization with epsilon = 3 is 25
average number of affinization = 16.868348393574298
Path 151 | total_timesteps 2354.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.867611996486385
Path 152 | total_timesteps 2368.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.86662484316186
Path 153 | total_timesteps 2382.
number of affinization with epsilon = 3 is 12
average number of affinization = 16.866014301844185
Path 154 | total_timesteps 2397.
number of affinization with epsilon = 3 is 14
average number of affinization = 16.8656547917712
Path 155 | total_timesteps 2412.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.864793678665496
Path 156 | total_timesteps 2425.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.863807373965386
Path 157 | total_timesteps 2437.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.86307210031348
Path 158 | total_timesteps 2450.
number of affinization with epsilon = 3 is 6
average number of affinization = 16.861710130391174
Path 159 | total_timesteps 2457.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.86059922276545
Path 160 | total_timesteps 2468.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.859488593632488
Path 161 | total_timesteps 2478.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.858503571876174
Path 162 | total_timesteps 2488.
number of affinization with epsilon = 3 is 14
average number of affinization = 16.85814536340852
Path 163 | total_timesteps 2505.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.85691016163388
Path 164 | total_timesteps 2515.
number of affinization with epsilon = 3 is 15
average number of affinization = 16.85667752442997
Path 165 | total_timesteps 2533.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.855818614555933
Path 166 | total_timesteps 2544.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.85495991983968
Path 167 | total_timesteps 2558.
number of affinization with epsilon = 3 is 14
average number of affinization = 16.85460237946149
Path 168 | total_timesteps 2575.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.85374405209116
Path 169 | total_timesteps 2588.
number of affinization with epsilon = 3 is 17
average number of affinization = 16.85376236384124
Path 170 | total_timesteps 2612.
number of affinization with epsilon = 3 is 31
average number of affinization = 16.855533299949926
Path 171 | total_timesteps 2647.
number of affinization with epsilon = 3 is 13
average number of affinization = 16.85505069470522
Path 172 | total_timesteps 2663.
number of affinization with epsilon = 3 is 20
average number of affinization = 16.855444305381727
Path 173 | total_timesteps 2684.
number of affinization with epsilon = 3 is 6
average number of affinization = 16.854085846577398
Path 174 | total_timesteps 2693.
number of affinization with epsilon = 3 is 12
average number of affinization = 16.85347847847848
Path 175 | total_timesteps 2711.
number of affinization with epsilon = 3 is 19
average number of affinization = 16.85374702865007
Path 176 | total_timesteps 2736.
number of affinization with epsilon = 3 is 13
average number of affinization = 16.853264948711534
Path 177 | total_timesteps 2751.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.85228267667292
Path 178 | total_timesteps 2761.
number of affinization with epsilon = 3 is 12
average number of affinization = 16.85167583791896
Path 179 | total_timesteps 2775.
number of affinization with epsilon = 3 is 19
average number of affinization = 16.851944479179693
Path 180 | total_timesteps 2796.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.8512128032008
Path 181 | total_timesteps 2808.
number of affinization with epsilon = 3 is 15
average number of affinization = 16.850981372671583
Path 182 | total_timesteps 2828.
number of affinization with epsilon = 3 is 16
average number of affinization = 16.850875
Path 183 | total_timesteps 2846.
number of affinization with epsilon = 3 is 6
average number of affinization = 16.84951881014873
Path 184 | total_timesteps 2856.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.848787803049238
Path 185 | total_timesteps 2870.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.84793202549044
Path 186 | total_timesteps 2881.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.84670164917541
Path 187 | total_timesteps 2889.
number of affinization with epsilon = 3 is 17
average number of affinization = 16.84672079950031
Path 188 | total_timesteps 2910.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.84599050711966
Path 189 | total_timesteps 2924.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.844885724990633
Path 190 | total_timesteps 2936.
number of affinization with epsilon = 3 is 16
average number of affinization = 16.84478021978022
Path 191 | total_timesteps 2955.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.843925583718317
Path 192 | total_timesteps 2966.
number of affinization with epsilon = 3 is 13
average number of affinization = 16.843445692883893
Path 193 | total_timesteps 2982.
number of affinization with epsilon = 3 is 12
average number of affinization = 16.842841093496443
Path 194 | total_timesteps 2995.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.84211183225162
Path 195 | total_timesteps 3009.
number of affinization with epsilon = 3 is 24
average number of affinization = 16.843005116685386
Path 196 | total_timesteps 3036.
number of affinization with epsilon = 3 is 16
average number of affinization = 16.84289992513102
Path 197 | total_timesteps 3054.
number of affinization with epsilon = 3 is 12
average number of affinization = 16.842295695570805
Path 198 | total_timesteps 3069.
number of affinization with epsilon = 3 is 16
average number of affinization = 16.842190618762476
Path 199 | total_timesteps 3089.
number of affinization with epsilon = 3 is 6
average number of affinization = 16.84083821878508
Path 200 | total_timesteps 3099.
number of affinization with epsilon = 3 is 6
average number of affinization = 16.839486156148666
Path 201 | total_timesteps 3109.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.838757949869063
Path 202 | total_timesteps 3122.
number of affinization with epsilon = 3 is 23
average number of affinization = 16.839526184538652
Path 203 | total_timesteps 3147.
number of affinization with epsilon = 3 is 6
average number of affinization = 16.83817479117317
Path 204 | total_timesteps 3157.
number of affinization with epsilon = 3 is 27
average number of affinization = 16.839441535776615
Path 205 | total_timesteps 3190.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.83858905646267
Path 206 | total_timesteps 3203.
number of affinization with epsilon = 3 is 12
average number of affinization = 16.837986041874377
Path 207 | total_timesteps 3217.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.836884735202492
Path 208 | total_timesteps 3228.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.836032893097432
Path 209 | total_timesteps 3239.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.8349321041485
Path 210 | total_timesteps 3250.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.83395615346288
Path 211 | total_timesteps 3260.
number of affinization with epsilon = 3 is 16
average number of affinization = 16.833852285465188
Path 212 | total_timesteps 3279.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.832627646326277
Path 213 | total_timesteps 3288.
number of affinization with epsilon = 3 is 32
average number of affinization = 16.83451624953306
Path 214 | total_timesteps 3324.
number of affinization with epsilon = 3 is 20
average number of affinization = 16.834910358565736
Path 215 | total_timesteps 3348.
number of affinization with epsilon = 3 is 5
average number of affinization = 16.83343707207768
Path 216 | total_timesteps 3355.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.832710978342046
Path 217 | total_timesteps 3369.
number of affinization with epsilon = 3 is 20
average number of affinization = 16.833105164903547
Path 218 | total_timesteps 3392.
number of affinization with epsilon = 3 is 18
average number of affinization = 16.83325037332006
Path 219 | total_timesteps 3414.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.832151300236408
Path 220 | total_timesteps 3425.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.831176909679023
Path 221 | total_timesteps 3435.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.829953974374924
Path 222 | total_timesteps 3444.
number of affinization with epsilon = 3 is 23
average number of affinization = 16.830721393034825
Path 223 | total_timesteps 3469.
number of affinization with epsilon = 3 is 24
average number of affinization = 16.83161298345977
Path 224 | total_timesteps 3496.
number of affinization with epsilon = 3 is 14
average number of affinization = 16.831260880378014
Path 225 | total_timesteps 3513.
number of affinization with epsilon = 3 is 14
average number of affinization = 16.830908864851423
Path 226 | total_timesteps 3531.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.83005967180507
Path 227 | total_timesteps 3544.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.828962088253572
Path 228 | total_timesteps 3553.
number of affinization with epsilon = 3 is 22
average number of affinization = 16.829604772557794
Path 229 | total_timesteps 3583.
number of affinization with epsilon = 3 is 16
average number of affinization = 16.829501677643844
Path 230 | total_timesteps 3603.
number of affinization with epsilon = 3 is 6
average number of affinization = 16.82815606361829
Path 231 | total_timesteps 3612.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.826935022984223
Path 232 | total_timesteps 3622.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.82608695652174
Path 233 | total_timesteps 3637.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.82511489255993
Path 234 | total_timesteps 3647.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.82414307004471
Path 235 | total_timesteps 3659.
number of affinization with epsilon = 3 is 12
average number of affinization = 16.823544020861792
Path 236 | total_timesteps 3674.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.82257263471567
Path 237 | total_timesteps 3686.
number of affinization with epsilon = 3 is 14
average number of affinization = 16.822222222222223
Path 238 | total_timesteps 3704.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.8211271102284
Path 239 | total_timesteps 3714.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.8199081543999
Path 240 | total_timesteps 3724.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.818689501116904
Path 241 | total_timesteps 3733.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.817967489763
Path 242 | total_timesteps 3745.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.816749379652606
Path 243 | total_timesteps 3754.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.815655625852873
Path 244 | total_timesteps 3767.
number of affinization with epsilon = 3 is 5
average number of affinization = 16.814190027288515
Path 245 | total_timesteps 3775.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.813096862210095
Path 246 | total_timesteps 3786.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.81237599206349
Path 247 | total_timesteps 3798.
number of affinization with epsilon = 3 is 18
average number of affinization = 16.812523248605082
Path 248 | total_timesteps 3820.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.811678651128194
Path 249 | total_timesteps 3831.
number of affinization with epsilon = 3 is 5
average number of affinization = 16.810214453948184
Path 250 | total_timesteps 3842.
number of affinization with epsilon = 3 is 24
average number of affinization = 16.811105602379772
Path 251 | total_timesteps 3871.
number of affinization with epsilon = 3 is 15
average number of affinization = 16.810881150080554
Path 252 | total_timesteps 3889.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.809665427509294
Path 253 | total_timesteps 3897.
number of affinization with epsilon = 3 is 22
average number of affinization = 16.810308511956386
Path 254 | total_timesteps 3922.
number of affinization with epsilon = 3 is 13
average number of affinization = 16.809836471754213
Path 255 | total_timesteps 3940.
number of affinization with epsilon = 3 is 4
average number of affinization = 16.8082497212932
Path 256 | total_timesteps 3949.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.807158781273223
Path 257 | total_timesteps 3959.
number of affinization with epsilon = 3 is 12
average number of affinization = 16.80656346749226
Path 258 | total_timesteps 3978.
number of affinization with epsilon = 3 is 22
average number of affinization = 16.807206537890046
Path 259 | total_timesteps 4006.
number of affinization with epsilon = 3 is 21
average number of affinization = 16.807725640708185
Path 260 | total_timesteps 4030.
number of affinization with epsilon = 3 is 17
average number of affinization = 16.807749442931417
Path 261 | total_timesteps 4051.
number of affinization with epsilon = 3 is 18
average number of affinization = 16.807897016957543
Path 262 | total_timesteps 4074.
number of affinization with epsilon = 3 is 18
average number of affinization = 16.808044554455446
Path 263 | total_timesteps 4098.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.80732582601163
Path 264 | total_timesteps 4111.
number of affinization with epsilon = 3 is 14
average number of affinization = 16.806978470675574
Path 265 | total_timesteps 4129.
number of affinization with epsilon = 3 is 12
average number of affinization = 16.80638376840282
Path 266 | total_timesteps 4145.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.80566551212271
Path 267 | total_timesteps 4160.
number of affinization with epsilon = 3 is 18
average number of affinization = 16.80581323438466
Path 268 | total_timesteps 4180.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.804847885233738
Path 269 | total_timesteps 4191.
number of affinization with epsilon = 3 is 6
average number of affinization = 16.803511809076294
Path 270 | total_timesteps 4199.
number of affinization with epsilon = 3 is 22
average number of affinization = 16.80415430267062
Path 271 | total_timesteps 4228.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.803313141303004
Path 272 | total_timesteps 4239.
number of affinization with epsilon = 3 is 4
average number of affinization = 16.801730531520395
Path 273 | total_timesteps 4247.
number of affinization with epsilon = 3 is 47
average number of affinization = 16.805462859967864
Path 274 | total_timesteps 4300.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.804374691052892
Path 275 | total_timesteps 4312.
number of affinization with epsilon = 3 is 13
average number of affinization = 16.80390460892129
Path 276 | total_timesteps 4329.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.802693353101063
Path 277 | total_timesteps 4337.
number of affinization with epsilon = 3 is 6
average number of affinization = 16.801358863495985
Path 278 | total_timesteps 4344.
number of affinization with epsilon = 3 is 14
average number of affinization = 16.8010128458498
Path 279 | total_timesteps 4362.
number of affinization with epsilon = 3 is 18
average number of affinization = 16.80116092379894
Path 280 | total_timesteps 4383.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.800321066930106
Path 281 | total_timesteps 4396.
number of affinization with epsilon = 3 is 6
average number of affinization = 16.79898752932461
Path 282 | total_timesteps 4405.
number of affinization with epsilon = 3 is 14
average number of affinization = 16.79864197530864
Path 283 | total_timesteps 4424.
number of affinization with epsilon = 3 is 17
average number of affinization = 16.7986668312554
Path 284 | total_timesteps 4446.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.797704270550483
Path 285 | total_timesteps 4456.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.796741947426877
Path 286 | total_timesteps 4469.
number of affinization with epsilon = 3 is 19
average number of affinization = 16.797013820335636
Path 287 | total_timesteps 4491.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.79592843923504
Path 288 | total_timesteps 4500.
number of affinization with epsilon = 3 is 18
average number of affinization = 16.796076980014803
Path 289 | total_timesteps 4522.
number of affinization with epsilon = 3 is 12
average number of affinization = 16.795485383002344
Path 290 | total_timesteps 4537.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.79477059694129
Path 291 | total_timesteps 4551.
number of affinization with epsilon = 3 is 17
average number of affinization = 16.794795905783698
Path 292 | total_timesteps 4572.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.79371146732429
Path 293 | total_timesteps 4582.
number of affinization with epsilon = 3 is 4
average number of affinization = 16.79213413882382
Path 294 | total_timesteps 4589.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.790927021696252
Path 295 | total_timesteps 4597.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.790089979045977
Path 296 | total_timesteps 4609.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.789253142716294
Path 297 | total_timesteps 4620.
number of affinization with epsilon = 3 is 26
average number of affinization = 16.790388170055454
Path 298 | total_timesteps 4649.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.78942828979793
Path 299 | total_timesteps 4661.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.788222249599606
Path 300 | total_timesteps 4671.
number of affinization with epsilon = 3 is 16
average number of affinization = 16.78812515397881
Path 301 | total_timesteps 4690.
number of affinization with epsilon = 3 is 4
average number of affinization = 16.786550067742333
Path 302 | total_timesteps 4698.
number of affinization with epsilon = 3 is 6
average number of affinization = 16.785221674876848
Path 303 | total_timesteps 4706.
number of affinization with epsilon = 3 is 16
average number of affinization = 16.78512498460781
Path 304 | total_timesteps 4725.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.783920216695396
Path 305 | total_timesteps 4735.
number of affinization with epsilon = 3 is 12
average number of affinization = 16.783331281546225
Path 306 | total_timesteps 4748.
number of affinization with epsilon = 3 is 42
average number of affinization = 16.78643525356967
Path 307 | total_timesteps 4796.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.785723076923077
Path 308 | total_timesteps 4808.
number of affinization with epsilon = 3 is 12
average number of affinization = 16.785134137336943
Path 309 | total_timesteps 4822.
number of affinization with epsilon = 3 is 15
average number of affinization = 16.784914482588903
Path 310 | total_timesteps 4838.
number of affinization with epsilon = 3 is 14
average number of affinization = 16.7845718503937
Path 311 | total_timesteps 4855.
number of affinization with epsilon = 3 is 20
average number of affinization = 16.78496740066429
Path 312 | total_timesteps 4880.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.783763837638375
Path 313 | total_timesteps 4890.
number of affinization with epsilon = 3 is 6
average number of affinization = 16.782437584552945
Path 314 | total_timesteps 4898.
number of affinization with epsilon = 3 is 13
average number of affinization = 16.78197245450074
Path 315 | total_timesteps 4912.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.781261527111766
Path 316 | total_timesteps 4925.
number of affinization with epsilon = 3 is 12
average number of affinization = 16.78067371526924
Path 317 | total_timesteps 4938.
number of affinization with epsilon = 3 is 16
average number of affinization = 16.78057775046097
Path 318 | total_timesteps 4958.
number of affinization with epsilon = 3 is 14
average number of affinization = 16.78023598820059
Path 319 | total_timesteps 4974.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.779279832862233
Path 320 | total_timesteps 4986.
number of affinization with epsilon = 3 is 6
average number of affinization = 16.777955271565496
Path 321 | total_timesteps 4994.
number of affinization with epsilon = 3 is 12
average number of affinization = 16.77736822705492
Path 322 | total_timesteps 5007.
number of affinization with epsilon = 3 is 5
average number of affinization = 16.775921375921374
Path 323 | total_timesteps 5017.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.774843385333497
Path 324 | total_timesteps 5027.
number of affinization with epsilon = 3 is 18
average number of affinization = 16.774993859002702
Path 325 | total_timesteps 5046.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.774039051946456
Path 326 | total_timesteps 5057.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.772838899803535
Path 327 | total_timesteps 5069.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.771639042357275
Path 328 | total_timesteps 5079.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.77056223913577
Path 329 | total_timesteps 5090.
number of affinization with epsilon = 3 is 6
average number of affinization = 16.769240211120657
Path 330 | total_timesteps 5098.
number of affinization with epsilon = 3 is 19
average number of affinization = 16.769513991163475
Path 331 | total_timesteps 5121.
number of affinization with epsilon = 3 is 6
average number of affinization = 16.76819241624739
Path 332 | total_timesteps 5130.
number of affinization with epsilon = 3 is 17
average number of affinization = 16.768220858895706
Path 333 | total_timesteps 5151.
number of affinization with epsilon = 3 is 17
average number of affinization = 16.768249294565084
Path 334 | total_timesteps 5173.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.76705103042198
Path 335 | total_timesteps 5182.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.766221022936342
Path 336 | total_timesteps 5196.
number of affinization with epsilon = 3 is 21
average number of affinization = 16.766740250183958
Path 337 | total_timesteps 5219.
number of affinization with epsilon = 3 is 12
average number of affinization = 16.766155732679337
Path 338 | total_timesteps 5232.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.765203531142717
Path 339 | total_timesteps 5244.
number of affinization with epsilon = 3 is 14
average number of affinization = 16.764864533529483
Path 340 | total_timesteps 5263.
number of affinization with epsilon = 3 is 23
average number of affinization = 16.765628830595734
Path 341 | total_timesteps 5293.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.764922171834783
Path 342 | total_timesteps 5306.
number of affinization with epsilon = 3 is 14
average number of affinization = 16.764583333333334
Path 343 | total_timesteps 5323.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.7638769758608
Path 344 | total_timesteps 5337.
number of affinization with epsilon = 3 is 12
average number of affinization = 16.763293310463123
Path 345 | total_timesteps 5352.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.762342276123974
Path 346 | total_timesteps 5363.
number of affinization with epsilon = 3 is 17
average number of affinization = 16.762371386575207
Path 347 | total_timesteps 5383.
number of affinization with epsilon = 3 is 17
average number of affinization = 16.762400489895896
Path 348 | total_timesteps 5406.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.761694832231203
Path 349 | total_timesteps 5422.
number of affinization with epsilon = 3 is 15
average number of affinization = 16.76147912330109
Path 350 | total_timesteps 5443.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.76077375122429
Path 351 | total_timesteps 5457.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.759701309829843
Path 352 | total_timesteps 5473.
number of affinization with epsilon = 3 is 13
average number of affinization = 16.759241126070993
Path 353 | total_timesteps 5487.
number of affinization with epsilon = 3 is 18
average number of affinization = 16.75939297515604
Path 354 | total_timesteps 5506.
number of affinization with epsilon = 3 is 17
average number of affinization = 16.759422418012726
Path 355 | total_timesteps 5524.
number of affinization with epsilon = 3 is 15
average number of affinization = 16.759207145479017
Path 356 | total_timesteps 5542.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.758013212625396
Path 357 | total_timesteps 5550.
number of affinization with epsilon = 3 is 16
average number of affinization = 16.757920489296637
Path 358 | total_timesteps 5571.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.757093933463796
Path 359 | total_timesteps 5584.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.75602299131711
Path 360 | total_timesteps 5594.
number of affinization with epsilon = 3 is 13
average number of affinization = 16.75556370750795
Path 361 | total_timesteps 5608.
number of affinization with epsilon = 3 is 5
average number of affinization = 16.7541264213229
Path 362 | total_timesteps 5616.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.753056234718827
Path 363 | total_timesteps 5627.
number of affinization with epsilon = 3 is 15
average number of affinization = 16.752841950861754
Path 364 | total_timesteps 5650.
number of affinization with epsilon = 3 is 18
average number of affinization = 16.752994377902713
Path 365 | total_timesteps 5673.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.752046926555053
Path 366 | total_timesteps 5684.
number of affinization with epsilon = 3 is 13
average number of affinization = 16.75158846529814
Path 367 | total_timesteps 5698.
number of affinization with epsilon = 3 is 13
average number of affinization = 16.751130116065973
Path 368 | total_timesteps 5714.
number of affinization with epsilon = 3 is 21
average number of affinization = 16.751649157097482
Path 369 | total_timesteps 5737.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.7507023329669
Path 370 | total_timesteps 5749.
number of affinization with epsilon = 3 is 16
average number of affinization = 16.750610649731314
Path 371 | total_timesteps 5767.
number of affinization with epsilon = 3 is 21
average number of affinization = 16.751129564049336
Path 372 | total_timesteps 5790.
number of affinization with epsilon = 3 is 12
average number of affinization = 16.75054945054945
Path 373 | total_timesteps 5806.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.74948113783421
Path 374 | total_timesteps 5816.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.748291015625
Path 375 | total_timesteps 5828.
number of affinization with epsilon = 3 is 15
average number of affinization = 16.74807762724277
Path 376 | total_timesteps 5845.
number of affinization with epsilon = 3 is 15
average number of affinization = 16.747864290944595
Path 377 | total_timesteps 5862.
number of affinization with epsilon = 3 is 14
average number of affinization = 16.747528981086027
Path 378 | total_timesteps 5879.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.746339677891655
Path 379 | total_timesteps 5888.
number of affinization with epsilon = 3 is 14
average number of affinization = 16.746004635842382
Path 380 | total_timesteps 5907.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.745181751646744
Path 381 | total_timesteps 5918.
number of affinization with epsilon = 3 is 35
average number of affinization = 16.747408220514696
Path 382 | total_timesteps 5956.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.746585365853658
Path 383 | total_timesteps 5968.
number of affinization with epsilon = 3 is 16
average number of affinization = 16.74649432995976
Path 384 | total_timesteps 5986.
number of affinization with epsilon = 3 is 6
average number of affinization = 16.745184101438674
Path 385 | total_timesteps 5994.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.744483725466292
Done generating on-policy rollouts.
Updating normalization.
Done updating normalization.
----------------------------
| AverageReturn | -5.75    |
| Iteration     | 27       |
| MaximumReturn | 7.92     |
| MinimumReturn | -20.5    |
| TotalSamples  | 116272   |
----------------------------
itr #28 | 
Fitting dynamics.
Fitting model 0 (0-based) in the ensemble of 2 models
Validation loss = 0.013289246708154678
Validation loss = 0.012946417555212975
Validation loss = 0.012809304520487785
Validation loss = 0.013033184222877026
Validation loss = 0.01316851656883955
Validation loss = 0.012958318926393986
Validation loss = 0.012816214002668858
Fitting model 1 (0-based) in the ensemble of 2 models
Validation loss = 0.012517692521214485
Validation loss = 0.01241335365921259
Validation loss = 0.012730554677546024
Validation loss = 0.012924205511808395
Validation loss = 0.01277934480458498
Validation loss = 0.012469097040593624
Done fitting dynamics.
Updating randomness.
Done updating randomness.
Training policy using TRPO.
Re-initialize init_std.
Obtaining samples for iteration 0...
Obtaining samples for iteration 1...
Obtaining samples for iteration 2...
Obtaining samples for iteration 3...
Obtaining samples for iteration 4...
Obtaining samples for iteration 5...
Obtaining samples for iteration 6...
Obtaining samples for iteration 7...
Obtaining samples for iteration 8...
Obtaining samples for iteration 9...
Obtaining samples for iteration 10...
Obtaining samples for iteration 11...
Obtaining samples for iteration 12...
Obtaining samples for iteration 13...
Obtaining samples for iteration 14...
Obtaining samples for iteration 15...
Obtaining samples for iteration 16...
Obtaining samples for iteration 17...
Obtaining samples for iteration 18...
Obtaining samples for iteration 19...
Done training policy.
Generating on-policy rollouts.
Path 0 | total_timesteps 0.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.7435397367138
Path 1 | total_timesteps 12.
number of affinization with epsilon = 3 is 19
average number of affinization = 16.743814747105425
Path 2 | total_timesteps 38.
number of affinization with epsilon = 3 is 12
average number of affinization = 16.74323665610529
Path 3 | total_timesteps 56.
number of affinization with epsilon = 3 is 27
average number of affinization = 16.744486414036796
Path 4 | total_timesteps 88.
number of affinization with epsilon = 3 is 21
average number of affinization = 16.74500487329435
Path 5 | total_timesteps 113.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.744061396028748
Path 6 | total_timesteps 125.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.74287454323995
Path 7 | total_timesteps 134.
number of affinization with epsilon = 3 is 19
average number of affinization = 16.74314943368652
Path 8 | total_timesteps 156.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.74220652703361
Path 9 | total_timesteps 170.
number of affinization with epsilon = 3 is 13
average number of affinization = 16.741750882746864
Path 10 | total_timesteps 185.
number of affinization with epsilon = 3 is 12
average number of affinization = 16.741173606038473
Path 11 | total_timesteps 201.
number of affinization with epsilon = 3 is 12
average number of affinization = 16.740596469872184
Path 12 | total_timesteps 217.
number of affinization with epsilon = 3 is 15
average number of affinization = 16.740384615384617
Path 13 | total_timesteps 234.
number of affinization with epsilon = 3 is 5
average number of affinization = 16.73895582329317
Path 14 | total_timesteps 243.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.73789243124848
Path 15 | total_timesteps 254.
number of affinization with epsilon = 3 is 13
average number of affinization = 16.7374376444823
Path 16 | total_timesteps 269.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.736739659367398
Path 17 | total_timesteps 284.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.7360418440579
Path 18 | total_timesteps 299.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.73522257358307
Path 19 | total_timesteps 310.
number of affinization with epsilon = 3 is 15
average number of affinization = 16.735011552961208
Path 20 | total_timesteps 328.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.733827821011673
Path 21 | total_timesteps 337.
number of affinization with epsilon = 3 is 20
average number of affinization = 16.734224924012157
Path 22 | total_timesteps 362.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.73316314125942
Path 23 | total_timesteps 371.
number of affinization with epsilon = 3 is 5
average number of affinization = 16.731736963656253
Path 24 | total_timesteps 379.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.73079727758872
Path 25 | total_timesteps 390.
number of affinization with epsilon = 3 is 19
average number of affinization = 16.73107303439057
Path 26 | total_timesteps 411.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.730012150668287
Path 27 | total_timesteps 422.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.728951524723605
Path 28 | total_timesteps 431.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.72776967930029
Path 29 | total_timesteps 439.
number of affinization with epsilon = 3 is 14
average number of affinization = 16.72743835782825
Path 30 | total_timesteps 455.
number of affinization with epsilon = 3 is 14
average number of affinization = 16.727107116832645
Path 31 | total_timesteps 474.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.72629022465088
Path 32 | total_timesteps 488.
number of affinization with epsilon = 3 is 19
average number of affinization = 16.72656629431763
Path 33 | total_timesteps 513.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.725506859293432
Path 34 | total_timesteps 525.
number of affinization with epsilon = 3 is 12
average number of affinization = 16.724933236222384
Path 35 | total_timesteps 539.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.723874256584537
Path 36 | total_timesteps 548.
number of affinization with epsilon = 3 is 19
average number of affinization = 16.724150485436894
Path 37 | total_timesteps 573.
number of affinization with epsilon = 3 is 17
average number of affinization = 16.724183958257495
Path 38 | total_timesteps 592.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.723489444309635
Path 39 | total_timesteps 605.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.722431153706175
Path 40 | total_timesteps 616.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.721737020863657
Path 41 | total_timesteps 629.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.72067919951486
Path 42 | total_timesteps 638.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.71962163473199
Path 43 | total_timesteps 648.
number of affinization with epsilon = 3 is 16
average number of affinization = 16.719534376136778
Path 44 | total_timesteps 666.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.718719689621725
Path 45 | total_timesteps 678.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.717541520184266
Path 46 | total_timesteps 688.
number of affinization with epsilon = 3 is 30
average number of affinization = 16.719151515151516
Path 47 | total_timesteps 723.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.717973578960127
Path 48 | total_timesteps 732.
number of affinization with epsilon = 3 is 15
average number of affinization = 16.717765390208434
Path 49 | total_timesteps 750.
number of affinization with epsilon = 3 is 15
average number of affinization = 16.717557251908396
Path 50 | total_timesteps 766.
number of affinization with epsilon = 3 is 17
average number of affinization = 16.717591470802034
Path 51 | total_timesteps 786.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.7167777104785
Path 52 | total_timesteps 797.
number of affinization with epsilon = 3 is 18
average number of affinization = 16.716933139534884
Path 53 | total_timesteps 820.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.71575632796415
Path 54 | total_timesteps 828.
number of affinization with epsilon = 3 is 31
average number of affinization = 16.717486074109953
Path 55 | total_timesteps 860.
number of affinization with epsilon = 3 is 25
average number of affinization = 16.7184889211769
Path 56 | total_timesteps 889.
number of affinization with epsilon = 3 is 4
average number of affinization = 16.716949152542373
Path 57 | total_timesteps 895.
number of affinization with epsilon = 3 is 13
average number of affinization = 16.71649921317032
Path 58 | total_timesteps 910.
number of affinization with epsilon = 3 is 17
average number of affinization = 16.716533526991043
Path 59 | total_timesteps 935.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.71547863971923
Path 60 | total_timesteps 945.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.71466602129719
Path 61 | total_timesteps 960.
number of affinization with epsilon = 3 is 14
average number of affinization = 16.714337568058077
Path 62 | total_timesteps 976.
number of affinization with epsilon = 3 is 35
average number of affinization = 16.716549721751754
Path 63 | total_timesteps 1014.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.715737268658522
Path 64 | total_timesteps 1026.
number of affinization with epsilon = 3 is 15
average number of affinization = 16.715529753265603
Path 65 | total_timesteps 1044.
number of affinization with epsilon = 3 is 20
average number of affinization = 16.7159269561011
Path 66 | total_timesteps 1071.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.714873035066507
Path 67 | total_timesteps 1082.
number of affinization with epsilon = 3 is 6
average number of affinization = 16.713577560149922
Path 68 | total_timesteps 1090.
number of affinization with epsilon = 3 is 6
average number of affinization = 16.71228239845261
Path 69 | total_timesteps 1099.
number of affinization with epsilon = 3 is 14
average number of affinization = 16.71195455094887
Path 70 | total_timesteps 1116.
number of affinization with epsilon = 3 is 12
average number of affinization = 16.711385061638868
Path 71 | total_timesteps 1129.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.71021148036254
Path 72 | total_timesteps 1138.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.70927984533591
Path 73 | total_timesteps 1148.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.708106801981394
Path 74 | total_timesteps 1158.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.70729644841749
Path 75 | total_timesteps 1172.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.70648629061481
Path 76 | total_timesteps 1184.
number of affinization with epsilon = 3 is 22
average number of affinization = 16.707125603864736
Path 77 | total_timesteps 1207.
number of affinization with epsilon = 3 is 18
average number of affinization = 16.70728172925975
Path 78 | total_timesteps 1229.
number of affinization with epsilon = 3 is 14
average number of affinization = 16.706954841825645
Path 79 | total_timesteps 1247.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.70614511650368
Path 80 | total_timesteps 1260.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.705335586673105
Path 81 | total_timesteps 1274.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.704526252263125
Path 82 | total_timesteps 1285.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.70335505672218
Path 83 | total_timesteps 1293.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.702425485700495
Path 84 | total_timesteps 1304.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.701254826254825
Path 85 | total_timesteps 1314.
number of affinization with epsilon = 3 is 12
average number of affinization = 16.700687658342382
Path 86 | total_timesteps 1328.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.699638118214718
Path 87 | total_timesteps 1338.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.698709443975396
Path 88 | total_timesteps 1349.
number of affinization with epsilon = 3 is 24
average number of affinization = 16.699589966232512
Path 89 | total_timesteps 1379.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.6985409381406
Path 90 | total_timesteps 1391.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.69761273209549
Path 91 | total_timesteps 1402.
number of affinization with epsilon = 3 is 16
average number of affinization = 16.697528631705847
Path 92 | total_timesteps 1423.
number of affinization with epsilon = 3 is 6
average number of affinization = 16.696239151398263
Path 93 | total_timesteps 1431.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.695552609376882
Path 94 | total_timesteps 1445.
number of affinization with epsilon = 3 is 17
average number of affinization = 16.695589298626174
Path 95 | total_timesteps 1469.
number of affinization with epsilon = 3 is 6
average number of affinization = 16.694300518134714
Path 96 | total_timesteps 1478.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.693614457831327
Path 97 | total_timesteps 1493.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.692687627996627
Path 98 | total_timesteps 1505.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.692001927246448
Path 99 | total_timesteps 1519.
number of affinization with epsilon = 3 is 20
average number of affinization = 16.692400337227507
Path 100 | total_timesteps 1544.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.691353564547207
Path 101 | total_timesteps 1555.
number of affinization with epsilon = 3 is 20
average number of affinization = 16.69175195665262
Path 102 | total_timesteps 1579.
number of affinization with epsilon = 3 is 6
average number of affinization = 16.69046472429569
Path 103 | total_timesteps 1589.
number of affinization with epsilon = 3 is 16
average number of affinization = 16.690381605874563
Path 104 | total_timesteps 1609.
number of affinization with epsilon = 3 is 6
average number of affinization = 16.68909484833895
Path 105 | total_timesteps 1616.
number of affinization with epsilon = 3 is 14
average number of affinization = 16.68877121193886
Path 106 | total_timesteps 1636.
number of affinization with epsilon = 3 is 4
average number of affinization = 16.687244283995188
Path 107 | total_timesteps 1644.
number of affinization with epsilon = 3 is 21
average number of affinization = 16.687763205390446
Path 108 | total_timesteps 1667.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.68683830606352
Path 109 | total_timesteps 1678.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.685913629255385
Path 110 | total_timesteps 1690.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.684868895838346
Path 111 | total_timesteps 1700.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.683704149128083
Path 112 | total_timesteps 1708.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.682900432900432
Path 113 | total_timesteps 1719.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.681736202957797
Path 114 | total_timesteps 1728.
number of affinization with epsilon = 3 is 22
average number of affinization = 16.682375571050734
Path 115 | total_timesteps 1755.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.681692511119124
Path 116 | total_timesteps 1767.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.68076923076923
Path 117 | total_timesteps 1779.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.68008652806153
Path 118 | total_timesteps 1792.
number of affinization with epsilon = 3 is 24
average number of affinization = 16.680966113914923
Path 119 | total_timesteps 1818.
number of affinization with epsilon = 3 is 4
average number of affinization = 16.679442508710803
Path 120 | total_timesteps 1825.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.67876021143681
Path 121 | total_timesteps 1838.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.678078078078077
Path 122 | total_timesteps 1850.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.677276002882536
Path 123 | total_timesteps 1863.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.67659421160082
Path 124 | total_timesteps 1876.
number of affinization with epsilon = 3 is 17
average number of affinization = 16.676633045148897
Path 125 | total_timesteps 1896.
number of affinization with epsilon = 3 is 6
average number of affinization = 16.67535118261496
Path 126 | total_timesteps 1905.
number of affinization with epsilon = 3 is 21
average number of affinization = 16.675870348139256
Path 127 | total_timesteps 1930.
number of affinization with epsilon = 3 is 23
average number of affinization = 16.67662945624775
Path 128 | total_timesteps 1961.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.67570811329813
Path 129 | total_timesteps 1972.
number of affinization with epsilon = 3 is 12
average number of affinization = 16.675147005880234
Path 130 | total_timesteps 1987.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.674346052315816
Path 131 | total_timesteps 1999.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.673185362927416
Path 132 | total_timesteps 2007.
number of affinization with epsilon = 3 is 25
average number of affinization = 16.67418426103647
Path 133 | total_timesteps 2039.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.673263763943865
Path 134 | total_timesteps 2049.
number of affinization with epsilon = 3 is 19
average number of affinization = 16.673542816023026
Path 135 | total_timesteps 2069.
number of affinization with epsilon = 3 is 12
average number of affinization = 16.67298237198705
Path 136 | total_timesteps 2082.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.671822541966428
Path 137 | total_timesteps 2090.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.67114254885505
Path 138 | total_timesteps 2103.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.670462718772477
Path 139 | total_timesteps 2117.
number of affinization with epsilon = 3 is 19
average number of affinization = 16.670741939350354
Path 140 | total_timesteps 2142.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.66982262703739
Path 141 | total_timesteps 2152.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.668783702816057
Path 142 | total_timesteps 2165.
number of affinization with epsilon = 3 is 13
average number of affinization = 16.668344116942247
Path 143 | total_timesteps 2180.
number of affinization with epsilon = 3 is 18
average number of affinization = 16.668503654007427
Path 144 | total_timesteps 2201.
number of affinization with epsilon = 3 is 12
average number of affinization = 16.66794441782463
Path 145 | total_timesteps 2216.
number of affinization with epsilon = 3 is 13
average number of affinization = 16.66750509042999
Path 146 | total_timesteps 2230.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.666347305389223
Path 147 | total_timesteps 2239.
number of affinization with epsilon = 3 is 20
average number of affinization = 16.666746497425457
Path 148 | total_timesteps 2267.
number of affinization with epsilon = 3 is 16
average number of affinization = 16.666666666666668
Path 149 | total_timesteps 2285.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.665748832754698
Path 150 | total_timesteps 2298.
number of affinization with epsilon = 3 is 18
average number of affinization = 16.665908546803927
Path 151 | total_timesteps 2319.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.66499102333932
Path 152 | total_timesteps 2331.
number of affinization with epsilon = 3 is 13
average number of affinization = 16.664552417424606
Path 153 | total_timesteps 2346.
number of affinization with epsilon = 3 is 16
average number of affinization = 16.664472896972597
Path 154 | total_timesteps 2366.
number of affinization with epsilon = 3 is 12
average number of affinization = 16.66391481215602
Path 155 | total_timesteps 2379.
number of affinization with epsilon = 3 is 27
average number of affinization = 16.665151333891615
Path 156 | total_timesteps 2410.
number of affinization with epsilon = 3 is 21
average number of affinization = 16.66566985645933
Path 157 | total_timesteps 2436.
number of affinization with epsilon = 3 is 5
average number of affinization = 16.664274608300442
Path 158 | total_timesteps 2444.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.6633580483138
Path 159 | total_timesteps 2459.
number of affinization with epsilon = 3 is 20
average number of affinization = 16.663757024991032
Path 160 | total_timesteps 2482.
number of affinization with epsilon = 3 is 4
average number of affinization = 16.662242945958873
Path 161 | total_timesteps 2489.
number of affinization with epsilon = 3 is 16
average number of affinization = 16.66216377764495
Path 162 | total_timesteps 2507.
number of affinization with epsilon = 3 is 14
average number of affinization = 16.661845565383697
Path 163 | total_timesteps 2525.
number of affinization with epsilon = 3 is 20
average number of affinization = 16.662244532090355
Path 164 | total_timesteps 2547.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.661567877629064
Path 165 | total_timesteps 2560.
number of affinization with epsilon = 3 is 14
average number of affinization = 16.661249850639265
Path 166 | total_timesteps 2577.
number of affinization with epsilon = 3 is 14
average number of affinization = 16.66093189964158
Path 167 | total_timesteps 2595.
number of affinization with epsilon = 3 is 18
average number of affinization = 16.661091864771233
Path 168 | total_timesteps 2617.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.660296225513616
Path 169 | total_timesteps 2628.
number of affinization with epsilon = 3 is 5
average number of affinization = 16.658903618774634
Path 170 | total_timesteps 2637.
number of affinization with epsilon = 3 is 28
average number of affinization = 16.660257941246716
Path 171 | total_timesteps 2672.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.659223880597015
Path 172 | total_timesteps 2683.
number of affinization with epsilon = 3 is 15
average number of affinization = 16.659025787965614
Path 173 | total_timesteps 2705.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.65787274680673
Path 174 | total_timesteps 2715.
number of affinization with epsilon = 3 is 15
average number of affinization = 16.657674862735735
Path 175 | total_timesteps 2732.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.65699964196205
Path 176 | total_timesteps 2745.
number of affinization with epsilon = 3 is 20
average number of affinization = 16.657398568019094
Path 177 | total_timesteps 2772.
number of affinization with epsilon = 3 is 15
average number of affinization = 16.657200811359026
Path 178 | total_timesteps 2791.
number of affinization with epsilon = 3 is 16
average number of affinization = 16.657122405153903
Path 179 | total_timesteps 2811.
number of affinization with epsilon = 3 is 6
average number of affinization = 16.6558511272814
Path 180 | total_timesteps 2819.
number of affinization with epsilon = 3 is 24
average number of affinization = 16.65672709923664
Path 181 | total_timesteps 2847.
number of affinization with epsilon = 3 is 23
average number of affinization = 16.657483601669647
Path 182 | total_timesteps 2872.
number of affinization with epsilon = 3 is 19
average number of affinization = 16.657762938230384
Path 183 | total_timesteps 2894.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.65684988672946
Path 184 | total_timesteps 2905.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.65569861707201
Path 185 | total_timesteps 2914.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.654786029324114
Path 186 | total_timesteps 2926.
number of affinization with epsilon = 3 is 5
average number of affinization = 16.653396901072707
Path 187 | total_timesteps 2935.
number of affinization with epsilon = 3 is 14
average number of affinization = 16.653080681682756
Path 188 | total_timesteps 2954.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.65204957102002
Path 189 | total_timesteps 2965.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.651256999880854
Path 190 | total_timesteps 2982.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.650107219442457
Path 191 | total_timesteps 2994.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.64919594997022
Path 192 | total_timesteps 3005.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.64828489757027
Path 193 | total_timesteps 3016.
number of affinization with epsilon = 3 is 5
average number of affinization = 16.646897701560082
Path 194 | total_timesteps 3024.
number of affinization with epsilon = 3 is 12
average number of affinization = 16.646344367706597
Path 195 | total_timesteps 3041.
number of affinization with epsilon = 3 is 14
average number of affinization = 16.646029289201095
Path 196 | total_timesteps 3058.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.645238095238096
Path 197 | total_timesteps 3070.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.644566123080587
Path 198 | total_timesteps 3084.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.643418233753867
Path 199 | total_timesteps 3093.
number of affinization with epsilon = 3 is 20
average number of affinization = 16.643817684160418
Path 200 | total_timesteps 3117.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.64278914802475
Path 201 | total_timesteps 3128.
number of affinization with epsilon = 3 is 17
average number of affinization = 16.64283164782867
Path 202 | total_timesteps 3146.
number of affinization with epsilon = 3 is 24
average number of affinization = 16.643706876040923
Path 203 | total_timesteps 3172.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.642916617104795
Path 204 | total_timesteps 3184.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.641888677450048
Path 205 | total_timesteps 3195.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.640979902485434
Path 206 | total_timesteps 3208.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.639833531510106
Path 207 | total_timesteps 3217.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.63868743312329
Path 208 | total_timesteps 3226.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.63801711840228
Path 209 | total_timesteps 3240.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.637228099370024
Path 210 | total_timesteps 3254.
number of affinization with epsilon = 3 is 5
average number of affinization = 16.63584502020442
Path 211 | total_timesteps 3263.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.6349376114082
Path 212 | total_timesteps 3273.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.633911596958175
Path 213 | total_timesteps 3283.
number of affinization with epsilon = 3 is 24
average number of affinization = 16.634786741119164
Path 214 | total_timesteps 3313.
number of affinization with epsilon = 3 is 16
average number of affinization = 16.63471133285816
Path 215 | total_timesteps 3333.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.63356693193966
Path 216 | total_timesteps 3343.
number of affinization with epsilon = 3 is 17
average number of affinization = 16.633610451306414
Path 217 | total_timesteps 3366.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.63246645291533
Path 218 | total_timesteps 3375.
number of affinization with epsilon = 3 is 20
average number of affinization = 16.632866302540965
Path 219 | total_timesteps 3398.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.631960109224742
Path 220 | total_timesteps 3408.
number of affinization with epsilon = 3 is 24
average number of affinization = 16.632834757834758
Path 221 | total_timesteps 3438.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.632047477744806
Path 222 | total_timesteps 3454.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.631023023973416
Path 223 | total_timesteps 3463.
number of affinization with epsilon = 3 is 17
average number of affinization = 16.6310668090661
Path 224 | total_timesteps 3481.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.63016136687233
Path 225 | total_timesteps 3492.
number of affinization with epsilon = 3 is 13
average number of affinization = 16.629730691659745
Path 226 | total_timesteps 3507.
number of affinization with epsilon = 3 is 13
average number of affinization = 16.629300118623963
Path 227 | total_timesteps 3523.
number of affinization with epsilon = 3 is 12
average number of affinization = 16.628751037836555
Path 228 | total_timesteps 3538.
number of affinization with epsilon = 3 is 14
average number of affinization = 16.628439278937382
Path 229 | total_timesteps 3555.
number of affinization with epsilon = 3 is 5
average number of affinization = 16.62706035811692
Path 230 | total_timesteps 3562.
number of affinization with epsilon = 3 is 14
average number of affinization = 16.62674887360683
Path 231 | total_timesteps 3581.
number of affinization with epsilon = 3 is 15
average number of affinization = 16.62655601659751
Path 232 | total_timesteps 3603.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.625533428165006
Path 233 | total_timesteps 3612.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.62474813322271
Path 234 | total_timesteps 3623.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.623844512917753
Path 235 | total_timesteps 3635.
number of affinization with epsilon = 3 is 12
average number of affinization = 16.62329659912312
Path 236 | total_timesteps 3648.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.622511848341233
Path 237 | total_timesteps 3659.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.621490344745883
Path 238 | total_timesteps 3669.
number of affinization with epsilon = 3 is 23
average number of affinization = 16.62224591329069
Path 239 | total_timesteps 3695.
number of affinization with epsilon = 3 is 20
average number of affinization = 16.622645978917447
Path 240 | total_timesteps 3717.
number of affinization with epsilon = 3 is 18
average number of affinization = 16.622809095215537
Path 241 | total_timesteps 3736.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.622143280047364
Path 242 | total_timesteps 3750.
number of affinization with epsilon = 3 is 6
average number of affinization = 16.62088562633199
Path 243 | total_timesteps 3759.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.620220196519476
Path 244 | total_timesteps 3777.
number of affinization with epsilon = 3 is 15
average number of affinization = 16.62002840909091
Path 245 | total_timesteps 3794.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.619363238253047
Path 246 | total_timesteps 3808.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.618579881656803
Path 247 | total_timesteps 3820.
number of affinization with epsilon = 3 is 13
average number of affinization = 16.6181516980239
Path 248 | total_timesteps 3835.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.617013724562234
Path 249 | total_timesteps 3845.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.615876020347805
Path 250 | total_timesteps 3855.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.61509344688905
Path 251 | total_timesteps 3867.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.61442933175636
Path 252 | total_timesteps 3879.
number of affinization with epsilon = 3 is 13
average number of affinization = 16.614001892147588
Path 253 | total_timesteps 3895.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.6131015726617
Path 254 | total_timesteps 3907.
number of affinization with epsilon = 3 is 14
average number of affinization = 16.612792622369355
Path 255 | total_timesteps 3927.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.611892658706704
Path 256 | total_timesteps 3939.
number of affinization with epsilon = 3 is 27
average number of affinization = 16.613120567375887
Path 257 | total_timesteps 3970.
number of affinization with epsilon = 3 is 12
average number of affinization = 16.612575345703817
Path 258 | total_timesteps 3985.
number of affinization with epsilon = 3 is 21
average number of affinization = 16.613093831245568
Path 259 | total_timesteps 4010.
number of affinization with epsilon = 3 is 13
average number of affinization = 16.612666902989485
Path 260 | total_timesteps 4026.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.611767485822305
Path 261 | total_timesteps 4038.
number of affinization with epsilon = 3 is 15
average number of affinization = 16.611577082102777
Path 262 | total_timesteps 4059.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.610796125679187
Path 263 | total_timesteps 4071.
number of affinization with epsilon = 3 is 15
average number of affinization = 16.610605881658202
Path 264 | total_timesteps 4091.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.60958904109589
Path 265 | total_timesteps 4101.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.60857244066596
Path 266 | total_timesteps 4113.
number of affinization with epsilon = 3 is 20
average number of affinization = 16.60897284533648
Path 267 | total_timesteps 4137.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.608310707118402
Path 268 | total_timesteps 4150.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.607530689329558
Path 269 | total_timesteps 4162.
number of affinization with epsilon = 3 is 21
average number of affinization = 16.608049097132067
Path 270 | total_timesteps 4187.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.60703327826292
Path 271 | total_timesteps 4198.
number of affinization with epsilon = 3 is 6
average number of affinization = 16.605781710914453
Path 272 | total_timesteps 4206.
number of affinization with epsilon = 3 is 6
average number of affinization = 16.60453043888627
Path 273 | total_timesteps 4214.
number of affinization with epsilon = 3 is 13
average number of affinization = 16.604105225905393
Path 274 | total_timesteps 4229.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.603090351497993
Path 275 | total_timesteps 4238.
number of affinization with epsilon = 3 is 28
average number of affinization = 16.604434485198727
Path 276 | total_timesteps 4268.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.603537735849056
Path 277 | total_timesteps 4279.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.60287701921943
Path 278 | total_timesteps 4292.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.601744871492574
Path 279 | total_timesteps 4302.
number of affinization with epsilon = 3 is 17
average number of affinization = 16.601791818931982
Path 280 | total_timesteps 4321.
number of affinization with epsilon = 3 is 34
average number of affinization = 16.603842527109855
Path 281 | total_timesteps 4360.
number of affinization with epsilon = 3 is 6
average number of affinization = 16.602592810842662
Path 282 | total_timesteps 4369.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.601814753711995
Path 283 | total_timesteps 4380.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.601036879934018
Path 284 | total_timesteps 4392.
number of affinization with epsilon = 3 is 12
average number of affinization = 16.60049481621112
Path 285 | total_timesteps 4408.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.599363882671692
Path 286 | total_timesteps 4417.
number of affinization with epsilon = 3 is 16
average number of affinization = 16.59929328621908
Path 287 | total_timesteps 4439.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.598633847603345
Path 288 | total_timesteps 4452.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.59762129062647
Path 289 | total_timesteps 4462.
number of affinization with epsilon = 3 is 12
average number of affinization = 16.59707994819263
Path 290 | total_timesteps 4476.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.59606781257358
Path 291 | total_timesteps 4489.
number of affinization with epsilon = 3 is 5
average number of affinization = 16.594702766333135
Path 292 | total_timesteps 4496.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.593926553672315
Path 293 | total_timesteps 4510.
number of affinization with epsilon = 3 is 15
average number of affinization = 16.593738966694126
Path 294 | total_timesteps 4528.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.592727700635443
Path 295 | total_timesteps 4539.
number of affinization with epsilon = 3 is 5
average number of affinization = 16.591363689845863
Path 296 | total_timesteps 4547.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.59035294117647
Path 297 | total_timesteps 4557.
number of affinization with epsilon = 3 is 13
average number of affinization = 16.589930596400425
Path 298 | total_timesteps 4571.
number of affinization with epsilon = 3 is 5
average number of affinization = 16.588567395906846
Path 299 | total_timesteps 4579.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.58743972715512
Path 300 | total_timesteps 4587.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.586312323612418
Path 301 | total_timesteps 4596.
number of affinization with epsilon = 3 is 18
average number of affinization = 16.586478542034097
Path 302 | total_timesteps 4621.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.585469080648952
Path 303 | total_timesteps 4633.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.58434230633596
Path 304 | total_timesteps 4642.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.583450869769628
Path 305 | total_timesteps 4654.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.582559642731226
Path 306 | total_timesteps 4667.
number of affinization with epsilon = 3 is 6
average number of affinization = 16.581316098707404
Path 307 | total_timesteps 4678.
number of affinization with epsilon = 3 is 15
average number of affinization = 16.581130301962165
Path 308 | total_timesteps 4697.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.580357142857142
Path 309 | total_timesteps 4709.
number of affinization with epsilon = 3 is 6
average number of affinization = 16.57911429578292
Path 310 | total_timesteps 4717.
number of affinization with epsilon = 3 is 19
average number of affinization = 16.579398637538173
Path 311 | total_timesteps 4741.
number of affinization with epsilon = 3 is 6
average number of affinization = 16.57815619495009
Path 312 | total_timesteps 4750.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.577266322217003
Path 313 | total_timesteps 4762.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.576259246213457
Path 314 | total_timesteps 4774.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.57525240666823
Path 315 | total_timesteps 4785.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.57448057283719
Path 316 | total_timesteps 4796.
number of affinization with epsilon = 3 is 12
average number of affinization = 16.573943661971832
Path 317 | total_timesteps 4811.
number of affinization with epsilon = 3 is 6
average number of affinization = 16.572702734420844
Path 318 | total_timesteps 4820.
number of affinization with epsilon = 3 is 6
average number of affinization = 16.571462098099037
Path 319 | total_timesteps 4828.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.570573741640267
Path 320 | total_timesteps 4838.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.569450961989677
Path 321 | total_timesteps 4848.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.56868035190616
Path 322 | total_timesteps 4861.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.568027210884352
Path 323 | total_timesteps 4876.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.56713967397678
Path 324 | total_timesteps 4890.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.566135084427767
Path 325 | total_timesteps 4903.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.56548247156759
Path 326 | total_timesteps 4920.
number of affinization with epsilon = 3 is 5
average number of affinization = 16.564126611957796
Path 327 | total_timesteps 4929.
number of affinization with epsilon = 3 is 5
average number of affinization = 16.562771070214513
Path 328 | total_timesteps 4937.
number of affinization with epsilon = 3 is 6
average number of affinization = 16.56153305203938
Path 329 | total_timesteps 4945.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.56041251611391
Path 330 | total_timesteps 4955.
number of affinization with epsilon = 3 is 14
average number of affinization = 16.560112491211623
Path 331 | total_timesteps 4971.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.559226713532514
Path 332 | total_timesteps 4982.
number of affinization with epsilon = 3 is 16
average number of affinization = 16.559161199625116
Path 333 | total_timesteps 5000.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.558041466557338
Path 334 | total_timesteps 5010.
number of affinization with epsilon = 3 is 5
average number of affinization = 16.556687748887327
Path 335 | total_timesteps 5018.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.555685677479797
Path 336 | total_timesteps 5029.
number of affinization with epsilon = 3 is 22
average number of affinization = 16.55632318501171
Path 337 | total_timesteps 5054.
number of affinization with epsilon = 3 is 20
average number of affinization = 16.556726378644186
Path 338 | total_timesteps 5077.
number of affinization with epsilon = 3 is 15
average number of affinization = 16.556544134863028
Path 339 | total_timesteps 5093.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.555425494556946
Path 340 | total_timesteps 5103.
number of affinization with epsilon = 3 is 6
average number of affinization = 16.554190074906366
Path 341 | total_timesteps 5110.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.5530719719134
Path 342 | total_timesteps 5123.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.552188158202668
Path 343 | total_timesteps 5135.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.551070551070552
Path 344 | total_timesteps 5144.
number of affinization with epsilon = 3 is 17
average number of affinization = 16.55112306972391
Path 345 | total_timesteps 5166.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.55012282138262
Path 346 | total_timesteps 5177.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.549473684210525
Path 347 | total_timesteps 5190.
number of affinization with epsilon = 3 is 15
average number of affinization = 16.549292480411648
Path 348 | total_timesteps 5208.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.54829279700655
Path 349 | total_timesteps 5219.
number of affinization with epsilon = 3 is 14
average number of affinization = 16.54799485560622
Path 350 | total_timesteps 5237.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.547346270750527
Path 351 | total_timesteps 5250.
number of affinization with epsilon = 3 is 6
average number of affinization = 16.546113383985972
Path 352 | total_timesteps 5259.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.545114539504443
Path 353 | total_timesteps 5269.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.543999065092905
Path 354 | total_timesteps 5280.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.543000701098386
Path 355 | total_timesteps 5290.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.541885734314757
Path 356 | total_timesteps 5299.
number of affinization with epsilon = 3 is 12
average number of affinization = 16.541355140186916
Path 357 | total_timesteps 5314.
number of affinization with epsilon = 3 is 32
average number of affinization = 16.543160845695596
Path 358 | total_timesteps 5353.
number of affinization with epsilon = 3 is 20
average number of affinization = 16.543564587713153
Path 359 | total_timesteps 5376.
number of affinization with epsilon = 3 is 21
average number of affinization = 16.544085016933316
Path 360 | total_timesteps 5399.
number of affinization with epsilon = 3 is 15
average number of affinization = 16.543904717421764
Path 361 | total_timesteps 5419.
number of affinization with epsilon = 3 is 16
average number of affinization = 16.543841214244015
Path 362 | total_timesteps 5438.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.54319402288116
Path 363 | total_timesteps 5451.
number of affinization with epsilon = 3 is 6
average number of affinization = 16.54196334772966
Path 364 | total_timesteps 5460.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.541199813258636
Path 365 | total_timesteps 5471.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.54031975726456
Path 366 | total_timesteps 5482.
number of affinization with epsilon = 3 is 20
average number of affinization = 16.540723453908985
Path 367 | total_timesteps 5506.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.53984365884961
Path 368 | total_timesteps 5519.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.538730751283246
Path 369 | total_timesteps 5529.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.53773474862942
Path 370 | total_timesteps 5538.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.53673897830651
Path 371 | total_timesteps 5549.
number of affinization with epsilon = 3 is 19
average number of affinization = 16.537026239067057
Path 372 | total_timesteps 5571.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.536263992537314
Path 373 | total_timesteps 5584.
number of affinization with epsilon = 3 is 14
average number of affinization = 16.535968287279935
Path 374 | total_timesteps 5602.
number of affinization with epsilon = 3 is 15
average number of affinization = 16.535789228258334
Path 375 | total_timesteps 5620.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.53479426506586
Path 376 | total_timesteps 5631.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.533916083916083
Path 377 | total_timesteps 5642.
number of affinization with epsilon = 3 is 50
average number of affinization = 16.537816105349027
Path 378 | total_timesteps 5703.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.536821253786997
Path 379 | total_timesteps 5715.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.535943143423047
Path 380 | total_timesteps 5727.
number of affinization with epsilon = 3 is 14
average number of affinization = 16.5356477166822
Path 381 | total_timesteps 5742.
number of affinization with epsilon = 3 is 6
average number of affinization = 16.534420500873615
Path 382 | total_timesteps 5751.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.533659445609132
Path 383 | total_timesteps 5764.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.53289856760219
Path 384 | total_timesteps 5778.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.532254308337215
Path 385 | total_timesteps 5793.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.531610199091862
Path 386 | total_timesteps 5807.
number of affinization with epsilon = 3 is 13
average number of affinization = 16.53119906868452
Path 387 | total_timesteps 5825.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.53008962868118
Path 388 | total_timesteps 5835.
number of affinization with epsilon = 3 is 12
average number of affinization = 16.529562383612664
Path 389 | total_timesteps 5850.
number of affinization with epsilon = 3 is 6
average number of affinization = 16.528337018503432
Path 390 | total_timesteps 5857.
number of affinization with epsilon = 3 is 13
average number of affinization = 16.527926460321154
Path 391 | total_timesteps 5873.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.526934264107037
Path 392 | total_timesteps 5883.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.5259422987436
Path 393 | total_timesteps 5893.
number of affinization with epsilon = 3 is 12
average number of affinization = 16.52541584273584
Path 394 | total_timesteps 5909.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.52465689695278
Path 395 | total_timesteps 5921.
number of affinization with epsilon = 3 is 12
average number of affinization = 16.52413071287359
Path 396 | total_timesteps 5936.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.523255813953487
Path 397 | total_timesteps 5946.
number of affinization with epsilon = 3 is 13
average number of affinization = 16.522846180676666
Path 398 | total_timesteps 5964.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.52173913043478
Path 399 | total_timesteps 5972.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.520748576078113
Path 400 | total_timesteps 5985.
number of affinization with epsilon = 3 is 14
average number of affinization = 16.520455602045562
Done generating on-policy rollouts.
Updating normalization.
Done updating normalization.
----------------------------
| AverageReturn | -5.58    |
| Iteration     | 28       |
| MaximumReturn | 12.5     |
| MinimumReturn | -26.2    |
| TotalSamples  | 120272   |
----------------------------
itr #29 | 
Fitting dynamics.
Fitting model 0 (0-based) in the ensemble of 2 models
Validation loss = 0.012497078627347946
Validation loss = 0.01280631497502327
Validation loss = 0.01271637249737978
Validation loss = 0.01295546256005764
Validation loss = 0.012662574648857117
Fitting model 1 (0-based) in the ensemble of 2 models
Validation loss = 0.013220732100307941
Validation loss = 0.012249999679625034
Validation loss = 0.0125205647200346
Validation loss = 0.01224951259791851
Validation loss = 0.012171877548098564
Validation loss = 0.012132293544709682
Validation loss = 0.012010309845209122
Validation loss = 0.012232008390128613
Validation loss = 0.012590539641678333
Validation loss = 0.012299178168177605
Validation loss = 0.012592566199600697
Done fitting dynamics.
Updating randomness.
Done updating randomness.
Training policy using TRPO.
Re-initialize init_std.
Obtaining samples for iteration 0...
Obtaining samples for iteration 1...
Obtaining samples for iteration 2...
Obtaining samples for iteration 3...
Obtaining samples for iteration 4...
Obtaining samples for iteration 5...
Obtaining samples for iteration 6...
Obtaining samples for iteration 7...
Obtaining samples for iteration 8...
Obtaining samples for iteration 9...
Obtaining samples for iteration 10...
Obtaining samples for iteration 11...
Obtaining samples for iteration 12...
Obtaining samples for iteration 13...
Obtaining samples for iteration 14...
Obtaining samples for iteration 15...
Obtaining samples for iteration 16...
Obtaining samples for iteration 17...
Obtaining samples for iteration 18...
Obtaining samples for iteration 19...
Done training policy.
Generating on-policy rollouts.
Path 0 | total_timesteps 0.
number of affinization with epsilon = 3 is 12
average number of affinization = 16.519930273097035
Path 1 | total_timesteps 15.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.519056472228677
Path 2 | total_timesteps 26.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.51795050540258
Path 3 | total_timesteps 36.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.516844795539033
Path 4 | total_timesteps 48.
number of affinization with epsilon = 3 is 6
average number of affinization = 16.515623185038912
Path 5 | total_timesteps 56.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.51486643437863
Path 6 | total_timesteps 68.
number of affinization with epsilon = 3 is 12
average number of affinization = 16.514342120543493
Path 7 | total_timesteps 85.
number of affinization with epsilon = 3 is 5
average number of affinization = 16.513005109150022
Path 8 | total_timesteps 93.
number of affinization with epsilon = 3 is 18
average number of affinization = 16.513177754557066
Path 9 | total_timesteps 114.
number of affinization with epsilon = 3 is 14
average number of affinization = 16.51288599953564
Path 10 | total_timesteps 134.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.511781775972143
Path 11 | total_timesteps 144.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.511142061281337
Path 12 | total_timesteps 156.
number of affinization with epsilon = 3 is 27
average number of affinization = 16.512359289776025
Path 13 | total_timesteps 186.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.51171965653284
Path 14 | total_timesteps 199.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.511080171713655
Path 15 | total_timesteps 213.
number of affinization with epsilon = 3 is 6
average number of affinization = 16.509860788863108
Path 16 | total_timesteps 221.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.50898967637165
Path 17 | total_timesteps 232.
number of affinization with epsilon = 3 is 5
average number of affinization = 16.50765483646486
Path 18 | total_timesteps 239.
number of affinization with epsilon = 3 is 28
average number of affinization = 16.508987591325525
Path 19 | total_timesteps 273.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.508116883116884
Path 20 | total_timesteps 286.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.507014492753623
Path 21 | total_timesteps 296.
number of affinization with epsilon = 3 is 12
average number of affinization = 16.50649200092743
Path 22 | total_timesteps 311.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.50550596963023
Path 23 | total_timesteps 321.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.504636068613816
Path 24 | total_timesteps 332.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.503534592652684
Path 25 | total_timesteps 344.
number of affinization with epsilon = 3 is 6
average number of affinization = 16.502317497103128
Path 26 | total_timesteps 351.
number of affinization with epsilon = 3 is 15
average number of affinization = 16.502143436450005
Path 27 | total_timesteps 369.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.50139017608897
Path 28 | total_timesteps 383.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.500521255646937
Path 29 | total_timesteps 395.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.499420894139448
Path 30 | total_timesteps 406.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.49843659525188
Path 31 | total_timesteps 417.
number of affinization with epsilon = 3 is 13
average number of affinization = 16.498031496062993
Path 32 | total_timesteps 433.
number of affinization with epsilon = 3 is 13
average number of affinization = 16.497626490679632
Path 33 | total_timesteps 451.
number of affinization with epsilon = 3 is 18
average number of affinization = 16.49780041676314
Path 34 | total_timesteps 474.
number of affinization with epsilon = 3 is 12
average number of affinization = 16.497279777752055
Path 35 | total_timesteps 488.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.496412037037036
Path 36 | total_timesteps 498.
number of affinization with epsilon = 3 is 6
average number of affinization = 16.495197315125566
Path 37 | total_timesteps 507.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.49456144411016
Path 38 | total_timesteps 521.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.493810019669095
Path 39 | total_timesteps 532.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.492827394724664
Path 40 | total_timesteps 544.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.491844997108156
Path 41 | total_timesteps 553.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.49086282674069
Path 42 | total_timesteps 563.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.49011217763386
Path 43 | total_timesteps 574.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.489246068455135
Path 44 | total_timesteps 588.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.48826453925309
Path 45 | total_timesteps 597.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.48728323699422
Path 46 | total_timesteps 607.
number of affinization with epsilon = 3 is 12
average number of affinization = 16.486764535891805
Path 47 | total_timesteps 621.
number of affinization with epsilon = 3 is 17
average number of affinization = 16.486823855755894
Path 48 | total_timesteps 643.
number of affinization with epsilon = 3 is 13
average number of affinization = 16.486420894487463
Path 49 | total_timesteps 657.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.485786919343656
Path 50 | total_timesteps 671.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.485037550548817
Path 51 | total_timesteps 682.
number of affinization with epsilon = 3 is 22
average number of affinization = 16.485674676524955
Path 52 | total_timesteps 709.
number of affinization with epsilon = 3 is 13
average number of affinization = 16.485272034191983
Path 53 | total_timesteps 724.
number of affinization with epsilon = 3 is 15
average number of affinization = 16.485100485100485
Path 54 | total_timesteps 742.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.484467028525234
Path 55 | total_timesteps 755.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.483487297921478
Path 56 | total_timesteps 766.
number of affinization with epsilon = 3 is 15
average number of affinization = 16.483316014317055
Path 57 | total_timesteps 785.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.482567536365735
Path 58 | total_timesteps 798.
number of affinization with epsilon = 3 is 14
average number of affinization = 16.482280965023662
Path 59 | total_timesteps 815.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.481417359187443
Path 60 | total_timesteps 827.
number of affinization with epsilon = 3 is 5
average number of affinization = 16.480092325447202
Path 61 | total_timesteps 835.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.479229171474728
Path 62 | total_timesteps 846.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.47848159686166
Path 63 | total_timesteps 859.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.477618827872636
Path 64 | total_timesteps 869.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.4766409043719
Path 65 | total_timesteps 881.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.475663206459053
Path 66 | total_timesteps 890.
number of affinization with epsilon = 3 is 6
average number of affinization = 16.474455080152232
Path 67 | total_timesteps 897.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.473823800738007
Path 68 | total_timesteps 910.
number of affinization with epsilon = 3 is 21
average number of affinization = 16.47434567047158
Path 69 | total_timesteps 934.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.473483975097995
Path 70 | total_timesteps 944.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.472737752161382
Path 71 | total_timesteps 959.
number of affinization with epsilon = 3 is 14
average number of affinization = 16.472452743199632
Path 72 | total_timesteps 975.
number of affinization with epsilon = 3 is 6
average number of affinization = 16.47124582228881
Path 73 | total_timesteps 985.
number of affinization with epsilon = 3 is 6
average number of affinization = 16.470039179534457
Path 74 | total_timesteps 996.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.46894803548796
Path 75 | total_timesteps 1006.
number of affinization with epsilon = 3 is 28
average number of affinization = 16.470276497695853
Path 76 | total_timesteps 1041.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.469415965902545
Path 77 | total_timesteps 1053.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.468785994010595
Path 78 | total_timesteps 1067.
number of affinization with epsilon = 3 is 17
average number of affinization = 16.468847172636185
Path 79 | total_timesteps 1087.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.468217411331185
Path 80 | total_timesteps 1102.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.467472654001153
Path 81 | total_timesteps 1115.
number of affinization with epsilon = 3 is 18
average number of affinization = 16.467649090490443
Path 82 | total_timesteps 1138.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.467019684586162
Path 83 | total_timesteps 1150.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.466045119705342
Path 84 | total_timesteps 1161.
number of affinization with epsilon = 3 is 21
average number of affinization = 16.46656692369663
Path 85 | total_timesteps 1184.
number of affinization with epsilon = 3 is 17
average number of affinization = 16.46662830840046
Path 86 | total_timesteps 1207.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.465539063398918
Path 87 | total_timesteps 1218.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.464565117349288
Path 88 | total_timesteps 1227.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.46347636028989
Path 89 | total_timesteps 1235.
number of affinization with epsilon = 3 is 13
average number of affinization = 16.463077984817115
Path 90 | total_timesteps 1249.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.46244968372628
Path 91 | total_timesteps 1265.
number of affinization with epsilon = 3 is 13
average number of affinization = 16.462051517939283
Path 92 | total_timesteps 1280.
number of affinization with epsilon = 3 is 17
average number of affinization = 16.462113372427275
Path 93 | total_timesteps 1301.
number of affinization with epsilon = 3 is 60
average number of affinization = 16.467118877902966
Path 94 | total_timesteps 1365.
number of affinization with epsilon = 3 is 14
average number of affinization = 16.466835268421658
Path 95 | total_timesteps 1383.
number of affinization with epsilon = 3 is 29
average number of affinization = 16.468275862068964
Path 96 | total_timesteps 1417.
number of affinization with epsilon = 3 is 16
average number of affinization = 16.468222043443284
Path 97 | total_timesteps 1437.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.467248908296945
Path 98 | total_timesteps 1451.
number of affinization with epsilon = 3 is 25
average number of affinization = 16.46822934620246
Path 99 | total_timesteps 1479.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.46714154411765
Path 100 | total_timesteps 1489.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.466283744974152
Path 101 | total_timesteps 1499.
number of affinization with epsilon = 3 is 13
average number of affinization = 16.46588559614059
Path 102 | total_timesteps 1515.
number of affinization with epsilon = 3 is 12
average number of affinization = 16.465372688641324
Path 103 | total_timesteps 1531.
number of affinization with epsilon = 3 is 12
average number of affinization = 16.4648598989435
Path 104 | total_timesteps 1545.
number of affinization with epsilon = 3 is 12
average number of affinization = 16.464347227006545
Path 105 | total_timesteps 1563.
number of affinization with epsilon = 3 is 23
average number of affinization = 16.465097588978185
Path 106 | total_timesteps 1591.
number of affinization with epsilon = 3 is 13
average number of affinization = 16.46469980484445
Path 107 | total_timesteps 1607.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.463957759412306
Path 108 | total_timesteps 1619.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.4632158843108
Path 109 | total_timesteps 1634.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.462129905898554
Path 110 | total_timesteps 1642.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.461044176706828
Path 111 | total_timesteps 1651.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.460302891234512
Path 112 | total_timesteps 1664.
number of affinization with epsilon = 3 is 20
average number of affinization = 16.460708959504416
Path 113 | total_timesteps 1690.
number of affinization with epsilon = 3 is 17
average number of affinization = 16.460770818995183
Path 114 | total_timesteps 1709.
number of affinization with epsilon = 3 is 18
average number of affinization = 16.460947356348203
Path 115 | total_timesteps 1731.
number of affinization with epsilon = 3 is 13
average number of affinization = 16.460550458715595
Path 116 | total_timesteps 1748.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.459580323357414
Path 117 | total_timesteps 1758.
number of affinization with epsilon = 3 is 13
average number of affinization = 16.459183673469386
Path 118 | total_timesteps 1776.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.45821391723031
Path 119 | total_timesteps 1786.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.45735900962861
Path 120 | total_timesteps 1801.
number of affinization with epsilon = 3 is 23
average number of affinization = 16.45810888252149
Path 121 | total_timesteps 1832.
number of affinization with epsilon = 3 is 4
average number of affinization = 16.456681182672472
Path 122 | total_timesteps 1839.
number of affinization with epsilon = 3 is 5
average number of affinization = 16.45536839692907
Path 123 | total_timesteps 1847.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.45474335472044
Path 124 | total_timesteps 1859.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.453774773742698
Path 125 | total_timesteps 1868.
number of affinization with epsilon = 3 is 17
average number of affinization = 16.453837342497135
Path 126 | total_timesteps 1890.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.452869087160693
Path 127 | total_timesteps 1899.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.451901053595968
Path 128 | total_timesteps 1910.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.45081873353945
Path 129 | total_timesteps 1922.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.449736661323563
Path 130 | total_timesteps 1931.
number of affinization with epsilon = 3 is 6
average number of affinization = 16.448540354894103
Path 131 | total_timesteps 1939.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.447802197802197
Path 132 | total_timesteps 1957.
number of affinization with epsilon = 3 is 6
average number of affinization = 16.44660638663157
Path 133 | total_timesteps 1965.
number of affinization with epsilon = 3 is 6
average number of affinization = 16.445410849164567
Path 134 | total_timesteps 1973.
number of affinization with epsilon = 3 is 18
average number of affinization = 16.44558874013045
Path 135 | total_timesteps 1993.
number of affinization with epsilon = 3 is 20
average number of affinization = 16.44599542334096
Path 136 | total_timesteps 2015.
number of affinization with epsilon = 3 is 25
average number of affinization = 16.4469740304313
Path 137 | total_timesteps 2043.
number of affinization with epsilon = 3 is 20
average number of affinization = 16.44738046213681
Path 138 | total_timesteps 2068.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.44675740592474
Path 139 | total_timesteps 2080.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.445905763952425
Path 140 | total_timesteps 2092.
number of affinization with epsilon = 3 is 15
average number of affinization = 16.445740423098915
Path 141 | total_timesteps 2111.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.44466041619026
Path 142 | total_timesteps 2119.
number of affinization with epsilon = 3 is 15
average number of affinization = 16.444495255516177
Path 143 | total_timesteps 2137.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.443644261545497
Path 144 | total_timesteps 2151.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.44302205966396
Path 145 | total_timesteps 2163.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.441942857142855
Path 146 | total_timesteps 2173.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.441092446577535
Path 147 | total_timesteps 2184.
number of affinization with epsilon = 3 is 26
average number of affinization = 16.442184643510053
Path 148 | total_timesteps 2213.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.44133439963441
Path 149 | total_timesteps 2226.
number of affinization with epsilon = 3 is 13
average number of affinization = 16.440941283984465
Path 150 | total_timesteps 2244.
number of affinization with epsilon = 3 is 20
average number of affinization = 16.441347801256423
Path 151 | total_timesteps 2269.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.440497944266788
Path 152 | total_timesteps 2280.
number of affinization with epsilon = 3 is 5
average number of affinization = 16.439191503939707
Path 153 | total_timesteps 2287.
number of affinization with epsilon = 3 is 27
average number of affinization = 16.44039735099338
Path 154 | total_timesteps 2319.
number of affinization with epsilon = 3 is 5
average number of affinization = 16.439091220458955
Path 155 | total_timesteps 2327.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.43824200913242
Path 156 | total_timesteps 2337.
number of affinization with epsilon = 3 is 6
average number of affinization = 16.437050565003997
Path 157 | total_timesteps 2346.
number of affinization with epsilon = 3 is 24
average number of affinization = 16.43791371832915
Path 158 | total_timesteps 2373.
number of affinization with epsilon = 3 is 14
average number of affinization = 16.437635512952184
Path 159 | total_timesteps 2389.
number of affinization with epsilon = 3 is 13
average number of affinization = 16.437243267914194
Path 160 | total_timesteps 2404.
number of affinization with epsilon = 3 is 6
average number of affinization = 16.436052481460354
Path 161 | total_timesteps 2412.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.435318275154003
Path 162 | total_timesteps 2424.
number of affinization with epsilon = 3 is 13
average number of affinization = 16.434926428652904
Path 163 | total_timesteps 2441.
number of affinization with epsilon = 3 is 12
average number of affinization = 16.434420620437955
Path 164 | total_timesteps 2455.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.433344737142207
Path 165 | total_timesteps 2465.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.43261117445838
Path 166 | total_timesteps 2477.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.431763766959296
Path 167 | total_timesteps 2488.
number of affinization with epsilon = 3 is 15
average number of affinization = 16.43160054719562
Path 168 | total_timesteps 2507.
number of affinization with epsilon = 3 is 13
average number of affinization = 16.43120939245412
Path 169 | total_timesteps 2522.
number of affinization with epsilon = 3 is 14
average number of affinization = 16.430932299977204
Path 170 | total_timesteps 2538.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.43031339031339
Path 171 | total_timesteps 2550.
number of affinization with epsilon = 3 is 6
average number of affinization = 16.429124886052872
Path 172 | total_timesteps 2558.
number of affinization with epsilon = 3 is 15
average number of affinization = 16.42896205992936
Path 173 | total_timesteps 2582.
number of affinization with epsilon = 3 is 5
average number of affinization = 16.427660059239006
Path 174 | total_timesteps 2590.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.426700079735735
Path 175 | total_timesteps 2602.
number of affinization with epsilon = 3 is 18
average number of affinization = 16.426879271070614
Path 176 | total_timesteps 2623.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.42614736362601
Path 177 | total_timesteps 2635.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.42552949214302
Path 178 | total_timesteps 2647.
number of affinization with epsilon = 3 is 12
average number of affinization = 16.4250256176705
Path 179 | total_timesteps 2663.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.4242941712204
Path 180 | total_timesteps 2676.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.423562891291976
Path 181 | total_timesteps 2688.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.422945595265194
Path 182 | total_timesteps 2703.
number of affinization with epsilon = 3 is 4
average number of affinization = 16.42153180835325
Path 183 | total_timesteps 2710.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.420914883932635
Path 184 | total_timesteps 2724.
number of affinization with epsilon = 3 is 23
average number of affinization = 16.421663442940037
Path 185 | total_timesteps 2749.
number of affinization with epsilon = 3 is 5
average number of affinization = 16.420364050056882
Path 186 | total_timesteps 2757.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.41940621089751
Path 187 | total_timesteps 2767.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.418789808917197
Path 188 | total_timesteps 2781.
number of affinization with epsilon = 3 is 6
average number of affinization = 16.417604912998975
Path 189 | total_timesteps 2790.
number of affinization with epsilon = 3 is 14
average number of affinization = 16.417329997725723
Path 190 | total_timesteps 2807.
number of affinization with epsilon = 3 is 19
average number of affinization = 16.417623649801023
Path 191 | total_timesteps 2830.
number of affinization with epsilon = 3 is 4
average number of affinization = 16.416211914506594
Path 192 | total_timesteps 2836.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.41525520063658
Path 193 | total_timesteps 2848.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.414526028642875
Path 194 | total_timesteps 2859.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.41379702238891
Path 195 | total_timesteps 2871.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.412954545454546
Path 196 | total_timesteps 2881.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.41233950687422
Path 197 | total_timesteps 2894.
number of affinization with epsilon = 3 is 34
average number of affinization = 16.41433765053397
Path 198 | total_timesteps 2933.
number of affinization with epsilon = 3 is 13
average number of affinization = 16.41394978984437
Path 199 | total_timesteps 2948.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.412880508859608
Path 200 | total_timesteps 2957.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.412265758091994
Path 201 | total_timesteps 2973.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.411537588008176
Path 202 | total_timesteps 2990.
number of affinization with epsilon = 3 is 15
average number of affinization = 16.411377313500626
Path 203 | total_timesteps 3007.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.410649409627613
Path 204 | total_timesteps 3020.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.410035191281644
Path 205 | total_timesteps 3034.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.409080590238364
Path 206 | total_timesteps 3045.
number of affinization with epsilon = 3 is 6
average number of affinization = 16.40789921688798
Path 207 | total_timesteps 3054.
number of affinization with epsilon = 3 is 12
average number of affinization = 16.407399001361778
Path 208 | total_timesteps 3070.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.406785430613866
Path 209 | total_timesteps 3082.
number of affinization with epsilon = 3 is 13
average number of affinization = 16.40639891082369
Path 210 | total_timesteps 3098.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.405558706749858
Path 211 | total_timesteps 3110.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.404491833030853
Path 212 | total_timesteps 3119.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.40376545310196
Path 213 | total_timesteps 3131.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.40303923792243
Path 214 | total_timesteps 3142.
number of affinization with epsilon = 3 is 26
average number of affinization = 16.404127452092073
Path 215 | total_timesteps 3171.
number of affinization with epsilon = 3 is 14
average number of affinization = 16.403854875283447
Path 216 | total_timesteps 3190.
number of affinization with epsilon = 3 is 12
average number of affinization = 16.403355628613536
Path 217 | total_timesteps 3205.
number of affinization with epsilon = 3 is 22
average number of affinization = 16.403990024937656
Path 218 | total_timesteps 3232.
number of affinization with epsilon = 3 is 14
average number of affinization = 16.403717556386717
Path 219 | total_timesteps 3249.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.402765185856754
Path 220 | total_timesteps 3260.
number of affinization with epsilon = 3 is 6
average number of affinization = 16.40158640226629
Path 221 | total_timesteps 3268.
number of affinization with epsilon = 3 is 15
average number of affinization = 16.401427600271923
Path 222 | total_timesteps 3286.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.400475812846945
Path 223 | total_timesteps 3298.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.39941096511101
Path 224 | total_timesteps 3307.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.39857288481142
Path 225 | total_timesteps 3317.
number of affinization with epsilon = 3 is 17
average number of affinization = 16.39864099660249
Path 226 | total_timesteps 3337.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.39768995583739
Path 227 | total_timesteps 3346.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.397078804347824
Path 228 | total_timesteps 3358.
number of affinization with epsilon = 3 is 6
average number of affinization = 16.395901732140835
Path 229 | total_timesteps 3367.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.395064523432193
Path 230 | total_timesteps 3377.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.394001131861913
Path 231 | total_timesteps 3385.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.392937980986872
Path 232 | total_timesteps 3394.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.392214552449925
Path 233 | total_timesteps 3406.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.391491287621633
Path 234 | total_timesteps 3419.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.39065505147641
Path 235 | total_timesteps 3432.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.390045248868777
Path 236 | total_timesteps 3447.
number of affinization with epsilon = 3 is 13
average number of affinization = 16.389661802963467
Path 237 | total_timesteps 3464.
number of affinization with epsilon = 3 is 16
average number of affinization = 16.389617733544448
Path 238 | total_timesteps 3484.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.388782087526856
Path 239 | total_timesteps 3497.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.388172772501132
Path 240 | total_timesteps 3511.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.38711136235161
Path 241 | total_timesteps 3519.
number of affinization with epsilon = 3 is 18
average number of affinization = 16.38729369206421
Path 242 | total_timesteps 3542.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.386458686560417
Path 243 | total_timesteps 3554.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.385510849909583
Path 244 | total_timesteps 3566.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.384789241722228
Path 245 | total_timesteps 3581.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.383728813559323
Path 246 | total_timesteps 3591.
number of affinization with epsilon = 3 is 6
average number of affinization = 16.38255564343012
Path 247 | total_timesteps 3600.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.381947582467237
Path 248 | total_timesteps 3613.
number of affinization with epsilon = 3 is 6
average number of affinization = 16.380774878572236
Path 249 | total_timesteps 3622.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.379715382877794
Path 250 | total_timesteps 3633.
number of affinization with epsilon = 3 is 12
average number of affinization = 16.37922077922078
Path 251 | total_timesteps 3646.
number of affinization with epsilon = 3 is 13
average number of affinization = 16.378839205058718
Path 252 | total_timesteps 3661.
number of affinization with epsilon = 3 is 14
average number of affinization = 16.378570622106807
Path 253 | total_timesteps 3677.
number of affinization with epsilon = 3 is 12
average number of affinization = 16.378076315195305
Path 254 | total_timesteps 3693.
number of affinization with epsilon = 3 is 25
average number of affinization = 16.379049554125746
Path 255 | total_timesteps 3719.
number of affinization with epsilon = 3 is 12
average number of affinization = 16.378555304740406
Path 256 | total_timesteps 3733.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.37749689651281
Path 257 | total_timesteps 3742.
number of affinization with epsilon = 3 is 4
average number of affinization = 16.376100203114422
Path 258 | total_timesteps 3751.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.375493625183346
Path 259 | total_timesteps 3765.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.374435920577618
Path 260 | total_timesteps 3774.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.373716864072193
Path 261 | total_timesteps 3787.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.372997969772165
Path 262 | total_timesteps 3798.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.372053682192398
Path 263 | total_timesteps 3811.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.37144790257104
Path 264 | total_timesteps 3823.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.37072950727252
Path 265 | total_timesteps 3835.
number of affinization with epsilon = 3 is 5
average number of affinization = 16.369447576099212
Path 266 | total_timesteps 3842.
number of affinization with epsilon = 3 is 18
average number of affinization = 16.369631383158605
Path 267 | total_timesteps 3862.
number of affinization with epsilon = 3 is 12
average number of affinization = 16.3691388638413
Path 268 | total_timesteps 3876.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.368082948270033
Path 269 | total_timesteps 3885.
number of affinization with epsilon = 3 is 6
average number of affinization = 16.366914581924725
Path 270 | total_timesteps 3895.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.366309859154928
Path 271 | total_timesteps 3908.
number of affinization with epsilon = 3 is 14
average number of affinization = 16.366043262730958
Path 272 | total_timesteps 3930.
number of affinization with epsilon = 3 is 12
average number of affinization = 16.36555142503098
Path 273 | total_timesteps 3946.
number of affinization with epsilon = 3 is 15
average number of affinization = 16.36539761207479
Path 274 | total_timesteps 3969.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.364455456695573
Path 275 | total_timesteps 3981.
number of affinization with epsilon = 3 is 16
average number of affinization = 16.364414414414416
Path 276 | total_timesteps 3999.
number of affinization with epsilon = 3 is 18
average number of affinization = 16.364598581240852
Path 277 | total_timesteps 4018.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.363994595811754
Path 278 | total_timesteps 4033.
number of affinization with epsilon = 3 is 20
average number of affinization = 16.364403917595407
Path 279 | total_timesteps 4055.
number of affinization with epsilon = 3 is 16
average number of affinization = 16.364362899594777
Path 280 | total_timesteps 4072.
number of affinization with epsilon = 3 is 21
average number of affinization = 16.3648846370287
Path 281 | total_timesteps 4099.
number of affinization with epsilon = 3 is 19
average number of affinization = 16.36518118388476
Path 282 | total_timesteps 4119.
number of affinization with epsilon = 3 is 13
average number of affinization = 16.364802520535616
Path 283 | total_timesteps 4137.
number of affinization with epsilon = 3 is 13
average number of affinization = 16.36442394239424
Path 284 | total_timesteps 4153.
number of affinization with epsilon = 3 is 5
average number of affinization = 16.363145460681743
Path 285 | total_timesteps 4162.
number of affinization with epsilon = 3 is 16
average number of affinization = 16.36310461192351
Path 286 | total_timesteps 4183.
number of affinization with epsilon = 3 is 12
average number of affinization = 16.36261387920369
Path 287 | total_timesteps 4197.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.361673414304992
Path 288 | total_timesteps 4208.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.360620712920273
Path 289 | total_timesteps 4217.
number of affinization with epsilon = 3 is 4
average number of affinization = 16.35923094220823
Path 290 | total_timesteps 4223.
number of affinization with epsilon = 3 is 6
average number of affinization = 16.35806632939854
Path 291 | total_timesteps 4231.
number of affinization with epsilon = 3 is 19
average number of affinization = 16.35836330935252
Path 292 | total_timesteps 4255.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.357311453298866
Path 293 | total_timesteps 4265.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.35637221847606
Path 294 | total_timesteps 4275.
number of affinization with epsilon = 3 is 20
average number of affinization = 16.356781660860772
Path 295 | total_timesteps 4301.
number of affinization with epsilon = 3 is 13
average number of affinization = 16.356404494382023
Path 296 | total_timesteps 4320.
number of affinization with epsilon = 3 is 13
average number of affinization = 16.356027412650263
Path 297 | total_timesteps 4335.
number of affinization with epsilon = 3 is 18
average number of affinization = 16.35621208717142
Path 298 | total_timesteps 4356.
number of affinization with epsilon = 3 is 12
average number of affinization = 16.35572279007076
Path 299 | total_timesteps 4374.
number of affinization with epsilon = 3 is 21
average number of affinization = 16.356244384546272
Path 300 | total_timesteps 4403.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.355530600786075
Path 301 | total_timesteps 4416.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.354816977318663
Path 302 | total_timesteps 4429.
number of affinization with epsilon = 3 is 6
average number of affinization = 16.353654429100708
Path 303 | total_timesteps 4437.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.352828917826674
Path 304 | total_timesteps 4450.
number of affinization with epsilon = 3 is 13
average number of affinization = 16.352452576046694
Path 305 | total_timesteps 4467.
number of affinization with epsilon = 3 is 12
average number of affinization = 16.351964085297418
Path 306 | total_timesteps 4481.
number of affinization with epsilon = 3 is 12
average number of affinization = 16.351475704185837
Path 307 | total_timesteps 4496.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.350426391382406
Path 308 | total_timesteps 4505.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.34971390104342
Path 309 | total_timesteps 4516.
number of affinization with epsilon = 3 is 30
average number of affinization = 16.351245232218982
Path 310 | total_timesteps 4552.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.350308468872687
Path 311 | total_timesteps 4563.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.349484073575596
Path 312 | total_timesteps 4574.
number of affinization with epsilon = 3 is 13
average number of affinization = 16.34910844454413
Path 313 | total_timesteps 4591.
number of affinization with epsilon = 3 is 6
average number of affinization = 16.34794797039695
Path 314 | total_timesteps 4601.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.346899876667788
Path 315 | total_timesteps 4610.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.346076233183858
Path 316 | total_timesteps 4623.
number of affinization with epsilon = 3 is 17
average number of affinization = 16.346149534805516
Path 317 | total_timesteps 4643.
number of affinization with epsilon = 3 is 12
average number of affinization = 16.345662407531943
Path 318 | total_timesteps 4656.
number of affinization with epsilon = 3 is 5
average number of affinization = 16.34439089992155
Path 319 | total_timesteps 4663.
number of affinization with epsilon = 3 is 15
average number of affinization = 16.344240251008518
Path 320 | total_timesteps 4681.
number of affinization with epsilon = 3 is 6
average number of affinization = 16.343081232493
Path 321 | total_timesteps 4689.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.342146538203004
Path 322 | total_timesteps 4698.
number of affinization with epsilon = 3 is 6
average number of affinization = 16.340988013890446
Path 323 | total_timesteps 4708.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.340389784946236
Path 324 | total_timesteps 4723.
number of affinization with epsilon = 3 is 22
average number of affinization = 16.341023630865717
Path 325 | total_timesteps 4754.
number of affinization with epsilon = 3 is 12
average number of affinization = 16.34053751399776
Path 326 | total_timesteps 4767.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.339939536446085
Path 327 | total_timesteps 4782.
number of affinization with epsilon = 3 is 6
average number of affinization = 16.338781907747425
Path 328 | total_timesteps 4790.
number of affinization with epsilon = 3 is 12
average number of affinization = 16.33829620508228
Path 329 | total_timesteps 4804.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.337250951421534
Path 330 | total_timesteps 4814.
number of affinization with epsilon = 3 is 6
average number of affinization = 16.336094012311136
Path 331 | total_timesteps 4824.
number of affinization with epsilon = 3 is 19
average number of affinization = 16.3363921217547
Path 332 | total_timesteps 4846.
number of affinization with epsilon = 3 is 22
average number of affinization = 16.337025847599865
Path 333 | total_timesteps 4873.
number of affinization with epsilon = 3 is 16
average number of affinization = 16.33698814052361
Path 334 | total_timesteps 4893.
number of affinization with epsilon = 3 is 16
average number of affinization = 16.33695044188388
Path 335 | total_timesteps 4911.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.335906040268455
Path 336 | total_timesteps 4924.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.335309249524663
Path 337 | total_timesteps 4937.
number of affinization with epsilon = 3 is 6
average number of affinization = 16.334153433236413
Path 338 | total_timesteps 4944.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.333556971933355
Path 339 | total_timesteps 4958.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.332960644007155
Path 340 | total_timesteps 4973.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.331917272219115
Path 341 | total_timesteps 4984.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.330874133691037
Path 342 | total_timesteps 4993.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.330278305577288
Path 343 | total_timesteps 5007.
number of affinization with epsilon = 3 is 5
average number of affinization = 16.329012069736255
Path 344 | total_timesteps 5016.
number of affinization with epsilon = 3 is 6
average number of affinization = 16.327857861213545
Path 345 | total_timesteps 5024.
number of affinization with epsilon = 3 is 17
average number of affinization = 16.327932960893854
Path 346 | total_timesteps 5042.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.326890850184338
Path 347 | total_timesteps 5051.
number of affinization with epsilon = 3 is 18
average number of affinization = 16.327077747989275
Path 348 | total_timesteps 5074.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.326371048810454
Path 349 | total_timesteps 5086.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.325329461693098
Path 350 | total_timesteps 5095.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.32439977666108
Path 351 | total_timesteps 5106.
number of affinization with epsilon = 3 is 13
average number of affinization = 16.32402858418937
Path 352 | total_timesteps 5123.
number of affinization with epsilon = 3 is 18
average number of affinization = 16.32421569722005
Path 353 | total_timesteps 5146.
number of affinization with epsilon = 3 is 25
average number of affinization = 16.325184192900203
Path 354 | total_timesteps 5178.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.32447817836812
Path 355 | total_timesteps 5190.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.3234375
Path 356 | total_timesteps 5199.
number of affinization with epsilon = 3 is 6
average number of affinization = 16.322285459212143
Path 357 | total_timesteps 5210.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.321245257754967
Path 358 | total_timesteps 5221.
number of affinization with epsilon = 3 is 15
average number of affinization = 16.32109784670311
Path 359 | total_timesteps 5240.
number of affinization with epsilon = 3 is 15
average number of affinization = 16.32095046854083
Path 360 | total_timesteps 5258.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.320245398773007
Path 361 | total_timesteps 5270.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.319540486281507
Path 362 | total_timesteps 5282.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.318612690978032
Path 363 | total_timesteps 5292.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.31801962533452
Path 364 | total_timesteps 5306.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.316980711339056
Path 365 | total_timesteps 5317.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.315942028985507
Path 366 | total_timesteps 5325.
number of affinization with epsilon = 3 is 4
average number of affinization = 16.31456916731691
Path 367 | total_timesteps 5333.
number of affinization with epsilon = 3 is 16
average number of affinization = 16.314534106107892
Path 368 | total_timesteps 5356.
number of affinization with epsilon = 3 is 12
average number of affinization = 16.314053270923882
Path 369 | total_timesteps 5370.
number of affinization with epsilon = 3 is 6
average number of affinization = 16.312903944729218
Path 370 | total_timesteps 5377.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.311977715877436
Path 371 | total_timesteps 5387.
number of affinization with epsilon = 3 is 16
average number of affinization = 16.311942959001783
Path 372 | total_timesteps 5405.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.31123983513423
Path 373 | total_timesteps 5416.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.31042548451771
Path 374 | total_timesteps 5427.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.309388573337788
Path 375 | total_timesteps 5437.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.308351893095768
Path 376 | total_timesteps 5445.
number of affinization with epsilon = 3 is 14
average number of affinization = 16.30809486694132
Path 377 | total_timesteps 5463.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.307281229124918
Path 378 | total_timesteps 5477.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.30624512968941
Path 379 | total_timesteps 5487.
number of affinization with epsilon = 3 is 25
average number of affinization = 16.30721282279608
Path 380 | total_timesteps 5514.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.306288258208124
Path 381 | total_timesteps 5526.
number of affinization with epsilon = 3 is 13
average number of affinization = 16.305920320498554
Path 382 | total_timesteps 5543.
number of affinization with epsilon = 3 is 15
average number of affinization = 16.30577500834539
Path 383 | total_timesteps 5560.
number of affinization with epsilon = 3 is 23
average number of affinization = 16.306519804183356
Path 384 | total_timesteps 5589.
number of affinization with epsilon = 3 is 15
average number of affinization = 16.306374457670486
Path 385 | total_timesteps 5608.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.305339265850947
Path 386 | total_timesteps 5617.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.304304304304303
Path 387 | total_timesteps 5626.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.30338078291815
Path 388 | total_timesteps 5640.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.302346269320584
Path 389 | total_timesteps 5649.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.301534356237493
Path 390 | total_timesteps 5663.
number of affinization with epsilon = 3 is 14
average number of affinization = 16.301278488048915
Path 391 | total_timesteps 5681.
number of affinization with epsilon = 3 is 13
average number of affinization = 16.300911516229434
Path 392 | total_timesteps 5698.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.30010003334445
Path 393 | total_timesteps 5708.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.299177595021117
Path 394 | total_timesteps 5718.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.29836648516502
Path 395 | total_timesteps 5729.
number of affinization with epsilon = 3 is 21
average number of affinization = 16.29888888888889
Path 396 | total_timesteps 5753.
number of affinization with epsilon = 3 is 13
average number of affinization = 16.298522386401512
Path 397 | total_timesteps 5768.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.29771161964008
Path 398 | total_timesteps 5780.
number of affinization with epsilon = 3 is 6
average number of affinization = 16.29656781072976
Path 399 | total_timesteps 5788.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.295757441137273
Path 400 | total_timesteps 5800.
number of affinization with epsilon = 3 is 33
average number of affinization = 16.297612437534703
Path 401 | total_timesteps 5838.
number of affinization with epsilon = 3 is 6
average number of affinization = 16.296469020652896
Path 402 | total_timesteps 5849.
number of affinization with epsilon = 3 is 6
average number of affinization = 16.29532585766626
Path 403 | total_timesteps 5858.
number of affinization with epsilon = 3 is 12
average number of affinization = 16.294849023090585
Path 404 | total_timesteps 5872.
number of affinization with epsilon = 3 is 25
average number of affinization = 16.295815295815295
Path 405 | total_timesteps 5903.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.29511653718091
Path 406 | total_timesteps 5918.
number of affinization with epsilon = 3 is 15
average number of affinization = 16.294972811008765
Path 407 | total_timesteps 5935.
number of affinization with epsilon = 3 is 25
average number of affinization = 16.29593874833555
Path 408 | total_timesteps 5968.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.29535115943637
Path 409 | total_timesteps 5983.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.2943199467495
Path 410 | total_timesteps 5992.
number of affinization with epsilon = 3 is 13
average number of affinization = 16.29395452024404
Done generating on-policy rollouts.
Updating normalization.
Done updating normalization.
----------------------------
| AverageReturn | -5.46    |
| Iteration     | 29       |
| MaximumReturn | 34.8     |
| MinimumReturn | -19.3    |
| TotalSamples  | 124276   |
----------------------------
itr #30 | 
Fitting dynamics.
Fitting model 0 (0-based) in the ensemble of 2 models
Validation loss = 0.012798212468624115
Validation loss = 0.01247323676943779
Validation loss = 0.012998982332646847
Validation loss = 0.01228893268853426
Validation loss = 0.012642721645534039
Validation loss = 0.012586073949933052
Validation loss = 0.012753346003592014
Validation loss = 0.012360835447907448
Fitting model 1 (0-based) in the ensemble of 2 models
Validation loss = 0.012101221829652786
Validation loss = 0.012329853139817715
Validation loss = 0.011944391764700413
Validation loss = 0.01233666855841875
Validation loss = 0.01188272051513195
Validation loss = 0.011920309625566006
Validation loss = 0.012115725316107273
Validation loss = 0.011758802458643913
Validation loss = 0.01205162052065134
Validation loss = 0.011976760812103748
Validation loss = 0.011933389119803905
Validation loss = 0.011844087392091751
Done fitting dynamics.
Updating randomness.
Done updating randomness.
Training policy using TRPO.
Re-initialize init_std.
Obtaining samples for iteration 0...
Obtaining samples for iteration 1...
Obtaining samples for iteration 2...
Obtaining samples for iteration 3...
Obtaining samples for iteration 4...
Obtaining samples for iteration 5...
Obtaining samples for iteration 6...
Obtaining samples for iteration 7...
Obtaining samples for iteration 8...
Obtaining samples for iteration 9...
Obtaining samples for iteration 10...
Obtaining samples for iteration 11...
Obtaining samples for iteration 12...
Obtaining samples for iteration 13...
Obtaining samples for iteration 14...
Obtaining samples for iteration 15...
Obtaining samples for iteration 16...
Obtaining samples for iteration 17...
Obtaining samples for iteration 18...
Obtaining samples for iteration 19...
Done training policy.
Generating on-policy rollouts.
Path 0 | total_timesteps 0.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.293034605146406
Path 1 | total_timesteps 10.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.29200399245869
Path 2 | total_timesteps 23.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.291417165668662
Path 3 | total_timesteps 36.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.290608714935136
Path 4 | total_timesteps 47.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.28991130820399
Path 5 | total_timesteps 58.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.289214056091343
Path 6 | total_timesteps 69.
number of affinization with epsilon = 3 is 12
average number of affinization = 16.28873863888273
Path 7 | total_timesteps 83.
number of affinization with epsilon = 3 is 6
average number of affinization = 16.287598359747314
Path 8 | total_timesteps 90.
number of affinization with epsilon = 3 is 16
average number of affinization = 16.2875664893617
Path 9 | total_timesteps 108.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.286869806094185
Path 10 | total_timesteps 121.
number of affinization with epsilon = 3 is 6
average number of affinization = 16.28573011300687
Path 11 | total_timesteps 129.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.284812229976737
Path 12 | total_timesteps 138.
number of affinization with epsilon = 3 is 15
average number of affinization = 16.284669915817457
Path 13 | total_timesteps 155.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.28386310776387
Path 14 | total_timesteps 166.
number of affinization with epsilon = 3 is 16
average number of affinization = 16.283831672203764
Path 15 | total_timesteps 184.
number of affinization with epsilon = 3 is 12
average number of affinization = 16.283357324770236
Path 16 | total_timesteps 198.
number of affinization with epsilon = 3 is 20
average number of affinization = 16.28376882196634
Path 17 | total_timesteps 226.
number of affinization with epsilon = 3 is 23
average number of affinization = 16.284512343628915
Path 18 | total_timesteps 252.
number of affinization with epsilon = 3 is 13
average number of affinization = 16.28414877130839
Path 19 | total_timesteps 267.
number of affinization with epsilon = 3 is 16
average number of affinization = 16.284117321527393
Path 20 | total_timesteps 288.
number of affinization with epsilon = 3 is 4
average number of affinization = 16.282757857459053
Path 21 | total_timesteps 296.
number of affinization with epsilon = 3 is 14
average number of affinization = 16.28250525616908
Path 22 | total_timesteps 312.
number of affinization with epsilon = 3 is 27
average number of affinization = 16.28369108209781
Path 23 | total_timesteps 347.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.283106538333886
Path 24 | total_timesteps 359.
number of affinization with epsilon = 3 is 12
average number of affinization = 16.282632743362832
Path 25 | total_timesteps 374.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.282048445968368
Path 26 | total_timesteps 386.
number of affinization with epsilon = 3 is 16
average number of affinization = 16.28201725282017
Path 27 | total_timesteps 404.
number of affinization with epsilon = 3 is 16
average number of affinization = 16.281986066570827
Path 28 | total_timesteps 423.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.28095975232198
Path 29 | total_timesteps 434.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.280375898286348
Path 30 | total_timesteps 449.
number of affinization with epsilon = 3 is 14
average number of affinization = 16.280123811629448
Path 31 | total_timesteps 469.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.27920857742898
Path 32 | total_timesteps 479.
number of affinization with epsilon = 3 is 17
average number of affinization = 16.279288240495138
Path 33 | total_timesteps 499.
number of affinization with epsilon = 3 is 19
average number of affinization = 16.279588904851366
Path 34 | total_timesteps 520.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.2785635359116
Path 35 | total_timesteps 530.
number of affinization with epsilon = 3 is 5
average number of affinization = 16.277317423489116
Path 36 | total_timesteps 538.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.27673442333186
Path 37 | total_timesteps 551.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.275930630730144
Path 38 | total_timesteps 561.
number of affinization with epsilon = 3 is 18
average number of affinization = 16.276121051468962
Path 39 | total_timesteps 585.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.275207067918277
Path 40 | total_timesteps 595.
number of affinization with epsilon = 3 is 14
average number of affinization = 16.27495583038869
Path 41 | total_timesteps 611.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.274263000993706
Path 42 | total_timesteps 624.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.273570324574962
Path 43 | total_timesteps 638.
number of affinization with epsilon = 3 is 12
average number of affinization = 16.273098576001765
Path 44 | total_timesteps 653.
number of affinization with epsilon = 3 is 16
average number of affinization = 16.27306843267108
Path 45 | total_timesteps 676.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.27226575433175
Path 46 | total_timesteps 686.
number of affinization with epsilon = 3 is 24
average number of affinization = 16.27311851688369
Path 47 | total_timesteps 718.
number of affinization with epsilon = 3 is 13
average number of affinization = 16.27275736511089
Path 48 | total_timesteps 736.
number of affinization with epsilon = 3 is 23
average number of affinization = 16.273499558693732
Path 49 | total_timesteps 765.
number of affinization with epsilon = 3 is 4
average number of affinization = 16.272145615002756
Path 50 | total_timesteps 774.
number of affinization with epsilon = 3 is 13
average number of affinization = 16.27178469005074
Path 51 | total_timesteps 788.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.27098268446013
Path 52 | total_timesteps 799.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.270180855756507
Path 53 | total_timesteps 810.
number of affinization with epsilon = 3 is 6
average number of affinization = 16.26904840666005
Path 54 | total_timesteps 817.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.26824696802646
Path 55 | total_timesteps 827.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.267225223238892
Path 56 | total_timesteps 836.
number of affinization with epsilon = 3 is 12
average number of affinization = 16.266754850088184
Path 57 | total_timesteps 850.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.26573349498512
Path 58 | total_timesteps 860.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.26482256998016
Path 59 | total_timesteps 870.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.264022038567493
Path 60 | total_timesteps 887.
number of affinization with epsilon = 3 is 44
average number of affinization = 16.26707800793301
Path 61 | total_timesteps 936.
number of affinization with epsilon = 3 is 13
average number of affinization = 16.26671807866035
Path 62 | total_timesteps 954.
number of affinization with epsilon = 3 is 5
average number of affinization = 16.265476977307777
Path 63 | total_timesteps 961.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.264566582222713
Path 64 | total_timesteps 970.
number of affinization with epsilon = 3 is 14
average number of affinization = 16.26431718061674
Path 65 | total_timesteps 988.
number of affinization with epsilon = 3 is 6
average number of affinization = 16.263186873692323
Path 66 | total_timesteps 998.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.262166923585113
Path 67 | total_timesteps 1006.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.261147198062314
Path 68 | total_timesteps 1014.
number of affinization with epsilon = 3 is 4
average number of affinization = 16.259797446059004
Path 69 | total_timesteps 1023.
number of affinization with epsilon = 3 is 20
average number of affinization = 16.26020913593836
Path 70 | total_timesteps 1049.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.259520140876074
Path 71 | total_timesteps 1062.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.258501155496862
Path 72 | total_timesteps 1070.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.257702464788732
Path 73 | total_timesteps 1082.
number of affinization with epsilon = 3 is 5
average number of affinization = 16.256463857410058
Path 74 | total_timesteps 1090.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.255555555555556
Path 75 | total_timesteps 1100.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.254977450225496
Path 76 | total_timesteps 1115.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.2540695116586
Path 77 | total_timesteps 1125.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.253271747498076
Path 78 | total_timesteps 1136.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.252694084011438
Path 79 | total_timesteps 1150.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.2521165475536
Path 80 | total_timesteps 1163.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.251099384344766
Path 81 | total_timesteps 1173.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.250302297460703
Path 82 | total_timesteps 1186.
number of affinization with epsilon = 3 is 13
average number of affinization = 16.249945042866564
Path 83 | total_timesteps 1202.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.24925816023739
Path 84 | total_timesteps 1215.
number of affinization with epsilon = 3 is 16
average number of affinization = 16.24923076923077
Path 85 | total_timesteps 1233.
number of affinization with epsilon = 3 is 13
average number of affinization = 16.24887375013735
Path 86 | total_timesteps 1250.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.248297077565372
Path 87 | total_timesteps 1264.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.247390970009885
Path 88 | total_timesteps 1274.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.24659490333919
Path 89 | total_timesteps 1284.
number of affinization with epsilon = 3 is 23
average number of affinization = 16.24733662822625
Path 90 | total_timesteps 1309.
number of affinization with epsilon = 3 is 17
average number of affinization = 16.247419283988577
Path 91 | total_timesteps 1331.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.24640386515867
Path 92 | total_timesteps 1341.
number of affinization with epsilon = 3 is 16
average number of affinization = 16.246376811594203
Path 93 | total_timesteps 1359.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.245471511691733
Path 94 | total_timesteps 1369.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.24478594950604
Path 95 | total_timesteps 1383.
number of affinization with epsilon = 3 is 23
average number of affinization = 16.245527384480297
Path 96 | total_timesteps 1408.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.244841966637402
Path 97 | total_timesteps 1420.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.243827499177
Path 98 | total_timesteps 1432.
number of affinization with epsilon = 3 is 6
average number of affinization = 16.242703533026113
Path 99 | total_timesteps 1441.
number of affinization with epsilon = 3 is 12
average number of affinization = 16.24223806911684
Path 100 | total_timesteps 1455.
number of affinization with epsilon = 3 is 6
average number of affinization = 16.241114523913996
Path 101 | total_timesteps 1466.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.24032028079412
Path 102 | total_timesteps 1477.
number of affinization with epsilon = 3 is 15
average number of affinization = 16.240184250932224
Path 103 | total_timesteps 1494.
number of affinization with epsilon = 3 is 12
average number of affinization = 16.23971926746354
Path 104 | total_timesteps 1509.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.238706140350878
Path 105 | total_timesteps 1519.
number of affinization with epsilon = 3 is 20
average number of affinization = 16.23911851770639
Path 106 | total_timesteps 1542.
number of affinization with epsilon = 3 is 6
average number of affinization = 16.23799605349704
Path 107 | total_timesteps 1552.
number of affinization with epsilon = 3 is 12
average number of affinization = 16.23753151375644
Path 108 | total_timesteps 1567.
number of affinization with epsilon = 3 is 16
average number of affinization = 16.237505480052608
Path 109 | total_timesteps 1587.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.236931506849317
Path 110 | total_timesteps 1603.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.23635765943458
Path 111 | total_timesteps 1617.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.23534567765969
Path 112 | total_timesteps 1625.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.23477212971078
Path 113 | total_timesteps 1638.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.233870084346588
Path 114 | total_timesteps 1647.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.233187294633076
Path 115 | total_timesteps 1660.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.232285620413975
Path 116 | total_timesteps 1670.
number of affinization with epsilon = 3 is 17
average number of affinization = 16.232369689005694
Path 117 | total_timesteps 1690.
number of affinization with epsilon = 3 is 15
average number of affinization = 16.232234753093177
Path 118 | total_timesteps 1710.
number of affinization with epsilon = 3 is 12
average number of affinization = 16.231771403547185
Path 119 | total_timesteps 1726.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.231089217296113
Path 120 | total_timesteps 1737.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.230516637478107
Path 121 | total_timesteps 1754.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.2296158476524
Path 122 | total_timesteps 1763.
number of affinization with epsilon = 3 is 24
average number of affinization = 16.230466185160868
Path 123 | total_timesteps 1789.
number of affinization with epsilon = 3 is 12
average number of affinization = 16.23000328263486
Path 124 | total_timesteps 1803.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.229431072210065
Path 125 | total_timesteps 1817.
number of affinization with epsilon = 3 is 16
average number of affinization = 16.229405973088284
Path 126 | total_timesteps 1837.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.228724567928243
Path 127 | total_timesteps 1849.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.228152685114296
Path 128 | total_timesteps 1866.
number of affinization with epsilon = 3 is 22
average number of affinization = 16.22878390201225
Path 129 | total_timesteps 1891.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.228212137780208
Path 130 | total_timesteps 1905.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.227312486332824
Path 131 | total_timesteps 1918.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.226413031595058
Path 132 | total_timesteps 1929.
number of affinization with epsilon = 3 is 13
average number of affinization = 16.226060341058155
Path 133 | total_timesteps 1943.
number of affinization with epsilon = 3 is 12
average number of affinization = 16.22559842605749
Path 134 | total_timesteps 1958.
number of affinization with epsilon = 3 is 15
average number of affinization = 16.22546448087432
Path 135 | total_timesteps 1978.
number of affinization with epsilon = 3 is 15
average number of affinization = 16.225330564965578
Path 136 | total_timesteps 1998.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.224322552447553
Path 137 | total_timesteps 2006.
number of affinization with epsilon = 3 is 6
average number of affinization = 16.22320550639135
Path 138 | total_timesteps 2016.
number of affinization with epsilon = 3 is 21
average number of affinization = 16.223727332313743
Path 139 | total_timesteps 2041.
number of affinization with epsilon = 3 is 13
average number of affinization = 16.223375204806118
Path 140 | total_timesteps 2056.
number of affinization with epsilon = 3 is 4
average number of affinization = 16.222040192223677
Path 141 | total_timesteps 2064.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.22103308943977
Path 142 | total_timesteps 2075.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.22002620659533
Path 143 | total_timesteps 2083.
number of affinization with epsilon = 3 is 19
average number of affinization = 16.220329730319904
Path 144 | total_timesteps 2104.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.219323144104802
Path 145 | total_timesteps 2113.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.21864425281083
Path 146 | total_timesteps 2126.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.2177472167649
Path 147 | total_timesteps 2137.
number of affinization with epsilon = 3 is 23
average number of affinization = 16.218487394957982
Path 148 | total_timesteps 2164.
number of affinization with epsilon = 3 is 5
average number of affinization = 16.217263203841117
Path 149 | total_timesteps 2173.
number of affinization with epsilon = 3 is 14
average number of affinization = 16.217021276595744
Path 150 | total_timesteps 2190.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.21601571023347
Path 151 | total_timesteps 2199.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.215228537144103
Path 152 | total_timesteps 2213.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.214659685863875
Path 153 | total_timesteps 2229.
number of affinization with epsilon = 3 is 12
average number of affinization = 16.21420002181263
Path 154 | total_timesteps 2244.
number of affinization with epsilon = 3 is 14
average number of affinization = 16.213958560523444
Path 155 | total_timesteps 2260.
number of affinization with epsilon = 3 is 5
average number of affinization = 16.21273579762294
Path 156 | total_timesteps 2268.
number of affinization with epsilon = 3 is 6
average number of affinization = 16.211622328826863
Path 157 | total_timesteps 2275.
number of affinization with epsilon = 3 is 42
average number of affinization = 16.214433664013953
Path 158 | total_timesteps 2321.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.21353826030085
Path 159 | total_timesteps 2332.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.212861035422343
Path 160 | total_timesteps 2345.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.21185701830863
Path 161 | total_timesteps 2356.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.210853220006538
Path 162 | total_timesteps 2367.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.210067552843757
Path 163 | total_timesteps 2377.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.209173112539492
Path 164 | total_timesteps 2386.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.208169934640523
Path 165 | total_timesteps 2395.
number of affinization with epsilon = 3 is 6
average number of affinization = 16.20705805467814
Path 166 | total_timesteps 2405.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.206382051840556
Path 167 | total_timesteps 2419.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.20548840248285
Path 168 | total_timesteps 2430.
number of affinization with epsilon = 3 is 17
average number of affinization = 16.205574912891986
Path 169 | total_timesteps 2452.
number of affinization with epsilon = 3 is 6
average number of affinization = 16.20446379967338
Path 170 | total_timesteps 2460.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.20357065099064
Path 171 | total_timesteps 2470.
number of affinization with epsilon = 3 is 13
average number of affinization = 16.20322194405138
Path 172 | total_timesteps 2484.
number of affinization with epsilon = 3 is 16
average number of affinization = 16.203199825859816
Path 173 | total_timesteps 2502.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.202524757862662
Path 174 | total_timesteps 2515.
number of affinization with epsilon = 3 is 6
average number of affinization = 16.201414581066377
Path 175 | total_timesteps 2525.
number of affinization with epsilon = 3 is 28
average number of affinization = 16.202698291807202
Path 176 | total_timesteps 2555.
number of affinization with epsilon = 3 is 16
average number of affinization = 16.202676240208877
Path 177 | total_timesteps 2575.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.20167518764277
Path 178 | total_timesteps 2584.
number of affinization with epsilon = 3 is 16
average number of affinization = 16.20165325212095
Path 179 | total_timesteps 2603.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.201087547580208
Path 180 | total_timesteps 2619.
number of affinization with epsilon = 3 is 18
average number of affinization = 16.20128316659417
Path 181 | total_timesteps 2639.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.200500163096663
Path 182 | total_timesteps 2649.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.199499891280713
Path 183 | total_timesteps 2659.
number of affinization with epsilon = 3 is 18
average number of affinization = 16.19969561908903
Path 184 | total_timesteps 2680.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.19913043478261
Path 185 | total_timesteps 2694.
number of affinization with epsilon = 3 is 14
average number of affinization = 16.198891424845126
Path 186 | total_timesteps 2710.
number of affinization with epsilon = 3 is 18
average number of affinization = 16.19908715496631
Path 187 | total_timesteps 2732.
number of affinization with epsilon = 3 is 18
average number of affinization = 16.19928284255134
Path 188 | total_timesteps 2753.
number of affinization with epsilon = 3 is 6
average number of affinization = 16.198174706649283
Path 189 | total_timesteps 2762.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.19750135795763
Path 190 | total_timesteps 2774.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.196719530740822
Path 191 | total_timesteps 2787.
number of affinization with epsilon = 3 is 6
average number of affinization = 16.195612034321712
Path 192 | total_timesteps 2794.
number of affinization with epsilon = 3 is 6
average number of affinization = 16.194504778453517
Path 193 | total_timesteps 2803.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.19361494190466
Path 194 | total_timesteps 2814.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.192942453854506
Path 195 | total_timesteps 2827.
number of affinization with epsilon = 3 is 6
average number of affinization = 16.19183584844208
Path 196 | total_timesteps 2836.
number of affinization with epsilon = 3 is 4
average number of affinization = 16.190512375162832
Path 197 | total_timesteps 2845.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.189623358298057
Path 198 | total_timesteps 2855.
number of affinization with epsilon = 3 is 17
average number of affinization = 16.189711308877794
Path 199 | total_timesteps 2878.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.188822571893652
Path 200 | total_timesteps 2888.
number of affinization with epsilon = 3 is 13
average number of affinization = 16.1884765625
Path 201 | total_timesteps 2904.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.187696647499187
Path 202 | total_timesteps 2917.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.186808418311998
Path 203 | total_timesteps 2929.
number of affinization with epsilon = 3 is 18
average number of affinization = 16.18700509816683
Path 204 | total_timesteps 2949.
number of affinization with epsilon = 3 is 13
average number of affinization = 16.186659436008675
Path 205 | total_timesteps 2963.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.185771608285435
Path 206 | total_timesteps 2975.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.184775536759922
Path 207 | total_timesteps 2986.
number of affinization with epsilon = 3 is 5
average number of affinization = 16.18356283205031
Path 208 | total_timesteps 2994.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.18267562879445
Path 209 | total_timesteps 3006.
number of affinization with epsilon = 3 is 19
average number of affinization = 16.1829810298103
Path 210 | total_timesteps 3032.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.182202471276828
Path 211 | total_timesteps 3043.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.181315703912432
Path 212 | total_timesteps 3054.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.18042912873862
Path 213 | total_timesteps 3064.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.179434391591723
Path 214 | total_timesteps 3072.
number of affinization with epsilon = 3 is 6
average number of affinization = 16.178331527627304
Path 215 | total_timesteps 3082.
number of affinization with epsilon = 3 is 13
average number of affinization = 16.177987216986242
Path 216 | total_timesteps 3099.
number of affinization with epsilon = 3 is 4
average number of affinization = 16.176668110918545
Path 217 | total_timesteps 3108.
number of affinization with epsilon = 3 is 15
average number of affinization = 16.176540669338245
Path 218 | total_timesteps 3128.
number of affinization with epsilon = 3 is 17
average number of affinization = 16.17662984622049
Path 219 | total_timesteps 3146.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.17596101786681
Path 220 | total_timesteps 3159.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.17507579038545
Path 221 | total_timesteps 3168.
number of affinization with epsilon = 3 is 23
average number of affinization = 16.175814658438888
Path 222 | total_timesteps 3197.
number of affinization with epsilon = 3 is 4
average number of affinization = 16.174496644295303
Path 223 | total_timesteps 3205.
number of affinization with epsilon = 3 is 30
average number of affinization = 16.175993072843383
Path 224 | total_timesteps 3238.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.17521645021645
Path 225 | total_timesteps 3248.
number of affinization with epsilon = 3 is 6
average number of affinization = 16.174115355481007
Path 226 | total_timesteps 3258.
number of affinization with epsilon = 3 is 20
average number of affinization = 16.174529322657435
Path 227 | total_timesteps 3282.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.173969490425186
Path 228 | total_timesteps 3296.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.173409779316312
Path 229 | total_timesteps 3309.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.1724175229854
Path 230 | total_timesteps 3318.
number of affinization with epsilon = 3 is 21
average number of affinization = 16.172939649578197
Path 231 | total_timesteps 3340.
number of affinization with epsilon = 3 is 6
average number of affinization = 16.171839515518545
Path 232 | total_timesteps 3347.
number of affinization with epsilon = 3 is 6
average number of affinization = 16.170739619377162
Path 233 | total_timesteps 3355.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.170180560060547
Path 234 | total_timesteps 3367.
number of affinization with epsilon = 3 is 15
average number of affinization = 16.170054054054056
Path 235 | total_timesteps 3384.
number of affinization with epsilon = 3 is 12
average number of affinization = 16.169603286131228
Path 236 | total_timesteps 3398.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.168828361435367
Path 237 | total_timesteps 3409.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.168269750351236
Path 238 | total_timesteps 3421.
number of affinization with epsilon = 3 is 5
average number of affinization = 16.167062891722498
Path 239 | total_timesteps 3434.
number of affinization with epsilon = 3 is 4
average number of affinization = 16.16574824419233
Path 240 | total_timesteps 3440.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.164866032843562
Path 241 | total_timesteps 3453.
number of affinization with epsilon = 3 is 13
average number of affinization = 16.16452414389111
Path 242 | total_timesteps 3468.
number of affinization with epsilon = 3 is 6
average number of affinization = 16.16342622596673
Path 243 | total_timesteps 3477.
number of affinization with epsilon = 3 is 15
average number of affinization = 16.163300572416027
Path 244 | total_timesteps 3493.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.16241900647948
Path 245 | total_timesteps 3505.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.161861570024836
Path 246 | total_timesteps 3518.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.160872381774993
Path 247 | total_timesteps 3526.
number of affinization with epsilon = 3 is 19
average number of affinization = 16.161178883730972
Path 248 | total_timesteps 3546.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.16029792746114
Path 249 | total_timesteps 3555.
number of affinization with epsilon = 3 is 14
average number of affinization = 16.160064759848893
Path 250 | total_timesteps 3572.
number of affinization with epsilon = 3 is 18
average number of affinization = 16.160263328297
Path 251 | total_timesteps 3593.
number of affinization with epsilon = 3 is 13
average number of affinization = 16.15992230495306
Path 252 | total_timesteps 3611.
number of affinization with epsilon = 3 is 12
average number of affinization = 16.15947345705654
Path 253 | total_timesteps 3624.
number of affinization with epsilon = 3 is 18
average number of affinization = 16.159672025029668
Path 254 | total_timesteps 3647.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.158899676375405
Path 255 | total_timesteps 3658.
number of affinization with epsilon = 3 is 23
average number of affinization = 16.15963757954913
Path 256 | total_timesteps 3685.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.158757549611735
Path 257 | total_timesteps 3696.
number of affinization with epsilon = 3 is 22
average number of affinization = 16.15938746899601
Path 258 | total_timesteps 3721.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.158615484149234
Path 259 | total_timesteps 3734.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.157951482479785
Path 260 | total_timesteps 3746.
number of affinization with epsilon = 3 is 12
average number of affinization = 16.157503234152653
Path 261 | total_timesteps 3762.
number of affinization with epsilon = 3 is 13
average number of affinization = 16.157162875929718
Path 262 | total_timesteps 3778.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.15628368182798
Path 263 | total_timesteps 3788.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.155296906994288
Path 264 | total_timesteps 3797.
number of affinization with epsilon = 3 is 22
average number of affinization = 16.15592672413793
Path 265 | total_timesteps 3826.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.1552634414395
Path 266 | total_timesteps 3841.
number of affinization with epsilon = 3 is 15
average number of affinization = 16.15513897866839
Path 267 | total_timesteps 3859.
number of affinization with epsilon = 3 is 13
average number of affinization = 16.15479909512011
Path 268 | total_timesteps 3875.
number of affinization with epsilon = 3 is 15
average number of affinization = 16.15467470917708
Path 269 | total_timesteps 3891.
number of affinization with epsilon = 3 is 22
average number of affinization = 16.155304254173398
Path 270 | total_timesteps 3917.
number of affinization with epsilon = 3 is 6
average number of affinization = 16.154210639672627
Path 271 | total_timesteps 3925.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.15333261548401
Path 272 | total_timesteps 3937.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.152454780361758
Path 273 | total_timesteps 3949.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.15168478845947
Path 274 | total_timesteps 3959.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.150914962325082
Path 275 | total_timesteps 3970.
number of affinization with epsilon = 3 is 37
average number of affinization = 16.15315897104725
Path 276 | total_timesteps 4013.
number of affinization with epsilon = 3 is 41
average number of affinization = 16.155832974601807
Path 277 | total_timesteps 4059.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.15527816636178
Path 278 | total_timesteps 4072.
number of affinization with epsilon = 3 is 4
average number of affinization = 16.153970303421563
Path 279 | total_timesteps 4079.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.153308230231307
Path 280 | total_timesteps 4093.
number of affinization with epsilon = 3 is 21
average number of affinization = 16.15382960413081
Path 281 | total_timesteps 4119.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.15327525008067
Path 282 | total_timesteps 4132.
number of affinization with epsilon = 3 is 5
average number of affinization = 16.152075715207573
Path 283 | total_timesteps 4139.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.151521668996665
Path 284 | total_timesteps 4154.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.150967741935485
Path 285 | total_timesteps 4168.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.150091388022794
Path 286 | total_timesteps 4180.
number of affinization with epsilon = 3 is 18
average number of affinization = 16.150290260159107
Path 287 | total_timesteps 4202.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.149736644093302
Path 288 | total_timesteps 4216.
number of affinization with epsilon = 3 is 21
average number of affinization = 16.150257953568357
Path 289 | total_timesteps 4239.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.14938205265986
Path 290 | total_timesteps 4250.
number of affinization with epsilon = 3 is 5
average number of affinization = 16.148183967332905
Path 291 | total_timesteps 4260.
number of affinization with epsilon = 3 is 5
average number of affinization = 16.146986139464918
Path 292 | total_timesteps 4268.
number of affinization with epsilon = 3 is 14
average number of affinization = 16.146755479157715
Path 293 | total_timesteps 4289.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.146202599634762
Path 294 | total_timesteps 4303.
number of affinization with epsilon = 3 is 5
average number of affinization = 16.14500537056928
Path 295 | total_timesteps 4310.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.144023198367524
Path 296 | total_timesteps 4321.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.1430412371134
Path 297 | total_timesteps 4332.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.142274240309245
Path 298 | total_timesteps 4344.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.141400042946103
Path 299 | total_timesteps 4355.
number of affinization with epsilon = 3 is 12
average number of affinization = 16.140955448201826
Path 300 | total_timesteps 4370.
number of affinization with epsilon = 3 is 15
average number of affinization = 16.140832975525978
Path 301 | total_timesteps 4387.
number of affinization with epsilon = 3 is 12
average number of affinization = 16.140388537082753
Path 302 | total_timesteps 4402.
number of affinization with epsilon = 3 is 26
average number of affinization = 16.1414466623739
Path 303 | total_timesteps 4431.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.140465715205494
Path 304 | total_timesteps 4439.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.13980686695279
Path 305 | total_timesteps 4451.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.138933590816436
Path 306 | total_timesteps 4462.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.137953228920832
Path 307 | total_timesteps 4472.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.13697307733562
Path 308 | total_timesteps 4480.
number of affinization with epsilon = 3 is 26
average number of affinization = 16.138030888030887
Path 309 | total_timesteps 4511.
number of affinization with epsilon = 3 is 15
average number of affinization = 16.13790884718499
Path 310 | total_timesteps 4527.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.13703624276217
Path 311 | total_timesteps 4536.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.136163825452986
Path 312 | total_timesteps 4546.
number of affinization with epsilon = 3 is 19
average number of affinization = 16.136470840480275
Path 313 | total_timesteps 4567.
number of affinization with epsilon = 3 is 16
average number of affinization = 16.13645621181263
Path 314 | total_timesteps 4587.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.135798499464094
Path 315 | total_timesteps 4599.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.1348194191405
Path 316 | total_timesteps 4608.
number of affinization with epsilon = 3 is 16
average number of affinization = 16.134804972138877
Path 317 | total_timesteps 4627.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.13414764813029
Path 318 | total_timesteps 4640.
number of affinization with epsilon = 3 is 6
average number of affinization = 16.133061924148276
Path 319 | total_timesteps 4653.
number of affinization with epsilon = 3 is 14
average number of affinization = 16.132833422603106
Path 320 | total_timesteps 4668.
number of affinization with epsilon = 3 is 5
average number of affinization = 16.131640959725793
Path 321 | total_timesteps 4676.
number of affinization with epsilon = 3 is 14
average number of affinization = 16.131412659312414
Path 322 | total_timesteps 4695.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.130756050546154
Path 323 | total_timesteps 4710.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.12999250455081
Path 324 | total_timesteps 4722.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.129122055674518
Path 325 | total_timesteps 4732.
number of affinization with epsilon = 3 is 12
average number of affinization = 16.12868001284659
Path 326 | total_timesteps 4746.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.128131021194605
Path 327 | total_timesteps 4760.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.127261051054266
Path 328 | total_timesteps 4769.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.12628424657534
Path 329 | total_timesteps 4777.
number of affinization with epsilon = 3 is 19
average number of affinization = 16.126591760299625
Path 330 | total_timesteps 4802.
number of affinization with epsilon = 3 is 12
average number of affinization = 16.126150224695056
Path 331 | total_timesteps 4816.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.12560179736814
Path 332 | total_timesteps 4829.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.124839537869065
Path 333 | total_timesteps 4839.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.124184404749172
Path 334 | total_timesteps 4850.
number of affinization with epsilon = 3 is 20
average number of affinization = 16.124598930481284
Path 335 | total_timesteps 4873.
number of affinization with epsilon = 3 is 12
average number of affinization = 16.124157844080848
Path 336 | total_timesteps 4889.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.123502994011975
Path 337 | total_timesteps 4900.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.1227413664065
Path 338 | total_timesteps 4916.
number of affinization with epsilon = 3 is 14
average number of affinization = 16.122514432328416
Path 339 | total_timesteps 4934.
number of affinization with epsilon = 3 is 21
average number of affinization = 16.12303580972742
Path 340 | total_timesteps 4958.
number of affinization with epsilon = 3 is 13
average number of affinization = 16.122702009405728
Path 341 | total_timesteps 4972.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.122047664849845
Path 342 | total_timesteps 4983.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.12107287882026
Path 343 | total_timesteps 4992.
number of affinization with epsilon = 3 is 6
average number of affinization = 16.119991452078214
Path 344 | total_timesteps 5003.
number of affinization with epsilon = 3 is 5
average number of affinization = 16.11880341880342
Path 345 | total_timesteps 5011.
number of affinization with epsilon = 3 is 13
average number of affinization = 16.11847024890503
Path 346 | total_timesteps 5026.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.117816705832087
Path 347 | total_timesteps 5040.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.116842892235393
Path 348 | total_timesteps 5048.
number of affinization with epsilon = 3 is 6
average number of affinization = 16.1157624946604
Path 349 | total_timesteps 5058.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.115109450080084
Path 350 | total_timesteps 5071.
number of affinization with epsilon = 3 is 13
average number of affinization = 16.114776852445015
Path 351 | total_timesteps 5089.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.113910536991565
Path 352 | total_timesteps 5100.
number of affinization with epsilon = 3 is 6
average number of affinization = 16.112830913748933
Path 353 | total_timesteps 5110.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.112071725904578
Path 354 | total_timesteps 5126.
number of affinization with epsilon = 3 is 23
average number of affinization = 16.1128068303095
Path 355 | total_timesteps 5151.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.11215451926155
Path 356 | total_timesteps 5164.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.111395646606915
Path 357 | total_timesteps 5175.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.110743625306732
Path 358 | total_timesteps 5188.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.110091743119266
Path 359 | total_timesteps 5200.
number of affinization with epsilon = 3 is 16
average number of affinization = 16.11008
Path 360 | total_timesteps 5218.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.109321672354948
Path 361 | total_timesteps 5230.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.108776794283887
Path 362 | total_timesteps 5245.
number of affinization with epsilon = 3 is 12
average number of affinization = 16.108338664960545
Path 363 | total_timesteps 5259.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.107794007889968
Path 364 | total_timesteps 5272.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.107142857142858
Path 365 | total_timesteps 5284.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.106598443662723
Path 366 | total_timesteps 5298.
number of affinization with epsilon = 3 is 12
average number of affinization = 16.106160733319122
Path 367 | total_timesteps 5313.
number of affinization with epsilon = 3 is 12
average number of affinization = 16.105723116274113
Path 368 | total_timesteps 5328.
number of affinization with epsilon = 3 is 14
average number of affinization = 16.105498721227622
Path 369 | total_timesteps 5343.
number of affinization with epsilon = 3 is 6
average number of affinization = 16.104421949920084
Path 370 | total_timesteps 5352.
number of affinization with epsilon = 3 is 5
average number of affinization = 16.10323886639676
Path 371 | total_timesteps 5360.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.102269095557688
Path 372 | total_timesteps 5369.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.101725607158073
Path 373 | total_timesteps 5381.
number of affinization with epsilon = 3 is 25
average number of affinization = 16.10267334114389
Path 374 | total_timesteps 5409.
number of affinization with epsilon = 3 is 14
average number of affinization = 16.1024494142705
Path 375 | total_timesteps 5426.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.101693110424875
Path 376 | total_timesteps 5441.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.100936967632027
Path 377 | total_timesteps 5452.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.10039391035878
Path 378 | total_timesteps 5467.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.09963806685118
Path 379 | total_timesteps 5478.
number of affinization with epsilon = 3 is 5
average number of affinization = 16.09845662586482
Path 380 | total_timesteps 5485.
number of affinization with epsilon = 3 is 22
average number of affinization = 16.09908471690081
Path 381 | total_timesteps 5515.
number of affinization with epsilon = 3 is 16
average number of affinization = 16.09907417260828
Path 382 | total_timesteps 5534.
number of affinization with epsilon = 3 is 24
average number of affinization = 16.099914875505426
Path 383 | total_timesteps 5564.
number of affinization with epsilon = 3 is 12
average number of affinization = 16.099478667943398
Path 384 | total_timesteps 5577.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.09851063829787
Path 385 | total_timesteps 5585.
number of affinization with epsilon = 3 is 4
average number of affinization = 16.097223699606424
Path 386 | total_timesteps 5594.
number of affinization with epsilon = 3 is 15
average number of affinization = 16.097106998510956
Path 387 | total_timesteps 5614.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.096139529937254
Path 388 | total_timesteps 5622.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.095172267120375
Path 389 | total_timesteps 5635.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.094205209994684
Path 390 | total_timesteps 5646.
number of affinization with epsilon = 3 is 13
average number of affinization = 16.093876249202637
Path 391 | total_timesteps 5664.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.09301583926863
Path 392 | total_timesteps 5676.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.092368197278912
Path 393 | total_timesteps 5691.
number of affinization with epsilon = 3 is 19
average number of affinization = 16.09267722393453
Path 394 | total_timesteps 5712.
number of affinization with epsilon = 3 is 13
average number of affinization = 16.092348565356005
Path 395 | total_timesteps 5726.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.091594942089046
Path 396 | total_timesteps 5737.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.090628984275394
Path 397 | total_timesteps 5747.
number of affinization with epsilon = 3 is 5
average number of affinization = 16.089450759587805
Path 398 | total_timesteps 5755.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.08891013384321
Path 399 | total_timesteps 5768.
number of affinization with epsilon = 3 is 15
average number of affinization = 16.088794476898567
Path 400 | total_timesteps 5785.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.08804163126593
Path 401 | total_timesteps 5796.
number of affinization with epsilon = 3 is 4
average number of affinization = 16.08675799086758
Path 402 | total_timesteps 5806.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.085793162030154
Path 403 | total_timesteps 5816.
number of affinization with epsilon = 3 is 20
average number of affinization = 16.086208727041086
Path 404 | total_timesteps 5838.
number of affinization with epsilon = 3 is 12
average number of affinization = 16.085774946921443
Path 405 | total_timesteps 5851.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.085128967200934
Path 406 | total_timesteps 5867.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.084589259180643
Path 407 | total_timesteps 5882.
number of affinization with epsilon = 3 is 17
average number of affinization = 16.08468640560331
Path 408 | total_timesteps 5903.
number of affinization with epsilon = 3 is 17
average number of affinization = 16.08478353140917
Path 409 | total_timesteps 5926.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.084137931034483
Path 410 | total_timesteps 5939.
number of affinization with epsilon = 3 is 16
average number of affinization = 16.08412900488012
Path 411 | total_timesteps 5957.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.0832714543333
Path 412 | total_timesteps 5970.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.082626219770894
Path 413 | total_timesteps 5984.
number of affinization with epsilon = 3 is 6
average number of affinization = 16.081556898928838
Path 414 | total_timesteps 5993.
number of affinization with epsilon = 3 is 22
average number of affinization = 16.08218451749735
Done generating on-policy rollouts.
Updating normalization.
Done updating normalization.
----------------------------
| AverageReturn | -5.9     |
| Iteration     | 30       |
| MaximumReturn | 5.22     |
| MinimumReturn | -19.2    |
| TotalSamples  | 128290   |
----------------------------
itr #31 | 
Fitting dynamics.
Fitting model 0 (0-based) in the ensemble of 2 models
Validation loss = 0.012458930723369122
Validation loss = 0.012274611741304398
Validation loss = 0.012183031067252159
Validation loss = 0.012224800884723663
Validation loss = 0.011934733018279076
Validation loss = 0.012441330589354038
Validation loss = 0.012301726266741753
Validation loss = 0.012902061454951763
Validation loss = 0.012106869369745255
Fitting model 1 (0-based) in the ensemble of 2 models
Validation loss = 0.01196347177028656
Validation loss = 0.012159917503595352
Validation loss = 0.011865485459566116
Validation loss = 0.011673806235194206
Validation loss = 0.01197727583348751
Validation loss = 0.012106374837458134
Validation loss = 0.012088051065802574
Validation loss = 0.01177632249891758
Done fitting dynamics.
Updating randomness.
Done updating randomness.
Training policy using TRPO.
Re-initialize init_std.
Obtaining samples for iteration 0...
Obtaining samples for iteration 1...
Obtaining samples for iteration 2...
Obtaining samples for iteration 3...
Obtaining samples for iteration 4...
Obtaining samples for iteration 5...
Obtaining samples for iteration 6...
Obtaining samples for iteration 7...
Obtaining samples for iteration 8...
Obtaining samples for iteration 9...
Obtaining samples for iteration 10...
Obtaining samples for iteration 11...
Obtaining samples for iteration 12...
Obtaining samples for iteration 13...
Obtaining samples for iteration 14...
Obtaining samples for iteration 15...
Obtaining samples for iteration 16...
Obtaining samples for iteration 17...
Obtaining samples for iteration 18...
Obtaining samples for iteration 19...
Done training policy.
Generating on-policy rollouts.
Path 0 | total_timesteps 0.
number of affinization with epsilon = 3 is 6
average number of affinization = 16.08111547025766
Path 1 | total_timesteps 10.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.080152671755727
Path 2 | total_timesteps 20.
number of affinization with epsilon = 3 is 6
average number of affinization = 16.07908406657479
Path 3 | total_timesteps 28.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.07812168751325
Path 4 | total_timesteps 36.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.077371489136194
Path 5 | total_timesteps 49.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.076515472657906
Path 6 | total_timesteps 60.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.07576560347568
Path 7 | total_timesteps 70.
number of affinization with epsilon = 3 is 17
average number of affinization = 16.075863530408984
Path 8 | total_timesteps 91.
number of affinization with epsilon = 3 is 12
average number of affinization = 16.075431719461807
Path 9 | total_timesteps 107.
number of affinization with epsilon = 3 is 12
average number of affinization = 16.075
Path 10 | total_timesteps 121.
number of affinization with epsilon = 3 is 13
average number of affinization = 16.074674292977438
Path 11 | total_timesteps 136.
number of affinization with epsilon = 3 is 13
average number of affinization = 16.074348654945986
Path 12 | total_timesteps 152.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.073387694588583
Path 13 | total_timesteps 165.
number of affinization with epsilon = 3 is 5
average number of affinization = 16.0722151630665
Path 14 | total_timesteps 173.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.071360508205398
Path 15 | total_timesteps 185.
number of affinization with epsilon = 3 is 6
average number of affinization = 16.0702943044675
Path 16 | total_timesteps 196.
number of affinization with epsilon = 3 is 6
average number of affinization = 16.06922832645284
Path 17 | total_timesteps 205.
number of affinization with epsilon = 3 is 17
average number of affinization = 16.06932684165961
Path 18 | total_timesteps 229.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.068472854270293
Path 19 | total_timesteps 240.
number of affinization with epsilon = 3 is 14
average number of affinization = 16.06825396825397
Path 20 | total_timesteps 257.
number of affinization with epsilon = 3 is 13
average number of affinization = 16.067929319648716
Path 21 | total_timesteps 273.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.067181548878544
Path 22 | total_timesteps 283.
number of affinization with epsilon = 3 is 12
average number of affinization = 16.066751295884906
Path 23 | total_timesteps 297.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.06579225724561
Path 24 | total_timesteps 307.
number of affinization with epsilon = 3 is 6
average number of affinization = 16.064727657324166
Path 25 | total_timesteps 318.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.063769035532996
Path 26 | total_timesteps 328.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.062810616474568
Path 27 | total_timesteps 338.
number of affinization with epsilon = 3 is 13
average number of affinization = 16.062486783675194
Path 28 | total_timesteps 354.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.06184586108468
Path 29 | total_timesteps 365.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.061310782241016
Path 30 | total_timesteps 380.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.06077581650988
Path 31 | total_timesteps 395.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.05981822024942
Path 32 | total_timesteps 404.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.058860826376414
Path 33 | total_timesteps 416.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.05790363482671
Path 34 | total_timesteps 426.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.057369255150554
Path 35 | total_timesteps 440.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.05672934713712
Path 36 | total_timesteps 452.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.05619520439421
Path 37 | total_timesteps 464.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.055449936628644
Path 38 | total_timesteps 475.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.05491604182068
Path 39 | total_timesteps 489.
number of affinization with epsilon = 3 is 14
average number of affinization = 16.05469904963041
Path 40 | total_timesteps 506.
number of affinization with epsilon = 3 is 17
average number of affinization = 16.054798859676907
Path 41 | total_timesteps 531.
number of affinization with epsilon = 3 is 28
average number of affinization = 16.056059966216218
Path 42 | total_timesteps 564.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.055315106090994
Path 43 | total_timesteps 575.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.05435929913447
Path 44 | total_timesteps 586.
number of affinization with epsilon = 3 is 6
average number of affinization = 16.0532981530343
Path 45 | total_timesteps 594.
number of affinization with epsilon = 3 is 16
average number of affinization = 16.053292528493035
Path 46 | total_timesteps 611.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.052653793394533
Path 47 | total_timesteps 623.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.05212070056974
Path 48 | total_timesteps 636.
number of affinization with epsilon = 3 is 6
average number of affinization = 16.051060238421776
Path 49 | total_timesteps 646.
number of affinization with epsilon = 3 is 4
average number of affinization = 16.049789029535866
Path 50 | total_timesteps 655.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.04915093344584
Path 51 | total_timesteps 667.
number of affinization with epsilon = 3 is 18
average number of affinization = 16.04935667580679
Path 52 | total_timesteps 690.
number of affinization with epsilon = 3 is 12
average number of affinization = 16.04892966360856
Path 53 | total_timesteps 704.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.048397300716996
Path 54 | total_timesteps 717.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.047443331576172
Path 55 | total_timesteps 727.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.046594982078854
Path 56 | total_timesteps 738.
number of affinization with epsilon = 3 is 12
average number of affinization = 16.04616844102456
Path 57 | total_timesteps 752.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.045425801011806
Path 58 | total_timesteps 763.
number of affinization with epsilon = 3 is 21
average number of affinization = 16.045947939719674
Path 59 | total_timesteps 788.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.045310853530033
Path 60 | total_timesteps 799.
number of affinization with epsilon = 3 is 5
average number of affinization = 16.04414708671373
Path 61 | total_timesteps 807.
number of affinization with epsilon = 3 is 12
average number of affinization = 16.0437210282343
Path 62 | total_timesteps 826.
number of affinization with epsilon = 3 is 6
average number of affinization = 16.04266301485305
Path 63 | total_timesteps 835.
number of affinization with epsilon = 3 is 5
average number of affinization = 16.041499894670316
Path 64 | total_timesteps 844.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.040758293838863
Path 65 | total_timesteps 856.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.040122156697556
Path 66 | total_timesteps 869.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.039486153522166
Path 67 | total_timesteps 881.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.038639713623922
Path 68 | total_timesteps 893.
number of affinization with epsilon = 3 is 5
average number of affinization = 16.037477629224128
Path 69 | total_timesteps 900.
number of affinization with epsilon = 3 is 18
average number of affinization = 16.037684210526315
Path 70 | total_timesteps 921.
number of affinization with epsilon = 3 is 12
average number of affinization = 16.037259235869907
Path 71 | total_timesteps 937.
number of affinization with epsilon = 3 is 5
average number of affinization = 16.03609766364976
Path 72 | total_timesteps 945.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.035357255603493
Path 73 | total_timesteps 955.
number of affinization with epsilon = 3 is 14
average number of affinization = 16.035143097643097
Path 74 | total_timesteps 971.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.034508153603365
Path 75 | total_timesteps 983.
number of affinization with epsilon = 3 is 6
average number of affinization = 16.033452556280245
Path 76 | total_timesteps 993.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.03271273798254
Path 77 | total_timesteps 1003.
number of affinization with epsilon = 3 is 16
average number of affinization = 16.03270929743374
Path 78 | total_timesteps 1023.
number of affinization with epsilon = 3 is 13
average number of affinization = 16.032390367020717
Path 79 | total_timesteps 1039.
number of affinization with epsilon = 3 is 16
average number of affinization = 16.032386961093586
Path 80 | total_timesteps 1057.
number of affinization with epsilon = 3 is 4
average number of affinization = 16.03112185890022
Path 81 | total_timesteps 1064.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.03048780487805
Path 82 | total_timesteps 1075.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.029643645537686
Path 83 | total_timesteps 1085.
number of affinization with epsilon = 3 is 32
average number of affinization = 16.031322261929787
Path 84 | total_timesteps 1119.
number of affinization with epsilon = 3 is 21
average number of affinization = 16.031844456121913
Path 85 | total_timesteps 1145.
number of affinization with epsilon = 3 is 3
average number of affinization = 16.03047498949138
Path 86 | total_timesteps 1153.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.029631186298204
Path 87 | total_timesteps 1162.
number of affinization with epsilon = 3 is 15
average number of affinization = 16.02952300903551
Path 88 | total_timesteps 1178.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.028784536190777
Path 89 | total_timesteps 1190.
number of affinization with epsilon = 3 is 6
average number of affinization = 16.027731092436976
Path 90 | total_timesteps 1197.
number of affinization with epsilon = 3 is 19
average number of affinization = 16.028043272765466
Path 91 | total_timesteps 1223.
number of affinization with epsilon = 3 is 13
average number of affinization = 16.027725267800882
Path 92 | total_timesteps 1238.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.02709230284574
Path 93 | total_timesteps 1253.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.02635447291054
Path 94 | total_timesteps 1266.
number of affinization with epsilon = 3 is 5
average number of affinization = 16.0251968503937
Path 95 | total_timesteps 1273.
number of affinization with epsilon = 3 is 16
average number of affinization = 16.025194205332774
Path 96 | total_timesteps 1292.
number of affinization with epsilon = 3 is 5
average number of affinization = 16.024036947622548
Path 97 | total_timesteps 1301.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.02340470193115
Path 98 | total_timesteps 1313.
number of affinization with epsilon = 3 is 19
average number of affinization = 16.023717074194565
Path 99 | total_timesteps 1334.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.02277019937041
Path 100 | total_timesteps 1344.
number of affinization with epsilon = 3 is 13
average number of affinization = 16.022453047948797
Path 101 | total_timesteps 1360.
number of affinization with epsilon = 3 is 5
average number of affinization = 16.021296684851027
Path 102 | total_timesteps 1368.
number of affinization with epsilon = 3 is 12
average number of affinization = 16.020874855764188
Path 103 | total_timesteps 1382.
number of affinization with epsilon = 3 is 6
average number of affinization = 16.019823788546255
Path 104 | total_timesteps 1392.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.018982695332983
Path 105 | total_timesteps 1404.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.01814177852349
Path 106 | total_timesteps 1415.
number of affinization with epsilon = 3 is 11
average number of affinization = 16.017615602390688
Path 107 | total_timesteps 1431.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.016879849024953
Path 108 | total_timesteps 1441.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.016144249921375
Path 109 | total_timesteps 1454.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.01551362683438
Path 110 | total_timesteps 1465.
number of affinization with epsilon = 3 is 15
average number of affinization = 16.01540719002201
Path 111 | total_timesteps 1483.
number of affinization with epsilon = 3 is 12
average number of affinization = 16.0149863760218
Path 112 | total_timesteps 1496.
number of affinization with epsilon = 3 is 22
average number of affinization = 16.01561353871948
Path 113 | total_timesteps 1523.
number of affinization with epsilon = 3 is 6
average number of affinization = 16.014564124057
Path 114 | total_timesteps 1531.
number of affinization with epsilon = 3 is 6
average number of affinization = 16.013514929282348
Path 115 | total_timesteps 1539.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.012884978001257
Path 116 | total_timesteps 1550.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.012150413742535
Path 117 | total_timesteps 1560.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.01152073732719
Path 118 | total_timesteps 1576.
number of affinization with epsilon = 3 is 13
average number of affinization = 16.011205361817993
Path 119 | total_timesteps 1593.
number of affinization with epsilon = 3 is 6
average number of affinization = 16.010157068062828
Path 120 | total_timesteps 1602.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.0094230970579
Path 121 | total_timesteps 1614.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.008479899497488
Path 122 | total_timesteps 1625.
number of affinization with epsilon = 3 is 12
average number of affinization = 16.008060295195225
Path 123 | total_timesteps 1638.
number of affinization with epsilon = 3 is 13
average number of affinization = 16.00774544693322
Path 124 | total_timesteps 1652.
number of affinization with epsilon = 3 is 12
average number of affinization = 16.007326007326007
Path 125 | total_timesteps 1665.
number of affinization with epsilon = 3 is 9
average number of affinization = 16.00659271661783
Path 126 | total_timesteps 1676.
number of affinization with epsilon = 3 is 14
average number of affinization = 16.006382756095007
Path 127 | total_timesteps 1695.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.005440468717303
Path 128 | total_timesteps 1703.
number of affinization with epsilon = 3 is 6
average number of affinization = 16.004393765038184
Path 129 | total_timesteps 1711.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.00355648535565
Path 130 | total_timesteps 1721.
number of affinization with epsilon = 3 is 10
average number of affinization = 16.002928563957745
Path 131 | total_timesteps 1734.
number of affinization with epsilon = 3 is 6
average number of affinization = 16.001882451370005
Path 132 | total_timesteps 1744.
number of affinization with epsilon = 3 is 8
average number of affinization = 16.00104569695702
Path 133 | total_timesteps 1753.
number of affinization with epsilon = 3 is 7
average number of affinization = 16.000104558762025
Path 134 | total_timesteps 1762.
number of affinization with epsilon = 3 is 11
average number of affinization = 15.99958180867747
Path 135 | total_timesteps 1775.
number of affinization with epsilon = 3 is 9
average number of affinization = 15.998850094083211
Path 136 | total_timesteps 1787.
number of affinization with epsilon = 3 is 10
average number of affinization = 15.99822305843002
Path 137 | total_timesteps 1800.
number of affinization with epsilon = 3 is 10
average number of affinization = 15.997596153846153
Path 138 | total_timesteps 1812.
number of affinization with epsilon = 3 is 8
average number of affinization = 15.996760372034695
Path 139 | total_timesteps 1823.
number of affinization with epsilon = 3 is 24
average number of affinization = 15.997596656217345
Path 140 | total_timesteps 1850.
number of affinization with epsilon = 3 is 7
average number of affinization = 15.996656566711943
Path 141 | total_timesteps 1860.
number of affinization with epsilon = 3 is 6
average number of affinization = 15.995612202256583
Path 142 | total_timesteps 1869.
number of affinization with epsilon = 3 is 11
average number of affinization = 15.995090358299384
Path 143 | total_timesteps 1882.
number of affinization with epsilon = 3 is 8
average number of affinization = 15.994255274702319
Path 144 | total_timesteps 1896.
number of affinization with epsilon = 3 is 8
average number of affinization = 15.993420365535249
Path 145 | total_timesteps 1907.
number of affinization with epsilon = 3 is 19
average number of affinization = 15.9937343358396
Path 146 | total_timesteps 1929.
number of affinization with epsilon = 3 is 10
average number of affinization = 15.99310848908844
Path 147 | total_timesteps 1941.
number of affinization with epsilon = 3 is 6
average number of affinization = 15.99206514930048
Path 148 | total_timesteps 1948.
number of affinization with epsilon = 3 is 11
average number of affinization = 15.991544002505481
Path 149 | total_timesteps 1964.
number of affinization with epsilon = 3 is 33
average number of affinization = 15.993319415448852
Path 150 | total_timesteps 2003.
number of affinization with epsilon = 3 is 11
average number of affinization = 15.99279824652959
Path 151 | total_timesteps 2019.
number of affinization with epsilon = 3 is 16
average number of affinization = 15.992798998121478
Path 152 | total_timesteps 2042.
number of affinization with epsilon = 3 is 7
average number of affinization = 15.99186058645518
Path 153 | total_timesteps 2051.
number of affinization with epsilon = 3 is 12
average number of affinization = 15.99144407345576
Path 154 | total_timesteps 2064.
number of affinization with epsilon = 3 is 14
average number of affinization = 15.991236306729265
Path 155 | total_timesteps 2079.
number of affinization with epsilon = 3 is 12
average number of affinization = 15.990819945754225
Path 156 | total_timesteps 2095.
number of affinization with epsilon = 3 is 12
average number of affinization = 15.990403671638678
Path 157 | total_timesteps 2112.
number of affinization with epsilon = 3 is 9
average number of affinization = 15.989674593241553
Path 158 | total_timesteps 2122.
number of affinization with epsilon = 3 is 10
average number of affinization = 15.989049953071227
Path 159 | total_timesteps 2136.
number of affinization with epsilon = 3 is 16
average number of affinization = 15.989051094890511
Path 160 | total_timesteps 2155.
number of affinization with epsilon = 3 is 7
average number of affinization = 15.988113856740695
Path 161 | total_timesteps 2164.
number of affinization with epsilon = 3 is 8
average number of affinization = 15.987281067556298
Path 162 | total_timesteps 2177.
number of affinization with epsilon = 3 is 16
average number of affinization = 15.987282393411864
Path 163 | total_timesteps 2197.
number of affinization with epsilon = 3 is 9
average number of affinization = 15.986554096310194
Path 164 | total_timesteps 2208.
number of affinization with epsilon = 3 is 10
average number of affinization = 15.985930171964565
Path 165 | total_timesteps 2220.
number of affinization with epsilon = 3 is 8
average number of affinization = 15.985097957482285
Path 166 | total_timesteps 2230.
number of affinization with epsilon = 3 is 7
average number of affinization = 15.984161717203293
Path 167 | total_timesteps 2241.
number of affinization with epsilon = 3 is 9
average number of affinization = 15.983434048760158
Path 168 | total_timesteps 2252.
number of affinization with epsilon = 3 is 6
average number of affinization = 15.982393999374935
Path 169 | total_timesteps 2261.
number of affinization with epsilon = 3 is 11
average number of affinization = 15.981875
Path 170 | total_timesteps 2277.
number of affinization with epsilon = 3 is 7
average number of affinization = 15.980939485470264
Path 171 | total_timesteps 2286.
number of affinization with epsilon = 3 is 12
average number of affinization = 15.980524890647782
Path 172 | total_timesteps 2301.
number of affinization with epsilon = 3 is 11
average number of affinization = 15.980006248047486
Path 173 | total_timesteps 2316.
number of affinization with epsilon = 3 is 18
average number of affinization = 15.98021657642649
Path 174 | total_timesteps 2337.
number of affinization with epsilon = 3 is 18
average number of affinization = 15.98042686100989
Path 175 | total_timesteps 2356.
number of affinization with epsilon = 3 is 8
average number of affinization = 15.97959608577972
Path 176 | total_timesteps 2366.
number of affinization with epsilon = 3 is 2
average number of affinization = 15.97814093889872
Path 177 | total_timesteps 2373.
number of affinization with epsilon = 3 is 7
average number of affinization = 15.977206494587843
Path 178 | total_timesteps 2382.
number of affinization with epsilon = 3 is 6
average number of affinization = 15.976168175668644
Path 179 | total_timesteps 2391.
number of affinization with epsilon = 3 is 12
average number of affinization = 15.975754422476587
Path 180 | total_timesteps 2408.
number of affinization with epsilon = 3 is 7
average number of affinization = 15.97482051815628
Path 181 | total_timesteps 2418.
number of affinization with epsilon = 3 is 7
average number of affinization = 15.973886808156472
Path 182 | total_timesteps 2427.
number of affinization with epsilon = 3 is 13
average number of affinization = 15.973577447206907
Path 183 | total_timesteps 2443.
number of affinization with epsilon = 3 is 6
average number of affinization = 15.972540045766591
Path 184 | total_timesteps 2451.
number of affinization with epsilon = 3 is 11
average number of affinization = 15.972022880915237
Path 185 | total_timesteps 2463.
number of affinization with epsilon = 3 is 12
average number of affinization = 15.971609816971714
Path 186 | total_timesteps 2477.
number of affinization with epsilon = 3 is 11
average number of affinization = 15.971092856400125
Path 187 | total_timesteps 2491.
number of affinization with epsilon = 3 is 16
average number of affinization = 15.971095861925557
Path 188 | total_timesteps 2509.
number of affinization with epsilon = 3 is 11
average number of affinization = 15.970579062272586
Path 189 | total_timesteps 2524.
number of affinization with epsilon = 3 is 14
average number of affinization = 15.97037422037422
Path 190 | total_timesteps 2541.
number of affinization with epsilon = 3 is 17
average number of affinization = 15.970481238956449
Path 191 | total_timesteps 2561.
number of affinization with epsilon = 3 is 10
average number of affinization = 15.96986073581376
Path 192 | total_timesteps 2574.
number of affinization with epsilon = 3 is 9
average number of affinization = 15.969136443936403
Path 193 | total_timesteps 2586.
number of affinization with epsilon = 3 is 8
average number of affinization = 15.968308395677473
Path 194 | total_timesteps 2595.
number of affinization with epsilon = 3 is 8
average number of affinization = 15.96748051948052
Path 195 | total_timesteps 2605.
number of affinization with epsilon = 3 is 14
average number of affinization = 15.96727612715562
Path 196 | total_timesteps 2623.
number of affinization with epsilon = 3 is 16
average number of affinization = 15.96727952633219
Path 197 | total_timesteps 2641.
number of affinization with epsilon = 3 is 5
average number of affinization = 15.966140423764022
Path 198 | total_timesteps 2648.
number of affinization with epsilon = 3 is 11
average number of affinization = 15.96562467545955
Path 199 | total_timesteps 2666.
number of affinization with epsilon = 3 is 12
average number of affinization = 15.96521287642783
Path 200 | total_timesteps 2681.
number of affinization with epsilon = 3 is 12
average number of affinization = 15.964801162911431
Path 201 | total_timesteps 2694.
number of affinization with epsilon = 3 is 6
average number of affinization = 15.96376661129568
Path 202 | total_timesteps 2704.
number of affinization with epsilon = 3 is 12
average number of affinization = 15.96335513339562
Path 203 | total_timesteps 2717.
number of affinization with epsilon = 3 is 10
average number of affinization = 15.962736142827486
Path 204 | total_timesteps 2730.
number of affinization with epsilon = 3 is 15
average number of affinization = 15.962636222106902
Path 205 | total_timesteps 2750.
number of affinization with epsilon = 3 is 8
average number of affinization = 15.961809879618098
Path 206 | total_timesteps 2760.
number of affinization with epsilon = 3 is 7
average number of affinization = 15.96087994189063
Path 207 | total_timesteps 2770.
number of affinization with epsilon = 3 is 7
average number of affinization = 15.959950197136335
Path 208 | total_timesteps 2780.
number of affinization with epsilon = 3 is 11
average number of affinization = 15.959435626102293
Path 209 | total_timesteps 2792.
number of affinization with epsilon = 3 is 7
average number of affinization = 15.95850622406639
Path 210 | total_timesteps 2800.
number of affinization with epsilon = 3 is 10
average number of affinization = 15.957888185872834
Path 211 | total_timesteps 2814.
number of affinization with epsilon = 3 is 13
average number of affinization = 15.957581414644265
Path 212 | total_timesteps 2829.
number of affinization with epsilon = 3 is 7
average number of affinization = 15.956652494037126
Path 213 | total_timesteps 2839.
number of affinization with epsilon = 3 is 9
average number of affinization = 15.955931148900872
Path 214 | total_timesteps 2851.
number of affinization with epsilon = 3 is 11
average number of affinization = 15.955417314670814
Path 215 | total_timesteps 2867.
number of affinization with epsilon = 3 is 15
average number of affinization = 15.955318266639022
Path 216 | total_timesteps 2891.
number of affinization with epsilon = 3 is 12
average number of affinization = 15.954908261635742
Path 217 | total_timesteps 2906.
number of affinization with epsilon = 3 is 9
average number of affinization = 15.954187396351575
Path 218 | total_timesteps 2916.
number of affinization with epsilon = 3 is 4
average number of affinization = 15.952948492071718
Path 219 | total_timesteps 2926.
number of affinization with epsilon = 3 is 6
average number of affinization = 15.951917098445596
Path 220 | total_timesteps 2935.
number of affinization with epsilon = 3 is 11
average number of affinization = 15.951403999585535
Path 221 | total_timesteps 2950.
number of affinization with epsilon = 3 is 8
average number of affinization = 15.950580190634065
Path 222 | total_timesteps 2962.
number of affinization with epsilon = 3 is 6
average number of affinization = 15.949549362892364
Path 223 | total_timesteps 2970.
number of affinization with epsilon = 3 is 10
average number of affinization = 15.948933084731717
Path 224 | total_timesteps 2983.
number of affinization with epsilon = 3 is 6
average number of affinization = 15.947902641118592
Path 225 | total_timesteps 2991.
number of affinization with epsilon = 3 is 8
average number of affinization = 15.947079536039768
Path 226 | total_timesteps 3001.
number of affinization with epsilon = 3 is 6
average number of affinization = 15.946049497773636
Path 227 | total_timesteps 3009.
number of affinization with epsilon = 3 is 13
average number of affinization = 15.945744460550838
Path 228 | total_timesteps 3023.
number of affinization with epsilon = 3 is 6
average number of affinization = 15.944714773786107
Path 229 | total_timesteps 3033.
number of affinization with epsilon = 3 is 5
average number of affinization = 15.943581780538302
Path 230 | total_timesteps 3040.
number of affinization with epsilon = 3 is 16
average number of affinization = 15.943587620329158
Path 231 | total_timesteps 3060.
number of affinization with epsilon = 3 is 7
average number of affinization = 15.942661974746429
Path 232 | total_timesteps 3070.
number of affinization with epsilon = 3 is 8
average number of affinization = 15.941840008279001
Path 233 | total_timesteps 3079.
number of affinization with epsilon = 3 is 8
average number of affinization = 15.94101821192053
Path 234 | total_timesteps 3091.
number of affinization with epsilon = 3 is 8
average number of affinization = 15.94019658561821
Path 235 | total_timesteps 3100.
number of affinization with epsilon = 3 is 13
average number of affinization = 15.939892406372854
Path 236 | total_timesteps 3115.
number of affinization with epsilon = 3 is 12
average number of affinization = 15.93948484535016
Path 237 | total_timesteps 3129.
number of affinization with epsilon = 3 is 11
average number of affinization = 15.938973934629706
Path 238 | total_timesteps 3143.
number of affinization with epsilon = 3 is 16
average number of affinization = 15.938980246147482
Path 239 | total_timesteps 3163.
number of affinization with epsilon = 3 is 29
average number of affinization = 15.940330920372286
Path 240 | total_timesteps 3196.
number of affinization with epsilon = 3 is 9
average number of affinization = 15.939613276806949
Path 241 | total_timesteps 3207.
number of affinization with epsilon = 3 is 8
average number of affinization = 15.938792390405293
Path 242 | total_timesteps 3219.
number of affinization with epsilon = 3 is 10
average number of affinization = 15.938178434818568
Path 243 | total_timesteps 3230.
number of affinization with epsilon = 3 is 8
average number of affinization = 15.937357866446144
Path 244 | total_timesteps 3239.
number of affinization with epsilon = 3 is 13
average number of affinization = 15.93705426356589
Path 245 | total_timesteps 3259.
number of affinization with epsilon = 3 is 10
average number of affinization = 15.936440677966102
Path 246 | total_timesteps 3271.
number of affinization with epsilon = 3 is 12
average number of affinization = 15.936033894802108
Path 247 | total_timesteps 3287.
number of affinization with epsilon = 3 is 8
average number of affinization = 15.93521388716677
Path 248 | total_timesteps 3297.
number of affinization with epsilon = 3 is 10
average number of affinization = 15.934600681888625
Path 249 | total_timesteps 3310.
number of affinization with epsilon = 3 is 10
average number of affinization = 15.933987603305786
Path 250 | total_timesteps 3324.
number of affinization with epsilon = 3 is 8
average number of affinization = 15.933168061150708
Path 251 | total_timesteps 3337.
number of affinization with epsilon = 3 is 15
average number of affinization = 15.933071679405082
Path 252 | total_timesteps 3353.
number of affinization with epsilon = 3 is 9
average number of affinization = 15.932355674894144
Path 253 | total_timesteps 3366.
number of affinization with epsilon = 3 is 8
average number of affinization = 15.931536555142504
Path 254 | total_timesteps 3377.
number of affinization with epsilon = 3 is 8
average number of affinization = 15.930717604543108
Path 255 | total_timesteps 3386.
number of affinization with epsilon = 3 is 8
average number of affinization = 15.929898823043567
Path 256 | total_timesteps 3396.
number of affinization with epsilon = 3 is 7
average number of affinization = 15.928976979457005
Path 257 | total_timesteps 3404.
number of affinization with epsilon = 3 is 20
average number of affinization = 15.929397192402973
Path 258 | total_timesteps 3428.
number of affinization with epsilon = 3 is 7
average number of affinization = 15.928475590876252
Path 259 | total_timesteps 3436.
number of affinization with epsilon = 3 is 14
average number of affinization = 15.928276573787409
Path 260 | total_timesteps 3454.
number of affinization with epsilon = 3 is 6
average number of affinization = 15.92725208956764
Path 261 | total_timesteps 3464.
number of affinization with epsilon = 3 is 17
average number of affinization = 15.927362773421379
Path 262 | total_timesteps 3485.
number of affinization with epsilon = 3 is 8
average number of affinization = 15.926544929330445
Path 263 | total_timesteps 3495.
number of affinization with epsilon = 3 is 7
average number of affinization = 15.925624097379822
Path 264 | total_timesteps 3503.
number of affinization with epsilon = 3 is 7
average number of affinization = 15.924703455389375
Path 265 | total_timesteps 3515.
number of affinization with epsilon = 3 is 9
average number of affinization = 15.923989273927393
Path 266 | total_timesteps 3525.
number of affinization with epsilon = 3 is 6
average number of affinization = 15.922965865731669
Path 267 | total_timesteps 3533.
number of affinization with epsilon = 3 is 20
average number of affinization = 15.923386265209322
Path 268 | total_timesteps 3554.
number of affinization with epsilon = 3 is 7
average number of affinization = 15.922466233632333
Path 269 | total_timesteps 3564.
number of affinization with epsilon = 3 is 12
average number of affinization = 15.922061855670103
Path 270 | total_timesteps 3578.
number of affinization with epsilon = 3 is 5
average number of affinization = 15.920935985980826
Path 271 | total_timesteps 3585.
number of affinization with epsilon = 3 is 8
average number of affinization = 15.920119562976707
Path 272 | total_timesteps 3594.
number of affinization with epsilon = 3 is 12
average number of affinization = 15.919715551891167
Path 273 | total_timesteps 3609.
number of affinization with epsilon = 3 is 7
average number of affinization = 15.918796372629844
Path 274 | total_timesteps 3619.
number of affinization with epsilon = 3 is 7
average number of affinization = 15.917877382792375
Path 275 | total_timesteps 3629.
number of affinization with epsilon = 3 is 8
average number of affinization = 15.917061611374407
Path 276 | total_timesteps 3638.
number of affinization with epsilon = 3 is 9
average number of affinization = 15.91634902647574
Path 277 | total_timesteps 3649.
number of affinization with epsilon = 3 is 9
average number of affinization = 15.915636588380718
Path 278 | total_timesteps 3662.
number of affinization with epsilon = 3 is 10
average number of affinization = 15.915027294263055
Path 279 | total_timesteps 3673.
number of affinization with epsilon = 3 is 7
average number of affinization = 15.914109165808444
Path 280 | total_timesteps 3682.
number of affinization with epsilon = 3 is 17
average number of affinization = 15.914220986510143
Path 281 | total_timesteps 3701.
number of affinization with epsilon = 3 is 9
average number of affinization = 15.91350906095552
Path 282 | total_timesteps 3713.
number of affinization with epsilon = 3 is 9
average number of affinization = 15.912797281993205
Path 283 | total_timesteps 3724.
number of affinization with epsilon = 3 is 14
average number of affinization = 15.912600370599135
Path 284 | total_timesteps 3742.
number of affinization with epsilon = 3 is 10
average number of affinization = 15.911991765311374
Path 285 | total_timesteps 3755.
number of affinization with epsilon = 3 is 9
average number of affinization = 15.911280362289007
Path 286 | total_timesteps 3768.
number of affinization with epsilon = 3 is 12
average number of affinization = 15.910877842955644
Path 287 | total_timesteps 3782.
number of affinization with epsilon = 3 is 5
average number of affinization = 15.909755093640667
Path 288 | total_timesteps 3791.
number of affinization with epsilon = 3 is 9
average number of affinization = 15.909044140343656
Path 289 | total_timesteps 3802.
number of affinization with epsilon = 3 is 11
average number of affinization = 15.908539094650205
Path 290 | total_timesteps 3818.
number of affinization with epsilon = 3 is 12
average number of affinization = 15.908137022940027
Path 291 | total_timesteps 3832.
number of affinization with epsilon = 3 is 11
average number of affinization = 15.907632174449702
Path 292 | total_timesteps 3845.
number of affinization with epsilon = 3 is 9
average number of affinization = 15.906921731975727
Path 293 | total_timesteps 3856.
number of affinization with epsilon = 3 is 7
average number of affinization = 15.906005758946936
Path 294 | total_timesteps 3865.
number of affinization with epsilon = 3 is 5
average number of affinization = 15.904884318766067
Path 295 | total_timesteps 3872.
number of affinization with epsilon = 3 is 8
average number of affinization = 15.90407156076496
Path 296 | total_timesteps 3882.
number of affinization with epsilon = 3 is 6
average number of affinization = 15.903053356636168
Path 297 | total_timesteps 3891.
number of affinization with epsilon = 3 is 10
average number of affinization = 15.902446546052632
Path 298 | total_timesteps 3903.
number of affinization with epsilon = 3 is 9
average number of affinization = 15.901737074725048
Path 299 | total_timesteps 3916.
number of affinization with epsilon = 3 is 8
average number of affinization = 15.90092497430627
Path 300 | total_timesteps 3925.
number of affinization with epsilon = 3 is 7
average number of affinization = 15.900010276436133
Path 301 | total_timesteps 3939.
number of affinization with epsilon = 3 is 13
average number of affinization = 15.899712289354706
Path 302 | total_timesteps 3953.
number of affinization with epsilon = 3 is 8
average number of affinization = 15.89890064728244
Path 303 | total_timesteps 3965.
number of affinization with epsilon = 3 is 6
average number of affinization = 15.897883706595438
Path 304 | total_timesteps 3975.
number of affinization with epsilon = 3 is 6
average number of affinization = 15.896866974833076
Path 305 | total_timesteps 3985.
number of affinization with epsilon = 3 is 9
average number of affinization = 15.896158586688578
Path 306 | total_timesteps 4000.
number of affinization with epsilon = 3 is 7
average number of affinization = 15.895244941973914
Path 307 | total_timesteps 4010.
number of affinization with epsilon = 3 is 10
average number of affinization = 15.89463955637708
Path 308 | total_timesteps 4021.
number of affinization with epsilon = 3 is 9
average number of affinization = 15.89393161515556
Path 309 | total_timesteps 4036.
number of affinization with epsilon = 3 is 14
average number of affinization = 15.893737166324435
Path 310 | total_timesteps 4057.
number of affinization with epsilon = 3 is 8
average number of affinization = 15.892926804229544
Path 311 | total_timesteps 4067.
number of affinization with epsilon = 3 is 10
average number of affinization = 15.892321905152945
Path 312 | total_timesteps 4079.
number of affinization with epsilon = 3 is 10
average number of affinization = 15.891717130247358
Path 313 | total_timesteps 4092.
number of affinization with epsilon = 3 is 10
average number of affinization = 15.891112479474549
Path 314 | total_timesteps 4105.
number of affinization with epsilon = 3 is 6
average number of affinization = 15.8900974858902
Path 315 | total_timesteps 4113.
number of affinization with epsilon = 3 is 12
average number of affinization = 15.889698337779603
Path 316 | total_timesteps 4127.
number of affinization with epsilon = 3 is 8
average number of affinization = 15.88888888888889
Path 317 | total_timesteps 4136.
number of affinization with epsilon = 3 is 12
average number of affinization = 15.888489946655724
Path 318 | total_timesteps 4152.
number of affinization with epsilon = 3 is 8
average number of affinization = 15.887680787773105
Path 319 | total_timesteps 4161.
number of affinization with epsilon = 3 is 17
average number of affinization = 15.887794871794872
Path 320 | total_timesteps 4180.
number of affinization with epsilon = 3 is 7
average number of affinization = 15.88688339657471
Path 321 | total_timesteps 4188.
number of affinization with epsilon = 3 is 6
average number of affinization = 15.88586956521739
Path 322 | total_timesteps 4197.
number of affinization with epsilon = 3 is 8
average number of affinization = 15.88506100686968
Path 323 | total_timesteps 4206.
number of affinization with epsilon = 3 is 8
average number of affinization = 15.884252614312077
Path 324 | total_timesteps 4217.
number of affinization with epsilon = 3 is 7
average number of affinization = 15.883341875961046
Path 325 | total_timesteps 4229.
number of affinization with epsilon = 3 is 10
average number of affinization = 15.882738827388273
Path 326 | total_timesteps 4243.
number of affinization with epsilon = 3 is 13
average number of affinization = 15.882443373987906
Path 327 | total_timesteps 4258.
number of affinization with epsilon = 3 is 14
average number of affinization = 15.882250461160075
Path 328 | total_timesteps 4275.
number of affinization with epsilon = 3 is 6
average number of affinization = 15.881237831745056
Path 329 | total_timesteps 4283.
number of affinization with epsilon = 3 is 8
average number of affinization = 15.880430327868853
Path 330 | total_timesteps 4294.
number of affinization with epsilon = 3 is 6
average number of affinization = 15.879418092408565
Path 331 | total_timesteps 4303.
number of affinization with epsilon = 3 is 11
average number of affinization = 15.878918254456053
Path 332 | total_timesteps 4319.
number of affinization with epsilon = 3 is 10
average number of affinization = 15.87831609136536
Path 333 | total_timesteps 4333.
number of affinization with epsilon = 3 is 9
average number of affinization = 15.877611634575993
Path 334 | total_timesteps 4344.
number of affinization with epsilon = 3 is 9
average number of affinization = 15.876907322068613
Path 335 | total_timesteps 4355.
number of affinization with epsilon = 3 is 12
average number of affinization = 15.876510342002867
Path 336 | total_timesteps 4369.
number of affinization with epsilon = 3 is 15
average number of affinization = 15.876420599979523
Path 337 | total_timesteps 4388.
number of affinization with epsilon = 3 is 7
average number of affinization = 15.875511875511876
Path 338 | total_timesteps 4398.
number of affinization with epsilon = 3 is 12
average number of affinization = 15.875115160200634
Path 339 | total_timesteps 4413.
number of affinization with epsilon = 3 is 9
average number of affinization = 15.874411463664279
Path 340 | total_timesteps 4425.
number of affinization with epsilon = 3 is 6
average number of affinization = 15.873400880155563
Path 341 | total_timesteps 4436.
number of affinization with epsilon = 3 is 9
average number of affinization = 15.872697503069995
Path 342 | total_timesteps 4449.
number of affinization with epsilon = 3 is 6
average number of affinization = 15.871687301749718
Path 343 | total_timesteps 4460.
number of affinization with epsilon = 3 is 8
average number of affinization = 15.870881931655413
Path 344 | total_timesteps 4471.
number of affinization with epsilon = 3 is 9
average number of affinization = 15.870179028132993
Path 345 | total_timesteps 4483.
number of affinization with epsilon = 3 is 14
average number of affinization = 15.869987725040916
Path 346 | total_timesteps 4501.
number of affinization with epsilon = 3 is 11
average number of affinization = 15.86948961849238
Path 347 | total_timesteps 4517.
number of affinization with epsilon = 3 is 14
average number of affinization = 15.869298425035794
Path 348 | total_timesteps 4536.
number of affinization with epsilon = 3 is 5
average number of affinization = 15.868186931179057
Path 349 | total_timesteps 4544.
number of affinization with epsilon = 3 is 8
average number of affinization = 15.867382413087935
Path 350 | total_timesteps 4558.
number of affinization with epsilon = 3 is 10
average number of affinization = 15.866782537572846
Path 351 | total_timesteps 4569.
number of affinization with epsilon = 3 is 10
average number of affinization = 15.866182784706604
Path 352 | total_timesteps 4581.
number of affinization with epsilon = 3 is 14
average number of affinization = 15.865992026985587
Path 353 | total_timesteps 4599.
number of affinization with epsilon = 3 is 6
average number of affinization = 15.864983646770238
Path 354 | total_timesteps 4606.
number of affinization with epsilon = 3 is 18
average number of affinization = 15.865201839550332
Path 355 | total_timesteps 4628.
number of affinization with epsilon = 3 is 4
average number of affinization = 15.863989372573064
Path 356 | total_timesteps 4636.
number of affinization with epsilon = 3 is 6
average number of affinization = 15.862981506079493
Path 357 | total_timesteps 4644.
number of affinization with epsilon = 3 is 7
average number of affinization = 15.862076011442582
Path 358 | total_timesteps 4655.
number of affinization with epsilon = 3 is 12
average number of affinization = 15.86168147921136
Path 359 | total_timesteps 4671.
number of affinization with epsilon = 3 is 17
average number of affinization = 15.86179775280899
Path 360 | total_timesteps 4691.
number of affinization with epsilon = 3 is 7
average number of affinization = 15.860892656521296
Path 361 | total_timesteps 4701.
number of affinization with epsilon = 3 is 7
average number of affinization = 15.859987745098039
Path 362 | total_timesteps 4712.
number of affinization with epsilon = 3 is 10
average number of affinization = 15.859389359746757
Path 363 | total_timesteps 4723.
number of affinization with epsilon = 3 is 7
average number of affinization = 15.858484786604043
Path 364 | total_timesteps 4732.
number of affinization with epsilon = 3 is 8
average number of affinization = 15.857682491066871
Path 365 | total_timesteps 4742.
number of affinization with epsilon = 3 is 6
average number of affinization = 15.856676194365047
Path 366 | total_timesteps 4750.
number of affinization with epsilon = 3 is 21
average number of affinization = 15.85720118403593
Path 367 | total_timesteps 4773.
number of affinization with epsilon = 3 is 8
average number of affinization = 15.856399265156154
Path 368 | total_timesteps 4783.
number of affinization with epsilon = 3 is 9
average number of affinization = 15.855699561179712
Path 369 | total_timesteps 4795.
number of affinization with epsilon = 3 is 8
average number of affinization = 15.854897959183674
Path 370 | total_timesteps 4805.
number of affinization with epsilon = 3 is 7
average number of affinization = 15.853994490358128
Path 371 | total_timesteps 4815.
number of affinization with epsilon = 3 is 14
average number of affinization = 15.853805345847785
Path 372 | total_timesteps 4832.
number of affinization with epsilon = 3 is 12
average number of affinization = 15.85341222074875
Path 373 | total_timesteps 4846.
number of affinization with epsilon = 3 is 20
average number of affinization = 15.853835169318646
Path 374 | total_timesteps 4871.
number of affinization with epsilon = 3 is 6
average number of affinization = 15.852830188679246
Path 375 | total_timesteps 4879.
number of affinization with epsilon = 3 is 11
average number of affinization = 15.852335304915359
Path 376 | total_timesteps 4894.
number of affinization with epsilon = 3 is 7
average number of affinization = 15.851432650147853
Path 377 | total_timesteps 4903.
number of affinization with epsilon = 3 is 22
average number of affinization = 15.852059543230016
Path 378 | total_timesteps 4934.
number of affinization with epsilon = 3 is 13
average number of affinization = 15.851768783770007
Path 379 | total_timesteps 4948.
number of affinization with epsilon = 3 is 9
average number of affinization = 15.851070336391437
Path 380 | total_timesteps 4958.
number of affinization with epsilon = 3 is 11
average number of affinization = 15.8505758842116
Path 381 | total_timesteps 4971.
number of affinization with epsilon = 3 is 5
average number of affinization = 15.849470036689768
Path 382 | total_timesteps 4979.
number of affinization with epsilon = 3 is 7
average number of affinization = 15.848568225822888
Path 383 | total_timesteps 4989.
number of affinization with epsilon = 3 is 10
average number of affinization = 15.847972284491542
Path 384 | total_timesteps 5000.
number of affinization with epsilon = 3 is 7
average number of affinization = 15.847070809984718
Path 385 | total_timesteps 5009.
number of affinization with epsilon = 3 is 9
average number of affinization = 15.846373268133659
Path 386 | total_timesteps 5019.
number of affinization with epsilon = 3 is 11
average number of affinization = 15.845879596618111
Path 387 | total_timesteps 5035.
number of affinization with epsilon = 3 is 8
average number of affinization = 15.845080464453046
Path 388 | total_timesteps 5045.
number of affinization with epsilon = 3 is 9
average number of affinization = 15.844383338425502
Path 389 | total_timesteps 5056.
number of affinization with epsilon = 3 is 6
average number of affinization = 15.843380855397148
Path 390 | total_timesteps 5065.
number of affinization with epsilon = 3 is 16
average number of affinization = 15.843396802769576
Path 391 | total_timesteps 5085.
number of affinization with epsilon = 3 is 6
average number of affinization = 15.842394624312767
Path 392 | total_timesteps 5093.
number of affinization with epsilon = 3 is 6
average number of affinization = 15.841392649903288
Path 393 | total_timesteps 5104.
number of affinization with epsilon = 3 is 12
average number of affinization = 15.841001628664495
Path 394 | total_timesteps 5120.
number of affinization with epsilon = 3 is 7
average number of affinization = 15.840101781170484
Path 395 | total_timesteps 5133.
number of affinization with epsilon = 3 is 9
average number of affinization = 15.839405658457155
Path 396 | total_timesteps 5146.
number of affinization with epsilon = 3 is 5
average number of affinization = 15.838302635595808
Path 397 | total_timesteps 5154.
number of affinization with epsilon = 3 is 8
average number of affinization = 15.837505087505088
Path 398 | total_timesteps 5164.
number of affinization with epsilon = 3 is 9
average number of affinization = 15.836809441448773
Path 399 | total_timesteps 5175.
number of affinization with epsilon = 3 is 8
average number of affinization = 15.836012207527975
Path 400 | total_timesteps 5185.
number of affinization with epsilon = 3 is 8
average number of affinization = 15.835215135794934
Path 401 | total_timesteps 5196.
number of affinization with epsilon = 3 is 9
average number of affinization = 15.834519934906428
Path 402 | total_timesteps 5207.
number of affinization with epsilon = 3 is 11
average number of affinization = 15.834028272144819
Path 403 | total_timesteps 5222.
number of affinization with epsilon = 3 is 8
average number of affinization = 15.833231645312182
Path 404 | total_timesteps 5231.
number of affinization with epsilon = 3 is 19
average number of affinization = 15.833553634977122
Path 405 | total_timesteps 5253.
number of affinization with epsilon = 3 is 8
average number of affinization = 15.832757218381456
Path 406 | total_timesteps 5263.
number of affinization with epsilon = 3 is 28
average number of affinization = 15.833994103893463
Path 407 | total_timesteps 5296.
number of affinization with epsilon = 3 is 9
average number of affinization = 15.83329945110795
Path 408 | total_timesteps 5307.
number of affinization with epsilon = 3 is 11
average number of affinization = 15.832808212216689
Path 409 | total_timesteps 5320.
number of affinization with epsilon = 3 is 11
average number of affinization = 15.832317073170731
Path 410 | total_timesteps 5332.
number of affinization with epsilon = 3 is 7
average number of affinization = 15.83141957118179
Path 411 | total_timesteps 5342.
number of affinization with epsilon = 3 is 17
average number of affinization = 15.831538305222516
Path 412 | total_timesteps 5362.
number of affinization with epsilon = 3 is 5
average number of affinization = 15.830437874631718
Path 413 | total_timesteps 5369.
number of affinization with epsilon = 3 is 9
average number of affinization = 15.829744006501421
Path 414 | total_timesteps 5380.
number of affinization with epsilon = 3 is 4
average number of affinization = 15.828542407313357
Path 415 | total_timesteps 5387.
number of affinization with epsilon = 3 is 10
average number of affinization = 15.827950436725574
Path 416 | total_timesteps 5399.
number of affinization with epsilon = 3 is 6
average number of affinization = 15.826952371280592
Path 417 | total_timesteps 5410.
number of affinization with epsilon = 3 is 10
average number of affinization = 15.826360682372055
Path 418 | total_timesteps 5422.
number of affinization with epsilon = 3 is 10
average number of affinization = 15.825769113615596
Path 419 | total_timesteps 5434.
number of affinization with epsilon = 3 is 15
average number of affinization = 15.825685279187818
Path 420 | total_timesteps 5453.
number of affinization with epsilon = 3 is 4
average number of affinization = 15.824484823875748
Path 421 | total_timesteps 5460.
number of affinization with epsilon = 3 is 6
average number of affinization = 15.823487616727569
Path 422 | total_timesteps 5469.
number of affinization with epsilon = 3 is 6
average number of affinization = 15.822490611996347
Path 423 | total_timesteps 5477.
number of affinization with epsilon = 3 is 8
average number of affinization = 15.821696772884108
Path 424 | total_timesteps 5488.
number of affinization with epsilon = 3 is 8
average number of affinization = 15.820903094875698
Path 425 | total_timesteps 5499.
number of affinization with epsilon = 3 is 7
average number of affinization = 15.820008116883116
Path 426 | total_timesteps 5509.
number of affinization with epsilon = 3 is 7
average number of affinization = 15.819113320482906
Path 427 | total_timesteps 5520.
number of affinization with epsilon = 3 is 12
average number of affinization = 15.818725907892068
Path 428 | total_timesteps 5533.
number of affinization with epsilon = 3 is 6
average number of affinization = 15.817729992899888
Path 429 | total_timesteps 5541.
number of affinization with epsilon = 3 is 6
average number of affinization = 15.816734279918863
Path 430 | total_timesteps 5549.
number of affinization with epsilon = 3 is 5
average number of affinization = 15.81563735929419
Path 431 | total_timesteps 5555.
number of affinization with epsilon = 3 is 5
average number of affinization = 15.814540661123504
Path 432 | total_timesteps 5563.
number of affinization with epsilon = 3 is 12
average number of affinization = 15.814153908547095
Path 433 | total_timesteps 5577.
number of affinization with epsilon = 3 is 7
average number of affinization = 15.813260340632603
Path 434 | total_timesteps 5585.
number of affinization with epsilon = 3 is 12
average number of affinization = 15.812873796249367
Path 435 | total_timesteps 5599.
number of affinization with epsilon = 3 is 9
average number of affinization = 15.81218325562538
Path 436 | total_timesteps 5612.
number of affinization with epsilon = 3 is 9
average number of affinization = 15.811492854971116
Path 437 | total_timesteps 5622.
number of affinization with epsilon = 3 is 8
average number of affinization = 15.810701256586947
Path 438 | total_timesteps 5632.
number of affinization with epsilon = 3 is 14
average number of affinization = 15.810517782956733
Path 439 | total_timesteps 5649.
number of affinization with epsilon = 3 is 12
average number of affinization = 15.810131712259372
Path 440 | total_timesteps 5665.
number of affinization with epsilon = 3 is 8
average number of affinization = 15.809340492351332
Path 441 | total_timesteps 5677.
number of affinization with epsilon = 3 is 14
average number of affinization = 15.809157212317666
Path 442 | total_timesteps 5695.
number of affinization with epsilon = 3 is 12
average number of affinization = 15.80877139673858
Path 443 | total_timesteps 5709.
number of affinization with epsilon = 3 is 18
average number of affinization = 15.808993315778814
Path 444 | total_timesteps 5728.
number of affinization with epsilon = 3 is 14
average number of affinization = 15.808810126582278
Path 445 | total_timesteps 5749.
number of affinization with epsilon = 3 is 17
average number of affinization = 15.808930741190766
Path 446 | total_timesteps 5767.
number of affinization with epsilon = 3 is 8
average number of affinization = 15.808140123519287
Path 447 | total_timesteps 5779.
number of affinization with epsilon = 3 is 8
average number of affinization = 15.807349665924276
Path 448 | total_timesteps 5788.
number of affinization with epsilon = 3 is 7
average number of affinization = 15.806458143536796
Path 449 | total_timesteps 5796.
number of affinization with epsilon = 3 is 23
average number of affinization = 15.807186234817813
Path 450 | total_timesteps 5821.
number of affinization with epsilon = 3 is 12
average number of affinization = 15.80680093107985
Path 451 | total_timesteps 5834.
number of affinization with epsilon = 3 is 7
average number of affinization = 15.805909734871484
Path 452 | total_timesteps 5846.
number of affinization with epsilon = 3 is 14
average number of affinization = 15.805727005969848
Path 453 | total_timesteps 5863.
number of affinization with epsilon = 3 is 8
average number of affinization = 15.80493727235937
Path 454 | total_timesteps 5875.
number of affinization with epsilon = 3 is 9
average number of affinization = 15.804248861911988
Path 455 | total_timesteps 5885.
number of affinization with epsilon = 3 is 6
average number of affinization = 15.803257131296784
Path 456 | total_timesteps 5893.
number of affinization with epsilon = 3 is 7
average number of affinization = 15.802366744209568
Path 457 | total_timesteps 5903.
number of affinization with epsilon = 3 is 16
average number of affinization = 15.802386731391586
Path 458 | total_timesteps 5924.
number of affinization with epsilon = 3 is 11
average number of affinization = 15.801901102234806
Path 459 | total_timesteps 5939.
number of affinization with epsilon = 3 is 11
average number of affinization = 15.801415571284126
Path 460 | total_timesteps 5954.
number of affinization with epsilon = 3 is 16
average number of affinization = 15.801435648569406
Path 461 | total_timesteps 5973.
number of affinization with epsilon = 3 is 11
average number of affinization = 15.800950262838658
Path 462 | total_timesteps 5986.
number of affinization with epsilon = 3 is 8
average number of affinization = 15.800161730516527
Path 463 | total_timesteps 5997.
number of affinization with epsilon = 3 is 13
average number of affinization = 15.799878714372348
Done generating on-policy rollouts.
Updating normalization.
Done updating normalization.
----------------------------
| AverageReturn | -5.9     |
| Iteration     | 31       |
| MaximumReturn | 12       |
| MinimumReturn | -16      |
| TotalSamples  | 132298   |
----------------------------
itr #32 | 
Fitting dynamics.
Fitting model 0 (0-based) in the ensemble of 2 models
Validation loss = 0.01235766988247633
Validation loss = 0.012236249633133411
Validation loss = 0.012859663926064968
Validation loss = 0.01194041222333908
Validation loss = 0.011974352411925793
Validation loss = 0.012018617242574692
Validation loss = 0.011977391317486763
Validation loss = 0.012159379199147224
Fitting model 1 (0-based) in the ensemble of 2 models
Validation loss = 0.011517437174916267
Validation loss = 0.011997612193226814
Validation loss = 0.01172570139169693
Validation loss = 0.011691011488437653
Validation loss = 0.011524404399096966
Done fitting dynamics.
Updating randomness.
Done updating randomness.
Training policy using TRPO.
Re-initialize init_std.
Obtaining samples for iteration 0...
Obtaining samples for iteration 1...
Obtaining samples for iteration 2...
Obtaining samples for iteration 3...
Obtaining samples for iteration 4...
Obtaining samples for iteration 5...
Obtaining samples for iteration 6...
Obtaining samples for iteration 7...
Obtaining samples for iteration 8...
Obtaining samples for iteration 9...
Obtaining samples for iteration 10...
Obtaining samples for iteration 11...
Obtaining samples for iteration 12...
Obtaining samples for iteration 13...
Obtaining samples for iteration 14...
Obtaining samples for iteration 15...
Obtaining samples for iteration 16...
Obtaining samples for iteration 17...
Obtaining samples for iteration 18...
Obtaining samples for iteration 19...
Done training policy.
Generating on-policy rollouts.
Path 0 | total_timesteps 0.
number of affinization with epsilon = 3 is 13
average number of affinization = 15.799595755432037
Path 1 | total_timesteps 14.
number of affinization with epsilon = 3 is 12
average number of affinization = 15.799211802748585
Path 2 | total_timesteps 29.
number of affinization with epsilon = 3 is 7
average number of affinization = 15.798322724057796
Path 3 | total_timesteps 39.
number of affinization with epsilon = 3 is 5
average number of affinization = 15.797231763992725
Path 4 | total_timesteps 47.
number of affinization with epsilon = 3 is 11
average number of affinization = 15.796747146176381
Path 5 | total_timesteps 60.
number of affinization with epsilon = 3 is 12
average number of affinization = 15.796363636363637
Path 6 | total_timesteps 74.
number of affinization with epsilon = 3 is 5
average number of affinization = 15.795273204726795
Path 7 | total_timesteps 83.
number of affinization with epsilon = 3 is 9
average number of affinization = 15.794586952130883
Path 8 | total_timesteps 95.
number of affinization with epsilon = 3 is 10
average number of affinization = 15.79400181763102
Path 9 | total_timesteps 107.
number of affinization with epsilon = 3 is 7
average number of affinization = 15.793113893376413
Path 10 | total_timesteps 116.
number of affinization with epsilon = 3 is 8
average number of affinization = 15.792327107521453
Path 11 | total_timesteps 128.
number of affinization with epsilon = 3 is 8
average number of affinization = 15.791540480516858
Path 12 | total_timesteps 137.
number of affinization with epsilon = 3 is 18
average number of affinization = 15.791763399616432
Path 13 | total_timesteps 157.
number of affinization with epsilon = 3 is 10
average number of affinization = 15.791178845377473
Path 14 | total_timesteps 168.
number of affinization with epsilon = 3 is 7
average number of affinization = 15.790291654051872
Path 15 | total_timesteps 179.
number of affinization with epsilon = 3 is 10
average number of affinization = 15.78970736629667
Path 16 | total_timesteps 192.
number of affinization with epsilon = 3 is 8
average number of affinization = 15.788921400464131
Path 17 | total_timesteps 201.
number of affinization with epsilon = 3 is 5
average number of affinization = 15.787832929782082
Path 18 | total_timesteps 209.
number of affinization with epsilon = 3 is 6
average number of affinization = 15.78684555634016
Path 19 | total_timesteps 218.
number of affinization with epsilon = 3 is 11
average number of affinization = 15.786362719386727
Path 20 | total_timesteps 236.
number of affinization with epsilon = 3 is 9
average number of affinization = 15.785678265254665
Path 21 | total_timesteps 246.
number of affinization with epsilon = 3 is 8
average number of affinization = 15.784893102057282
Path 22 | total_timesteps 257.
number of affinization with epsilon = 3 is 7
average number of affinization = 15.784007260260159
Path 23 | total_timesteps 270.
number of affinization with epsilon = 3 is 8
average number of affinization = 15.783222423875781
Path 24 | total_timesteps 280.
number of affinization with epsilon = 3 is 8
average number of affinization = 15.782437745740499
Path 25 | total_timesteps 292.
number of affinization with epsilon = 3 is 20
average number of affinization = 15.782862903225807
Path 26 | total_timesteps 317.
number of affinization with epsilon = 3 is 5
average number of affinization = 15.781776030642073
Path 27 | total_timesteps 324.
number of affinization with epsilon = 3 is 10
average number of affinization = 15.781193307800846
Path 28 | total_timesteps 341.
number of affinization with epsilon = 3 is 11
average number of affinization = 15.780711478383553
Path 29 | total_timesteps 355.
number of affinization with epsilon = 3 is 5
average number of affinization = 15.77962515114873
Path 30 | total_timesteps 362.
number of affinization with epsilon = 3 is 16
average number of affinization = 15.779647355163728
Path 31 | total_timesteps 381.
number of affinization with epsilon = 3 is 13
average number of affinization = 15.779367318154343
Path 32 | total_timesteps 397.
number of affinization with epsilon = 3 is 9
average number of affinization = 15.778684396091467
Path 33 | total_timesteps 408.
number of affinization with epsilon = 3 is 11
average number of affinization = 15.778203062046737
Path 34 | total_timesteps 422.
number of affinization with epsilon = 3 is 9
average number of affinization = 15.777520394803101
Path 35 | total_timesteps 433.
number of affinization with epsilon = 3 is 11
average number of affinization = 15.777039274924471
Path 36 | total_timesteps 448.
number of affinization with epsilon = 3 is 17
average number of affinization = 15.77716242070285
Path 37 | total_timesteps 469.
number of affinization with epsilon = 3 is 6
average number of affinization = 15.776178010471204
Path 38 | total_timesteps 477.
number of affinization with epsilon = 3 is 9
average number of affinization = 15.77549582200745
Path 39 | total_timesteps 487.
number of affinization with epsilon = 3 is 9
average number of affinization = 15.77481377088786
Path 40 | total_timesteps 499.
number of affinization with epsilon = 3 is 9
average number of affinization = 15.77413185707096
Path 41 | total_timesteps 512.
number of affinization with epsilon = 3 is 7
average number of affinization = 15.77324879227053
Path 42 | total_timesteps 521.
number of affinization with epsilon = 3 is 7
average number of affinization = 15.772365905202777
Path 43 | total_timesteps 529.
number of affinization with epsilon = 3 is 7
average number of affinization = 15.771483195814048
Path 44 | total_timesteps 538.
number of affinization with epsilon = 3 is 8
average number of affinization = 15.770701277794547
Path 45 | total_timesteps 549.
number of affinization with epsilon = 3 is 12
average number of affinization = 15.770321931589537
Path 46 | total_timesteps 565.
number of affinization with epsilon = 3 is 11
average number of affinization = 15.769842068202394
Path 47 | total_timesteps 577.
number of affinization with epsilon = 3 is 15
average number of affinization = 15.769764634882318
Path 48 | total_timesteps 594.
number of affinization with epsilon = 3 is 8
average number of affinization = 15.768983204264307
Path 49 | total_timesteps 605.
number of affinization with epsilon = 3 is 5
average number of affinization = 15.767900241351569
Path 50 | total_timesteps 614.
number of affinization with epsilon = 3 is 6
average number of affinization = 15.766918049270991
Path 51 | total_timesteps 624.
number of affinization with epsilon = 3 is 10
average number of affinization = 15.766338226422683
Path 52 | total_timesteps 638.
number of affinization with epsilon = 3 is 7
average number of affinization = 15.76545692168493
Path 53 | total_timesteps 647.
number of affinization with epsilon = 3 is 10
average number of affinization = 15.764877362283876
Path 54 | total_timesteps 660.
number of affinization with epsilon = 3 is 9
average number of affinization = 15.76419740677455
Path 55 | total_timesteps 671.
number of affinization with epsilon = 3 is 6
average number of affinization = 15.76321608040201
Path 56 | total_timesteps 678.
number of affinization with epsilon = 3 is 14
average number of affinization = 15.763038890563763
Path 57 | total_timesteps 697.
number of affinization with epsilon = 3 is 29
average number of affinization = 15.764368971061094
Path 58 | total_timesteps 727.
number of affinization with epsilon = 3 is 9
average number of affinization = 15.763689339897518
Path 59 | total_timesteps 738.
number of affinization with epsilon = 3 is 7
average number of affinization = 15.762808921036768
Path 60 | total_timesteps 747.
number of affinization with epsilon = 3 is 10
average number of affinization = 15.762230035158211
Path 61 | total_timesteps 759.
number of affinization with epsilon = 3 is 14
average number of affinization = 15.762053033346726
Path 62 | total_timesteps 775.
number of affinization with epsilon = 3 is 7
average number of affinization = 15.761173044089585
Path 63 | total_timesteps 785.
number of affinization with epsilon = 3 is 14
average number of affinization = 15.760996183972685
Path 64 | total_timesteps 802.
number of affinization with epsilon = 3 is 6
average number of affinization = 15.760016065870067
Path 65 | total_timesteps 810.
number of affinization with epsilon = 3 is 10
average number of affinization = 15.759437751004016
Path 66 | total_timesteps 823.
number of affinization with epsilon = 3 is 8
average number of affinization = 15.75865876919988
Path 67 | total_timesteps 833.
number of affinization with epsilon = 3 is 6
average number of affinization = 15.757679180887372
Path 68 | total_timesteps 842.
number of affinization with epsilon = 3 is 7
average number of affinization = 15.7568001605942
Path 69 | total_timesteps 851.
number of affinization with epsilon = 3 is 6
average number of affinization = 15.755820955439582
Path 70 | total_timesteps 863.
number of affinization with epsilon = 3 is 6
average number of affinization = 15.754841946813848
Path 71 | total_timesteps 871.
number of affinization with epsilon = 3 is 10
average number of affinization = 15.754264499297612
Path 72 | total_timesteps 885.
number of affinization with epsilon = 3 is 13
average number of affinization = 15.753988160931073
Path 73 | total_timesteps 902.
number of affinization with epsilon = 3 is 5
average number of affinization = 15.752909309791333
Path 74 | total_timesteps 910.
number of affinization with epsilon = 3 is 13
average number of affinization = 15.752633162804695
Path 75 | total_timesteps 924.
number of affinization with epsilon = 3 is 10
average number of affinization = 15.752056168505517
Path 76 | total_timesteps 937.
number of affinization with epsilon = 3 is 9
average number of affinization = 15.751378999097382
Path 77 | total_timesteps 948.
number of affinization with epsilon = 3 is 14
average number of affinization = 15.751203369434416
Path 78 | total_timesteps 963.
number of affinization with epsilon = 3 is 8
average number of affinization = 15.750426150606637
Path 79 | total_timesteps 974.
number of affinization with epsilon = 3 is 5
average number of affinization = 15.749348305594546
Path 80 | total_timesteps 982.
number of affinization with epsilon = 3 is 10
average number of affinization = 15.748771929824562
Path 81 | total_timesteps 994.
number of affinization with epsilon = 3 is 7
average number of affinization = 15.747894947874899
Path 82 | total_timesteps 1005.
number of affinization with epsilon = 3 is 10
average number of affinization = 15.747318833316628
Path 83 | total_timesteps 1018.
number of affinization with epsilon = 3 is 7
average number of affinization = 15.746442172780116
Path 84 | total_timesteps 1027.
number of affinization with epsilon = 3 is 10
average number of affinization = 15.745866319270467
Path 85 | total_timesteps 1039.
number of affinization with epsilon = 3 is 8
average number of affinization = 15.745090180360721
Path 86 | total_timesteps 1050.
number of affinization with epsilon = 3 is 6
average number of affinization = 15.744113816250877
Path 87 | total_timesteps 1058.
number of affinization with epsilon = 3 is 11
average number of affinization = 15.7436385493889
Path 88 | total_timesteps 1072.
number of affinization with epsilon = 3 is 12
average number of affinization = 15.743263548031655
Path 89 | total_timesteps 1089.
number of affinization with epsilon = 3 is 8
average number of affinization = 15.74248798076923
Path 90 | total_timesteps 1102.
number of affinization with epsilon = 3 is 13
average number of affinization = 15.74221331997997
Path 91 | total_timesteps 1120.
number of affinization with epsilon = 3 is 8
average number of affinization = 15.741438013218506
Path 92 | total_timesteps 1129.
number of affinization with epsilon = 3 is 7
average number of affinization = 15.740562731551016
Path 93 | total_timesteps 1141.
number of affinization with epsilon = 3 is 11
average number of affinization = 15.740088105726873
Path 94 | total_timesteps 1153.
number of affinization with epsilon = 3 is 11
average number of affinization = 15.739613574932426
Path 95 | total_timesteps 1167.
number of affinization with epsilon = 3 is 9
average number of affinization = 15.738938938938938
Path 96 | total_timesteps 1178.
number of affinization with epsilon = 3 is 15
average number of affinization = 15.738864978480633
Path 97 | total_timesteps 1199.
number of affinization with epsilon = 3 is 8
average number of affinization = 15.738090472377902
Path 98 | total_timesteps 1209.
number of affinization with epsilon = 3 is 12
average number of affinization = 15.737716401481038
Path 99 | total_timesteps 1224.
number of affinization with epsilon = 3 is 13
average number of affinization = 15.737442465479287
Path 100 | total_timesteps 1238.
number of affinization with epsilon = 3 is 9
average number of affinization = 15.736768384192096
Path 101 | total_timesteps 1250.
number of affinization with epsilon = 3 is 5
average number of affinization = 15.735694277711085
Path 102 | total_timesteps 1259.
number of affinization with epsilon = 3 is 4
average number of affinization = 15.734520356106833
Path 103 | total_timesteps 1267.
number of affinization with epsilon = 3 is 10
average number of affinization = 15.733946789357871
Path 104 | total_timesteps 1281.
number of affinization with epsilon = 3 is 8
average number of affinization = 15.733173317331733
Path 105 | total_timesteps 1292.
number of affinization with epsilon = 3 is 10
average number of affinization = 15.7326
Path 106 | total_timesteps 1305.
number of affinization with epsilon = 3 is 6
average number of affinization = 15.731626837316268
Path 107 | total_timesteps 1314.
number of affinization with epsilon = 3 is 22
average number of affinization = 15.732253549290142
Path 108 | total_timesteps 1338.
number of affinization with epsilon = 3 is 5
average number of affinization = 15.731180645806258
Path 109 | total_timesteps 1346.
number of affinization with epsilon = 3 is 4
average number of affinization = 15.73000799680128
Path 110 | total_timesteps 1353.
number of affinization with epsilon = 3 is 14
average number of affinization = 15.72983508245877
Path 111 | total_timesteps 1368.
number of affinization with epsilon = 3 is 8
average number of affinization = 15.729062562462522
Path 112 | total_timesteps 1378.
number of affinization with epsilon = 3 is 5
average number of affinization = 15.7279904067153
Path 113 | total_timesteps 1385.
number of affinization with epsilon = 3 is 6
average number of affinization = 15.727018385291766
Path 114 | total_timesteps 1394.
number of affinization with epsilon = 3 is 11
average number of affinization = 15.726546108502347
Path 115 | total_timesteps 1407.
number of affinization with epsilon = 3 is 20
average number of affinization = 15.726973026973027
Path 116 | total_timesteps 1431.
number of affinization with epsilon = 3 is 18
average number of affinization = 15.727200079912096
Path 117 | total_timesteps 1452.
number of affinization with epsilon = 3 is 14
average number of affinization = 15.727027566919697
Path 118 | total_timesteps 1468.
number of affinization with epsilon = 3 is 5
average number of affinization = 15.725956256866073
Path 119 | total_timesteps 1476.
number of affinization with epsilon = 3 is 13
average number of affinization = 15.725684042340722
Path 120 | total_timesteps 1494.
number of affinization with epsilon = 3 is 11
average number of affinization = 15.725212181727409
Path 121 | total_timesteps 1508.
number of affinization with epsilon = 3 is 9
average number of affinization = 15.72454073482428
Path 122 | total_timesteps 1519.
number of affinization with epsilon = 3 is 13
average number of affinization = 15.724268743136667
Path 123 | total_timesteps 1533.
number of affinization with epsilon = 3 is 14
average number of affinization = 15.724096626073068
Path 124 | total_timesteps 1550.
number of affinization with epsilon = 3 is 7
average number of affinization = 15.723225870845393
Path 125 | total_timesteps 1559.
number of affinization with epsilon = 3 is 10
average number of affinization = 15.722654690618763
Path 126 | total_timesteps 1570.
number of affinization with epsilon = 3 is 6
average number of affinization = 15.721684462628481
Path 127 | total_timesteps 1577.
number of affinization with epsilon = 3 is 6
average number of affinization = 15.720714428257832
Path 128 | total_timesteps 1584.
number of affinization with epsilon = 3 is 11
average number of affinization = 15.720243440087797
Path 129 | total_timesteps 1598.
number of affinization with epsilon = 3 is 12
average number of affinization = 15.719872306464485
Path 130 | total_timesteps 1612.
number of affinization with epsilon = 3 is 11
average number of affinization = 15.719401496259351
Path 131 | total_timesteps 1628.
number of affinization with epsilon = 3 is 12
average number of affinization = 15.719030520646319
Path 132 | total_timesteps 1641.
number of affinization with epsilon = 3 is 14
average number of affinization = 15.718859080482696
Path 133 | total_timesteps 1660.
number of affinization with epsilon = 3 is 14
average number of affinization = 15.718687674511369
Path 134 | total_timesteps 1675.
number of affinization with epsilon = 3 is 8
average number of affinization = 15.717918037690698
Path 135 | total_timesteps 1685.
number of affinization with epsilon = 3 is 15
average number of affinization = 15.717846460618146
Path 136 | total_timesteps 1703.
number of affinization with epsilon = 3 is 15
average number of affinization = 15.717774897816769
Path 137 | total_timesteps 1722.
number of affinization with epsilon = 3 is 8
average number of affinization = 15.717005582137162
Path 138 | total_timesteps 1732.
number of affinization with epsilon = 3 is 8
average number of affinization = 15.716236419814612
Path 139 | total_timesteps 1742.
number of affinization with epsilon = 3 is 10
average number of affinization = 15.715666733107435
Path 140 | total_timesteps 1755.
number of affinization with epsilon = 3 is 9
average number of affinization = 15.714997508719481
Path 141 | total_timesteps 1767.
number of affinization with epsilon = 3 is 12
average number of affinization = 15.714627341570347
Path 142 | total_timesteps 1782.
number of affinization with epsilon = 3 is 6
average number of affinization = 15.713659459998008
Path 143 | total_timesteps 1790.
number of affinization with epsilon = 3 is 9
average number of affinization = 15.712990635584777
Path 144 | total_timesteps 1801.
number of affinization with epsilon = 3 is 5
average number of affinization = 15.711923498356411
Path 145 | total_timesteps 1809.
number of affinization with epsilon = 3 is 11
average number of affinization = 15.711454183266932
Path 146 | total_timesteps 1823.
number of affinization with epsilon = 3 is 16
average number of affinization = 15.711482920027885
Path 147 | total_timesteps 1842.
number of affinization with epsilon = 3 is 11
average number of affinization = 15.711013742282415
Path 148 | total_timesteps 1859.
number of affinization with epsilon = 3 is 21
average number of affinization = 15.71154037638156
Path 149 | total_timesteps 1888.
number of affinization with epsilon = 3 is 9
average number of affinization = 15.710872162485066
Path 150 | total_timesteps 1899.
number of affinization with epsilon = 3 is 12
average number of affinization = 15.710502737680438
Path 151 | total_timesteps 1915.
number of affinization with epsilon = 3 is 6
average number of affinization = 15.70953613378459
Path 152 | total_timesteps 1923.
number of affinization with epsilon = 3 is 7
average number of affinization = 15.708669254503832
Path 153 | total_timesteps 1932.
number of affinization with epsilon = 3 is 13
average number of affinization = 15.708399681528663
Path 154 | total_timesteps 1946.
number of affinization with epsilon = 3 is 13
average number of affinization = 15.708130162205194
Path 155 | total_timesteps 1961.
number of affinization with epsilon = 3 is 17
average number of affinization = 15.708258706467662
Path 156 | total_timesteps 1981.
number of affinization with epsilon = 3 is 10
average number of affinization = 15.707690777037111
Path 157 | total_timesteps 1994.
number of affinization with epsilon = 3 is 13
average number of affinization = 15.707421408674891
Path 158 | total_timesteps 2009.
number of affinization with epsilon = 3 is 10
average number of affinization = 15.706853675519746
Path 159 | total_timesteps 2020.
number of affinization with epsilon = 3 is 12
average number of affinization = 15.706484981102049
Path 160 | total_timesteps 2034.
number of affinization with epsilon = 3 is 8
average number of affinization = 15.705718547986077
Path 161 | total_timesteps 2043.
number of affinization with epsilon = 3 is 10
average number of affinization = 15.705151153540175
Path 162 | total_timesteps 2059.
number of affinization with epsilon = 3 is 7
average number of affinization = 15.704285572238241
Path 163 | total_timesteps 2070.
number of affinization with epsilon = 3 is 8
average number of affinization = 15.703519586398887
Path 164 | total_timesteps 2082.
number of affinization with epsilon = 3 is 10
average number of affinization = 15.702952579779302
Path 165 | total_timesteps 2094.
number of affinization with epsilon = 3 is 32
average number of affinization = 15.704572564612326
Path 166 | total_timesteps 2130.
number of affinization with epsilon = 3 is 9
average number of affinization = 15.703906172348674
Path 167 | total_timesteps 2140.
number of affinization with epsilon = 3 is 8
average number of affinization = 15.703140528721924
Path 168 | total_timesteps 2151.
number of affinization with epsilon = 3 is 6
average number of affinization = 15.702176289376926
Path 169 | total_timesteps 2160.
number of affinization with epsilon = 3 is 7
average number of affinization = 15.70131160572337
Path 170 | total_timesteps 2169.
number of affinization with epsilon = 3 is 13
average number of affinization = 15.701043219076006
Path 171 | total_timesteps 2186.
number of affinization with epsilon = 3 is 12
average number of affinization = 15.700675541426584
Path 172 | total_timesteps 2201.
number of affinization with epsilon = 3 is 8
average number of affinization = 15.699910598986788
Path 173 | total_timesteps 2210.
number of affinization with epsilon = 3 is 13
average number of affinization = 15.699642431466032
Path 174 | total_timesteps 2229.
number of affinization with epsilon = 3 is 7
average number of affinization = 15.698778428840997
Path 175 | total_timesteps 2237.
number of affinization with epsilon = 3 is 13
average number of affinization = 15.698510427010923
Path 176 | total_timesteps 2254.
number of affinization with epsilon = 3 is 16
average number of affinization = 15.69854036341972
Path 177 | total_timesteps 2273.
number of affinization with epsilon = 3 is 7
average number of affinization = 15.697676727561557
Path 178 | total_timesteps 2281.
number of affinization with epsilon = 3 is 11
average number of affinization = 15.697210364340316
Path 179 | total_timesteps 2295.
number of affinization with epsilon = 3 is 8
average number of affinization = 15.696446297399246
Path 180 | total_timesteps 2305.
number of affinization with epsilon = 3 is 8
average number of affinization = 15.695682382133995
Path 181 | total_timesteps 2314.
number of affinization with epsilon = 3 is 10
average number of affinization = 15.695117109964272
Path 182 | total_timesteps 2327.
number of affinization with epsilon = 3 is 13
average number of affinization = 15.694849657636201
Path 183 | total_timesteps 2341.
number of affinization with epsilon = 3 is 8
average number of affinization = 15.69408612820004
Path 184 | total_timesteps 2351.
number of affinization with epsilon = 3 is 7
average number of affinization = 15.693223534080762
Path 185 | total_timesteps 2359.
number of affinization with epsilon = 3 is 6
average number of affinization = 15.692261904761905
Path 186 | total_timesteps 2366.
number of affinization with epsilon = 3 is 8
average number of affinization = 15.691498859240154
Path 187 | total_timesteps 2375.
number of affinization with epsilon = 3 is 7
average number of affinization = 15.69063677841698
Path 188 | total_timesteps 2385.
number of affinization with epsilon = 3 is 8
average number of affinization = 15.68987404542299
Path 189 | total_timesteps 2396.
number of affinization with epsilon = 3 is 13
average number of affinization = 15.689607298690996
Path 190 | total_timesteps 2412.
number of affinization with epsilon = 3 is 6
average number of affinization = 15.688646504709965
Path 191 | total_timesteps 2420.
number of affinization with epsilon = 3 is 4
average number of affinization = 15.687487606583383
Path 192 | total_timesteps 2427.
number of affinization with epsilon = 3 is 13
average number of affinization = 15.687221175770794
Path 193 | total_timesteps 2442.
number of affinization with epsilon = 3 is 12
average number of affinization = 15.686855670103093
Path 194 | total_timesteps 2457.
number of affinization with epsilon = 3 is 12
average number of affinization = 15.686490236891665
Path 195 | total_timesteps 2471.
number of affinization with epsilon = 3 is 8
average number of affinization = 15.685728444003963
Path 196 | total_timesteps 2482.
number of affinization with epsilon = 3 is 5
average number of affinization = 15.684669507481914
Path 197 | total_timesteps 2491.
number of affinization with epsilon = 3 is 8
average number of affinization = 15.683908045977011
Path 198 | total_timesteps 2507.
number of affinization with epsilon = 3 is 6
average number of affinization = 15.68294857822253
Path 199 | total_timesteps 2520.
number of affinization with epsilon = 3 is 7
average number of affinization = 15.682088369328314
Path 200 | total_timesteps 2529.
number of affinization with epsilon = 3 is 6
average number of affinization = 15.68112927191679
Path 201 | total_timesteps 2537.
number of affinization with epsilon = 3 is 14
average number of affinization = 15.680962757527734
Path 202 | total_timesteps 2553.
number of affinization with epsilon = 3 is 12
average number of affinization = 15.680598197484402
Path 203 | total_timesteps 2567.
number of affinization with epsilon = 3 is 10
average number of affinization = 15.680035650623886
Path 204 | total_timesteps 2578.
number of affinization with epsilon = 3 is 7
average number of affinization = 15.679176156055055
Path 205 | total_timesteps 2588.
number of affinization with epsilon = 3 is 8
average number of affinization = 15.678415841584158
Path 206 | total_timesteps 2600.
number of affinization with epsilon = 3 is 10
average number of affinization = 15.677853677853678
Path 207 | total_timesteps 2613.
number of affinization with epsilon = 3 is 25
average number of affinization = 15.67877647990497
Path 208 | total_timesteps 2645.
number of affinization with epsilon = 3 is 13
average number of affinization = 15.678511333267346
Path 209 | total_timesteps 2659.
number of affinization with epsilon = 3 is 12
average number of affinization = 15.678147268408551
Path 210 | total_timesteps 2674.
number of affinization with epsilon = 3 is 5
average number of affinization = 15.677090549233053
Path 211 | total_timesteps 2682.
number of affinization with epsilon = 3 is 9
average number of affinization = 15.676429843657234
Path 212 | total_timesteps 2694.
number of affinization with epsilon = 3 is 5
average number of affinization = 15.675373503512418
Path 213 | total_timesteps 2703.
number of affinization with epsilon = 3 is 6
average number of affinization = 15.674416303917688
Path 214 | total_timesteps 2710.
number of affinization with epsilon = 3 is 14
average number of affinization = 15.674250667721832
Path 215 | total_timesteps 2728.
number of affinization with epsilon = 3 is 16
average number of affinization = 15.674282888229476
Path 216 | total_timesteps 2747.
number of affinization with epsilon = 3 is 11
average number of affinization = 15.67382059143507
Path 217 | total_timesteps 2760.
number of affinization with epsilon = 3 is 9
average number of affinization = 15.673160601265822
Path 218 | total_timesteps 2771.
number of affinization with epsilon = 3 is 13
average number of affinization = 15.672896272124987
Path 219 | total_timesteps 2788.
number of affinization with epsilon = 3 is 8
average number of affinization = 15.672137631006526
Path 220 | total_timesteps 2799.
number of affinization with epsilon = 3 is 7
average number of affinization = 15.671280276816608
Path 221 | total_timesteps 2808.
number of affinization with epsilon = 3 is 7
average number of affinization = 15.670423092131276
Path 222 | total_timesteps 2818.
number of affinization with epsilon = 3 is 13
average number of affinization = 15.670159138084413
Path 223 | total_timesteps 2834.
number of affinization with epsilon = 3 is 12
average number of affinization = 15.669796402451077
Path 224 | total_timesteps 2851.
number of affinization with epsilon = 3 is 9
average number of affinization = 15.669137266528313
Path 225 | total_timesteps 2862.
number of affinization with epsilon = 3 is 7
average number of affinization = 15.668280632411067
Path 226 | total_timesteps 2870.
number of affinization with epsilon = 3 is 7
average number of affinization = 15.667424167572374
Path 227 | total_timesteps 2879.
number of affinization with epsilon = 3 is 10
average number of affinization = 15.666864256075874
Path 228 | total_timesteps 2891.
number of affinization with epsilon = 3 is 16
average number of affinization = 15.666897164872074
Path 229 | total_timesteps 2912.
number of affinization with epsilon = 3 is 11
average number of affinization = 15.666436191228764
Path 230 | total_timesteps 2924.
number of affinization with epsilon = 3 is 6
average number of affinization = 15.665481481481482
Path 231 | total_timesteps 2932.
number of affinization with epsilon = 3 is 5
average number of affinization = 15.664428204621766
Path 232 | total_timesteps 2939.
number of affinization with epsilon = 3 is 28
average number of affinization = 15.665646292090452
Path 233 | total_timesteps 2969.
number of affinization with epsilon = 3 is 12
average number of affinization = 15.665284360189574
Path 234 | total_timesteps 2983.
number of affinization with epsilon = 3 is 18
average number of affinization = 15.665514858327574
Path 235 | total_timesteps 3005.
number of affinization with epsilon = 3 is 8
average number of affinization = 15.664758144126358
Path 236 | total_timesteps 3015.
number of affinization with epsilon = 3 is 11
average number of affinization = 15.66429770012832
Path 237 | total_timesteps 3027.
number of affinization with epsilon = 3 is 17
average number of affinization = 15.664429530201343
Path 238 | total_timesteps 3047.
number of affinization with epsilon = 3 is 7
average number of affinization = 15.663574459686174
Path 239 | total_timesteps 3056.
number of affinization with epsilon = 3 is 11
average number of affinization = 15.663114268798106
Path 240 | total_timesteps 3072.
number of affinization with epsilon = 3 is 9
average number of affinization = 15.662456832757771
Path 241 | total_timesteps 3083.
number of affinization with epsilon = 3 is 7
average number of affinization = 15.661602209944752
Path 242 | total_timesteps 3093.
number of affinization with epsilon = 3 is 8
average number of affinization = 15.660846404261616
Path 243 | total_timesteps 3106.
number of affinization with epsilon = 3 is 8
average number of affinization = 15.660090747681988
Path 244 | total_timesteps 3116.
number of affinization with epsilon = 3 is 8
average number of affinization = 15.659335240161752
Path 245 | total_timesteps 3128.
number of affinization with epsilon = 3 is 12
average number of affinization = 15.658974358974358
Path 246 | total_timesteps 3142.
number of affinization with epsilon = 3 is 17
average number of affinization = 15.659106596982546
Path 247 | total_timesteps 3161.
number of affinization with epsilon = 3 is 5
average number of affinization = 15.658055610333268
Path 248 | total_timesteps 3170.
number of affinization with epsilon = 3 is 6
average number of affinization = 15.657103421078576
Path 249 | total_timesteps 3177.
number of affinization with epsilon = 3 is 7
average number of affinization = 15.65625
Path 250 | total_timesteps 3186.
number of affinization with epsilon = 3 is 6
average number of affinization = 15.655298176441597
Path 251 | total_timesteps 3196.
number of affinization with epsilon = 3 is 10
average number of affinization = 15.654740784545634
Path 252 | total_timesteps 3207.
number of affinization with epsilon = 3 is 9
average number of affinization = 15.654084951217108
Path 253 | total_timesteps 3220.
number of affinization with epsilon = 3 is 28
average number of affinization = 15.655301537248718
Path 254 | total_timesteps 3255.
number of affinization with epsilon = 3 is 7
average number of affinization = 15.654448714159031
Path 255 | total_timesteps 3264.
number of affinization with epsilon = 3 is 6
average number of affinization = 15.653497536945812
Path 256 | total_timesteps 3272.
number of affinization with epsilon = 3 is 6
average number of affinization = 15.652546547138213
Path 257 | total_timesteps 3280.
number of affinization with epsilon = 3 is 8
average number of affinization = 15.651792750197005
Path 258 | total_timesteps 3291.
number of affinization with epsilon = 3 is 5
average number of affinization = 15.650743622574609
Path 259 | total_timesteps 3301.
number of affinization with epsilon = 3 is 11
average number of affinization = 15.650285601733307
Path 260 | total_timesteps 3316.
number of affinization with epsilon = 3 is 9
average number of affinization = 15.649630723781389
Path 261 | total_timesteps 3328.
number of affinization with epsilon = 3 is 9
average number of affinization = 15.648975974793226
Path 262 | total_timesteps 3339.
number of affinization with epsilon = 3 is 16
average number of affinization = 15.649010534606676
Path 263 | total_timesteps 3357.
number of affinization with epsilon = 3 is 9
average number of affinization = 15.648355975585746
Path 264 | total_timesteps 3368.
number of affinization with epsilon = 3 is 7
average number of affinization = 15.647504675657053
Path 265 | total_timesteps 3378.
number of affinization with epsilon = 3 is 12
average number of affinization = 15.647145669291339
Path 266 | total_timesteps 3392.
number of affinization with epsilon = 3 is 11
average number of affinization = 15.64668831807893
Path 267 | total_timesteps 3406.
number of affinization with epsilon = 3 is 8
average number of affinization = 15.645935839401693
Path 268 | total_timesteps 3416.
number of affinization with epsilon = 3 is 18
average number of affinization = 15.646167470235167
Path 269 | total_timesteps 3436.
number of affinization with epsilon = 3 is 9
average number of affinization = 15.645513577331759
Path 270 | total_timesteps 3447.
number of affinization with epsilon = 3 is 11
average number of affinization = 15.64505656665027
Path 271 | total_timesteps 3461.
number of affinization with epsilon = 3 is 10
average number of affinization = 15.64450127877238
Path 272 | total_timesteps 3476.
number of affinization with epsilon = 3 is 5
average number of affinization = 15.643454312973345
Path 273 | total_timesteps 3485.
number of affinization with epsilon = 3 is 14
average number of affinization = 15.643292682926829
Path 274 | total_timesteps 3502.
number of affinization with epsilon = 3 is 11
average number of affinization = 15.64283607041007
Path 275 | total_timesteps 3515.
number of affinization with epsilon = 3 is 14
average number of affinization = 15.64267453294002
Path 276 | total_timesteps 3532.
number of affinization with epsilon = 3 is 5
average number of affinization = 15.641628158489825
Path 277 | total_timesteps 3541.
number of affinization with epsilon = 3 is 7
average number of affinization = 15.640778607943375
Path 278 | total_timesteps 3550.
number of affinization with epsilon = 3 is 5
average number of affinization = 15.639732625577508
Path 279 | total_timesteps 3557.
number of affinization with epsilon = 3 is 24
average number of affinization = 15.640554354236288
Path 280 | total_timesteps 3583.
number of affinization with epsilon = 3 is 20
average number of affinization = 15.640982800982801
Path 281 | total_timesteps 3607.
number of affinization with epsilon = 3 is 6
average number of affinization = 15.64003537735849
Path 282 | total_timesteps 3615.
number of affinization with epsilon = 3 is 14
average number of affinization = 15.639874226196325
Path 283 | total_timesteps 3632.
number of affinization with epsilon = 3 is 16
average number of affinization = 15.639909608960503
Path 284 | total_timesteps 3651.
number of affinization with epsilon = 3 is 6
average number of affinization = 15.638962569997053
Path 285 | total_timesteps 3659.
number of affinization with epsilon = 3 is 7
average number of affinization = 15.63811394891945
Path 286 | total_timesteps 3672.
number of affinization with epsilon = 3 is 6
average number of affinization = 15.637167272370101
Path 287 | total_timesteps 3680.
number of affinization with epsilon = 3 is 7
average number of affinization = 15.636318994303673
Path 288 | total_timesteps 3690.
number of affinization with epsilon = 3 is 8
average number of affinization = 15.63556908573112
Path 289 | total_timesteps 3701.
number of affinization with epsilon = 3 is 9
average number of affinization = 15.634917517674785
Path 290 | total_timesteps 3715.
number of affinization with epsilon = 3 is 14
average number of affinization = 15.634756995581737
Path 291 | total_timesteps 3734.
number of affinization with epsilon = 3 is 22
average number of affinization = 15.63538189672099
Path 292 | total_timesteps 3760.
number of affinization with epsilon = 3 is 6
average number of affinization = 15.634436045940905
Path 293 | total_timesteps 3770.
number of affinization with epsilon = 3 is 7
average number of affinization = 15.633588535531999
Path 294 | total_timesteps 3780.
number of affinization with epsilon = 3 is 11
average number of affinization = 15.633133771714594
Path 295 | total_timesteps 3794.
number of affinization with epsilon = 3 is 6
average number of affinization = 15.632188420019627
Path 296 | total_timesteps 3802.
number of affinization with epsilon = 3 is 7
average number of affinization = 15.63134137964871
Path 297 | total_timesteps 3813.
number of affinization with epsilon = 3 is 10
average number of affinization = 15.63078885400314
Path 298 | total_timesteps 3827.
number of affinization with epsilon = 3 is 3
average number of affinization = 15.629549690964387
Path 299 | total_timesteps 3835.
number of affinization with epsilon = 3 is 20
average number of affinization = 15.629978418677654
Path 300 | total_timesteps 3861.
number of affinization with epsilon = 3 is 7
average number of affinization = 15.6291319274154
Path 301 | total_timesteps 3870.
number of affinization with epsilon = 3 is 8
average number of affinization = 15.62838367987446
Path 302 | total_timesteps 3879.
number of affinization with epsilon = 3 is 12
average number of affinization = 15.628027851328822
Path 303 | total_timesteps 3894.
number of affinization with epsilon = 3 is 9
average number of affinization = 15.627377917238674
Path 304 | total_timesteps 3906.
number of affinization with epsilon = 3 is 13
average number of affinization = 15.627120305912344
Path 305 | total_timesteps 3922.
number of affinization with epsilon = 3 is 15
average number of affinization = 15.627058823529412
Path 306 | total_timesteps 3942.
number of affinization with epsilon = 3 is 8
average number of affinization = 15.626311145966081
Path 307 | total_timesteps 3952.
number of affinization with epsilon = 3 is 9
average number of affinization = 15.625661634973534
Path 308 | total_timesteps 3964.
number of affinization with epsilon = 3 is 6
average number of affinization = 15.624718220131333
Path 309 | total_timesteps 3975.
number of affinization with epsilon = 3 is 17
average number of affinization = 15.624852998823991
Path 310 | total_timesteps 3993.
number of affinization with epsilon = 3 is 5
average number of affinization = 15.623811856932877
Path 311 | total_timesteps 4000.
number of affinization with epsilon = 3 is 9
average number of affinization = 15.623162845385067
Path 312 | total_timesteps 4010.
number of affinization with epsilon = 3 is 8
average number of affinization = 15.622415989027138
Path 313 | total_timesteps 4021.
number of affinization with epsilon = 3 is 6
average number of affinization = 15.621473354231975
Path 314 | total_timesteps 4029.
number of affinization with epsilon = 3 is 10
average number of affinization = 15.620922715251249
Path 315 | total_timesteps 4042.
number of affinization with epsilon = 3 is 14
average number of affinization = 15.620763956904995
Path 316 | total_timesteps 4062.
number of affinization with epsilon = 3 is 7
average number of affinization = 15.619919694447164
Path 317 | total_timesteps 4071.
number of affinization with epsilon = 3 is 6
average number of affinization = 15.6189776733255
Path 318 | total_timesteps 4082.
number of affinization with epsilon = 3 is 8
average number of affinization = 15.618231665524332
Path 319 | total_timesteps 4092.
number of affinization with epsilon = 3 is 23
average number of affinization = 15.618954376346192
Path 320 | total_timesteps 4121.
number of affinization with epsilon = 3 is 11
average number of affinization = 15.618502202643171
Path 321 | total_timesteps 4133.
number of affinization with epsilon = 3 is 8
average number of affinization = 15.61775646045419
Path 322 | total_timesteps 4142.
number of affinization with epsilon = 3 is 8
average number of affinization = 15.617010864245865
Path 323 | total_timesteps 4152.
number of affinization with epsilon = 3 is 10
average number of affinization = 15.616461146995498
Path 324 | total_timesteps 4165.
number of affinization with epsilon = 3 is 7
average number of affinization = 15.615617966532929
Path 325 | total_timesteps 4173.
number of affinization with epsilon = 3 is 11
average number of affinization = 15.615166340508805
Path 326 | total_timesteps 4186.
number of affinization with epsilon = 3 is 4
average number of affinization = 15.614029938362195
Path 327 | total_timesteps 4195.
number of affinization with epsilon = 3 is 9
average number of affinization = 15.613382899628252
Path 328 | total_timesteps 4207.
number of affinization with epsilon = 3 is 12
average number of affinization = 15.613029443411914
Path 329 | total_timesteps 4221.
number of affinization with epsilon = 3 is 6
average number of affinization = 15.612089201877934
Path 330 | total_timesteps 4230.
number of affinization with epsilon = 3 is 10
average number of affinization = 15.611540342298289
Path 331 | total_timesteps 4242.
number of affinization with epsilon = 3 is 21
average number of affinization = 15.61206727948367
Path 332 | total_timesteps 4267.
number of affinization with epsilon = 3 is 15
average number of affinization = 15.61200743130928
Path 333 | total_timesteps 4284.
number of affinization with epsilon = 3 is 5
average number of affinization = 15.610969886585842
Path 334 | total_timesteps 4291.
number of affinization with epsilon = 3 is 12
average number of affinization = 15.610616873594681
Path 335 | total_timesteps 4306.
number of affinization with epsilon = 3 is 8
average number of affinization = 15.609872922776148
Path 336 | total_timesteps 4316.
number of affinization with epsilon = 3 is 7
average number of affinization = 15.609031375232137
Path 337 | total_timesteps 4327.
number of affinization with epsilon = 3 is 6
average number of affinization = 15.608092259577795
Path 338 | total_timesteps 4335.
number of affinization with epsilon = 3 is 8
average number of affinization = 15.607348773575687
Path 339 | total_timesteps 4345.
number of affinization with epsilon = 3 is 19
average number of affinization = 15.607680281414892
Path 340 | total_timesteps 4370.
number of affinization with epsilon = 3 is 16
average number of affinization = 15.60771861260381
Path 341 | total_timesteps 4389.
number of affinization with epsilon = 3 is 10
average number of affinization = 15.607170769831965
Path 342 | total_timesteps 4401.
number of affinization with epsilon = 3 is 11
average number of affinization = 15.606720718960633
Path 343 | total_timesteps 4415.
number of affinization with epsilon = 3 is 11
average number of affinization = 15.606270756007033
Path 344 | total_timesteps 4427.
number of affinization with epsilon = 3 is 12
average number of affinization = 15.60591854673308
Path 345 | total_timesteps 4441.
number of affinization with epsilon = 3 is 16
average number of affinization = 15.60595703125
Path 346 | total_timesteps 4461.
number of affinization with epsilon = 3 is 14
average number of affinization = 15.605800214822771
Path 347 | total_timesteps 4477.
number of affinization with epsilon = 3 is 16
average number of affinization = 15.605838703378247
Path 348 | total_timesteps 4497.
number of affinization with epsilon = 3 is 6
average number of affinization = 15.604900907937127
Path 349 | total_timesteps 4508.
number of affinization with epsilon = 3 is 8
average number of affinization = 15.604158531823506
Path 350 | total_timesteps 4517.
number of affinization with epsilon = 3 is 5
average number of affinization = 15.603123474865788
Path 351 | total_timesteps 4526.
number of affinization with epsilon = 3 is 9
average number of affinization = 15.602479016201444
Path 352 | total_timesteps 4536.
number of affinization with epsilon = 3 is 28
average number of affinization = 15.603688884551577
Path 353 | total_timesteps 4570.
number of affinization with epsilon = 3 is 7
average number of affinization = 15.602849336455893
Path 354 | total_timesteps 4580.
number of affinization with epsilon = 3 is 9
average number of affinization = 15.602205093179823
Path 355 | total_timesteps 4591.
number of affinization with epsilon = 3 is 10
average number of affinization = 15.601658536585365
Path 356 | total_timesteps 4605.
number of affinization with epsilon = 3 is 11
average number of affinization = 15.60120963808409
Path 357 | total_timesteps 4619.
number of affinization with epsilon = 3 is 9
average number of affinization = 15.600565743269605
Path 358 | total_timesteps 4630.
number of affinization with epsilon = 3 is 7
average number of affinization = 15.599726909197308
Path 359 | total_timesteps 4639.
number of affinization with epsilon = 3 is 10
average number of affinization = 15.59918080748976
Path 360 | total_timesteps 4652.
number of affinization with epsilon = 3 is 11
average number of affinization = 15.598732325694783
Path 361 | total_timesteps 4665.
number of affinization with epsilon = 3 is 7
average number of affinization = 15.59789391575663
Path 362 | total_timesteps 4673.
number of affinization with epsilon = 3 is 10
average number of affinization = 15.597348152481233
Path 363 | total_timesteps 4686.
number of affinization with epsilon = 3 is 10
average number of affinization = 15.59680249561318
Path 364 | total_timesteps 4698.
number of affinization with epsilon = 3 is 11
average number of affinization = 15.596354420508822
Path 365 | total_timesteps 4713.
number of affinization with epsilon = 3 is 4
average number of affinization = 15.59522417153996
Path 366 | total_timesteps 4720.
number of affinization with epsilon = 3 is 7
average number of affinization = 15.594386512035864
Path 367 | total_timesteps 4728.
number of affinization with epsilon = 3 is 9
average number of affinization = 15.593743909569286
Path 368 | total_timesteps 4741.
number of affinization with epsilon = 3 is 7
average number of affinization = 15.592906557536782
Path 369 | total_timesteps 4749.
number of affinization with epsilon = 3 is 18
average number of affinization = 15.593141075604054
Path 370 | total_timesteps 4770.
number of affinization with epsilon = 3 is 9
average number of affinization = 15.59249878226985
Path 371 | total_timesteps 4780.
number of affinization with epsilon = 3 is 8
average number of affinization = 15.591759205143191
Path 372 | total_timesteps 4790.
number of affinization with epsilon = 3 is 17
average number of affinization = 15.591896367001072
Path 373 | total_timesteps 4810.
number of affinization with epsilon = 3 is 14
average number of affinization = 15.591741332294507
Path 374 | total_timesteps 4828.
number of affinization with epsilon = 3 is 8
average number of affinization = 15.591002044989775
Path 375 | total_timesteps 4839.
number of affinization with epsilon = 3 is 7
average number of affinization = 15.59016553067186
Path 376 | total_timesteps 4847.
number of affinization with epsilon = 3 is 8
average number of affinization = 15.589426540745789
Path 377 | total_timesteps 4858.
number of affinization with epsilon = 3 is 10
average number of affinization = 15.588882398753894
Path 378 | total_timesteps 4870.
number of affinization with epsilon = 3 is 20
average number of affinization = 15.589311788182615
Path 379 | total_timesteps 4895.
number of affinization with epsilon = 3 is 16
average number of affinization = 15.589351761728635
Path 380 | total_timesteps 4914.
number of affinization with epsilon = 3 is 15
average number of affinization = 15.589294403892945
Path 381 | total_timesteps 4933.
number of affinization with epsilon = 3 is 5
average number of affinization = 15.588263915920592
Path 382 | total_timesteps 4944.
number of affinization with epsilon = 3 is 13
average number of affinization = 15.588012065777951
Path 383 | total_timesteps 4959.
number of affinization with epsilon = 3 is 9
average number of affinization = 15.587371083868456
Path 384 | total_timesteps 4972.
number of affinization with epsilon = 3 is 8
average number of affinization = 15.586632940947563
Path 385 | total_timesteps 4983.
number of affinization with epsilon = 3 is 23
average number of affinization = 15.587354085603113
Path 386 | total_timesteps 5013.
number of affinization with epsilon = 3 is 14
average number of affinization = 15.587199688746232
Path 387 | total_timesteps 5033.
number of affinization with epsilon = 3 is 16
average number of affinization = 15.587239836607663
Path 388 | total_timesteps 5051.
number of affinization with epsilon = 3 is 15
average number of affinization = 15.58718272877565
Path 389 | total_timesteps 5069.
number of affinization with epsilon = 3 is 6
average number of affinization = 15.586250486192142
Path 390 | total_timesteps 5079.
number of affinization with epsilon = 3 is 7
average number of affinization = 15.585415653864851
Path 391 | total_timesteps 5088.
number of affinization with epsilon = 3 is 6
average number of affinization = 15.584483764339879
Path 392 | total_timesteps 5096.
number of affinization with epsilon = 3 is 19
average number of affinization = 15.584815786915524
Path 393 | total_timesteps 5118.
number of affinization with epsilon = 3 is 7
average number of affinization = 15.58398133748056
Path 394 | total_timesteps 5126.
number of affinization with epsilon = 3 is 9
average number of affinization = 15.583341432597921
Path 395 | total_timesteps 5137.
number of affinization with epsilon = 3 is 8
average number of affinization = 15.582604470359572
Path 396 | total_timesteps 5146.
number of affinization with epsilon = 3 is 12
average number of affinization = 15.582256340491691
Path 397 | total_timesteps 5159.
number of affinization with epsilon = 3 is 10
average number of affinization = 15.581713952584531
Path 398 | total_timesteps 5170.
number of affinization with epsilon = 3 is 10
average number of affinization = 15.581171670067036
Path 399 | total_timesteps 5183.
number of affinization with epsilon = 3 is 11
average number of affinization = 15.58072663687585
Path 400 | total_timesteps 5196.
number of affinization with epsilon = 3 is 10
average number of affinization = 15.580184555609518
Path 401 | total_timesteps 5207.
number of affinization with epsilon = 3 is 7
average number of affinization = 15.579351204351203
Path 402 | total_timesteps 5217.
number of affinization with epsilon = 3 is 13
average number of affinization = 15.579100708944353
Path 403 | total_timesteps 5232.
number of affinization with epsilon = 3 is 10
average number of affinization = 15.578558943484172
Path 404 | total_timesteps 5243.
number of affinization with epsilon = 3 is 7
average number of affinization = 15.577725992814836
Path 405 | total_timesteps 5253.
number of affinization with epsilon = 3 is 11
average number of affinization = 15.577281553398059
Path 406 | total_timesteps 5266.
number of affinization with epsilon = 3 is 8
average number of affinization = 15.576545966411029
Path 407 | total_timesteps 5275.
number of affinization with epsilon = 3 is 13
average number of affinization = 15.576295864880606
Path 408 | total_timesteps 5289.
number of affinization with epsilon = 3 is 6
average number of affinization = 15.575366398136465
Path 409 | total_timesteps 5297.
number of affinization with epsilon = 3 is 7
average number of affinization = 15.574534161490684
Path 410 | total_timesteps 5307.
number of affinization with epsilon = 3 is 8
average number of affinization = 15.573799126637555
Path 411 | total_timesteps 5317.
number of affinization with epsilon = 3 is 8
average number of affinization = 15.573064234426548
Path 412 | total_timesteps 5328.
number of affinization with epsilon = 3 is 23
average number of affinization = 15.573784806442223
Path 413 | total_timesteps 5358.
number of affinization with epsilon = 3 is 6
average number of affinization = 15.572856034148234
Path 414 | total_timesteps 5367.
number of affinization with epsilon = 3 is 6
average number of affinization = 15.571927442040936
Path 415 | total_timesteps 5377.
number of affinization with epsilon = 3 is 6
average number of affinization = 15.570999030067895
Path 416 | total_timesteps 5386.
number of affinization with epsilon = 3 is 8
average number of affinization = 15.570264765784113
Path 417 | total_timesteps 5395.
number of affinization with epsilon = 3 is 3
average number of affinization = 15.569045771916214
Path 418 | total_timesteps 5401.
number of affinization with epsilon = 3 is 8
average number of affinization = 15.568311839425967
Path 419 | total_timesteps 5410.
number of affinization with epsilon = 3 is 12
average number of affinization = 15.567965871630793
Path 420 | total_timesteps 5423.
number of affinization with epsilon = 3 is 12
average number of affinization = 15.567619970916141
Path 421 | total_timesteps 5439.
number of affinization with epsilon = 3 is 12
average number of affinization = 15.567274137262505
Path 422 | total_timesteps 5452.
number of affinization with epsilon = 3 is 15
average number of affinization = 15.567219152854513
Path 423 | total_timesteps 5469.
number of affinization with epsilon = 3 is 22
average number of affinization = 15.567842605156038
Path 424 | total_timesteps 5495.
number of affinization with epsilon = 3 is 13
average number of affinization = 15.567593759085183
Path 425 | total_timesteps 5512.
number of affinization with epsilon = 3 is 8
average number of affinization = 15.56686046511628
Path 426 | total_timesteps 5524.
number of affinization with epsilon = 3 is 23
average number of affinization = 15.567580660788684
Path 427 | total_timesteps 5551.
number of affinization with epsilon = 3 is 13
average number of affinization = 15.567331912420073
Path 428 | total_timesteps 5570.
number of affinization with epsilon = 3 is 8
average number of affinization = 15.566598856921438
Path 429 | total_timesteps 5579.
number of affinization with epsilon = 3 is 10
average number of affinization = 15.566059666795816
Path 430 | total_timesteps 5592.
number of affinization with epsilon = 3 is 7
average number of affinization = 15.565230024213076
Path 431 | total_timesteps 5601.
number of affinization with epsilon = 3 is 9
average number of affinization = 15.564594228161921
Path 432 | total_timesteps 5612.
number of affinization with epsilon = 3 is 14
average number of affinization = 15.564442722959233
Path 433 | total_timesteps 5628.
number of affinization with epsilon = 3 is 13
average number of affinization = 15.564194422927963
Path 434 | total_timesteps 5648.
number of affinization with epsilon = 3 is 9
average number of affinization = 15.563558911801723
Path 435 | total_timesteps 5660.
number of affinization with epsilon = 3 is 7
average number of affinization = 15.56272991287512
Path 436 | total_timesteps 5670.
number of affinization with epsilon = 3 is 15
average number of affinization = 15.562675442841932
Path 437 | total_timesteps 5687.
number of affinization with epsilon = 3 is 6
average number of affinization = 15.561749903213318
Path 438 | total_timesteps 5696.
number of affinization with epsilon = 3 is 12
average number of affinization = 15.561405206619568
Path 439 | total_timesteps 5709.
number of affinization with epsilon = 3 is 14
average number of affinization = 15.561254112637894
Path 440 | total_timesteps 5726.
number of affinization with epsilon = 3 is 11
average number of affinization = 15.560812772133527
Path 441 | total_timesteps 5738.
number of affinization with epsilon = 3 is 7
average number of affinization = 15.55998452012384
Path 442 | total_timesteps 5746.
number of affinization with epsilon = 3 is 11
average number of affinization = 15.559543387830125
Path 443 | total_timesteps 5760.
number of affinization with epsilon = 3 is 14
average number of affinization = 15.55939253240472
Path 444 | total_timesteps 5777.
number of affinization with epsilon = 3 is 6
average number of affinization = 15.558467936937808
Path 445 | total_timesteps 5785.
number of affinization with epsilon = 3 is 14
average number of affinization = 15.558317214700194
Path 446 | total_timesteps 5802.
number of affinization with epsilon = 3 is 15
average number of affinization = 15.55826322405957
Path 447 | total_timesteps 5821.
number of affinization with epsilon = 3 is 10
average number of affinization = 15.557725778379424
Path 448 | total_timesteps 5833.
number of affinization with epsilon = 3 is 10
average number of affinization = 15.557188436623804
Path 449 | total_timesteps 5846.
number of affinization with epsilon = 3 is 5
average number of affinization = 15.556167826759474
Path 450 | total_timesteps 5853.
number of affinization with epsilon = 3 is 8
average number of affinization = 15.55543740937651
Path 451 | total_timesteps 5862.
number of affinization with epsilon = 3 is 11
average number of affinization = 15.55499710032863
Path 452 | total_timesteps 5876.
number of affinization with epsilon = 3 is 9
average number of affinization = 15.554363583647435
Path 453 | total_timesteps 5889.
number of affinization with epsilon = 3 is 6
average number of affinization = 15.55344027831465
Path 454 | total_timesteps 5896.
number of affinization with epsilon = 3 is 6
average number of affinization = 15.552517151415596
Path 455 | total_timesteps 5904.
number of affinization with epsilon = 3 is 11
average number of affinization = 15.55207729468599
Path 456 | total_timesteps 5919.
number of affinization with epsilon = 3 is 16
average number of affinization = 15.552120568061056
Path 457 | total_timesteps 5936.
number of affinization with epsilon = 3 is 9
average number of affinization = 15.551487635239567
Path 458 | total_timesteps 5950.
number of affinization with epsilon = 3 is 9
average number of affinization = 15.550854824688496
Path 459 | total_timesteps 5961.
number of affinization with epsilon = 3 is 11
average number of affinization = 15.550415298435388
Path 460 | total_timesteps 5974.
number of affinization with epsilon = 3 is 12
average number of affinization = 15.550072428778368
Path 461 | total_timesteps 5989.
number of affinization with epsilon = 3 is 5
average number of affinization = 15.54905368868289
Path 462 | total_timesteps 5998.
number of affinization with epsilon = 3 is 9
average number of affinization = 15.548421357535966
Done generating on-policy rollouts.
Updating normalization.
Done updating normalization.
----------------------------
| AverageReturn | -5.82    |
| Iteration     | 32       |
| MaximumReturn | 5.85     |
| MinimumReturn | -20.2    |
| TotalSamples  | 136304   |
----------------------------
