Iteration                Wall_Time                Samples                  Train_Return             Train_Paths              Test_Return              Test_Paths               Critic_Loss              Critic_Steps             Actor_Loss               Actor_Steps              Adv_Mean                 Adv_Std                  Adv_Weights_Min          Adv_Weights_Mean         Adv_Weights_Max          
0                        0.0003627492321862115    2084                     -270.14232412772947      22                       -1335.295807547282       32                       0.025103689420341264     202                      2.2794399166770107       1007                     -28.734602               30.124512                0.011205632              2.0906324                179.93231                
50                       0.051661727759573194     108945                   -144.2055114783613       1029                     -213.79053426376575      32                       0.0045923777088719845    10563                    1.8976960438463657       52705                    0.99570876               9.631602                 0.0025483964             19.850088                362929.8                 
100                      0.14776593347390493      235241                   -54.407125195099916      213                      -119.59840169914501      32                       0.0019250642317553835    22893                    1.750020164515785        114289                   0.105181806              6.1451902                6.910031e-07             216.18747                8398931.0                
150                      0.27100180957052444      381503                   53.44737857413816        151                      74.64774210714685        32                       0.00022171791197903734   37165                    1.6412727642384812       185642                   0.08208865               2.0099993                1.956363e-06             1392354.0                25160897000.0            
200                      0.3895407326353921       530539                   97.65794816876782        150                      87.60754767202633        32                       0.00017658420186807678   51707                    1.3680527410409555       258349                   -0.2060756               1.71742                  5.582508e-07             1.4257281e+18            6.783475e+22             
250                      0.5053831545511881       680689                   104.22935690708482       150                      121.36161293346436       32                       4.535165548629728e-05    66357                    1.5336699085430887       331599                   0.066035                 0.92708063               1.7538111e-06            17.422285                223529.97                
300                      0.6161166367928187       830839                   109.38578546415079       150                      220.42032807439136       32                       3.4992058631096275e-05   81007                    1.5062381679287542       404849                   0.048569866              0.802692                 1.2151001e-05            88.36602                 1265367.0                
350                      0.7178912095228831       980226                   115.79303890266803       150                      225.28992374605082       32                       0.0002020965664053126    95584                    1.1013615214377133       477727                   -0.021548497             1.9161903                0.00046000126            8544487000000000.0       3.1777712e+20            
400                      0.8158024166689979       1130108                  113.56466396382814       150                      215.4108759544947        32                       8.522789709193714e-05    110208                   1.1880596902997014       550846                   -0.08595694              1.3397278                9.41612e-13              6742020700000.0          3.1329543e+17            
450                      0.913803661664327        1278837                  115.67898999530999       150                      218.1436686477637        32                       8.012770131586355e-05    124721                   1.142229495520478        623403                   0.074529275              1.205643                 3.5094692e-07            6.9455883e+16            3.2925333e+21            
500                      1.0089258686701457       1428284                  116.61369799594179       150                      220.9150206411864        32                       0.00010292296879527512   139303                   0.9737000553274318       696310                   0.043239444              1.3756882                0.002958785              1.974877e+22             9.5172235e+26            
550                      1.099522903561592        1570055                  122.31799491973443       151                      225.28017771189732       32                       0.0002046075519237909    153141                   0.9271449378732936       765473                   -0.28110775              1.9677335                7.968722e-21             3353495600.0             145539040000000.0        
600                      1.1879970469739702       1710526                  131.2810029591585        152                      229.74110575632236       32                       0.0007480582788128902    166853                   0.8473703638278584       834003                   -0.1992388               3.7571325                2.74211e-12              20211696.0               233573270000.0           
650                      1.265110303229756        1836274                  178.27015090985515       187                      223.95563079387713       32                       0.0041828609094387145    179137                   0.6524525414443597       895332                   0.79085666               9.122056                 1.1290218e-05            25.767776                20996.484                
700                      1.3302730219893986       1949744                  218.10308672402917       339                      220.19256185658344       32                       0.0023878355820973712    190212                   0.7572430326738431       950595                   0.2963051                6.728296                 7.5667845e-06            590.54645                15214243.0               
750                      1.3950412966807684       2063926                  222.54354081512415       406                      216.38498302961827       32                       0.0013651887266552401    201347                   0.6958009713906737       1006176                  -0.17412423              5.209647                 0.0014055615             27710.479                735351550.0              
800                      1.4565955481264325       2175066                  225.25713463825508       450                      231.9057741815659        32                       0.0012083850148636075    212181                   0.7238745861106302       1060248                  0.014286402              4.8206496                3.444965e-11             106.349365               1366555.4                
850                      1.5169168048434787       2286931                  224.74360710942483       458                      218.55553112044896       32                       0.001167330088797939     223084                   0.7248641762760917       1114669                  -0.01911437              4.813682                 1.6127615e-10            2201.3508                67665980.0               
900                      1.5760952926344343       2397304                  227.9471873081129        464                      227.9191858373355        32                       0.0012588912467344092    233841                   0.6318952320032198       1168359                  0.14402927               5.0204144                0.00042497602            66442.55                 938546940.0              
950                      1.6346261655622059       2507474                  228.42053985984782       479                      215.45311892122604       32                       0.0012997151499959678    244579                   0.6422798046167346       1221944                  0.16596197               5.07079                  5.848694e-11             15963.456                543112640.0              
1000                     1.692977966732449        2615465                  229.71760384563336       476                      222.58234810730443       32                       0.0008184111931107261    255111                   0.6970295372391094       1274468                  0.09365074               3.9190793                7.954179e-05             117237.94                4253025800.0             
1050                     1.7521161047617595       2726707                  228.59776566079705       501                      223.70425488160782       32                       0.000602524925545218     265949                   0.7402593439275568       1328568                  -0.3050381               3.4320621                0.00015447676            2.721004                 25774.545                
1100                     1.8090696297751532       2834758                  230.72929813962685       502                      218.2741763227372        32                       0.0016785633126530078    276477                   0.6035655068081383       1381108                  0.20922844               5.6041975                3.684344e-15             348678.38                12447259000.0            
1150                     1.8675700189669926       2943994                  233.5819158671997        510                      230.32080384480568       32                       0.0009489029359359008    287118                   0.6118118873009315       1434220                  0.13642254               4.2084856                4.3358734e-05            406934.56                9451961000.0             
1200                     1.92409137070179         3052807                  234.04747003218694       530                      240.8000074530893        32                       0.0007044136668173011    297714                   0.6184494048068786       1487114                  0.22501108               3.8220694                4.6474564e-05            276089.22                10234598000.0            
1250                     1.980106804172198        3161048                  234.6385871793152        536                      222.61608471124077       32                       0.0009167834537700542    308256                   0.6519977851600498       1539732                  0.029162923              4.2629943                1.9527288e-11            97.68061                 1814848.1                
1300                     2.0370177053080667       3269660                  234.20686714262024       544                      236.03290828591543       32                       0.0008404506500377211    318833                   0.6414251567042151       1592520                  -0.17736074              3.9615746                2.389368e-15             742424.3                 36740540000.0            
1350                     2.0929214537143705       3377961                  233.3328446238349        536                      229.10200737158738       32                       0.0006104462757343199    329379                   0.6699678006704073       1645161                  0.020060834              3.4215508                0.00038259974            6.1100874                71610.984                
1400                     2.1495790718661416       3487202                  235.89065725067968       541                      237.41847809634686       32                       0.0005958153371605577    340020                   0.6094481131986972       1698262                  0.10306716               3.435917                 0.00022467299            3.5796368                16293.424                
1450                     2.2050943791866304       3594232                  234.14384810637742       535                      230.47088428355113       32                       0.0007679708625959313    350445                   0.7514838914364432       1750283                  -0.032695606             3.8991516                0.00012253481            16.386908                237955.05                
1500                     2.261189862092336        3702477                  233.5643398232862        548                      238.90706190495078       32                       0.0010008090152973082    360989                   0.5837092086687378       1802896                  -0.08310889              4.5433817                1.0607445e-12            2.3541768                16251.167                
1550                     2.316674399243461        3809938                  234.5338596735665        547                      239.10473975410108       32                       0.001616235121642009     371459                   0.5676834514757805       1855126                  0.022904802              5.5825953                1.4678078e-15            712.8146                 21454130.0               
1600                     2.3714588100380367       3916791                  233.67589078579954       555                      232.3945505551765        32                       0.001228233226915685     381867                   0.6043987274169922       1907053                  -0.028323475             4.8441873                1.318474e-13             6.9592175                192974.4                 
1650                     2.4271175263987645       4024830                  236.90131292930116       561                      235.3329956547877        32                       0.000836460769755169     392389                   0.6324912498481535       1959559                  -0.16021991              3.9905672                4.9302217e-20            1.6662289                830.2805                 
1700                     2.4829946415954165       4133992                  235.17102713457132       568                      243.603586271299         32                       0.001361247809494243     403023                   0.5937622789077833       2012609                  0.182438                 4.9740086                7.5083846e-14            10.321785                192692.12                
1750                     2.5383125901884505       4241920                  236.99862680850669       560                      238.623794831857         32                       0.0006397004002955423    413536                   0.5321942784353169       2065059                  0.2623228                3.5231597                0.0025991213             3.8592799                29102.844                
1800                     2.5933787022034327       4349997                  232.8981996042276        574                      230.99679079070984       32                       0.0010723547880039659    424061                   0.5586187783958527       2117576                  -0.14388135              4.699553                 1.4272794e-15            5.646396                 94044.27                 
1850                     2.6486893091599146       4458073                  234.05966891593067       577                      234.80062641485918       32                       0.0013122366796625724    434584                   0.5458602753595614       2170088                  0.10740618               5.102068                 2.2243194e-13            2.0747092                11216.775                
1900                     2.7039872317181692       4566626                  234.45486959856183       580                      240.6393212993268        32                       0.0008235726379541959    445152                   0.5694073025908184       2222833                  0.12173087               3.9192522                4.2056563e-18            3.0165892                26700.541                
1950                     2.7592916886674033       4674513                  233.48648263575393       565                      236.32685339040526       32                       0.0007887950184148386    455656                   0.6203932455920298       2275262                  -0.19273672              3.8330054                1.255291e-15             3.232522                 11042.876                
2000                     2.814942465490765        4783383                  234.66352403071983       582                      236.21163166694535       32                       0.00098700524756202      466258                   0.5760707713939526       2328162                  -0.030011054             4.321273                 2.9833568e-13            1337660.5                49950880000.0            
2050                     2.8700043100118635       4891648                  236.19196416892228       588                      235.89866771427393       32                       0.0008354562406356519    476799                   0.5673787591546859       2380761                  -0.24758534              4.059592                 8.7290405e-17            4.208765                 24493.639                
2100                     2.9248246256510417       4998963                  235.86023307123125       573                      234.12100873916486       32                       0.0012541091272616274    487248                   0.5504031566246735       2432905                  -0.3050303               5.0542746                1.9062404e-17            1.7505133                10335.349                
2150                     2.980549777150154        5107009                  234.53483480499298       569                      233.17846226849036       32                       0.0016324887343492553    497766                   0.5739870951586287       2485409                  -0.1320384               5.5094666                4.3904208e-12            8215.452                 404917100.0              
2200                     3.0357464457882775       5215099                  236.0843132409443        590                      231.62878809192344       32                       0.0011388693918597023    508290                   0.5534107854260288       2537923                  0.15558086               4.673078                 1.6749189e-14            2.2216938                13729.247                
2250                     3.092116252647506        5325319                  233.22771985820677       587                      240.35250326707816       32                       0.0011941370440692435    519020                   0.5402859529949192       2591481                  0.09916902               4.751884                 3.3057972e-17            2721.7725                90251900.0               
2300                     3.147480346494251        5433334                  232.73046812332376       581                      236.30631088378584       32                       0.0018119267978758183    529533                   0.5664026732706168       2643966                  -0.5291508               5.844781                 2.602254e-13             1423.344                 43079180.0               
2350                     3.202520422604349        5541459                  233.1217231844156        587                      230.71338725746295       32                       0.0011655038179353226    540063                   0.543304443359375        2696501                  0.2441152                4.7806044                2.8473038e-13            9325.122                 315461630.0              
2400                     3.257899286084705        5649112                  236.63396780592282       581                      233.36890284094247       32                       0.000949749911050184     550545                   0.5154137891881606       2748803                  0.06047082               4.425667                 1.3190254e-16            1275.7574                40770292.0               
2450                     3.3125611396630603       5756896                  238.12577190590835       590                      226.61780305919905       32                       0.000993787961186103     561036                   0.5135957537956958       2801169                  -0.028678805             4.3841615                1.2068194e-15            2.0550485                5902.7134                
2500                     3.3681241261296804       5864575                  234.6937908522474        573                      233.85756048053184       32                       0.0009146269078545727    571519                   0.4961962223950977       2853492                  -0.0508972               4.289649                 1.3259142e-12            37.96061                 1119081.2                
2550                     3.4229833502239653       5972752                  237.55313980740834       590                      233.97185056475752       32                       0.0007533075884707923    582052                   0.5412361122733081       2906051                  -0.18404005              3.822638                 2.888378e-16             9.049007                 164394.47                
2600                     3.478755608929528        6082123                  237.71019186993323       585                      233.62848996698997       32                       0.0006415627932434447    592702                   0.5274834007737739       2959194                  -0.13861759              3.5915792                0.00014335215            6074.8                   210007330.0              
2650                     3.533988763160176        6190428                  233.3005514533217        597                      232.92480051820593       32                       0.0016560652384571002    603249                   0.48609045326300293      3011812                  0.19767123               5.753737                 3.455842e-12             3.2242556                61949.56                 
2700                     3.589353495173984        6299561                  238.34307728674185       602                      232.91658229432352       32                       0.0006964378632031954    613872                   0.48999586838942305      3064831                  0.22884385               3.7820625                2.6647675e-17            3.5327852                23726.492                
2750                     3.644458685848448        6407905                  236.8721417192674        597                      233.48521691746174       32                       0.000973114919234819     624421                   0.47510527878972936      3117467                  -0.048419636             4.47586                  2.1826432e-15            1743.9825                64123424.0               
2800                     3.6997098035944833       6516504                  237.8392529822318        593                      235.40378278790683       32                       0.0009803274288553323    634995                   0.4969548869015548       3170228                  0.090238735              4.277981                 4.0633377e-14            142575.77                5120919000.0             
2850                     3.753886246614986        6623169                  237.56529010848473       601                      237.2723258685829        32                       0.0005451801849241873    645380                   0.4876371252453577       3222041                  -0.20705241              3.3238652                0.0007634701             3.2165563                27300.562                
2900                     3.8078259865442914       6729834                  238.0067652042223        608                      233.57095145185136       32                       0.0009225381940018897    655762                   0.4807994718991505       3273852                  0.0040787472             4.1279993                1.0902632e-13            1954.1157                95569140.0               
2950                     3.862111198835903        6837124                  237.2232970638962        605                      237.30277951260925       32                       0.0008456406179168414    666206                   0.5125848405897225       3325970                  -0.19782181              4.0233054                1.4450846e-15            1359.8518                66967000.0               
3000                     3.916491384771135        6944510                  238.61225197067498       608                      236.5328752848814        32                       0.0008672729061154896    676661                   0.4345746247664742       3378132                  0.12603469               4.316581                 4.052944e-17             1.998303                 600.59515                
3050                     3.9706760793262057       7051635                  235.01782658483725       608                      240.41007214025495       32                       0.0019877260694136987    687086                   0.5124190666772037       3430164                  -0.026329683             6.2272725                2.7032144e-12            54.44871                 2529989.8                
3100                     4.02507164173656         7158979                  235.40341576286716       612                      236.57728774644255       32                       0.0013513443646607575    697533                   0.5031559033021608       3482301                  0.0887698                5.07076                  5.1375005e-14            847.0928                 31713864.0               
3150                     4.080033649139934        7267027                  234.13992964724918       605                      236.3931451268493        32                       0.0013852944073167819    708052                   0.45335211721407315      3534789                  0.15249863               5.1328034                1.2692924e-13            79420.88                 3918848300.0             
3200                     4.134929030272696        7375084                  236.38454674113882       605                      237.50664147454862       32                       0.0021413883891715823    718572                   0.4705240769490444       3587281                  -0.20692305              6.472064                 1.849853e-12             78.178024                2053977.8                
3250                     4.1894716982709035       7482584                  235.47796870558705       604                      235.29048493450034       32                       0.0019115485110372868    729037                   0.484539719996754        3639502                  -0.26935354              6.046029                 1.3841639e-11            187.5946                 1758747.9                
3300                     4.244001434511609        7589757                  235.4293180255394        599                      234.40127489587317       32                       0.00256978968779246      739470                   0.45974013384650736      3691564                  0.047077533              7.0381665                5.8125254e-12            14.131495                224508.45                
3350                     4.298565080695682        7696836                  236.42262151424885       596                      239.04840097902195       32                       0.0012097714038995595    749895                   0.4858129424166817       3743585                  -0.06457754              4.9266167                8.958546e-15             7.735334                 249645.77                
3400                     4.352971283462312        7803822                  235.93462884597045       600                      231.91565900644838       32                       0.001580895289130833     760309                   0.4924363038526052       3795554                  -0.28311366              5.4680934                4.1506425e-12            113.29131                4878022.5                
3450                     4.408629954854647        7913553                  234.41849433218025       603                      236.3687541908642        32                       0.0012470191136163926    770991                   0.4806232811228066       3848863                  0.27518436               4.9272523                1.5198537e-10            9526.843                 296882300.0              
3500                     4.463983500202497        8021903                  233.00494637284444       601                      241.5628027973356        32                       0.0010921841118192892    781538                   0.486506035987367        3901499                  0.13030356               4.6536713                3.1070337e-12            15887.18                 526256260.0              
3550                     4.518753830658065        8129451                  237.84583656511845       610                      233.54206021457497       32                       0.0008087982538298433    792005                   0.47605263975245005      3953738                  -0.14892723              3.8595612                0.0005217244             120189.02                4273069000.0             
3600                     4.573496373163329        8236285                  235.6779921549014        610                      236.66847109795563       32                       0.0014437640585550449    802404                   0.4625566320335411       4005628                  -0.087660074             5.29345                  1.6507786e-12            14.909086                420393.72                
3650                     4.62872194091479         8344772                  237.67689606520253       618                      231.59872025725724       32                       0.0010148812907402505    812968                   0.46592466941108596      4058325                  -0.21559079              4.484473                 1.8694876e-10            3082.7473                50404736.0               
3700                     4.6828766612211865       8452006                  236.00743097414025       622                      236.05925910587084       32                       0.0008941247914601298    823403                   0.4541134139866505       4110406                  0.014042526              4.179734                 2.4030796e-11            5.2082434                19036.338                
3750                     4.737048652966817        8558926                  235.2077781426541        620                      233.6847719906847        32                       0.0018763486387694411    833810                   0.42355376865224714      4162334                  0.20483595               5.9895306                5.995711e-11             3.1217947                16783.271                
3800                     4.791832251283857        8666347                  237.49330730142603       617                      237.04534083753825       32                       0.0018906032587114668    844265                   0.44586558400848764      4214507                  -0.031972636             6.114699                 1.5232135e-11            6630.9316                206128940.0              
3850                     4.846600073840883        8773887                  235.44795874976967       610                      235.78153233901273       32                       0.0010480530632352367    854733                   0.457222007106414        4266745                  -0.06875473              4.7101693                3.1802767e-13            1714.7086                63499056.0               
3900                     4.901193677716785        8881474                  237.94846141155304       613                      233.48353560551774       32                       0.0010787719633521104    865205                   0.4354712522624175       4318999                  -0.22976062              4.578498                 2.4897955e-12            15269.186                524100600.0              
3950                     4.956051444212596        8988787                  236.2108134667215        615                      240.58367533905601       32                       0.0010298473575103904    875649                   0.4696616185457928       4371126                  -0.06417988              4.4319606                7.359737e-13             29254540.0               1099125900000.0          
4000                     5.011167764729923        9096917                  237.18311181632126       606                      234.81633774948153       32                       0.0009479546716427916    886174                   0.41942031643401956      4423652                  0.017629888              4.3188705                5.374261e-16             4.20412                  103663.99                
4050                     5.066341961291101        9204757                  233.43292160846465       608                      237.93076528566286       32                       0.0008807297221463711    896671                   0.4774053084885967       4476036                  -0.1415297               4.2354774                7.1028185e-14            4025.5403                134670530.0              
4100                     5.120986284547382        9312441                  236.63086977506646       617                      236.93667588416488       32                       0.0016664705625394495    907151                   0.40347370505332947      4528340                  0.23085432               5.7971907                1.7943723e-16            1657.5109                43594880.0               
4150                     5.176023350556691        9420736                  234.8000957360417        621                      241.95386866447188       32                       0.0010849974105055903    917690                   0.4594653504395912       4580942                  -0.20763046              4.6309433                1.6603272e-16            490.1393                 24147260.0               
4200                     5.231542089184125        9529093                  235.38588766958202       613                      238.92683888791663       32                       0.0012743395952442985    928237                   0.4621193874404725       4633577                  -0.18006255              5.005011                 4.212447e-11             35.509148                422622.7                 
4250                     5.2862888464662765       9636913                  235.49841999711302       612                      237.0982616086306        32                       0.0016893442084149617    938731                   0.4384040496258264       4685948                  -0.0562426               5.7493587                8.260472e-13             13.503363                226929.92                
4300                     5.340750046902233        9743962                  235.62739006308772       608                      240.26991488559963       32                       0.0013592644756388777    949153                   0.42926039745083194      4737945                  -0.112703614             5.1688504                4.076941e-13             12.107338                464165.97                
4350                     5.395023055076599        9851321                  234.96105923767982       623                      231.38941195436146       32                       0.0018372640890233656    959603                   0.43317536481722135      4790088                  0.11313894               5.9665327                2.4105402e-14            259.0237                 7059643.5                
4400                     5.449864884018898        9959066                  236.44305126640995       619                      238.45317518073458       32                       0.0018106062176092615    970091                   0.45507579299638856      4842419                  -0.30842397              5.784253                 9.457554e-13             186.4871                 8742189.0                
