Optimization started at 2023-04-10 15:06:36.153923
--------------------------------
Loading column definition...
Checking column definition...
Loading data...
Dropping columns / rows...
Checking for NA values...
Setting data types...
Dropping columns / rows...
Encoding data...
	Updated column definition:
		id: REAL_VALUED (ID)
		time: DATE (TIME)
		gl: REAL_VALUED (TARGET)
		Height: REAL_VALUED (STATIC_INPUT)
		Weight: REAL_VALUED (STATIC_INPUT)
		Gender: REAL_VALUED (STATIC_INPUT)
		Race: REAL_VALUED (STATIC_INPUT)
		EduLevel: REAL_VALUED (STATIC_INPUT)
		AnnualInc: REAL_VALUED (STATIC_INPUT)
		MaritalStatus: REAL_VALUED (STATIC_INPUT)
		DaysWkEx: REAL_VALUED (STATIC_INPUT)
		DaysWkDrinkAlc: REAL_VALUED (STATIC_INPUT)
		DaysMonBingeAlc: REAL_VALUED (STATIC_INPUT)
		T1DDiagAge: REAL_VALUED (STATIC_INPUT)
		NumHospDKA: REAL_VALUED (STATIC_INPUT)
		NumSHSinceT1DDiag: REAL_VALUED (STATIC_INPUT)
		InsDeliveryMethod: REAL_VALUED (STATIC_INPUT)
		UnitsInsTotal: REAL_VALUED (STATIC_INPUT)
		NumMeterCheckDay: REAL_VALUED (STATIC_INPUT)
		Aspirin: REAL_VALUED (STATIC_INPUT)
		Simvastatin: REAL_VALUED (STATIC_INPUT)
		Lisinopril: REAL_VALUED (STATIC_INPUT)
		Vitamin D: REAL_VALUED (STATIC_INPUT)
		Multivitamin preparation: REAL_VALUED (STATIC_INPUT)
		Omeprazole: REAL_VALUED (STATIC_INPUT)
		atorvastatin: REAL_VALUED (STATIC_INPUT)
		Synthroid: REAL_VALUED (STATIC_INPUT)
		vitamin D3: REAL_VALUED (STATIC_INPUT)
		Hypertension: REAL_VALUED (STATIC_INPUT)
		Hyperlipidemia: REAL_VALUED (STATIC_INPUT)
		Hypothyroidism: REAL_VALUED (STATIC_INPUT)
		Depression: REAL_VALUED (STATIC_INPUT)
		Coronary artery disease: REAL_VALUED (STATIC_INPUT)
		Diabetic peripheral neuropathy: REAL_VALUED (STATIC_INPUT)
		Dyslipidemia: REAL_VALUED (STATIC_INPUT)
		Chronic kidney disease: REAL_VALUED (STATIC_INPUT)
		Osteoporosis: REAL_VALUED (STATIC_INPUT)
		Proliferative diabetic retinopathy: REAL_VALUED (STATIC_INPUT)
		Hypercholesterolemia: REAL_VALUED (STATIC_INPUT)
		Erectile dysfunction: REAL_VALUED (STATIC_INPUT)
		Type I diabetes mellitus: REAL_VALUED (STATIC_INPUT)
		time_year: REAL_VALUED (KNOWN_INPUT)
		time_month: REAL_VALUED (KNOWN_INPUT)
		time_day: REAL_VALUED (KNOWN_INPUT)
		time_hour: REAL_VALUED (KNOWN_INPUT)
		time_minute: REAL_VALUED (KNOWN_INPUT)
Interpolating data...
	Dropped segments: 1416
	Extracted segments: 681
	Interpolated values: 140564
	Percent of values interpolated: 24.24%
Splitting data...
	Train: 431798 (69.72%)
	Val: 57067 (9.21%)
	Test: 72421 (11.69%)
	Test OOD: 58048 (9.37%)
Scaling data...
	No scaling applied
Data formatting complete.
--------------------------------
	Train: 425413 (68.73%)
	Val: 56593 (9.14%)
	Test: 72022 (11.64%)
	Test OOD: 64922 (10.49%)
	No scaling applied
		Model Seed: 10 Seed: 1 ID mean of (MSE, MAE): [611.8337    15.722503]
		Model Seed: 10 Seed: 1 OOD mean of (MSE, MAE) stats: [755.2136    17.670916]
		Model Seed: 10 Seed: 1 ID median of (MSE, MAE): [178.50238   11.295735]
		Model Seed: 10 Seed: 1 OOD median of (MSE, MAE) stats: [240.1776    13.057659]
		Model Seed: 10 Seed: 1 ID likelihoods: -26.163610458374023
		Model Seed: 10 Seed: 1 OOD likelihoods: -31.683624267578125
		Model Seed: 10 Seed: 1 ID calibration errors: [0.02937596 0.01047781 0.06277729 0.1341032  0.20629276 0.2724308
 0.33044288 0.38024485 0.4235676  0.46577597 0.49988604 0.5307362 ]
		Model Seed: 10 Seed: 1 OOD calibration errors: [0.02638466 0.01370515 0.09157392 0.1897984  0.28136843 0.36120543
 0.43203062 0.4926313  0.5413144  0.5841565  0.6202195  0.65124285]
	Train: 429990 (69.47%)
	Val: 56876 (9.19%)
	Test: 72378 (11.69%)
	Test OOD: 59706 (9.65%)
	No scaling applied
		Model Seed: 10 Seed: 2 ID mean of (MSE, MAE): [610.893     15.644221]
		Model Seed: 10 Seed: 2 OOD mean of (MSE, MAE) stats: [671.8692    16.548313]
		Model Seed: 10 Seed: 2 ID median of (MSE, MAE): [178.03522   11.203063]
		Model Seed: 10 Seed: 2 OOD median of (MSE, MAE) stats: [203.55365   11.952011]
		Model Seed: 10 Seed: 2 ID likelihoods: -26.13913345336914
		Model Seed: 10 Seed: 2 OOD likelihoods: -28.4927978515625
		Model Seed: 10 Seed: 2 ID calibration errors: [0.0878757  0.05245101 0.07696392 0.13547763 0.20550925 0.27094314
 0.3272748  0.37925404 0.42392826 0.46372882 0.49764556 0.5267806 ]
		Model Seed: 10 Seed: 2 OOD calibration errors: [0.07944439 0.04266563 0.07534507 0.1493815  0.23523563 0.31203863
 0.3796528  0.43969533 0.49195644 0.5376067  0.57825005 0.6084799 ]
	Model Seed: 10 ID mean of (MSE, MAE): [611.36334   15.683362]
	Model Seed: 10 OOD mean of (MSE, MAE): [713.5414    17.109615]
	Model Seed: 10 ID median of (MSE, MAE): [178.2688    11.249399]
	Model Seed: 10 OOD median of (MSE, MAE): [221.86563   12.504835]
	Model Seed: 10 ID likelihoods: -26.151371955871582
	Model Seed: 10 OOD likelihoods: -30.088211059570312
	Model Seed: 10 ID calibration errors: [0.05862583 0.03146441 0.06987061 0.13479042 0.205901   0.27168697
 0.32885885 0.37974945 0.42374793 0.46475238 0.4987658  0.5287584 ]
	Model Seed: 10 OOD calibration errors: [0.05291452 0.02818539 0.0834595  0.16958995 0.25830203 0.33662203
 0.4058417  0.4661633  0.5166354  0.5608816  0.5992348  0.62986135]
	Train: 425413 (68.73%)
	Val: 56593 (9.14%)
	Test: 72022 (11.64%)
	Test OOD: 64922 (10.49%)
	No scaling applied
		Model Seed: 11 Seed: 1 ID mean of (MSE, MAE): [618.39667   15.932532]
		Model Seed: 11 Seed: 1 OOD mean of (MSE, MAE) stats: [757.4765    17.802427]
		Model Seed: 11 Seed: 1 ID median of (MSE, MAE): [189.49544   11.606819]
		Model Seed: 11 Seed: 1 OOD median of (MSE, MAE) stats: [242.99011   13.158653]
		Model Seed: 11 Seed: 1 ID likelihoods: -26.154251098632812
		Model Seed: 11 Seed: 1 OOD likelihoods: -31.492517471313477
		Model Seed: 11 Seed: 1 ID calibration errors: [0.00570937 0.03270609 0.102291   0.18646315 0.2690867  0.34139708
 0.40051192 0.4511572  0.4932819  0.5318865  0.56134844 0.5847605 ]
		Model Seed: 11 Seed: 1 OOD calibration errors: [0.00285011 0.04496789 0.13201977 0.23641297 0.3378584  0.4269545
 0.4967191  0.5553437  0.60338    0.6420743  0.6746715  0.70171756]
	Train: 429990 (69.47%)
	Val: 56876 (9.19%)
	Test: 72378 (11.69%)
	Test OOD: 59706 (9.65%)
	No scaling applied
		Model Seed: 11 Seed: 2 ID mean of (MSE, MAE): [612.969     15.858652]
		Model Seed: 11 Seed: 2 OOD mean of (MSE, MAE) stats: [678.48987   16.851099]
		Model Seed: 11 Seed: 2 ID median of (MSE, MAE): [181.34065   11.462444]
		Model Seed: 11 Seed: 2 OOD median of (MSE, MAE) stats: [215.52959   12.507843]
		Model Seed: 11 Seed: 2 ID likelihoods: -26.130962371826172
		Model Seed: 11 Seed: 2 OOD likelihoods: -28.640277862548828
		Model Seed: 11 Seed: 2 ID calibration errors: [0.17891973 0.17547563 0.22468495 0.2830541  0.3370988  0.38622043
 0.43092978 0.47191817 0.508319   0.5375054  0.56323624 0.5836723 ]
		Model Seed: 11 Seed: 2 OOD calibration errors: [0.1841489  0.19807443 0.26633266 0.33638734 0.39992127 0.45726767
 0.5116107  0.5581513  0.59842414 0.62871677 0.65797305 0.68113977]
	Model Seed: 11 ID mean of (MSE, MAE): [615.68286   15.895592]
	Model Seed: 11 OOD mean of (MSE, MAE): [717.98315   17.326763]
	Model Seed: 11 ID median of (MSE, MAE): [185.41805   11.534632]
	Model Seed: 11 OOD median of (MSE, MAE): [229.25986   12.833248]
	Model Seed: 11 ID likelihoods: -26.142606735229492
	Model Seed: 11 OOD likelihoods: -30.066397666931152
	Model Seed: 11 ID calibration errors: [0.09231456 0.10409085 0.16348797 0.23475863 0.30309275 0.36380875
 0.41572085 0.4615377  0.5008005  0.534696   0.56229234 0.58421636]
	Model Seed: 11 OOD calibration errors: [0.0934995  0.12152116 0.19917622 0.28640014 0.36888984 0.44211107
 0.5041649  0.5567475  0.6009021  0.6353955  0.66632223 0.69142866]
	Train: 425413 (68.73%)
	Val: 56593 (9.14%)
	Test: 72022 (11.64%)
	Test OOD: 64922 (10.49%)
	No scaling applied
		Model Seed: 12 Seed: 1 ID mean of (MSE, MAE): [613.22833   16.105494]
		Model Seed: 12 Seed: 1 OOD mean of (MSE, MAE) stats: [753.4093    18.071291]
		Model Seed: 12 Seed: 1 ID median of (MSE, MAE): [201.64816   12.066734]
		Model Seed: 12 Seed: 1 OOD median of (MSE, MAE) stats: [266.51843   13.876918]
		Model Seed: 12 Seed: 1 ID likelihoods: -26.096689224243164
		Model Seed: 12 Seed: 1 OOD likelihoods: -31.466156005859375
		Model Seed: 12 Seed: 1 ID calibration errors: [0.25452712 0.17857325 0.19306251 0.24234433 0.30091918 0.35772994
 0.40741345 0.45128402 0.49265835 0.5263966  0.55730414 0.58108103]
		Model Seed: 12 Seed: 1 OOD calibration errors: [0.23086242 0.21487354 0.27405983 0.34836587 0.42013183 0.48632827
 0.54224557 0.58775115 0.62570155 0.66262585 0.6904963  0.7140247 ]
	Train: 429990 (69.47%)
	Val: 56876 (9.19%)
	Test: 72378 (11.69%)
	Test OOD: 59706 (9.65%)
	No scaling applied
		Model Seed: 12 Seed: 2 ID mean of (MSE, MAE): [608.5796    15.660537]
		Model Seed: 12 Seed: 2 OOD mean of (MSE, MAE) stats: [670.0802    16.564959]
		Model Seed: 12 Seed: 2 ID median of (MSE, MAE): [177.89116   11.197128]
		Model Seed: 12 Seed: 2 OOD median of (MSE, MAE) stats: [202.23315   11.964749]
		Model Seed: 12 Seed: 2 ID likelihoods: -26.0896053314209
		Model Seed: 12 Seed: 2 OOD likelihoods: -28.514801025390625
		Model Seed: 12 Seed: 2 ID calibration errors: [0.06729809 0.0673201  0.11601469 0.1837219  0.2529955  0.31607816
 0.3669507  0.41210088 0.4528855  0.48746106 0.5138252  0.53446263]
		Model Seed: 12 Seed: 2 OOD calibration errors: [0.05453401 0.07307319 0.14187852 0.22244538 0.3029147  0.3722986
 0.42803895 0.47634056 0.5222658  0.55965334 0.58811903 0.60971117]
	Model Seed: 12 ID mean of (MSE, MAE): [610.90393   15.883015]
	Model Seed: 12 OOD mean of (MSE, MAE): [711.74475   17.318125]
	Model Seed: 12 ID median of (MSE, MAE): [189.76965   11.631931]
	Model Seed: 12 OOD median of (MSE, MAE): [234.3758    12.920834]
	Model Seed: 12 ID likelihoods: -26.09314727783203
	Model Seed: 12 OOD likelihoods: -29.990478515625
	Model Seed: 12 ID calibration errors: [0.1609126  0.12294668 0.1545386  0.21303311 0.27695733 0.33690405
 0.38718206 0.43169245 0.47277194 0.5069288  0.53556466 0.5577718 ]
	Model Seed: 12 OOD calibration errors: [0.14269821 0.14397337 0.20796917 0.28540564 0.36152327 0.42931342
 0.48514226 0.53204584 0.57398367 0.6111396  0.6393077  0.661868  ]
	Train: 425413 (68.73%)
	Val: 56593 (9.14%)
	Test: 72022 (11.64%)
	Test OOD: 64922 (10.49%)
	No scaling applied
		Model Seed: 13 Seed: 1 ID mean of (MSE, MAE): [612.6488    15.803849]
		Model Seed: 13 Seed: 1 OOD mean of (MSE, MAE) stats: [745.191     17.575958]
		Model Seed: 13 Seed: 1 ID median of (MSE, MAE): [185.98111   11.502505]
		Model Seed: 13 Seed: 1 OOD median of (MSE, MAE) stats: [234.7293    12.905574]
		Model Seed: 13 Seed: 1 ID likelihoods: -26.05234146118164
		Model Seed: 13 Seed: 1 OOD likelihoods: -31.130657196044922
		Model Seed: 13 Seed: 1 ID calibration errors: [0.0579168  0.02910046 0.08603729 0.16508693 0.23852432 0.30335385
 0.35952404 0.40611383 0.4456659  0.48255515 0.5129733  0.537215  ]
		Model Seed: 13 Seed: 1 OOD calibration errors: [0.04342919 0.04014105 0.1171485  0.21219285 0.3011025  0.37765104
 0.44434476 0.501721   0.54819775 0.5866864  0.61976016 0.6448118 ]
	Train: 429990 (69.47%)
	Val: 56876 (9.19%)
	Test: 72378 (11.69%)
	Test OOD: 59706 (9.65%)
	No scaling applied
		Model Seed: 13 Seed: 2 ID mean of (MSE, MAE): [610.34125  15.6374 ]
		Model Seed: 13 Seed: 2 OOD mean of (MSE, MAE) stats: [672.2508    16.528618]
		Model Seed: 13 Seed: 2 ID median of (MSE, MAE): [173.57721   11.093198]
		Model Seed: 13 Seed: 2 OOD median of (MSE, MAE) stats: [197.86891   11.818913]
		Model Seed: 13 Seed: 2 ID likelihoods: -26.338754653930664
		Model Seed: 13 Seed: 2 OOD likelihoods: -28.75716209411621
		Model Seed: 13 Seed: 2 ID calibration errors: [0.00215723 0.01875456 0.06694833 0.13167787 0.20250998 0.26944202
 0.32621938 0.3753146  0.41721198 0.45594722 0.48984107 0.5178906 ]
		Model Seed: 13 Seed: 2 OOD calibration errors: [0.00535301 0.02254701 0.07693024 0.14914422 0.2319481  0.30888352
 0.37753117 0.43430158 0.48599532 0.5308143  0.56896263 0.59735   ]
	Model Seed: 13 ID mean of (MSE, MAE): [611.495     15.720625]
	Model Seed: 13 OOD mean of (MSE, MAE): [708.7209    17.052288]
	Model Seed: 13 ID median of (MSE, MAE): [179.77916   11.297852]
	Model Seed: 13 OOD median of (MSE, MAE): [216.2991    12.362244]
	Model Seed: 13 ID likelihoods: -26.195548057556152
	Model Seed: 13 OOD likelihoods: -29.943909645080566
	Model Seed: 13 ID calibration errors: [0.03003702 0.02392751 0.07649282 0.1483824  0.22051716 0.28639793
 0.34287173 0.39071423 0.43143892 0.4692512  0.5014072  0.5275528 ]
	Model Seed: 13 OOD calibration errors: [0.0243911  0.03134403 0.09703937 0.18066853 0.2665253  0.34326726
 0.41093796 0.46801132 0.5170965  0.55875033 0.5943614  0.6210809 ]
	Train: 425413 (68.73%)
	Val: 56593 (9.14%)
	Test: 72022 (11.64%)
	Test OOD: 64922 (10.49%)
	No scaling applied
		Model Seed: 14 Seed: 1 ID mean of (MSE, MAE): [610.4058    15.592942]
		Model Seed: 14 Seed: 1 OOD mean of (MSE, MAE) stats: [750.9207    17.491087]
		Model Seed: 14 Seed: 1 ID median of (MSE, MAE): [171.50107   11.041404]
		Model Seed: 14 Seed: 1 OOD median of (MSE, MAE) stats: [226.79297  12.63799]
		Model Seed: 14 Seed: 1 ID likelihoods: -25.983531951904297
		Model Seed: 14 Seed: 1 OOD likelihoods: -31.387039184570312
		Model Seed: 14 Seed: 1 ID calibration errors: [0.03466086 0.02608519 0.0848768  0.16219132 0.23563205 0.3003308
 0.35387585 0.4006765  0.44068614 0.47952396 0.51130086 0.53560257]
		Model Seed: 14 Seed: 1 OOD calibration errors: [0.02256077 0.02641623 0.11289576 0.2160166  0.30491114 0.3826203
 0.44764644 0.50095993 0.54716295 0.5868199  0.6205703  0.6452966 ]
	Train: 429990 (69.47%)
	Val: 56876 (9.19%)
	Test: 72378 (11.69%)
	Test OOD: 59706 (9.65%)
	No scaling applied
		Model Seed: 14 Seed: 2 ID mean of (MSE, MAE): [623.24805  16.09106]
		Model Seed: 14 Seed: 2 OOD mean of (MSE, MAE) stats: [686.5305    17.086123]
		Model Seed: 14 Seed: 2 ID median of (MSE, MAE): [195.94019   11.926926]
		Model Seed: 14 Seed: 2 OOD median of (MSE, MAE) stats: [231.07405   12.987171]
		Model Seed: 14 Seed: 2 ID likelihoods: -26.424678802490234
		Model Seed: 14 Seed: 2 OOD likelihoods: -28.860836029052734
		Model Seed: 14 Seed: 2 ID calibration errors: [0.1520658  0.10936869 0.16373584 0.23667194 0.30597752 0.36275932
 0.40927967 0.45331958 0.48935676 0.5202756  0.543765   0.562362  ]
		Model Seed: 14 Seed: 2 OOD calibration errors: [0.17556465 0.15051746 0.22007255 0.29957122 0.3692336  0.43265855
 0.4875438  0.532564   0.5720063  0.6026566  0.627514   0.64660007]
	Model Seed: 14 ID mean of (MSE, MAE): [616.8269    15.842001]
	Model Seed: 14 OOD mean of (MSE, MAE): [718.7256    17.288605]
	Model Seed: 14 ID median of (MSE, MAE): [183.72063   11.484165]
	Model Seed: 14 OOD median of (MSE, MAE): [228.9335   12.81258]
	Model Seed: 14 ID likelihoods: -26.204105377197266
	Model Seed: 14 OOD likelihoods: -30.123937606811523
	Model Seed: 14 ID calibration errors: [0.09336333 0.06772694 0.12430632 0.19943163 0.2708048  0.33154505
 0.38157776 0.42699802 0.46502143 0.49989977 0.52753294 0.54898226]
	Model Seed: 14 OOD calibration errors: [0.09906271 0.08846685 0.16648415 0.2577939  0.33707237 0.40763944
 0.4675951  0.51676196 0.5595846  0.59473825 0.62404215 0.6459483 ]
	Train: 425413 (68.73%)
	Val: 56593 (9.14%)
	Test: 72022 (11.64%)
	Test OOD: 64922 (10.49%)
	No scaling applied
		Model Seed: 15 Seed: 1 ID mean of (MSE, MAE): [614.67035   16.063374]
		Model Seed: 15 Seed: 1 OOD mean of (MSE, MAE) stats: [768.9688    18.161724]
		Model Seed: 15 Seed: 1 ID median of (MSE, MAE): [190.47269   11.789093]
		Model Seed: 15 Seed: 1 OOD median of (MSE, MAE) stats: [256.81503   13.716954]
		Model Seed: 15 Seed: 1 ID likelihoods: -26.314651489257812
		Model Seed: 15 Seed: 1 OOD likelihoods: -32.23380661010742
		Model Seed: 15 Seed: 1 ID calibration errors: [0.3051844  0.24961846 0.2655738  0.30052105 0.34244138 0.3865531
 0.4303193  0.4713506  0.5095129  0.5412559  0.566088   0.58761513]
		Model Seed: 15 Seed: 1 OOD calibration errors: [0.3101146  0.2872407  0.3373933  0.39854413 0.45624968 0.51314247
 0.56687516 0.61128914 0.6482786  0.6803509  0.7085454  0.7308408 ]
	Train: 429990 (69.47%)
	Val: 56876 (9.19%)
	Test: 72378 (11.69%)
	Test OOD: 59706 (9.65%)
	No scaling applied
		Model Seed: 15 Seed: 2 ID mean of (MSE, MAE): [617.2237     15.9169445]
		Model Seed: 15 Seed: 2 OOD mean of (MSE, MAE) stats: [680.18317   16.877924]
		Model Seed: 15 Seed: 2 ID median of (MSE, MAE): [192.42586   11.740916]
		Model Seed: 15 Seed: 2 OOD median of (MSE, MAE) stats: [225.39201  12.72752]
		Model Seed: 15 Seed: 2 ID likelihoods: -26.282196044921875
		Model Seed: 15 Seed: 2 OOD likelihoods: -28.72673988342285
		Model Seed: 15 Seed: 2 ID calibration errors: [0.05023231 0.03761778 0.10400339 0.18891934 0.26708633 0.334912
 0.39326704 0.4453593  0.49036264 0.52990466 0.5627621  0.59154   ]
		Model Seed: 15 Seed: 2 OOD calibration errors: [0.05156588 0.05246777 0.13732465 0.23484577 0.32321206 0.39779508
 0.464986   0.5224798  0.57145464 0.6126032  0.6507612  0.6825934 ]
	Model Seed: 15 ID mean of (MSE, MAE): [615.947     15.990159]
	Model Seed: 15 OOD mean of (MSE, MAE): [724.576     17.519825]
	Model Seed: 15 ID median of (MSE, MAE): [191.44928   11.765005]
	Model Seed: 15 OOD median of (MSE, MAE): [241.10352   13.222237]
	Model Seed: 15 ID likelihoods: -26.298423767089844
	Model Seed: 15 OOD likelihoods: -30.480273246765137
	Model Seed: 15 ID calibration errors: [0.17770836 0.14361812 0.1847886  0.24472019 0.30476385 0.36073256
 0.41179317 0.45835495 0.49993777 0.5355803  0.56442505 0.58957756]
	Model Seed: 15 OOD calibration errors: [0.18084024 0.16985424 0.23735899 0.31669495 0.38973087 0.45546877
 0.5159306  0.56688446 0.6098666  0.64647704 0.6796533  0.70671713]
	Train: 425413 (68.73%)
	Val: 56593 (9.14%)
	Test: 72022 (11.64%)
	Test OOD: 64922 (10.49%)
	No scaling applied
		Model Seed: 16 Seed: 1 ID mean of (MSE, MAE): [610.89764   15.764934]
		Model Seed: 16 Seed: 1 OOD mean of (MSE, MAE) stats: [753.72736   17.693695]
		Model Seed: 16 Seed: 1 ID median of (MSE, MAE): [183.81631  11.45714]
		Model Seed: 16 Seed: 1 OOD median of (MSE, MAE) stats: [237.99178   12.982837]
		Model Seed: 16 Seed: 1 ID likelihoods: -26.048675537109375
		Model Seed: 16 Seed: 1 OOD likelihoods: -31.54755210876465
		Model Seed: 16 Seed: 1 ID calibration errors: [0.06011449 0.03810928 0.0958263  0.17432329 0.2516468  0.31552213
 0.3712211  0.41886204 0.4615357  0.49938577 0.53105986 0.55672747]
		Model Seed: 16 Seed: 1 OOD calibration errors: [0.04358469 0.05291814 0.139466   0.24156602 0.3340578  0.41075873
 0.4767765  0.5317534  0.5755728  0.6185066  0.6522953  0.67828196]
	Train: 429990 (69.47%)
	Val: 56876 (9.19%)
	Test: 72378 (11.69%)
	Test OOD: 59706 (9.65%)
	No scaling applied
		Model Seed: 16 Seed: 2 ID mean of (MSE, MAE): [614.065     15.937617]
		Model Seed: 16 Seed: 2 OOD mean of (MSE, MAE) stats: [678.19946   16.878675]
		Model Seed: 16 Seed: 2 ID median of (MSE, MAE): [188.97542    11.7375345]
		Model Seed: 16 Seed: 2 OOD median of (MSE, MAE) stats: [219.14867   12.635082]
		Model Seed: 16 Seed: 2 ID likelihoods: -26.128433227539062
		Model Seed: 16 Seed: 2 OOD likelihoods: -28.58370018005371
		Model Seed: 16 Seed: 2 ID calibration errors: [0.23059194 0.18237048 0.219179   0.27836287 0.33698785 0.39038008
 0.43609366 0.47718957 0.515277   0.5491943  0.57415426 0.5958318 ]
		Model Seed: 16 Seed: 2 OOD calibration errors: [0.23045602 0.20249729 0.26124692 0.33442736 0.40281132 0.46239734
 0.5158236  0.5646628  0.6050956  0.64011353 0.6667804  0.6933454 ]
	Model Seed: 16 ID mean of (MSE, MAE): [612.4813    15.851275]
	Model Seed: 16 OOD mean of (MSE, MAE): [715.9634    17.286186]
	Model Seed: 16 ID median of (MSE, MAE): [186.39587   11.597338]
	Model Seed: 16 OOD median of (MSE, MAE): [228.57022  12.80896]
	Model Seed: 16 ID likelihoods: -26.08855438232422
	Model Seed: 16 OOD likelihoods: -30.06562614440918
	Model Seed: 16 ID calibration errors: [0.14535321 0.11023988 0.15750265 0.22634308 0.2943173  0.3529511
 0.40365738 0.44802582 0.48840636 0.52429    0.55260706 0.57627964]
	Model Seed: 16 OOD calibration errors: [0.13702036 0.12770772 0.20035645 0.28799668 0.36843455 0.43657804
 0.49630004 0.5482081  0.5903342  0.6293101  0.65953785 0.68581367]
	Train: 425413 (68.73%)
	Val: 56593 (9.14%)
	Test: 72022 (11.64%)
	Test OOD: 64922 (10.49%)
	No scaling applied
		Model Seed: 17 Seed: 1 ID mean of (MSE, MAE): [613.3653    15.756435]
		Model Seed: 17 Seed: 1 OOD mean of (MSE, MAE) stats: [753.314     17.652073]
		Model Seed: 17 Seed: 1 ID median of (MSE, MAE): [181.0921   11.32641]
		Model Seed: 17 Seed: 1 OOD median of (MSE, MAE) stats: [236.96315    12.9711275]
		Model Seed: 17 Seed: 1 ID likelihoods: -26.06772232055664
		Model Seed: 17 Seed: 1 OOD likelihoods: -31.455547332763672
		Model Seed: 17 Seed: 1 ID calibration errors: [0.02610006 0.02238495 0.09805545 0.18043387 0.25598663 0.3253358
 0.38557357 0.434327   0.4782723  0.51869667 0.5527076  0.57759833]
		Model Seed: 17 Seed: 1 OOD calibration errors: [0.02050229 0.03496026 0.13973755 0.24507697 0.3391188  0.42161423
 0.49218157 0.5490564  0.5956653  0.63952214 0.6740794  0.6989056 ]
	Train: 429990 (69.47%)
	Val: 56876 (9.19%)
	Test: 72378 (11.69%)
	Test OOD: 59706 (9.65%)
	No scaling applied
		Model Seed: 17 Seed: 2 ID mean of (MSE, MAE): [612.14307   15.814161]
		Model Seed: 17 Seed: 2 OOD mean of (MSE, MAE) stats: [679.3655    16.799488]
		Model Seed: 17 Seed: 2 ID median of (MSE, MAE): [179.2323    11.355732]
		Model Seed: 17 Seed: 2 OOD median of (MSE, MAE) stats: [211.60457   12.315585]
		Model Seed: 17 Seed: 2 ID likelihoods: -26.13564682006836
		Model Seed: 17 Seed: 2 OOD likelihoods: -28.715648651123047
		Model Seed: 17 Seed: 2 ID calibration errors: [0.23066022 0.19074017 0.22182906 0.2746679  0.32872337 0.3787812
 0.42571086 0.46656537 0.50288093 0.5342629  0.55862635 0.5807202 ]
		Model Seed: 17 Seed: 2 OOD calibration errors: [0.2095764  0.19823277 0.25560144 0.32426387 0.38842598 0.4481135
 0.5020076  0.5506797  0.59124124 0.624581   0.6528038  0.6769695 ]
	Model Seed: 17 ID mean of (MSE, MAE): [612.75415   15.785298]
	Model Seed: 17 OOD mean of (MSE, MAE): [716.3397   17.22578]
	Model Seed: 17 ID median of (MSE, MAE): [180.1622    11.341071]
	Model Seed: 17 OOD median of (MSE, MAE): [224.28386   12.643356]
	Model Seed: 17 ID likelihoods: -26.1016845703125
	Model Seed: 17 OOD likelihoods: -30.08559799194336
	Model Seed: 17 ID calibration errors: [0.12838013 0.10656255 0.15994225 0.22755088 0.292355   0.3520585
 0.4056422  0.4504462  0.49057662 0.5264798  0.555667   0.57915926]
	Model Seed: 17 OOD calibration errors: [0.11503934 0.11659651 0.19766949 0.2846704  0.3637724  0.43486387
 0.49709457 0.54986805 0.5934533  0.6320516  0.6634416  0.68793756]
	Train: 425413 (68.73%)
	Val: 56593 (9.14%)
	Test: 72022 (11.64%)
	Test OOD: 64922 (10.49%)
	No scaling applied
		Model Seed: 18 Seed: 1 ID mean of (MSE, MAE): [615.5514   15.69787]
		Model Seed: 18 Seed: 1 OOD mean of (MSE, MAE) stats: [754.2061    17.560835]
		Model Seed: 18 Seed: 1 ID median of (MSE, MAE): [175.82964   11.103695]
		Model Seed: 18 Seed: 1 OOD median of (MSE, MAE) stats: [226.71461   12.643943]
		Model Seed: 18 Seed: 1 ID likelihoods: -26.15945053100586
		Model Seed: 18 Seed: 1 OOD likelihoods: -31.46442222595215
		Model Seed: 18 Seed: 1 ID calibration errors: [0.07197344 0.05936222 0.10130749 0.16536643 0.23617995 0.29793286
 0.3502835  0.39602587 0.4356131  0.47376046 0.50471103 0.5325994 ]
		Model Seed: 18 Seed: 1 OOD calibration errors: [0.08168933 0.06089283 0.11245272 0.1991634  0.28936434 0.36775276
 0.43420994 0.48931363 0.5361697  0.57981825 0.61340415 0.64413774]
	Train: 429990 (69.47%)
	Val: 56876 (9.19%)
	Test: 72378 (11.69%)
	Test OOD: 59706 (9.65%)
	No scaling applied
		Model Seed: 18 Seed: 2 ID mean of (MSE, MAE): [613.2563    15.666181]
		Model Seed: 18 Seed: 2 OOD mean of (MSE, MAE) stats: [674.8451    16.575195]
		Model Seed: 18 Seed: 2 ID median of (MSE, MAE): [174.87532   11.135437]
		Model Seed: 18 Seed: 2 OOD median of (MSE, MAE) stats: [204.11845   12.049339]
		Model Seed: 18 Seed: 2 ID likelihoods: -26.21786880493164
		Model Seed: 18 Seed: 2 OOD likelihoods: -28.58757972717285
		Model Seed: 18 Seed: 2 ID calibration errors: [0.03778283 0.01576153 0.08139247 0.165088   0.24213056 0.30966812
 0.36811125 0.41737354 0.45938784 0.4949355  0.51982564 0.5423175 ]
		Model Seed: 18 Seed: 2 OOD calibration errors: [0.03109256 0.01955443 0.10496059 0.20438454 0.29251966 0.3675859
 0.43420213 0.49104425 0.53627574 0.5730138  0.6056177  0.63185674]
	Model Seed: 18 ID mean of (MSE, MAE): [614.4038    15.682026]
	Model Seed: 18 OOD mean of (MSE, MAE): [714.52563   17.068016]
	Model Seed: 18 ID median of (MSE, MAE): [175.35248   11.119566]
	Model Seed: 18 OOD median of (MSE, MAE): [215.41653   12.346642]
	Model Seed: 18 ID likelihoods: -26.18865966796875
	Model Seed: 18 OOD likelihoods: -30.0260009765625
	Model Seed: 18 ID calibration errors: [0.05487814 0.03756187 0.09134998 0.1652272  0.23915526 0.3038005
 0.35919738 0.40669972 0.44750047 0.484348   0.5122683  0.5374584 ]
	Model Seed: 18 OOD calibration errors: [0.05639094 0.04022363 0.10870665 0.20177397 0.290942   0.36766934
 0.43420604 0.49017894 0.5362227  0.576416   0.6095109  0.63799727]
	Train: 425413 (68.73%)
	Val: 56593 (9.14%)
	Test: 72022 (11.64%)
	Test OOD: 64922 (10.49%)
	No scaling applied
		Model Seed: 19 Seed: 1 ID mean of (MSE, MAE): [615.04877   15.862856]
		Model Seed: 19 Seed: 1 OOD mean of (MSE, MAE) stats: [761.9632    17.862597]
		Model Seed: 19 Seed: 1 ID median of (MSE, MAE): [183.21066   11.414493]
		Model Seed: 19 Seed: 1 OOD median of (MSE, MAE) stats: [243.45012   13.179165]
		Model Seed: 19 Seed: 1 ID likelihoods: -26.165740966796875
		Model Seed: 19 Seed: 1 OOD likelihoods: -31.8255615234375
		Model Seed: 19 Seed: 1 ID calibration errors: [0.09945785 0.0957078  0.14671373 0.21061389 0.27160946 0.32989007
 0.3816212  0.42593375 0.46661097 0.50178736 0.5332548  0.5579637 ]
		Model Seed: 19 Seed: 1 OOD calibration errors: [0.07042657 0.10410466 0.19624741 0.29126674 0.3703151  0.43912664
 0.49964076 0.54835856 0.58953166 0.6257254  0.6582356  0.68342215]
	Train: 429990 (69.47%)
	Val: 56876 (9.19%)
	Test: 72378 (11.69%)
	Test OOD: 59706 (9.65%)
	No scaling applied
		Model Seed: 19 Seed: 2 ID mean of (MSE, MAE): [607.0905    15.683954]
		Model Seed: 19 Seed: 2 OOD mean of (MSE, MAE) stats: [662.5503    16.502813]
		Model Seed: 19 Seed: 2 ID median of (MSE, MAE): [185.27174   11.488277]
		Model Seed: 19 Seed: 2 OOD median of (MSE, MAE) stats: [210.73187   12.219447]
		Model Seed: 19 Seed: 2 ID likelihoods: -25.94052505493164
		Model Seed: 19 Seed: 2 OOD likelihoods: -28.089664459228516
		Model Seed: 19 Seed: 2 ID calibration errors: [0.01171872 0.02646041 0.09973267 0.18228114 0.2547115  0.31435806
 0.3663134  0.40952572 0.4442727  0.47742128 0.50510323 0.5272789 ]
		Model Seed: 19 Seed: 2 OOD calibration errors: [0.0136517  0.03761538 0.12479314 0.21908411 0.29748315 0.36414787
 0.4214118  0.46832368 0.51200676 0.5465306  0.57708716 0.60213417]
	Model Seed: 19 ID mean of (MSE, MAE): [611.06964   15.773405]
	Model Seed: 19 OOD mean of (MSE, MAE): [712.2567    17.182705]
	Model Seed: 19 ID median of (MSE, MAE): [184.24121    11.4513855]
	Model Seed: 19 OOD median of (MSE, MAE): [227.091      12.6993065]
	Model Seed: 19 ID likelihoods: -26.053133010864258
	Model Seed: 19 OOD likelihoods: -29.957612991333008
	Model Seed: 19 ID calibration errors: [0.05558829 0.06108411 0.1232232  0.19644752 0.26316047 0.32212406
 0.3739673  0.41772974 0.45544183 0.48960432 0.519179   0.5426213 ]
	Model Seed: 19 OOD calibration errors: [0.04203914 0.07086002 0.16052029 0.2551754  0.33389914 0.40163726
 0.4605263  0.50834113 0.5507692  0.586128   0.61766136 0.64277816]
ID mean of (MSE, MAE): [613.2927856445312, 15.810676574707031] +- [2.1221261024475098, 0.09496807307004929] +- [0.3118645  0.01960307] 
OOD mean of (MSE, MAE): [715.4378051757812, 17.237789154052734] +- [4.185544967651367, 0.13478852808475494] +- [40.001323   0.5164698] 
ID median of (MSE, MAE): [183.4557342529297, 11.447234153747559] +- [4.8360748291015625, 0.1862076222896576] +- [0.6992245  0.01316863] 
OOD median of (MSE, MAE): [226.7198944091797, 12.715423583984375] +- [7.391016006469727, 0.25331032276153564] +- [14.594409    0.39765802] 
ID likelihoods: -26.15172348022461 +- 0.0687593128376103 +- 0.03105697631835902 
OOD likelihoods: -30.082804584503172 +- 0.14387149610602484 +- 1.485883808135986 
ID calibration errors: [0.09971614181995392, 0.08092229068279266, 0.1305502951145172, 0.19906850159168243, 0.26710250973701477, 0.32820093631744385, 0.381046861410141, 0.42719483375549316, 0.46756434440612793, 0.5035830736160278, 0.5329709649085999, 0.5572377443313599] +- [0.048299696296453476, 0.03986580669879913, 0.03798159211874008, 0.036001402884721756, 0.03303822502493858, 0.03027958609163761, 0.028302226215600967, 0.02690119668841362, 0.02631474658846855, 0.02494298852980137, 0.023603327572345734, 0.022321345284581184] +- [5.2141110e-03 6.7097425e-03 6.8981330e-03 6.9237615e-03 6.2705715e-03
 5.1533050e-03 3.9681865e-03 3.5972555e-03 2.8238875e-03 1.4806200e-03
 9.2471000e-05 9.5214000e-04] 
OOD calibration errors: [0.09438960254192352, 0.09387329965829849, 0.16587403416633606, 0.2526169419288635, 0.33390918374061584, 0.405517041683197, 0.467773973941803, 0.5203211307525635, 0.5648847818374634, 0.6031287908554077, 0.6353073120117188, 0.6611431241035461] +- [0.04783126339316368, 0.04729754105210304, 0.05001863092184067, 0.048259664326906204, 0.043930936604738235, 0.04037344455718994, 0.03723406419157982, 0.03466600924730301, 0.03244658187031746, 0.030551016330718994, 0.02899082563817501, 0.028299691155552864] +- [0.00914914 0.00585125 0.00057455 0.00522343 0.00953863 0.01319839
 0.01549309 0.01649676 0.01621264 0.01749982 0.01792043 0.01812508] 
