Find best regularization using val_mask
gat_ntk3 finished
+----------------+---------------------------+-----------------------------------+--------------------------------+----------------+---------------------------+---------------------+-----------------------------
--------------------+
|                |                           |                                   |                                |                |                           |                     | Dataset: fcora Layer: 2 Adja
cency: [AddEye()]   |
+================+===========================+===================================+================================+================+===========================+=====================+=============================
====================+
| gat_gp-linear  | ('kernel_fro', 1.26)      | ('train_loss_best_perf', 183.702) | ('train_loss_no_reg', 181.629) | ('reg', 1.0)   | ('best_acc_train', 0.756) | ('Test acc', 0.791) | ('time', 103.88)
                    |
+----------------+---------------------------+-----------------------------------+--------------------------------+----------------+---------------------------+---------------------+-----------------------------
--------------------+
| gat_ntk-linear | ('kernel_fro', 5.06)      | ('train_loss_best_perf', 183.702) | ('train_loss_no_reg', 181.629) | ('reg', 1.0)   | ('best_acc_train', 0.756) | ('Test acc', 0.791) | ('time', 103.88)
                    |
+----------------+---------------------------+-----------------------------------+--------------------------------+----------------+---------------------------+---------------------+-----------------------------
--------------------+
| gat_gp         | ('kernel_fro', 6.13)      | ('train_loss_best_perf', 168.585) | ('train_loss_no_reg', 173.08)  | ('reg', 0.132) | ('best_acc_train', 0.76)  | ('Test acc', 0.794) | ('time', 104.17)
                    |
+----------------+---------------------------+-----------------------------------+--------------------------------+----------------+---------------------------+---------------------+-----------------------------
--------------------+
| gat_ntk        | ('kernel_fro', 13.82)     | ('train_loss_best_perf', 168.586) | ('train_loss_no_reg', 172.078) | ('reg', 0.04)  | ('best_acc_train', 0.762) | ('Test acc', 0.79)  | ('time', 104.17)
                    |
+----------------+---------------------------+-----------------------------------+--------------------------------+----------------+---------------------------+---------------------+-----------------------------
--------------------+
| gat_gp2        | ('kernel_fro', 6.13)      | ('train_loss_best_perf', 168.585) | ('train_loss_no_reg', 173.08)  | ('reg', 0.132) | ('best_acc_train', 0.76)  | ('Test acc', 0.794) | ('time', 208.88)
                    |
+----------------+---------------------------+-----------------------------------+--------------------------------+----------------+---------------------------+---------------------+-----------------------------
--------------------+
| gat_ntk2       | ('kernel_fro', 106505.86) | ('train_loss_best_perf', 168.894) | ('train_loss_no_reg', 172.672) | ('reg', 0.174) | ('best_acc_train', 0.762) | ('Test acc', 0.8)   | ('time', 208.88)
                    |
+----------------+---------------------------+-----------------------------------+--------------------------------+----------------+---------------------------+---------------------+-----------------------------
--------------------+
| gat_gp3        | ('kernel_fro', 2.4)       | ('train_loss_best_perf', 183.611) | ('train_loss_no_reg', 181.387) | ('reg', 1.0)   | ('best_acc_train', 0.756) | ('Test acc', 0.791) | ('time', 204.98)                                |
+----------------+---------------------------+-----------------------------------+--------------------------------+----------------+---------------------------+---------------------+-------------------------------------------------+
| gat_ntk3       | ('kernel_fro', 7006.78)   | ('train_loss_best_perf', 183.774) | ('train_loss_no_reg', 181.755) | ('reg', 1.0)   | ('best_acc_train', 0.756) | ('Test acc', 0.791) | ('time', 204.98)                                |
+----------------+---------------------------+-----------------------------------+--------------------------------+----------------+---------------------------+---------------------+-------------------------------------------------+


+----------------+--------------------------+-----------------------------------+--------------------------------+----------------+---------------------------+---------------------+-----------------------------------------------------+
|                |                          |                                   |                                |                |                           |                     | Dataset: fciteseer Layer: 2 Adjacency: [AddEye()]   |
+================+==========================+===================================+================================+================+===========================+=====================+=====================================================+
| gat_gp-linear  | ('kernel_fro', 0.14)     | ('train_loss_best_perf', 199.328) | ('train_loss_no_reg', 189.405) | ('reg', 2.089) | ('best_acc_train', 0.708) | ('Test acc', 0.717) | ('time', 136.09)                                    |
+----------------+--------------------------+-----------------------------------+--------------------------------+----------------+---------------------------+---------------------+-----------------------------------------------------+
| gat_ntk-linear | ('kernel_fro', 0.56)     | ('train_loss_best_perf', 199.328) | ('train_loss_no_reg', 189.405) | ('reg', 2.089) | ('best_acc_train', 0.708) | ('Test acc', 0.717) | ('time', 136.09)                                    |
+----------------+--------------------------+-----------------------------------+--------------------------------+----------------+---------------------------+---------------------+-----------------------------------------------------+
| gat_gp         | ('kernel_fro', 1.29)     | ('train_loss_best_perf', 193.407) | ('train_loss_no_reg', 186.287) | ('reg', 1.096) | ('best_acc_train', 0.7)   | ('Test acc', 0.712) | ('time', 140.38)                                    |
+----------------+--------------------------+-----------------------------------+--------------------------------+----------------+---------------------------+---------------------+-----------------------------------------------------+
| gat_ntk        | ('kernel_fro', 2.84)     | ('train_loss_best_perf', 193.285) | ('train_loss_no_reg', 186.044) | ('reg', 1.202) | ('best_acc_train', 0.698) | ('Test acc', 0.713) | ('time', 140.38)                                    |
+----------------+--------------------------+-----------------------------------+--------------------------------+----------------+---------------------------+---------------------+-----------------------------------------------------+
| gat_gp2        | ('kernel_fro', 1.29)     | ('train_loss_best_perf', 193.407) | ('train_loss_no_reg', 186.287) | ('reg', 1.096) | ('best_acc_train', 0.7)   | ('Test acc', 0.712) | ('time', 261.9)                                     |
+----------------+--------------------------+-----------------------------------+--------------------------------+----------------+---------------------------+---------------------+-----------------------------------------------------+
| gat_ntk2       | ('kernel_fro', 27557.44) | ('train_loss_best_perf', 193.269) | ('train_loss_no_reg', 186.326) | ('reg', 1.096) | ('best_acc_train', 0.704) | ('Test acc', 0.714) | ('time', 261.9)                                     |
+----------------+--------------------------+-----------------------------------+--------------------------------+----------------+---------------------------+---------------------+-----------------------------------------------------+
| gat_gp3        | ('kernel_fro', 0.27)     | ('train_loss_best_perf', 199.285) | ('train_loss_no_reg', 189.271) | ('reg', 2.089) | ('best_acc_train', 0.708) | ('Test acc', 0.717) | ('time', 249.6)                                     |
+----------------+--------------------------+-----------------------------------+--------------------------------+----------------+---------------------------+---------------------+-----------------------------------------------------+
| gat_ntk3       | ('kernel_fro', 966.2)    | ('train_loss_best_perf', 199.324) | ('train_loss_no_reg', 189.4)   | ('reg', 2.089) | ('best_acc_train', 0.708) | ('Test acc', 0.717) | ('time', 249.6)                                     |
+----------------+--------------------------+-----------------------------------+--------------------------------+----------------+---------------------------+---------------------+-----------------------------------------------------+
Total Time : 23.59


+----------------+----------------------------------+-----------------------------------+--------------------------------+----------------+---------------------------+---------------------+----------------------
---------------------------+
|                |                                  |                                   |                                |                |                           |                     | Dataset: fwiki Layer:
 2 Adjacency: [AddEye()]   |
+================+==================================+===================================+================================+================+===========================+=====================+======================
===========================+
| gat_gp-linear  | ('kernel_fro', 136293384000.0)   | ('train_loss_best_perf', 314.792) | ('train_loss_no_reg', 350.388) | ('reg', 0.002) | ('best_acc_train', 0.732) | ('Test acc', 0.744) | ('time', 396.18)
                           |
+----------------+----------------------------------+-----------------------------------+--------------------------------+----------------+---------------------------+---------------------+----------------------
---------------------------+
| gat_ntk-linear | ('kernel_fro', 545173540000.0)   | ('train_loss_best_perf', 314.792) | ('train_loss_no_reg', 350.388) | ('reg', 0.002) | ('best_acc_train', 0.732) | ('Test acc', 0.744) | ('time', 396.18)
                           |
+----------------+----------------------------------+-----------------------------------+--------------------------------+----------------+---------------------------+---------------------+----------------------
---------------------------+

---------------------------+
| gat_gp         | ('kernel_fro', 587034660000.0)   | ('train_loss_best_perf', 354.579) | ('train_loss_no_reg', 832.3)   | ('reg', 0.016) | ('best_acc_train', 0.769) | ('Test acc', 0.775) | ('time', 304.68)
                           |
+----------------+----------------------------------+-----------------------------------+--------------------------------+----------------+---------------------------+---------------------+----------------------
---------------------------+
| gat_ntk        | ('kernel_fro', 1282079900000.0)  | ('train_loss_best_perf', 373.69)  | ('train_loss_no_reg', 610.282) | ('reg', 0.007) | ('best_acc_train', 0.757) | ('Test acc', 0.771) | ('time', 304.68)                                |
+----------------+----------------------------------+-----------------------------------+--------------------------------+----------------+---------------------------+---------------------+-------------------------------------------------+
| gat_gp2        | ('kernel_fro', 587034660000.0)   | ('train_loss_best_perf', 354.579) | ('train_loss_no_reg', 832.3)   | ('reg', 0.016) | ('best_acc_train', 0.769) | ('Test acc', 0.775) | ('time', 696.54)                                |
+----------------+----------------------------------+-----------------------------------+--------------------------------+----------------+---------------------------+---------------------+-------------------------------------------------+
| gat_ntk2       | ('kernel_fro', 17524455000000.0) | ('train_loss_best_perf', 464.898) | ('train_loss_no_reg', 789.186) | ('reg', 0.016) | ('best_acc_train', 0.786) | ('Test acc', 0.798) | ('time', 696.54)                                |
+----------------+----------------------------------+-----------------------------------+--------------------------------+----------------+---------------------------+---------------------+-------------------------------------------------+
| gat_gp3        | ('kernel_fro', 572828.44)        | ('train_loss_best_perf', 153.651) | ('train_loss_no_reg', 181.044) | ('reg', 0.023) | ('best_acc_train', 0.8)   | ('Test acc', 0.802) | ('time', 708.33)                                |
+----------------+----------------------------------+-----------------------------------+--------------------------------+----------------+---------------------------+---------------------+-------------------------------------------------+
| gat_ntk3       | ('kernel_fro', 2183467800.0)     | ('train_loss_best_perf', 197.309) | ('train_loss_no_reg', 214.098) | ('reg', 0.009) | ('best_acc_train', 0.794) | ('Test acc', 0.78)  | ('time', 708.33)                                |
+----------------+----------------------------------+-----------------------------------+--------------------------------+----------------+---------------------------+---------------------+-------------------------------------------------+
Total Time : 35.66