/data/home/weiyb/miniconda3/envs/NLGraph/lib/python3.10/site-packages/torchvision/models/_utils.py:208: UserWarning: The parameter 'pretrained' is deprecated since 0.13 and may be removed in the future, please use 'weights' instead.
  warnings.warn(
/data/home/weiyb/miniconda3/envs/NLGraph/lib/python3.10/site-packages/torchvision/models/_utils.py:223: UserWarning: Arguments other than a weight enum or `None` for 'weights' are deprecated since 0.13 and may be removed in the future. The current behavior is equivalent to passing `weights=ResNet50_Weights.IMAGENET1K_V1`. You can also use `weights=ResNet50_Weights.DEFAULT` to get the most up-to-date weights.
  warnings.warn(msg)
cat_node_feat_mf:  False
cat_n2v_feat:  False
Namespace(use_val_edges_as_input=False, data_name='cora', neg_mode='equal', gnn_model='GCN', score_model='mlp_score', load=None, loadmod=False, savemod=False, num_layers=1, num_layers_predictor=3, hidden_channels=128, dropout=0.3, batch_size=256, lr=0.005, epochs=1000, eval_steps=5, runs=5, kill_cnt=10, output_dir='/data/home/weiyb/HeaRT/checkpoints/GNN', l2=0.0001, seed=42, velr=0.0, fslr=0.005, hop_num=2, id=5, feat=10, VE='resnet50', test=False, layout_aug=False, save=False, use_saved_model=False, metric='MRR', device=0, log_steps=1, gin_mlp_layer=2, gat_head=1, cat_node_feat_mf=False, cat_n2v_feat=False)
the number of nodes in cora is:  2708
2708 tensor(2707)
dataset split 
train edge 4488
valid edge 263
valid edge_neg 263
test edge 527
test edge_neg 527
#################################           0           #################################
seed:  0
No saved model parameters found. Starting training from scratch.
layers in gcn:  1
train valid_pos valid_neg test_pos test_neg torch.Size([263]) torch.Size([263]) torch.Size([263]) torch.Size([527]) torch.Size([527])
Hits@1
2024-06-25 16:28:34,378 - [INFO] - Run: 01, Epoch: 05, Loss: 0.4492, Valid: 1.14%, Test: 1.14%
Hits@3
2024-06-25 16:28:34,378 - [INFO] - Run: 01, Epoch: 05, Loss: 0.4492, Valid: 1.52%, Test: 2.85%
Hits@10
2024-06-25 16:28:34,378 - [INFO] - Run: 01, Epoch: 05, Loss: 0.4492, Valid: 9.89%, Test: 8.54%
Hits@100
2024-06-25 16:28:34,378 - [INFO] - Run: 01, Epoch: 05, Loss: 0.4492, Valid: 54.37%, Test: 26.57%
MRR
2024-06-25 16:28:34,378 - [INFO] - Run: 01, Epoch: 05, Loss: 0.4492, Valid: 3.82%, Test: 3.63%
AUC
2024-06-25 16:28:34,378 - [INFO] - Run: 01, Epoch: 05, Loss: 0.4492, Valid: 60.49%, Test: 56.56%
AP
2024-06-25 16:28:34,378 - [INFO] - Run: 01, Epoch: 05, Loss: 0.4492, Valid: 60.41%, Test: 59.33%
---
Best Current: 3.63_5
train valid_pos valid_neg test_pos test_neg torch.Size([263]) torch.Size([263]) torch.Size([263]) torch.Size([527]) torch.Size([527])
Hits@1
2024-06-25 18:36:04,852 - [INFO] - Run: 01, Epoch: 10, Loss: 0.1464, Valid: 0.38%, Test: 1.33%
Hits@3
2024-06-25 18:36:04,852 - [INFO] - Run: 01, Epoch: 10, Loss: 0.1464, Valid: 1.90%, Test: 2.28%
Hits@10
2024-06-25 18:36:04,852 - [INFO] - Run: 01, Epoch: 10, Loss: 0.1464, Valid: 13.31%, Test: 8.54%
Hits@100
2024-06-25 18:36:04,853 - [INFO] - Run: 01, Epoch: 10, Loss: 0.1464, Valid: 55.13%, Test: 28.27%
MRR
2024-06-25 18:36:04,853 - [INFO] - Run: 01, Epoch: 10, Loss: 0.1464, Valid: 4.64%, Test: 3.54%
AUC
2024-06-25 18:36:04,853 - [INFO] - Run: 01, Epoch: 10, Loss: 0.1464, Valid: 61.96%, Test: 54.86%
AP
2024-06-25 18:36:04,853 - [INFO] - Run: 01, Epoch: 10, Loss: 0.1464, Valid: 63.63%, Test: 58.30%
---
Best Current: 3.54_10
train valid_pos valid_neg test_pos test_neg torch.Size([263]) torch.Size([263]) torch.Size([263]) torch.Size([527]) torch.Size([527])
Hits@1
2024-06-25 19:44:40,079 - [INFO] - Run: 01, Epoch: 15, Loss: 0.1031, Valid: 0.76%, Test: 2.09%
Hits@3
2024-06-25 19:44:40,079 - [INFO] - Run: 01, Epoch: 15, Loss: 0.1031, Valid: 1.52%, Test: 3.04%
Hits@10
2024-06-25 19:44:40,079 - [INFO] - Run: 01, Epoch: 15, Loss: 0.1031, Valid: 12.55%, Test: 5.69%
Hits@100
2024-06-25 19:44:40,079 - [INFO] - Run: 01, Epoch: 15, Loss: 0.1031, Valid: 45.63%, Test: 21.63%
MRR
2024-06-25 19:44:40,079 - [INFO] - Run: 01, Epoch: 15, Loss: 0.1031, Valid: 3.84%, Test: 3.70%
AUC
2024-06-25 19:44:40,080 - [INFO] - Run: 01, Epoch: 15, Loss: 0.1031, Valid: 55.79%, Test: 47.62%
AP
2024-06-25 19:44:40,080 - [INFO] - Run: 01, Epoch: 15, Loss: 0.1031, Valid: 58.36%, Test: 53.31%
---
train valid_pos valid_neg test_pos test_neg torch.Size([263]) torch.Size([263]) torch.Size([263]) torch.Size([527]) torch.Size([527])
Hits@1
2024-06-25 20:39:19,232 - [INFO] - Run: 01, Epoch: 20, Loss: 0.0530, Valid: 1.14%, Test: 0.76%
Hits@3
2024-06-25 20:39:19,232 - [INFO] - Run: 01, Epoch: 20, Loss: 0.0530, Valid: 1.52%, Test: 3.98%
Hits@10
2024-06-25 20:39:19,232 - [INFO] - Run: 01, Epoch: 20, Loss: 0.0530, Valid: 13.69%, Test: 7.78%
Hits@100
2024-06-25 20:39:19,232 - [INFO] - Run: 01, Epoch: 20, Loss: 0.0530, Valid: 53.61%, Test: 22.58%
MRR
2024-06-25 20:39:19,232 - [INFO] - Run: 01, Epoch: 20, Loss: 0.0530, Valid: 4.58%, Test: 3.32%
AUC
2024-06-25 20:39:19,232 - [INFO] - Run: 01, Epoch: 20, Loss: 0.0530, Valid: 58.72%, Test: 50.28%
AP
2024-06-25 20:39:19,232 - [INFO] - Run: 01, Epoch: 20, Loss: 0.0530, Valid: 60.67%, Test: 54.87%
---
train valid_pos valid_neg test_pos test_neg torch.Size([263]) torch.Size([263]) torch.Size([263]) torch.Size([527]) torch.Size([527])
Hits@1
2024-06-25 21:31:22,285 - [INFO] - Run: 01, Epoch: 25, Loss: 0.1440, Valid: 1.14%, Test: 0.95%
Hits@3
2024-06-25 21:31:22,286 - [INFO] - Run: 01, Epoch: 25, Loss: 0.1440, Valid: 4.56%, Test: 5.12%
Hits@10
2024-06-25 21:31:22,286 - [INFO] - Run: 01, Epoch: 25, Loss: 0.1440, Valid: 17.49%, Test: 6.45%
Hits@100
2024-06-25 21:31:22,286 - [INFO] - Run: 01, Epoch: 25, Loss: 0.1440, Valid: 57.79%, Test: 30.36%
MRR
2024-06-25 21:31:22,286 - [INFO] - Run: 01, Epoch: 25, Loss: 0.1440, Valid: 6.04%, Test: 3.82%
AUC
2024-06-25 21:31:22,286 - [INFO] - Run: 01, Epoch: 25, Loss: 0.1440, Valid: 63.35%, Test: 56.36%
AP
2024-06-25 21:31:22,286 - [INFO] - Run: 01, Epoch: 25, Loss: 0.1440, Valid: 65.93%, Test: 59.85%
---
Best Current: 3.82_25
train valid_pos valid_neg test_pos test_neg torch.Size([263]) torch.Size([263]) torch.Size([263]) torch.Size([527]) torch.Size([527])
Hits@1
2024-06-25 23:06:26,434 - [INFO] - Run: 01, Epoch: 30, Loss: 0.0575, Valid: 0.38%, Test: 1.33%
Hits@3
2024-06-25 23:06:26,434 - [INFO] - Run: 01, Epoch: 30, Loss: 0.0575, Valid: 1.14%, Test: 2.66%
Hits@10
2024-06-25 23:06:26,434 - [INFO] - Run: 01, Epoch: 30, Loss: 0.0575, Valid: 9.89%, Test: 6.45%
Hits@100
2024-06-25 23:06:26,434 - [INFO] - Run: 01, Epoch: 30, Loss: 0.0575, Valid: 49.05%, Test: 21.63%
MRR
2024-06-25 23:06:26,434 - [INFO] - Run: 01, Epoch: 30, Loss: 0.0575, Valid: 3.68%, Test: 3.34%
AUC
2024-06-25 23:06:26,434 - [INFO] - Run: 01, Epoch: 30, Loss: 0.0575, Valid: 57.64%, Test: 50.29%
AP
2024-06-25 23:06:26,434 - [INFO] - Run: 01, Epoch: 30, Loss: 0.0575, Valid: 59.33%, Test: 54.76%
---
train valid_pos valid_neg test_pos test_neg torch.Size([263]) torch.Size([263]) torch.Size([263]) torch.Size([527]) torch.Size([527])
Hits@1
2024-06-26 01:05:25,289 - [INFO] - Run: 01, Epoch: 35, Loss: 0.0595, Valid: 1.14%, Test: 1.71%
Hits@3
2024-06-26 01:05:25,290 - [INFO] - Run: 01, Epoch: 35, Loss: 0.0595, Valid: 3.04%, Test: 2.47%
Hits@10
2024-06-26 01:05:25,290 - [INFO] - Run: 01, Epoch: 35, Loss: 0.0595, Valid: 4.56%, Test: 4.93%
Hits@100
2024-06-26 01:05:25,290 - [INFO] - Run: 01, Epoch: 35, Loss: 0.0595, Valid: 44.87%, Test: 21.25%
MRR
2024-06-26 01:05:25,290 - [INFO] - Run: 01, Epoch: 35, Loss: 0.0595, Valid: 3.71%, Test: 3.09%
AUC
2024-06-26 01:05:25,290 - [INFO] - Run: 01, Epoch: 35, Loss: 0.0595, Valid: 54.24%, Test: 46.20%
AP
2024-06-26 01:05:25,290 - [INFO] - Run: 01, Epoch: 35, Loss: 0.0595, Valid: 56.25%, Test: 51.27%
---
train valid_pos valid_neg test_pos test_neg torch.Size([263]) torch.Size([263]) torch.Size([263]) torch.Size([527]) torch.Size([527])
Hits@1
2024-06-26 02:58:17,749 - [INFO] - Run: 01, Epoch: 40, Loss: 0.0259, Valid: 1.52%, Test: 0.95%
Hits@3
2024-06-26 02:58:17,749 - [INFO] - Run: 01, Epoch: 40, Loss: 0.0259, Valid: 1.90%, Test: 3.23%
Hits@10
2024-06-26 02:58:17,749 - [INFO] - Run: 01, Epoch: 40, Loss: 0.0259, Valid: 8.75%, Test: 5.50%
Hits@100
2024-06-26 02:58:17,749 - [INFO] - Run: 01, Epoch: 40, Loss: 0.0259, Valid: 49.43%, Test: 20.30%
MRR
2024-06-26 02:58:17,749 - [INFO] - Run: 01, Epoch: 40, Loss: 0.0259, Valid: 4.19%, Test: 2.98%
AUC
2024-06-26 02:58:17,749 - [INFO] - Run: 01, Epoch: 40, Loss: 0.0259, Valid: 57.30%, Test: 47.81%
AP
2024-06-26 02:58:17,749 - [INFO] - Run: 01, Epoch: 40, Loss: 0.0259, Valid: 58.73%, Test: 52.45%
---
train valid_pos valid_neg test_pos test_neg torch.Size([263]) torch.Size([263]) torch.Size([263]) torch.Size([527]) torch.Size([527])
Hits@1
2024-06-26 04:52:24,462 - [INFO] - Run: 01, Epoch: 45, Loss: 0.0515, Valid: 0.76%, Test: 0.57%
Hits@3
2024-06-26 04:52:24,462 - [INFO] - Run: 01, Epoch: 45, Loss: 0.0515, Valid: 3.04%, Test: 3.80%
Hits@10
2024-06-26 04:52:24,462 - [INFO] - Run: 01, Epoch: 45, Loss: 0.0515, Valid: 13.31%, Test: 5.88%
Hits@100
2024-06-26 04:52:24,463 - [INFO] - Run: 01, Epoch: 45, Loss: 0.0515, Valid: 58.56%, Test: 27.51%
MRR
2024-06-26 04:52:24,463 - [INFO] - Run: 01, Epoch: 45, Loss: 0.0515, Valid: 5.24%, Test: 3.34%
AUC
2024-06-26 04:52:24,463 - [INFO] - Run: 01, Epoch: 45, Loss: 0.0515, Valid: 62.12%, Test: 56.33%
AP
2024-06-26 04:52:24,463 - [INFO] - Run: 01, Epoch: 45, Loss: 0.0515, Valid: 64.47%, Test: 59.06%
---
train valid_pos valid_neg test_pos test_neg torch.Size([263]) torch.Size([263]) torch.Size([263]) torch.Size([527]) torch.Size([527])
Hits@1
2024-06-26 07:22:31,170 - [INFO] - Run: 01, Epoch: 50, Loss: 0.0158, Valid: 2.66%, Test: 2.47%
Hits@3
2024-06-26 07:22:31,170 - [INFO] - Run: 01, Epoch: 50, Loss: 0.0158, Valid: 3.42%, Test: 2.47%
Hits@10
2024-06-26 07:22:31,170 - [INFO] - Run: 01, Epoch: 50, Loss: 0.0158, Valid: 11.79%, Test: 9.87%
Hits@100
2024-06-26 07:22:31,170 - [INFO] - Run: 01, Epoch: 50, Loss: 0.0158, Valid: 60.08%, Test: 33.97%
MRR
2024-06-26 07:22:31,170 - [INFO] - Run: 01, Epoch: 50, Loss: 0.0158, Valid: 6.40%, Test: 4.91%
AUC
2024-06-26 07:22:31,170 - [INFO] - Run: 01, Epoch: 50, Loss: 0.0158, Valid: 65.04%, Test: 59.46%
AP
2024-06-26 07:22:31,170 - [INFO] - Run: 01, Epoch: 50, Loss: 0.0158, Valid: 66.71%, Test: 63.03%
---
Best Current: 4.91_50
train valid_pos valid_neg test_pos test_neg torch.Size([263]) torch.Size([263]) torch.Size([263]) torch.Size([527]) torch.Size([527])
Hits@1
2024-06-26 09:53:18,969 - [INFO] - Run: 01, Epoch: 55, Loss: 0.0189, Valid: 0.00%, Test: 0.57%
Hits@3
2024-06-26 09:53:18,969 - [INFO] - Run: 01, Epoch: 55, Loss: 0.0189, Valid: 1.14%, Test: 2.09%
Hits@10
2024-06-26 09:53:18,969 - [INFO] - Run: 01, Epoch: 55, Loss: 0.0189, Valid: 6.84%, Test: 4.17%
Hits@100
2024-06-26 09:53:18,969 - [INFO] - Run: 01, Epoch: 55, Loss: 0.0189, Valid: 47.53%, Test: 18.60%
MRR
2024-06-26 09:53:18,969 - [INFO] - Run: 01, Epoch: 55, Loss: 0.0189, Valid: 2.51%, Test: 2.42%
AUC
2024-06-26 09:53:18,969 - [INFO] - Run: 01, Epoch: 55, Loss: 0.0189, Valid: 53.94%, Test: 47.42%
AP
2024-06-26 09:53:18,969 - [INFO] - Run: 01, Epoch: 55, Loss: 0.0189, Valid: 54.66%, Test: 50.84%
---
train valid_pos valid_neg test_pos test_neg torch.Size([263]) torch.Size([263]) torch.Size([263]) torch.Size([527]) torch.Size([527])
Hits@1
2024-06-26 12:01:59,538 - [INFO] - Run: 01, Epoch: 60, Loss: 0.0444, Valid: 0.38%, Test: 0.19%
Hits@3
2024-06-26 12:01:59,538 - [INFO] - Run: 01, Epoch: 60, Loss: 0.0444, Valid: 4.18%, Test: 3.23%
Hits@10
2024-06-26 12:01:59,538 - [INFO] - Run: 01, Epoch: 60, Loss: 0.0444, Valid: 13.31%, Test: 9.87%
Hits@100
2024-06-26 12:01:59,538 - [INFO] - Run: 01, Epoch: 60, Loss: 0.0444, Valid: 59.32%, Test: 37.95%
MRR
2024-06-26 12:01:59,538 - [INFO] - Run: 01, Epoch: 60, Loss: 0.0444, Valid: 5.63%, Test: 3.76%
AUC
2024-06-26 12:01:59,539 - [INFO] - Run: 01, Epoch: 60, Loss: 0.0444, Valid: 65.02%, Test: 61.07%
AP
2024-06-26 12:01:59,539 - [INFO] - Run: 01, Epoch: 60, Loss: 0.0444, Valid: 66.62%, Test: 63.99%
---
train valid_pos valid_neg test_pos test_neg torch.Size([263]) torch.Size([263]) torch.Size([263]) torch.Size([527]) torch.Size([527])
Hits@1
2024-06-26 13:53:27,368 - [INFO] - Run: 01, Epoch: 65, Loss: 0.0288, Valid: 1.14%, Test: 1.14%
Hits@3
2024-06-26 13:53:27,368 - [INFO] - Run: 01, Epoch: 65, Loss: 0.0288, Valid: 3.42%, Test: 2.85%
Hits@10
2024-06-26 13:53:27,368 - [INFO] - Run: 01, Epoch: 65, Loss: 0.0288, Valid: 15.59%, Test: 6.07%
Hits@100
2024-06-26 13:53:27,368 - [INFO] - Run: 01, Epoch: 65, Loss: 0.0288, Valid: 55.89%, Test: 27.13%
MRR
2024-06-26 13:53:27,368 - [INFO] - Run: 01, Epoch: 65, Loss: 0.0288, Valid: 4.97%, Test: 3.27%
AUC
2024-06-26 13:53:27,368 - [INFO] - Run: 01, Epoch: 65, Loss: 0.0288, Valid: 62.19%, Test: 54.24%
AP
2024-06-26 13:53:27,368 - [INFO] - Run: 01, Epoch: 65, Loss: 0.0288, Valid: 63.29%, Test: 57.81%
---
train valid_pos valid_neg test_pos test_neg torch.Size([263]) torch.Size([263]) torch.Size([263]) torch.Size([527]) torch.Size([527])
Hits@1
2024-06-26 15:18:42,396 - [INFO] - Run: 01, Epoch: 70, Loss: 0.0090, Valid: 0.76%, Test: 1.14%
Hits@3
2024-06-26 15:18:42,396 - [INFO] - Run: 01, Epoch: 70, Loss: 0.0090, Valid: 2.28%, Test: 2.09%
Hits@10
2024-06-26 15:18:42,396 - [INFO] - Run: 01, Epoch: 70, Loss: 0.0090, Valid: 7.22%, Test: 5.50%
Hits@100
2024-06-26 15:18:42,396 - [INFO] - Run: 01, Epoch: 70, Loss: 0.0090, Valid: 54.75%, Test: 22.58%
MRR
2024-06-26 15:18:42,396 - [INFO] - Run: 01, Epoch: 70, Loss: 0.0090, Valid: 3.77%, Test: 2.96%
AUC
2024-06-26 15:18:42,396 - [INFO] - Run: 01, Epoch: 70, Loss: 0.0090, Valid: 60.54%, Test: 52.58%
AP
2024-06-26 15:18:42,396 - [INFO] - Run: 01, Epoch: 70, Loss: 0.0090, Valid: 60.43%, Test: 55.31%
