-------------------------------------------------
<<model>>: CodeLlama-13b-hf <<train data>>: cleaned_curl/tokenized_combined_data_100664 <<test data>>: total_testing_cleaned_curl_level_1.json.json
Number of testing APIs: 55
Overall API Call Match Accuracy: 0.348
-------------------------------------------------
<<model>>: CodeLlama-13b-hf <<train data>>: cleaned_curl/tokenized_combined_data_100664 <<test data>>: total_testing_cleaned_curl_level_2.json.json
Number of testing APIs: 886
Overall API Call Match Accuracy: 0.287
-------------------------------------------------
<<model>>: CodeLlama-13b-hf <<train data>>: cleaned_curl/tokenized_combined_data_100664 <<test data>>: total_testing_cleaned_curl_level_3.json.json
Number of testing APIs: 69
Overall API Call Match Accuracy: 0.217
-------------------------------------------------
<<model>>: CodeLlama-13b-hf <<train data>>: cleaned_curl/tokenized_combined_data_100664 <<test data>>: total_testing_cleaned_curl_level_1_retrieval_IC_3.json.json
Number of testing APIs: 55
Overall API Call Match Accuracy: 0.642
-------------------------------------------------
<<model>>: CodeLlama-13b-hf <<train data>>: cleaned_curl/tokenized_combined_data_100664 <<test data>>: total_testing_cleaned_curl_level_2_retrieval_IC_3.json.json
Number of testing APIs: 886
Overall API Call Match Accuracy: 0.570
-------------------------------------------------
<<model>>: CodeLlama-13b-hf <<train data>>: cleaned_curl/tokenized_combined_data_100664 <<test data>>: total_testing_cleaned_curl_level_3_retrieval_IC_3.json.json
Number of testing APIs: 69
Overall API Call Match Accuracy: 0.693
-------------------------------------------------
<<model>>: CodeLlama-13b-hf <<train data>>: cleaned_curl/tokenized_combined_data_100664 <<test data>>: total_testing_cleaned_python_level_1.json.json
Number of testing APIs: 54
Overall API Call Match Accuracy: 0.000
-------------------------------------------------
<<model>>: CodeLlama-13b-hf <<train data>>: cleaned_curl/tokenized_combined_data_100664 <<test data>>: total_testing_cleaned_python_level_2.json.json
Number of testing APIs: 900
Overall API Call Match Accuracy: 0.000
-------------------------------------------------
<<model>>: CodeLlama-13b-hf <<train data>>: cleaned_curl/tokenized_combined_data_100664 <<test data>>: total_testing_cleaned_python_level_3.json.json
Number of testing APIs: 116
Overall API Call Match Accuracy: 0.000
-------------------------------------------------
<<model>>: CodeLlama-13b-hf <<train data>>: cleaned_curl/tokenized_combined_data_100664 <<test data>>: total_testing_cleaned_python_level_1_retrieval_IC_3.json.json
Number of testing APIs: 54
Overall API Call Match Accuracy: 0.543
-------------------------------------------------
<<model>>: CodeLlama-13b-hf <<train data>>: cleaned_curl/tokenized_combined_data_100664 <<test data>>: total_testing_cleaned_python_level_2_retrieval_IC_3.json.json
Number of testing APIs: 900
Overall API Call Match Accuracy: 0.450
-------------------------------------------------
<<model>>: CodeLlama-13b-hf <<train data>>: cleaned_curl/tokenized_combined_data_100664 <<test data>>: total_testing_cleaned_python_level_3_retrieval_IC_3.json.json
Number of testing APIs: 116
Overall API Call Match Accuracy: 0.488
-------------------------------------------------
<<model>>: CodeLlama-13b-hf <<train data>>: cleaned_curl/tokenized_combined_data_100664 <<test data>>: total_testing_cleaned_java_level_1.json.json
Number of testing APIs: 56
Overall API Call Match Accuracy: 0.000
-------------------------------------------------
<<model>>: CodeLlama-13b-hf <<train data>>: cleaned_curl/tokenized_combined_data_100664 <<test data>>: total_testing_cleaned_java_level_2.json.json
Number of testing APIs: 904
Overall API Call Match Accuracy: 0.000
-------------------------------------------------
<<model>>: CodeLlama-13b-hf <<train data>>: cleaned_curl/tokenized_combined_data_100664 <<test data>>: total_testing_cleaned_java_level_3.json.json
Number of testing APIs: 115
Overall API Call Match Accuracy: 0.000
-------------------------------------------------
<<model>>: CodeLlama-13b-hf <<train data>>: cleaned_curl/tokenized_combined_data_100664 <<test data>>: total_testing_cleaned_java_level_1_retrieval_IC_3.json.json
Number of testing APIs: 56
Overall API Call Match Accuracy: 0.572
-------------------------------------------------
<<model>>: CodeLlama-13b-hf <<train data>>: cleaned_curl/tokenized_combined_data_100664 <<test data>>: total_testing_cleaned_java_level_2_retrieval_IC_3.json.json
Number of testing APIs: 904
Overall API Call Match Accuracy: 0.533
-------------------------------------------------
<<model>>: CodeLlama-13b-hf <<train data>>: cleaned_curl/tokenized_combined_data_100664 <<test data>>: total_testing_cleaned_java_level_3_retrieval_IC_3.json.json
Number of testing APIs: 115
Overall API Call Match Accuracy: 0.544
-------------------------------------------------
<<model>>: CodeLlama-13b-hf <<train data>>: cleaned_curl/tokenized_combined_data_100664 <<test data>>: total_testing_cleaned_go_level_1.json.json
Number of testing APIs: 55
Overall API Call Match Accuracy: 0.000
-------------------------------------------------
<<model>>: CodeLlama-13b-hf <<train data>>: cleaned_curl/tokenized_combined_data_100664 <<test data>>: total_testing_cleaned_go_level_2.json.json
Number of testing APIs: 889
Overall API Call Match Accuracy: 0.000
-------------------------------------------------
<<model>>: CodeLlama-13b-hf <<train data>>: cleaned_curl/tokenized_combined_data_100664 <<test data>>: total_testing_cleaned_go_level_3.json.json
Number of testing APIs: 113
Overall API Call Match Accuracy: 0.000
-------------------------------------------------
<<model>>: CodeLlama-13b-hf <<train data>>: cleaned_curl/tokenized_combined_data_100664 <<test data>>: total_testing_cleaned_go_level_1_retrieval_IC_3.json.json
Number of testing APIs: 55
Overall API Call Match Accuracy: 0.599
-------------------------------------------------
<<model>>: CodeLlama-13b-hf <<train data>>: cleaned_curl/tokenized_combined_data_100664 <<test data>>: total_testing_cleaned_go_level_2_retrieval_IC_3.json.json
Number of testing APIs: 889
Overall API Call Match Accuracy: 0.539
-------------------------------------------------
<<model>>: CodeLlama-13b-hf <<train data>>: cleaned_curl/tokenized_combined_data_100664 <<test data>>: total_testing_cleaned_go_level_3_retrieval_IC_3.json.json
Number of testing APIs: 113
Overall API Call Match Accuracy: 0.567
-------------------------------------------------
<<model>>: CodeLlama-13b-hf <<train data>>: cleaned_curl/tokenized_combined_data_100664 <<test data>>: total_testing_cleaned_javascript_level_1.json.json
Number of testing APIs: 56
Overall API Call Match Accuracy: 0.000
-------------------------------------------------
<<model>>: CodeLlama-13b-hf <<train data>>: cleaned_curl/tokenized_combined_data_100664 <<test data>>: total_testing_cleaned_javascript_level_2.json.json
Number of testing APIs: 910
Overall API Call Match Accuracy: 0.000
-------------------------------------------------
<<model>>: CodeLlama-13b-hf <<train data>>: cleaned_curl/tokenized_combined_data_100664 <<test data>>: total_testing_cleaned_javascript_level_3.json.json
Number of testing APIs: 81
Overall API Call Match Accuracy: 0.000
-------------------------------------------------
<<model>>: CodeLlama-13b-hf <<train data>>: cleaned_curl/tokenized_combined_data_100664 <<test data>>: total_testing_cleaned_javascript_level_1_retrieval_IC_3.json.json
Number of testing APIs: 56
Overall API Call Match Accuracy: 0.611
-------------------------------------------------
<<model>>: CodeLlama-13b-hf <<train data>>: cleaned_curl/tokenized_combined_data_100664 <<test data>>: total_testing_cleaned_javascript_level_2_retrieval_IC_3.json.json
Number of testing APIs: 910
Overall API Call Match Accuracy: 0.548
-------------------------------------------------
<<model>>: CodeLlama-13b-hf <<train data>>: cleaned_curl/tokenized_combined_data_100664 <<test data>>: total_testing_cleaned_javascript_level_3_retrieval_IC_3.json.json
Number of testing APIs: 81
Overall API Call Match Accuracy: 0.592
-------------------------------------------------
<<model>>: CodeLlama-13b-hf <<train data>>: cleaned_curl/tokenized_combined_data_100664 <<test data>>: total_testing_cleaned_libcurl_level_1.json.json
Number of testing APIs: 56
Overall API Call Match Accuracy: 0.000
-------------------------------------------------
<<model>>: CodeLlama-13b-hf <<train data>>: cleaned_curl/tokenized_combined_data_100664 <<test data>>: total_testing_cleaned_libcurl_level_2.json.json
Number of testing APIs: 911
Overall API Call Match Accuracy: 0.000
-------------------------------------------------
<<model>>: CodeLlama-13b-hf <<train data>>: cleaned_curl/tokenized_combined_data_100664 <<test data>>: total_testing_cleaned_libcurl_level_3.json.json
Number of testing APIs: 82
Overall API Call Match Accuracy: 0.000
-------------------------------------------------
<<model>>: CodeLlama-13b-hf <<train data>>: cleaned_curl/tokenized_combined_data_100664 <<test data>>: total_testing_cleaned_libcurl_level_1_retrieval_IC_3.json.json
Number of testing APIs: 56
Overall API Call Match Accuracy: 0.380
-------------------------------------------------
<<model>>: CodeLlama-13b-hf <<train data>>: cleaned_curl/tokenized_combined_data_100664 <<test data>>: total_testing_cleaned_libcurl_level_2_retrieval_IC_3.json.json
Number of testing APIs: 911
Overall API Call Match Accuracy: 0.349
-------------------------------------------------
<<model>>: CodeLlama-13b-hf <<train data>>: cleaned_curl/tokenized_combined_data_100664 <<test data>>: total_testing_cleaned_libcurl_level_3_retrieval_IC_3.json.json
Number of testing APIs: 82
Overall API Call Match Accuracy: 0.368
-------------------------------------------------
<<model>>: CodeLlama-13b-hf <<train data>>: cleaned_curl/tokenized_combined_data_100664 <<test data>>: total_testing_cleaned_node_level_1.json.json
Number of testing APIs: 56
Overall API Call Match Accuracy: 0.000
-------------------------------------------------
<<model>>: CodeLlama-13b-hf <<train data>>: cleaned_curl/tokenized_combined_data_100664 <<test data>>: total_testing_cleaned_node_level_2.json.json
Number of testing APIs: 906
Overall API Call Match Accuracy: 0.000
-------------------------------------------------
<<model>>: CodeLlama-13b-hf <<train data>>: cleaned_curl/tokenized_combined_data_100664 <<test data>>: total_testing_cleaned_node_level_3.json.json
Number of testing APIs: 114
Overall API Call Match Accuracy: 0.000
-------------------------------------------------
<<model>>: CodeLlama-13b-hf <<train data>>: cleaned_curl/tokenized_combined_data_100664 <<test data>>: total_testing_cleaned_node_level_1_retrieval_IC_3.json.json
Number of testing APIs: 56
Overall API Call Match Accuracy: 0.621
-------------------------------------------------
<<model>>: CodeLlama-13b-hf <<train data>>: cleaned_curl/tokenized_combined_data_100664 <<test data>>: total_testing_cleaned_node_level_2_retrieval_IC_3.json.json
Number of testing APIs: 906
Overall API Call Match Accuracy: 0.571
-------------------------------------------------
<<model>>: CodeLlama-13b-hf <<train data>>: cleaned_curl/tokenized_combined_data_100664 <<test data>>: total_testing_cleaned_node_level_3_retrieval_IC_3.json.json
Number of testing APIs: 114
Overall API Call Match Accuracy: 0.627
-------------------------------------------------
<<model>>: CodeLlama-13b-hf <<train data>>: cleaned_curl/tokenized_combined_data_100664 <<test data>>: total_testing_cleaned_php_level_1.json.json
Number of testing APIs: 57
Overall API Call Match Accuracy: 0.000
-------------------------------------------------
<<model>>: CodeLlama-13b-hf <<train data>>: cleaned_curl/tokenized_combined_data_100664 <<test data>>: total_testing_cleaned_php_level_2.json.json
Number of testing APIs: 904
Overall API Call Match Accuracy: 0.000
-------------------------------------------------
<<model>>: CodeLlama-13b-hf <<train data>>: cleaned_curl/tokenized_combined_data_100664 <<test data>>: total_testing_cleaned_php_level_3.json.json
Number of testing APIs: 114
Overall API Call Match Accuracy: 0.000
-------------------------------------------------
<<model>>: CodeLlama-13b-hf <<train data>>: cleaned_curl/tokenized_combined_data_100664 <<test data>>: total_testing_cleaned_php_level_1_retrieval_IC_3.json.json
Number of testing APIs: 57
Overall API Call Match Accuracy: 0.537
-------------------------------------------------
<<model>>: CodeLlama-13b-hf <<train data>>: cleaned_curl/tokenized_combined_data_100664 <<test data>>: total_testing_cleaned_php_level_2_retrieval_IC_3.json.json
Number of testing APIs: 904
Overall API Call Match Accuracy: 0.480
-------------------------------------------------
<<model>>: CodeLlama-13b-hf <<train data>>: cleaned_curl/tokenized_combined_data_100664 <<test data>>: total_testing_cleaned_php_level_3_retrieval_IC_3.json.json
Number of testing APIs: 114
Overall API Call Match Accuracy: 0.545
-------------------------------------------------
<<model>>: CodeLlama-13b-hf <<train data>>: cleaned_curl/tokenized_combined_data_100664 <<test data>>: total_testing_cleaned_ruby_level_1.json.json
Number of testing APIs: 56
Overall API Call Match Accuracy: 0.000
-------------------------------------------------
<<model>>: CodeLlama-13b-hf <<train data>>: cleaned_curl/tokenized_combined_data_100664 <<test data>>: total_testing_cleaned_ruby_level_2.json.json
Number of testing APIs: 890
Overall API Call Match Accuracy: 0.000
-------------------------------------------------
<<model>>: CodeLlama-13b-hf <<train data>>: cleaned_curl/tokenized_combined_data_100664 <<test data>>: total_testing_cleaned_ruby_level_3.json.json
Number of testing APIs: 115
Overall API Call Match Accuracy: 0.000
-------------------------------------------------
<<model>>: CodeLlama-13b-hf <<train data>>: cleaned_curl/tokenized_combined_data_100664 <<test data>>: total_testing_cleaned_ruby_level_1_retrieval_IC_3.json.json
Number of testing APIs: 56
Overall API Call Match Accuracy: 0.521
-------------------------------------------------
<<model>>: CodeLlama-13b-hf <<train data>>: cleaned_curl/tokenized_combined_data_100664 <<test data>>: total_testing_cleaned_ruby_level_2_retrieval_IC_3.json.json
Number of testing APIs: 890
Overall API Call Match Accuracy: 0.482
-------------------------------------------------
<<model>>: CodeLlama-13b-hf <<train data>>: cleaned_curl/tokenized_combined_data_100664 <<test data>>: total_testing_cleaned_ruby_level_3_retrieval_IC_3.json.json
Number of testing APIs: 115
Overall API Call Match Accuracy: 0.551
-------------------------------------------------
<<model>>: CodeLlama-13b-hf <<train data>>: cleaned_curl/tokenized_combined_data_100664 <<test data>>: total_testing_cleaned_swift_level_1.json.json
Number of testing APIs: 56
Overall API Call Match Accuracy: 0.000
-------------------------------------------------
<<model>>: CodeLlama-13b-hf <<train data>>: cleaned_curl/tokenized_combined_data_100664 <<test data>>: total_testing_cleaned_swift_level_2.json.json
Number of testing APIs: 889
Overall API Call Match Accuracy: 0.000
-------------------------------------------------
<<model>>: CodeLlama-13b-hf <<train data>>: cleaned_curl/tokenized_combined_data_100664 <<test data>>: total_testing_cleaned_swift_level_3.json.json
Number of testing APIs: 115
Overall API Call Match Accuracy: 0.000
-------------------------------------------------
<<model>>: CodeLlama-13b-hf <<train data>>: cleaned_curl/tokenized_combined_data_100664 <<test data>>: total_testing_cleaned_swift_level_1_retrieval_IC_3.json.json
Number of testing APIs: 56
Overall API Call Match Accuracy: 0.623
-------------------------------------------------
<<model>>: CodeLlama-13b-hf <<train data>>: cleaned_curl/tokenized_combined_data_100664 <<test data>>: total_testing_cleaned_swift_level_2_retrieval_IC_3.json.json
Number of testing APIs: 889
Overall API Call Match Accuracy: 0.558
-------------------------------------------------
<<model>>: CodeLlama-13b-hf <<train data>>: cleaned_curl/tokenized_combined_data_100664 <<test data>>: total_testing_cleaned_swift_level_3_retrieval_IC_3.json.json
Number of testing APIs: 115
Overall API Call Match Accuracy: 0.586