=== OVERALL RESULTS SUMMARY ===
Seed: 1
Total generated codes    : 10
Compiled successfully    : 4
Compilation failed       : 6

Successful compilations:
 - LLM: Qwen/Qwen2.5-Coder-3B, Model: eight_schools, Folder: expts-org/small/2/seed_1/Qwen_Qwen2.5-Coder-3B/eight_schools
 - LLM: Qwen/Qwen2.5-Coder-3B, Model: dugongs, Folder: expts-org/small/2/seed_1/Qwen_Qwen2.5-Coder-3B/dugongs
 - LLM: Qwen/Qwen2.5-Coder-3B, Model: glm, Folder: expts-org/small/2/seed_1/Qwen_Qwen2.5-Coder-3B/glm
 - LLM: Qwen/Qwen2.5-Coder-3B, Model: surgical, Folder: expts-org/small/2/seed_1/Qwen_Qwen2.5-Coder-3B/surgical

Failed compilations:
 - LLM: microsoft/Phi-3.5-mini-instruct, Model: eight_schools, Folder: expts-org/small/2/seed_1/microsoft_Phi-3.5-mini-instruct/eight_schools
 - LLM: microsoft/Phi-3.5-mini-instruct, Model: dugongs, Folder: expts-org/small/2/seed_1/microsoft_Phi-3.5-mini-instruct/dugongs
 - LLM: microsoft/Phi-3.5-mini-instruct, Model: gp, Folder: expts-org/small/2/seed_1/microsoft_Phi-3.5-mini-instruct/gp
 - LLM: microsoft/Phi-3.5-mini-instruct, Model: glm, Folder: expts-org/small/2/seed_1/microsoft_Phi-3.5-mini-instruct/glm
 - LLM: microsoft/Phi-3.5-mini-instruct, Model: surgical, Folder: expts-org/small/2/seed_1/microsoft_Phi-3.5-mini-instruct/surgical
 - LLM: Qwen/Qwen2.5-Coder-3B, Model: gp, Folder: expts-org/small/2/seed_1/Qwen_Qwen2.5-Coder-3B/gp
