Used file: ./datasets/LOOP_SEATTLE/data-00000-of-00001.arrow

+----------------+-----------------+------------------+---------------------+----------------+--------------------+-----------------------+
|   Input Length | Output Length   |   Total Channels |   Selected Channels |   Input Tokens |   Generated Tokens |   Conversation Length |
+================+=================+==================+=====================+================+====================+=======================+
|            155 | -               |                1 |                   1 |            485 |                161 |                     2 |
+----------------+-----------------+------------------+---------------------+----------------+--------------------+-----------------------+
|            386 | -               |                1 |                   1 |            485 |                130 |                     2 |
+----------------+-----------------+------------------+---------------------+----------------+--------------------+-----------------------+
|            342 | -               |                1 |                   1 |            485 |                164 |                     2 |
+----------------+-----------------+------------------+---------------------+----------------+--------------------+-----------------------+
|            249 | -               |                1 |                   1 |            485 |                216 |                     2 |
+----------------+-----------------+------------------+---------------------+----------------+--------------------+-----------------------+
|            239 | -               |                1 |                   1 |            485 |                155 |                     2 |
+----------------+-----------------+------------------+---------------------+----------------+--------------------+-----------------------+
|            150 | -               |                1 |                   1 |            485 |                173 |                     2 |
+----------------+-----------------+------------------+---------------------+----------------+--------------------+-----------------------+
|            319 | -               |                1 |                   1 |            485 |                169 |                     2 |
+----------------+-----------------+------------------+---------------------+----------------+--------------------+-----------------------+
|            346 | -               |                1 |                   1 |            485 |                138 |                     2 |
+----------------+-----------------+------------------+---------------------+----------------+--------------------+-----------------------+
|            310 | -               |                1 |                   1 |            485 |                146 |                     2 |
+----------------+-----------------+------------------+---------------------+----------------+--------------------+-----------------------+
|            111 | -               |                1 |                   1 |            485 |                169 |                     2 |
+----------------+-----------------+------------------+---------------------+----------------+--------------------+-----------------------+
|            205 | -               |                1 |                   1 |            485 |                144 |                     2 |
+----------------+-----------------+------------------+---------------------+----------------+--------------------+-----------------------+
|            146 | -               |                1 |                   1 |            485 |                158 |                     2 |
+----------------+-----------------+------------------+---------------------+----------------+--------------------+-----------------------+
|            466 | -               |                1 |                   1 |            485 |                196 |                     2 |
+----------------+-----------------+------------------+---------------------+----------------+--------------------+-----------------------+
|            393 | -               |                1 |                   1 |            485 |                175 |                     2 |
+----------------+-----------------+------------------+---------------------+----------------+--------------------+-----------------------+
|            279 | -               |                1 |                   1 |            485 |                181 |                     2 |
+----------------+-----------------+------------------+---------------------+----------------+--------------------+-----------------------+
|            380 | -               |                1 |                   1 |            485 |                161 |                     2 |
+----------------+-----------------+------------------+---------------------+----------------+--------------------+-----------------------+
|            281 | -               |                1 |                   1 |            485 |                154 |                     2 |
+----------------+-----------------+------------------+---------------------+----------------+--------------------+-----------------------+
|            410 | -               |                1 |                   1 |            485 |                146 |                     2 |
+----------------+-----------------+------------------+---------------------+----------------+--------------------+-----------------------+
|            358 | -               |                1 |                   1 |            485 |                158 |                     2 |
+----------------+-----------------+------------------+---------------------+----------------+--------------------+-----------------------+
|            471 | -               |                1 |                   1 |            485 |                176 |                     2 |
+----------------+-----------------+------------------+---------------------+----------------+--------------------+-----------------------+
|            228 | -               |                1 |                   1 |            485 |                156 |                     2 |
+----------------+-----------------+------------------+---------------------+----------------+--------------------+-----------------------+
|            423 | -               |                1 |                   1 |            485 |                158 |                     2 |
+----------------+-----------------+------------------+---------------------+----------------+--------------------+-----------------------+
|            494 | -               |                1 |                   1 |            485 |                143 |                     2 |
+----------------+-----------------+------------------+---------------------+----------------+--------------------+-----------------------+
|            408 | -               |                1 |                   1 |            485 |                145 |                     2 |
+----------------+-----------------+------------------+---------------------+----------------+--------------------+-----------------------+
|            165 | -               |                1 |                   1 |            485 |                171 |                     2 |
+----------------+-----------------+------------------+---------------------+----------------+--------------------+-----------------------+
Model used: gpt-4o-mini
System prompt tokens: 452
Total input tokens: 12125
Total generated tokens: 4043
Total tokens: 16168

Arguments used:
Dataset Directory: ./datasets/LOOP_SEATTLE
Prompt Path: ./system_prompts/benchmarkQA.txt
Number of Samples: 25
Bias: 1.0
Max Length: 1024
API: openai
Task: QA
