Used file: ./datasets/LOOP_SEATTLE/data-00000-of-00001.arrow

+----------------+-----------------+------------------+---------------------+----------------+--------------------+-----------------------+
|   Input Length | Output Length   |   Total Channels |   Selected Channels |   Input Tokens |   Generated Tokens |   Conversation Length |
+================+=================+==================+=====================+================+====================+=======================+
|            244 | -               |                1 |                   1 |            485 |                163 |                     2 |
+----------------+-----------------+------------------+---------------------+----------------+--------------------+-----------------------+
|            463 | -               |                1 |                   1 |            485 |                184 |                     2 |
+----------------+-----------------+------------------+---------------------+----------------+--------------------+-----------------------+
|            450 | -               |                1 |                   1 |            485 |                137 |                     2 |
+----------------+-----------------+------------------+---------------------+----------------+--------------------+-----------------------+
|            295 | -               |                1 |                   1 |            485 |                150 |                     2 |
+----------------+-----------------+------------------+---------------------+----------------+--------------------+-----------------------+
|            432 | -               |                1 |                   1 |            485 |                183 |                     2 |
+----------------+-----------------+------------------+---------------------+----------------+--------------------+-----------------------+
|            347 | -               |                1 |                   1 |            485 |                158 |                     2 |
+----------------+-----------------+------------------+---------------------+----------------+--------------------+-----------------------+
|            176 | -               |                1 |                   1 |            485 |                148 |                     2 |
+----------------+-----------------+------------------+---------------------+----------------+--------------------+-----------------------+
|            159 | -               |                1 |                   1 |            485 |                156 |                     2 |
+----------------+-----------------+------------------+---------------------+----------------+--------------------+-----------------------+
|            228 | -               |                1 |                   1 |            485 |                156 |                     2 |
+----------------+-----------------+------------------+---------------------+----------------+--------------------+-----------------------+
|            215 | -               |                1 |                   1 |            485 |                157 |                     2 |
+----------------+-----------------+------------------+---------------------+----------------+--------------------+-----------------------+
|            409 | -               |                1 |                   1 |            485 |                174 |                     2 |
+----------------+-----------------+------------------+---------------------+----------------+--------------------+-----------------------+
|            391 | -               |                1 |                   1 |            485 |                142 |                     2 |
+----------------+-----------------+------------------+---------------------+----------------+--------------------+-----------------------+
|            490 | -               |                1 |                   1 |            485 |                184 |                     2 |
+----------------+-----------------+------------------+---------------------+----------------+--------------------+-----------------------+
|            289 | -               |                1 |                   1 |            485 |                146 |                     2 |
+----------------+-----------------+------------------+---------------------+----------------+--------------------+-----------------------+
|            255 | -               |                1 |                   1 |            485 |                168 |                     2 |
+----------------+-----------------+------------------+---------------------+----------------+--------------------+-----------------------+
|            364 | -               |                1 |                   1 |            485 |                176 |                     2 |
+----------------+-----------------+------------------+---------------------+----------------+--------------------+-----------------------+
|            376 | -               |                1 |                   1 |            485 |                172 |                     2 |
+----------------+-----------------+------------------+---------------------+----------------+--------------------+-----------------------+
|            193 | -               |                1 |                   1 |            485 |                159 |                     2 |
+----------------+-----------------+------------------+---------------------+----------------+--------------------+-----------------------+
|            163 | -               |                1 |                   1 |            485 |                124 |                     2 |
+----------------+-----------------+------------------+---------------------+----------------+--------------------+-----------------------+
|            411 | -               |                1 |                   1 |            485 |                153 |                     2 |
+----------------+-----------------+------------------+---------------------+----------------+--------------------+-----------------------+
|            368 | -               |                1 |                   1 |            485 |                135 |                     2 |
+----------------+-----------------+------------------+---------------------+----------------+--------------------+-----------------------+
|            317 | -               |                1 |                   1 |            485 |                165 |                     2 |
+----------------+-----------------+------------------+---------------------+----------------+--------------------+-----------------------+
|            250 | -               |                1 |                   1 |            485 |                137 |                     2 |
+----------------+-----------------+------------------+---------------------+----------------+--------------------+-----------------------+
|            230 | -               |                1 |                   1 |            485 |                154 |                     2 |
+----------------+-----------------+------------------+---------------------+----------------+--------------------+-----------------------+
|            177 | -               |                1 |                   1 |            485 |                210 |                     2 |
+----------------+-----------------+------------------+---------------------+----------------+--------------------+-----------------------+
Model used: gpt-4o-mini
System prompt tokens: 452
Total input tokens: 12125
Total generated tokens: 3991
Total tokens: 16116

Arguments used:
Dataset Directory: ./datasets/LOOP_SEATTLE
Prompt Path: ./system_prompts/benchmarkQA.txt
Number of Samples: 25
Bias: 1.0
Max Length: 1024
API: openai
Task: QA
