<strong>For each example, you will be asked:</strong>
<ul>
    <li>Which explanation is the easiest to read and <strong>understand?</strong></li>
    <li>Which explanation most helps you decide how much you <strong>trust</strong> the system's answer?</li>
    <li>Which explanation most helps you understand what <strong>mistakes</strong> the system might have made?</li>
    <li>Which explanation most helps you make a judgement about whether the answer is likely to be <strong>correct?</strong></li>
    <li>Overall, which explanation do you <strong>prefer?</strong></li>
</ul>

<br>

<strong>Annotation guidelines</strong><br>
<ul>
    <li>When answering questions, <strong>only consider</strong> substantial differences in the information in each explanation about the question answering process.</li>
    <li><strong>Do not consider:</strong></li>
        <ul>
            <li>The <strong>formatting</strong> of the explanation, including bold or italic text, bullet points, or overall structure.</li>
            <li>The <strong>validity</strong> of the approach taken by the system. We are not critiquing the overall process that the system used.</li>
            <li>The <strong>correctness</strong> of the final answer provided by the system. We are not judging whether the answer is right or wrong.</li>
        </ul>
</ul>
