Visual attributes used by Artificial Intelligence models to make predictions


In this HIT, we will describe a main object and show you different visualizations related to a visual attribute. Your task is to determine whether the visual attribute is a part of the main object, its background or some different object. Occasionally, the images may contain disturbing or adult content. We would like to remind you that participation in our study is voluntary and that you can withdraw from the study at any time.

  • Top five images
    a set of five images for which the model detects the visual attribute with the highest scores. By looking at what these images have in common, you can try to understand the meaning of the visual attribute.
  • Highlighted visual attribute
    for the same set of five images, we show a heatmap of where the model is looking at when detecting the visual attribute. The higher the intensity of the red color, the more relevant is that part of the image for the visual attribute. The higher the intensity of the blue color, the less relevant is that part of the image for the visual attribute. Example (water), Example (fingers)
  • Amplified visual attribute
    again for the same set of five images, we show modified images that significantly increase the score of the visual attribute detected by the model. Example (water), Example (fingers). This can be useful for understanding the the visual attribute particularly when the visualizations of previous section (highlighted visual attributes) overlap on two different objects such as in these examples: overlap between cougar and wires, overlap between groom and flowers.

  • Object category name(s)
    A set of comma separated names (all names have the same meaning) for the object of interest.
  • Object supercategory
    The supercategory (usually easier to understand than the object category) to which the object belongs. For example: ambulance and airliner belong to the supercategory vehicles; chihuahua and papillon belong to the supercategory dogs etc.
  • Example images containing the object
    A set of images containing the object of interest to help you understand the object better.
  • Object definition
    A brief definition of the object.
  • Wikipedia link(s)
    A set of wikipedia links to help you understand the object meaning.
 


Visual attribute
Top five
images
Highlighted visual
attributes
Amplified visual
attributes

     

Main object
Object category name(s): ${synset}

Object supercategory: ${superclass}

Object definition: ${gloss}

Below you can find some images containing the object. Note that other possibly larger objects may also be present in these images:

If you are still unsure about the object meaning, you may also consult the following Wikipedia page(s): ${wikilinks}


Please answer the questions below

Q1. Which of the following best describes the focus of the red region in the Highlighted visual attributes?

  • Amplified visual attributes can be useful in some cases when the red region overlaps over multiple objects such as in these examples: overlap between cougar and wires, overlap between groom and flowers.
  • You can ignore Amplified visual attributes when the red region does not overlap over multiple objects.
  • The main object has the following name(s): ${synset}
  • The main object belongs to the following supercategory: ${superclass}

               Focus is on the background of the main object.
                    Examples: greenery in the background of grasshopper, water in the background of albatross, flower in the background of bee,
                                baseball pitch in the background of player.


               Focus is on some other object (not a part of the main object).
                    Examples: baby is not a part of bassinet (baby's bed), legs are not a part of maillot (dress for dancers), tree branch is not a part of bird,
                                graffiti is not a part of freight car, flowers are not a part of groom, wires are not a part of cougar.
            

               Focus is on some part of the main object.
                    Examples: nose of a cougar, whiskers of a cat, legs of a lobster, structure of a steel bridge.
Q2. How confident are you about your answer to Q1?
Q3. Please give reason(s) for your answer to Q1? This question is mandatory for completing this HIT. Detailed answers will receive a bonus.