Visual attributes used by Artificial Intelligence models to make predictions
In this HIT, we will describe a main object and show you different visualizations related to a visual attribute. Your task is to determine whether the visual attribute is a part of the main object, its background or some different object. Occasionally, the images may contain disturbing or adult content. We would like to remind you that participation in our study is voluntary and that you can withdraw from the study at any time.
- Top five images
a set of five images for which the model detects the visual attribute with the highest scores. By looking at what these images have in common, you can try to understand the meaning of the visual attribute.
- Highlighted visual attribute
for the same set of five images, we show a heatmap of where the model is looking at when detecting the visual attribute. The higher the intensity of the red color, the more relevant is that part of the image for the visual attribute. The higher the intensity of the blue color, the less relevant is that part of the image for the visual attribute. Example (water), Example (fingers)
- Amplified visual attribute
again for the same set of five images, we show modified images that significantly increase the score of the visual attribute detected by the model. Example (water), Example (fingers). This can be useful for understanding the the visual attribute particularly when the visualizations of previous section (highlighted visual attributes) overlap on two different objects such as in these examples: overlap between cougar and wires, overlap between groom and flowers.
- Object category name(s)
A set of comma separated names (all names have the same meaning) for the object of interest.
- Object supercategory
The supercategory (usually easier to understand than the object category) to which the object belongs. For example: ambulance and airliner belong to the supercategory vehicles; chihuahua and papillon belong to the supercategory dogs etc.
- Example images containing the object
A set of images containing the object of interest to help you understand the object better.
- Object definition
A brief definition of the object.
- Wikipedia link(s)
A set of wikipedia links to help you understand the object meaning.