You will be presented with a series of images, along with a caption that describes the image. Rate how well the caption fits the image to gain points. As more users agree on how well a caption fits the image, the confidence level will rise. The higher the confidence level, the more accurate you will have to be with your rating to earn points. You are encouraged to submit a dispute to your score, and given the option to do so in the dashboard and during gameplay.
Before you begin the game, you will need to successfully complete a tutorial. First, you will rate 10 images to familiarize yourself with the game and the rating system. Then, you will complete 20 test ratings as a "probation period" to ensure your ratings are in line with the expected rating. You need to earn at least 25 points in the tutorial to unlock and start the actual game. If you don’t earn at least 25 points, you will be sent to another pass of the tutorial and will complete 20 more "probation period" test ratings. As it is explained in “how your score is calculated” below, we want game players to rate image-captions with values that are closely aligned with the community consensus.
Points are accumulated for each rating you complete in the game. Once
you reach the points below, you will be sent a gift card. Please allow
some time for this process, as it is not automated.
250 points: $10 Amazon Gift Card will be sent to you
1000 points: additional $20
2000 points: additional $20
3000 points: additional $20
If you rate an image/caption and receive a negative score but you believe the consensus score is incorrect, you can dispute your rating. You must give an explanation as to why you believe the consensus score is incorrect and what you think the image caption should actually be. We will review your dispute and if your dispute is accepted, we will not only give you back the points you were deducted, we will also give you 3 times the score you should have received. e.g. If you received a -2 score, but you should have received +2, we will add 8 points to your total score (+2 for the points deducted, 2 * 3 for the points you should have received.)
This guide is available to you during gameplay. Please use it as necessary to ensure the most accurate ratings!
| Rating | Description |
|---|---|
| 1 | Objects are incorrectly identified. The caption gives the wrong idea about what is happening in the image. |
| 2 | Objects are partially correctly identified with some errors, but the caption is accurate enough to give an idea of what is happening in the image. The caption identifies most of the objects but might not identify everything. There is no interpretation of what anything means. |
| 3 | Relevant objects are correctly identified. The caption describes what is seen but not where objects are in space. There is no description of the overall setting and no interpretation of an event. |
| 4 | Objects and/or a general scene and/or an action are correctly identified but not every element is completely identified. The caption describes what is seen and where things are in space. There is no interpretation of an event. |
| 5 | Objects, a general scene, and actions are correctly identified if present in the image. The caption describes what is seen and where things are in space. |