Test and development of a user interface for a subjective experiment
Budget: €6 – €12 EUR
Test and development of a user interface for a subjective experiment with two alternative choices.
Interface for an experiment with a point guessing game:
1- First, instructions are shown to familiarize the subject with the subjective task and questionnaire, and to show the subject how to perform the experiment. At the end of the instructions, a "Next" button is shown for the subject to continue.
2- After the subject clicks on the "Next" button, a consent form is displayed. The subject enters their " Worker ID" in the consent form and confirms it (by pressing the "Agree" button).
3- Training session,
I think we should also train the subjects by giving them some easy pairs and some hard pairs to judge. In particular, they should learn and practice that they only have 3 seconds to answer when the display is blank. And we could give them feedback on which answer was correct (simply saying that there are more points on the left or right side). Without this training, many will not answer the first more difficult questions.
4- Then a page reminiscent of the type of first test is displayed (e.g., test "TYPE I" with a choice of "not sure" and a request to complete the NASA questionnaire based only on that type of test question),
5- Then n test type I or II questions (randomly selected) are presented. Each question follows the 5+3 second logic that we have used in our other experiments. A five-second image comparison and then 3 seconds for decision (must also disable the "not sure" during the 5-second session in this study).
6- After n questions have been evaluated, the NASA questionnaire is shown. We used exactly the NASA questionnaire for the cognitive test.
7- Then a page reminding the type of the second test is shown (e.g. Test TYPE II 2AFC without the "not sure" option and asking to complete the questionnaire based only on these test questions), and then the n questions for Test TYPE II are shown, followed by the NASA questionnaire for the second test. For the cognitive test, we used exactly the NASA questionnaire.
8- The participants of the experiment are marked in the AMT so that they cannot participate in the next HITs (if any).
If we randomize the type of subject and run only one experiment, the next two steps are not required:
9- Another experiment is conducted in a different HIT after the first experiment is completed. The only difference from the experiment of the first HIT is that the order of the experiments is changed between TYPE I and TYPE II.
The participants in the second HIT are also marked as ineligible for future HITs (in case we want to collect more votes later).
Interface for an experiment with a point guessing game:
1- First, instructions are shown to familiarize the subject with the subjective task and questionnaire, and to show the subject how to perform the experiment. At the end of the instructions, a "Next" button is shown for the subject to continue.
2- After the subject clicks on the "Next" button, a consent form is displayed. The subject enters their " Worker ID" in the consent form and confirms it (by pressing the "Agree" button).
3- Training session,
I think we should also train the subjects by giving them some easy pairs and some hard pairs to judge. In particular, they should learn and practice that they only have 3 seconds to answer when the display is blank. And we could give them feedback on which answer was correct (simply saying that there are more points on the left or right side). Without this training, many will not answer the first more difficult questions.
4- Then a page reminiscent of the type of first test is displayed (e.g., test "TYPE I" with a choice of "not sure" and a request to complete the NASA questionnaire based only on that type of test question),
5- Then n test type I or II questions (randomly selected) are presented. Each question follows the 5+3 second logic that we have used in our other experiments. A five-second image comparison and then 3 seconds for decision (must also disable the "not sure" during the 5-second session in this study).
6- After n questions have been evaluated, the NASA questionnaire is shown. We used exactly the NASA questionnaire for the cognitive test.
7- Then a page reminding the type of the second test is shown (e.g. Test TYPE II 2AFC without the "not sure" option and asking to complete the questionnaire based only on these test questions), and then the n questions for Test TYPE II are shown, followed by the NASA questionnaire for the second test. For the cognitive test, we used exactly the NASA questionnaire.
8- The participants of the experiment are marked in the AMT so that they cannot participate in the next HITs (if any).
If we randomize the type of subject and run only one experiment, the next two steps are not required:
9- Another experiment is conducted in a different HIT after the first experiment is completed. The only difference from the experiment of the first HIT is that the order of the experiments is changed between TYPE I and TYPE II.
The participants in the second HIT are also marked as ineligible for future HITs (in case we want to collect more votes later).