At the end of the day, your personal result will be for however you interpreted the instructions. But population-wide results should remain comparatively valid assuming each population is comparable in terms of being conservative/liberal with what they claim to know. E.g. you can still measure the difference between 25-year-olds and 30-year-olds because they're answering it in the same way collectively, and it's the differences I'm more interested in for research, than the absolute values.
I thought about making it something like a multiple-choice quiz, but it would have made the quiz a lot slower, and therefore either a lot longer or a lot less accurate, so checkboxes seemed like the only way to go.
Agreed that this is the hardest part is taking the quiz. Not sure if you'll see consistent interpretations based on age/education, but curious to see your analysis of this!
I thought the explanations in the "more info" box was very useful. I'd suggest keeping it open by default on the first page (closed on other pages) as it seems a critical to read that box before taking the quiz. Just a thought!
This was also a bit confusing to me. "Goodfellas"? I knew that was a film (I've heard the name before), but I haven't seen it, and I couldn't tell you who's in it or what it's about. Does that count as "uniquely identifying?"
> Uniquely identify means you can identify the specific person or thing — not just a category.
> Just knowing someone is an “actor” isn't enough, because there are lots of actors. But if you can name their role in a specific movie or recognize them by sight, that’s uniquely identifying — so check the box!
At the end of the day, your personal result will be for however you interpreted the instructions. But population-wide results should remain comparatively valid assuming each population is comparable in terms of being conservative/liberal with what they claim to know. E.g. you can still measure the difference between 25-year-olds and 30-year-olds because they're answering it in the same way collectively, and it's the differences I'm more interested in for research, than the absolute values.
I thought about making it something like a multiple-choice quiz, but it would have made the quiz a lot slower, and therefore either a lot longer or a lot less accurate, so checkboxes seemed like the only way to go.