Tag: Questionnaire Design
-
Some light shed on Web survey breakoffs
It's been hard to go to an MR conference over the last couple of years and not get at least one presentation pitching the use of Flash as a cure all for much of what ills online—falling response rates, high abandonment, high levels of satisficing, etc. I have never found these presentations to be terribly…
-
I don’t know
I have this assignment of sorts to read an often-cited article by Jon Krosnick and some colleagues titled, "The Impact of 'No Opinion' Response Options on Data Quality," Public Opinion Quarterly, 66:371-403. This is quite timely as I have just finished a bit of empirical research with some colleagues that cites this article, although I…
-
More comparisons of Web to other methods
I am finally getting around to wading through the mother lode of academic research noted in an earlier post way back at the beginning of March. The special POQ issue has two articles, one looking at Web versus face-to-face and the other comparing CATI, Web and IVR. The results are not particularly surprising, but it's nice…
-
Sweating the small stuff
Andrea Widener asked me a question today about our use of underscore for selective emphasis in Web surveys. We used to use blue. Andrea’s query made we wonder what the current thinking is on the topic. For this I turned to Mick Couper’s Designing Effective Web Surveys. Now I should divulge at the outset that…
-
Cultural bias in global surveys
This is a huge topic and an area where there is a lot written but little definitive being said. And so I read with interest a little blurb in the current issue of mySSI. One of the articles reports on research by Nielsen UAE which seems to show that people in some countries are culturally…
-
Sometimes helping hurts
One of the guiding principles of Web questionnaire design should be to constantly look for ways to make it easier for people to answer our questions. We have just moved into the analysis stage of our latest set of experiments with the good folks at ISR. One of the experiments on this round looked at…
-
More from 3MC
Several of the sessions on the last day of 3MC were devoted to the general topic of response styles in multinational research. While I was aware that the problem of people from different cultures responding differently (especially in scale usage) this was the first systematic discussion I had heard on the issues. Given that we…
-
The Trade-off on Trade-offs
It’s just dawned on me that while I posted a number of updates from GOR08 I have not reported on the interesting research that Bob Rayner, Mick Couper, Dan Hartman, and I presented. The issue at hand was the "best" way to ask feature trade-off questions online. For some time we have been presenting pairs…
-
Is that somewhat satisfied or very satisfied?
Andrew Cober has been working with an Energy client for whom we do a phone study. While monitoring the client heard respondents struggling some with questions like this: Would you describe the price you currently pay for electricity as very reasonable, somewhat reasonable, neither reasonable nor unreasonable, somewhat unreasonable or very unreasonable? So Andrew and…