Category: Web Surveys
-
Norman doors and online questionnaire design
In usability circles the doors in the pictures on the right are called “Norman doors.” Their named for Donald Norman who wrote a fascinating little book called, The Design of Everyday Things. In the book Norman talks a great deal about affordances, that is, properties of objects that help us to do things with them. …
-
The latest online panel dust up
Gregg Peterson's post earlier this week on this blog about the Panel of Panelists at the CASRO Online Conference created quite a stir. I saw an unusual number of pageviews, there was a fair amount of retweeting of the link and other industry commentators worked a similar theme. It came on the heels of Ron…
-
The bottom line on online sample routers
So what's the bottom line? I don't think we need to fear routing. Routing is essentially about automating and systematizing what panel companies have been doing for a decade. While some vendors are working on ways to claim greater representivity by the questions they ask in their screeners that's really a separate issue from routing.…
-
The problem of router bias
Everyone worries about router bias and it's not clear that anyone has figured out how to deal with it. At its core it seems to come down to the priority given to one survey over others and how that impacts the samples delivered to all of those other surveys. Before panels we drew samples that…
-
Respondents in routers
The heart of routing is screening respondents. Conceptually, routing involves amassing all of the screening questions of waiting surveys (of which there typically are hundreds) and packaging them in a way that they can be efficiently administered while minimizing the chances that a respondent gets routed to a survey and then fails to qualify. Some…
-
Let’s have a look at online sample routers
A couple of weeks back I moderated about a four hour discussion on online sample routers sponsored by the ARF's Foundations of Quality research initiative. The current focus of the initiative is development of a research agenda that touches on the key dimensions of online research. The role of sample routers and how they may…
-
A Literary Digest moment
Last week McKinsey released results from a study of the impact of US healthcare reform (The Affordable Care Act) on employer-provided health insurance. The report estimated that 78 million workers were likely to lose their employer provided health insurance once the law kicks in fully in 2014. This estimate is significantly at odds with other…
-
Can we really do two things at once?
Like most research companies mine now routinely includes cell phones in our telephone samples. Best practice requires that before we interview someone on a cell phone we determine if it's safe to do the interview. If, for example, the respondent is driving a car we don't do the interview. Yesterday someone asked me if it…
-
Getting to the bottom of the respondent engagement problem
I've been working along with some colleagues on the lit review section of a paper for the ESOMAR Congress. The topic is "gamification" as the next experiment designed to increase respondent engagement in online surveys. As anyone who has done their homework knows the issue of survey respondent engagement did not arise with the growth…
-
New challenges to online panel data quality
Among the many criticisms we hear of online panels is the charge that we have no idea whether these respondents are who they say they are and that the incentive-driven nature of panels encourages people to pretend they are someone they are not. A number of companies have introduced products to clean up online samples…