A project to make businesses more aware of their customer experience, and how to fix it. By Mark Hurst. |
About Mark Hurst | Mark's Gel Conference | New York Times Story on This Is Broken | Newsletter: Subscribe | RSS Feed |
Search this site:
Categories:
- Advertising
- Current Affairs
- Customer Service
- Fixed
- Food and Drink
- Just for Fun
- Misc
- Not broken
- Place
- Product Design
- Signs
- Travel
- Web/Tech
Previous: Smoothie menu | Main | Next: Equifax.com secret question
March 20, 2006 11:43 AM
Broken: Stupid survey
From Seth Godin, a rant on a poorly designed survey: Stupid Survey Award, 2006.
My online school gives us the option of filling out an opinion survey for each class we are taking where we rate the instructor and course materials. I have a few issues with it.
A) It's about 50-60 questions long. That's equivalent to one of my exams.
B) At any point I may save my progress and come back later. That means they're storing my answers somewhere, tied to my student account. Are the results truly anonymous? If I had difficulties with a teacher and gave them a bad review, I wonder how long it will take that teacher to figure out who the squeaky wheel is?
C) The semester is 11 weeks long. They give us the survey during week 7 or 8. How can I possibly give a legitimate response at that point?
I agree for the most part with what Seth says in his rant, but I think he kind of deep-sixes himself when he gets to "they're not going to use the feedback because they actually want it, but because they intend to use it to sell the idea to others."
If this is indeed the case (and I suspect he's right), then the survey is anything but stupid: it's going to accomplish exactly what "they" want it to do. Disingenuous, yes, but not stupid.
Without knowing what data they are truly seeking, I'm not sure if we can blame them for the wide array of questions. First, if I recall correctly from my psychology courses, it is a common practice to "flood" the survey with a variety of questions to avoid having the respondant figure out how to manipulate the results. Maybe they're only really interested in numbers 3, 7, and 14. (If so, maybe they shouldn't have called it "Airport Parking Concept Survey") Second, the marketing and business people need to know that it would be profitable, and questions like income matter. Someone on a $30k income won't use a luxury like valet parking. (Why they don't already have this data elsewhere, I don't know.)Let's hope they know what they're doing... ::shrug::
Comments on this entry are closed
Previous: Smoothie menu | Main | Next: Equifax.com secret question
I never give my opinion to anyone. :)
Posted by: JAC at March 20, 2006 12:40 PM