The strength of a survey lies in its questions.
Ask the right kind of questions objectively and you get direct objective answers actually useful to you without needing to sift through redundant emotional clutter.
Naturally. Does this survey in particular, ask the right kind of questions? Do they lend themselves to detailed and honest responses? The multiple-choice style is rather limiting in some questions. Let's pull out some examples from the survey.
On a scale of 1-5 (from Strongly Disagree to Strongly Agree), how much do you agree with the following statements about one-time only events?
- One-time-only events are something I look forward to and plan to login for
Detailed response: Yes, I look forward to them, but I live in a timezone that makes it inconvenient to log on. Is it possible to 'plan' to log in? Should I take leave from my day job in order to log in, or lose sleep over it? So I Strongly Agree with one part of the statement, and disagree with the other. What's the number to choose on a scale of 1-5?
The rest of the questions in that section are likewise difficult to give any opinion on, subjective or objective, because I have never had a chance to participate in a one-time event.
Or consider the last two questions in that section:
- The final battle against the Ancient Karka should only happen once
- The final battle against the Ancient Karka should happen multiple times
Detailed response: In this case it is inaccurate to choose 3, which actually indicates 'No Strong Opinion'. Nonsense, of course we have an opinion, it's just outside the scope of the survey. Obviously silly for the battle to happen multiple times. Where's the realism in that? But if it only happens once during a rather limited time period, then how do we compensate for the people who are unable to participate during that admittedly very narrow window? An outright war is usually not over within a matter of hours. Create an event that runs continually over a period of a few days to a week and many other people will get to participate and enjoy the fruits of labour of the dev team. Sure, we could still get some that rock up after a vacation or after living under a rock for a week and say they missed it, but it will be far fewer in number than those who missed it because they were in the 'wrong' timezone.
Or consider one of the final questions in the survey:
- Would you refer a friend to play Guild Wars 2 in the future based on this weekend event? (Select ONE from list)
Yes, Maybe, No.
Detailed response: Yes, I would refer a friend to play GW2 in the future, but not based on *this* weekend event in which I never got to play myself. Does that mean I should choose 'Yes', 'No' or 'Maybe'?
For sure, the survey needs to ask the right questions.
Edited by Xekk, 21 November 2012 - 05:19 AM.