L8 Survey & Questionaires Flashcards
(38 cards)
What is a survey in the context of usability engineering?
• A research methodology for gathering information from a sample
• Methods: face-to-face, telephone, self-administered (paper or online)
How does a questionnaire differ from a survey?
• A questionnaire is the tool used in a survey
• Composed of written questions to gather specific data
When is it appropriate to use questionnaires in usability evaluation?
• Ideal for evaluating or improving existing systems
• Useful to measure satisfaction, identify feature preferences, or assess user needs
Why might questionnaires be unsuitable for open design questions?
• People may not know what they want in a new system
• Open-ended design questions lack predefined response sets
What are the core components of a questionnaire?
• Demographic questions: age, gender, occupation
• Factual questions: behavior, ownership
• Non-factual questions: attitudes, beliefs
What types of questions make up a complete usability questionnaire?
• Demographic classification
• Factual (e.g., usage, frequency)
• Subjective (e.g., attitudes, satisfaction)
What are the key types of response formats in questionnaires?
• Open-ended (free text)
• Closed-ended: Yes/No, scales, value ranges
Why are satisfaction questions important in usability testing?
• Satisfaction reflects subjective usability
• Cannot be measured without user feedback
What does a ‘high quality’ usability questionnaire need?
• High validity: measures intended constructs
• High reliability: consistently reproducible results
What traits define valid and reliable questionnaire data?
• Validity ensures accuracy
• Reliability ensures consistency
Why is the SUS (System Usability Scale) recommended for usability measurement?
• Pre-validated scale with known scoring
• Provides a usability score out of 100
How should you approach sample size for usability surveys?
• Aim for at least 10-15 respondents
• Adjust based on project design and goals
What is the minimum recommended sample size for usability tests?
• Around 10-15 participants for meaningful quantitative results
What are best practices for demographic question design?
• Use ranges (e.g., age: 25–34)
• Avoid asking unnecessary personal info
• Leave demographic questions for the end
What makes factual questions tricky to design?
• Memory recall difficulty
• Bias from sensitive topics
• Misinterpretation of wording
What should be avoided when asking users to recall past behaviors?
• Vague timeframes
• Leading or sensitive wording
What defines a well-written non-factual (attitude) question?
• Simple, unambiguous language
• No double-barrels or double negatives
• Avoids bias and social desirability
Why is pilot testing important in questionnaire design?
• Identifies confusing wording
• Ensures clarity and effectiveness before launch
What’s the role of multiple items in measuring attitudes?
• Increases reliability of the scale
• Helps uncover deeper psychological constructs
How can using several related questions improve attitude measurement?
• Provides more accurate, stable results
• Covers different dimensions of the same attitude
What are common scale types used in questionnaires?
• Likert (Agree–Disagree)
• Semantic differential (e.g., easy–difficult)
What are design tips for building effective scales?
• Use 5–10 points
• Include neutral and ‘not applicable’ options
• Balance between positive and negative items
What does this diagram illustrate about attitude scale development?
- A multi-step process: interviews → draft questions → pilot → factor analysis
- Shows that academic rigor is needed for validity, not suited for quick projects
Why is this process rarely feasible in student usability projects?
- Time-consuming
- Requires large sample sizes and statistical expertise
