Surveys and Questionnaires Flashcards
(25 cards)
What is a survey?
A research methodology for gathering information from a sample of people via face-to-face, telephone, or online methods.
What is a questionnaire?
A set of written questions used to conduct a survey.
What are the main components of a questionnaire?
Demographics, factual questions (e.g. behavior), and non-factual questions (e.g. attitudes and beliefs).
What are open vs closed questions?
Open questions allow free text responses; closed questions offer fixed answer choices.
When should you avoid using questionnaires?
When exploring very open design questions or when respondents may not know what they want.
When are questionnaires useful?
When redesigning a system to assess current positives/negatives or interest in new features.
What defines usability in evaluation?
Effectiveness, efficiency, and satisfaction.
Why is measuring satisfaction difficult?
Because it is a subjective judgment and must be asked of users.
What makes a good measurement?
High validity (measuring what is intended) and high reliability (consistent results).
What is the SUS scale?
System Usability Scale – a validated questionnaire that gives a usability score out of 100.
How many participants are recommended for usability questionnaires?
Generally 10-15 people, depending on study design.
Should you design your own usability questionnaire?
No, use pre-validated ones unless your goals are different and well justified.
What are common demographic questions?
Gender, age, education level, occupation, income, ethnicity.
What is the best practice for demographic questions?
Place them at the end, make them optional, and use ranges instead of exact values.
What are factual queries?
Questions about behavior, ownership, or frequency, e.g., ‘How often do you skip lectures?’
What are tricky issues with factual queries?
Memory recall, social desirability bias, and vague wording.
How can you improve recall in factual questions?
Provide timeframes and response sets.
What are non-factual questions?
Questions about opinions, attitudes, beliefs, and intentions.
Why are non-factual questions less reliable?
They depend on the state of mind and are harder to verify.
What biases affect attitude measurement?
Question wording, agreement tendency, social desirability, and context.
What are tips for wording questions?
Avoid double-barrelled or negative questions, use clear, simple language.
What is psychometrics?
The science of measuring mental states like trust using validated scales.
Why use multiple items to measure attitudes?
To increase reliability and account for variability.
What are common attitude scales?
Agree-disagree Likert scales and semantic differentials.
