Midterm Flashcards
What are the main decisions when designing research instruments?
- Appropriate type of questions
- Make sure wording of questions, instructions and cover letter is clear
- Decide method of distribution and return of the questionnaires
- Determine methods of data collection
What are the three types of question content?
Behaviour
Beliefs and attitudes
Characteristics and attributes
What are the types of questions?
Direct
Indirect
Open-ended
Closed
When do you use direct vs indirect questions?
Use indirect when there is a sensitive topic
Typically use direct
What are the types of open-ended questions?
Infinite responses
Limited amount of answers
Starting questions
Follow ups
Questions bringing arguments
Questions bringing attitudes
What are the ways that answers can be recorded by interviewee?
Lists
Categories
Rankings
Scales
Grids
Quantities
Describe a list question
Multiple choices that are not mutually exclusive
“Check all that apply”
Describe a category question
Multiple options but all are mutually exclusive (e.g. at least once a day, at least once a week…)
“Choose only one option”
Describe a ranking question
Rank between 1 and 5 for example, placing numbers beside choices as per the instructions
Describe a scale question
Usually horizontally formatted
From strongly agree to strongly disagree for example
Describe a grid question
Multiple scale questions in one grid
Describe a quantity question
Question with numerical answer such as amount of times you have done something, or the year you were born etc.
What are the key response bias issues in survey research?
Non-differentiation
Central tendency
Leniency
Auspices
Telescoping
Fatigue
What is non-differentiation?
When a respondent selects the same answer for all questions
What is the central tendency issue?
It is the tendency of respondents to select answers in the middle of a scale question
How should you solve a central tendency issue?
You should expand the scale
(It is shown that reliability and validity highest for about a 7 point scale for bipolar scales, and 5 points for unipolar)
What is the leniency issue?
The tendency to give inflated ratings rather than true assessments (common in performance ratings of employees etc.)
How can you solve the leniency issue?
By shifting the scale down, for example:
instead of
not helpful at all - of some help - very helpful
use
of some help - very helpful - absolutely indispensable
What is auspices bias?
Bias in the responses of subjects caused by the respondents being influenced by the organization conducting the study
What is the telescoping issue?
A bias causing people to misremember the time frame of events
How can you solve telescoping bias?
By expanding the time frame in question
What is the fatigue issue?
When a respondents answers are affected due to the fact that the survey is too long/complex
How do you solve the fatigue issue?
Keep the survey short and to the point
What is the data on the fatigue issue in surveys?
It is shown that surveys that took more than 17.5 minutes led to predicted completion rates of less than 70%
Surveys with more than 30 screens/questions are predicted to exceed acceptable dropout levels
Other reports indicate that 55 clicks is a threshold level