2.2 - Item Development Considerations

Question 1

Questions which ask respondents to choose from a fixed set of response alternatives

Answer 1

Close-ended questions

Question 2

Questions which ask respondents to respond in their own words without any response alternatives

Answer 2

Open-ended questions

Question 3

Yes/No questions, MCQ, and numerical rating scale questions are examples of:

Answer 3

Open-ended questions

Question 4

5 key characteristics of close-ended questions:

Answer 4

1. Fixed response options
2. Structured format
3. Quantitative data
4. Limited expressiveness
5. Used in surveys and questionnaires

Question 5

5 key characteristics of open-ended questions

Answer 5

1. No preset response options
2. Narrative or short-answer format
3. Qualitative data
4. Useful for exploratory research
5. Require careful analysis

Question 6

Most widely used response format

Answer 6

Rating Scales (e.g Likert)

Question 7

Type of rating scale where numerical values are anchored by words (e.g. “Strongly agree”)

Answer 7

Likert Scales

Question 8

Respondents may have difficult distinguishing between adjacent points on a rating scale. This is known as:

Answer 8

Item-ordering effect or proximity effect

Question 9

5 advantages of likert scales

Answer 9

1. Efficient to create
2. Familiar to respondents
3. Efficient data collection
4. Numerical scores for analysis
5. Flexibility

Question 10

The bare minimum number of points for a rating scale for parametric statistics is ___. The best results are provided by scales with ___ to ___ points

Answer 10

5, 6 to 7

Question 11

A 6-point scale is better than a 5-point scale because:

Answer 11

6-point scales give more variability in responses

Question 12

2 arguments against including a midpoint in response scales (e.g. “Neither agree nor disagree”, “Sometimes”)

Answer 12

1. Forced decision-making
2. Non-response bias

Question 13

Argument for including a midpoint in response scales (e.g. “Neither agree nor disagree”, “Sometimes”)

Answer 13

Capturing ambivalence

Question 14

5 advantages of closed-ended questions

Answer 14

1. Efficiency
2. Controlled response options
3. Improved recall
4. Easier data analysis
5. Consistency and reliability

Question 15

4 disadvantages of closed-ended questions

Answer 15

1. Limited response options
2. Forced responses
3. Lack of flexibility
4. Potential for frustration

Question 16

5 advantages of open-ended questions

Answer 16

1. Rich and detailed data
2. Flexibility
3. Exploration of sensitive topics
4. Qualitative insights
5. Enhance client reporting

Question 17

6 disadvantages of open-ended questions

Answer 17

1. Time consumption
2. Fatigue and boredom
3. Poor response quality
4. Analytical challenges
5. Lack of quantitative measurement
6. Variability in respondent skills

Question 18

Endorsing a positively-keyed item on a measure indicates ___ with the attribute of interest. while endorsing a negatively-keyed item indicates ___ with the attribute.

Answer 18

The presence of or agreement, The absence of or disagreement

Question 19

A mix of positively- and negatively-keyed items prevents respondents from getting into ___

Answer 19

A response set (Acquiescence)

Question 20

An item that asks two or more questions in the same item, where each may be answered differently by respondents

Answer 20

Double-barrelled items

Question 21

Items should use simple language and avoid slang terms, colloquiums and jargon because ___

Answer 21

These types of language may be unfamiliar or confusing to some respondents

Question 22

Items should be short and concise because ___

Answer 22

Long items may be difficult for some respondents to understand, or respondents might get bored