Lecture 9: Validating Questionnaires

Question 1

Steps of designing questionnaire

Answer 1

• considering administration type
• design questions
• designing answers
• other things to consider
• translation process and pilot

Question 2

5 Steps of translation

Answer 2

1. forward translation
2. backward translation
3. bilingual expert panel
4. pre-testing on target population
5. final version + document process

Question 3

Three methods to pre-test questionnaire

Answer 3

• observations
• cognitive interviewing
  x concurrent (thinking out loud)
  x retrospective (response after respondent answered question)

Question 4

cross-cultural validation

Answer 4

Refers to whether measures/construct that were originally generated in one culture are applicable, meaningful and thus equivalent in another culture

Question 5

5 ways of cross-cultural validation

Answer 5

1. conceptual
2. item
3. semantic
4. operational
5. measurement

Question 6

Conceptual equivalence

Answer 6

refers to how the underlying concept(s) of the scale are conceptualized in the new context and culture. Achieved when same relationship to the underlying concept(s) exist in both culture, primarily in terms of domains included and the emphasis placed on the different domains

Question 7

Item equivalence

Answer 7

explores whether items are equally relevant and acceptable. It is attained when items estimate the same parameters of the concept(s) under study

Question 8

Semantic equivalence

Answer 8

Is concerned with language. It is achieved when a similar meaning of words and concepts is transferred and when a similar effect on respondents is obtained

Question 9

Operational equivalence

Answer 9

concerns with the suitability of the questionnaire format, instructions and mode of administration. It is attained when these do not affect the results

Question 10

Measurement equivalence

Answer 10

Refer to psychometric properties of the scale and is reached if the psychometric properties of the adapted version are acceptable

Question 11

Content validity

Answer 11

The degree to which the content of an instrument is an adequate reflection of the construct to be measured

Question 12

Construct validity

Answer 12

The degree to which the scores of an instrument are consistent with hypothesis based on the assumption that the instrument validly measures the construct to be measured

Question 13

Criterion validity

Answer 13

The degree to which the scores of an instrument are an adequate reflection of a ‘gold standard’

Question 14

Internal consistency

Answer 14

Reliability
Interrelatedness among the items
with cronbach’s alpha