Session 8: Quantitative measurements

Question 1

What is a homogenous construct?

Answer 1

A homogeneous construct in quantitative research means all items in a scale or measure reflect the same, single concept—leading to stronger reliability and clearer interpretation.

Question 2

What is Cronbach’s Alpha?

Answer 2

Cronbach’s alpha (α) is a statistical test used to measure the internal consistency (or reliability) of a set of items in a questionnaire or scale.

In simple terms, it tells you how well a group of questions work together to measure the same underlying concept (e.g., self-esteem, anxiety, job satisfaction).

α > 0.7 Ok
α > 0.9 very good

Question 3

Face Validity

Answer 3

Does it look appropriate on the surface?

Question 4

Concurrent Validity

Answer 4

Does it agree with another known measure?

Question 5

Predictive Validity

Answer 5

Can it predict future outcomes?

Question 6

questionnaire development steps

Answer 6

1. The research questions
2. List topics under each research question
3. List required background variables
4. Search for questions and scales from previous research
5. Assess the variables against the plan for data analysis

Question 7

What is important to keep in mind when designing a questionnaire?

Answer 7

Each question lead to a cost both for the respondent and the investigator
- Does it add value?
- Can the respondent answer the question?

Question 8

Is it possible to use questions that have been used in previous survey research?

Answer 8

Yes, as long as you cite relevant publication and seek permission as required.

Advantages:

• Questions are already tested
• Increased probability for validity and reliability (if published in good journal)
• Allow you to draw comparisons with other research
• Might give you ideas on how to best approach your own questions

Question 9

What are vignette questions? And what are the advantages of them?

Answer 9

Vignette questionspresent one or more scenarios and ask you to apply your knowledge, judgment, or reasoning to analyze or respond to the situation.

• Present respondents with a scenario
• Ask them how they would respond or what they think the characters should do
• Anchors opinions and choices in a concrete, specific context (may be easier to answer)
• Useful for sensitive topics
  –Less threatening: imaginary characters suggest social distance from respondent

Question 10

What are rules to bear in mind when designing questions?

Answer 10

general rules of thumb:

• always bear in mind the research question
• what do you want to know?
• how would you answer it?

specific rules when designing questions:

• avoid ambiguous terms in questions
• avoid long questions
• avoid double-barrelled questions
• avoid questions that are actually asking two questions
• avoid very general questions
• avoid leading questions
• avoid questions that include negatives
• avoid technical and obscure terms
• does the respondent have the requisite knowledge?
• make sure that there is a symmetri between a closed question and its answers
• make sure that the answers provided for a closed question are balanced
• consider wether to include ‘don’t know’ options or not
• avoid questions where you can mark more than one option
• define time period for the question when relevant
• be aware of memory problems
• avoid asking about future intentions

Question 11

Why are piloting studies important?

Answer 11

Piloting interviewsare important in research because they help youtest and refine your interview questions, format, and approachbefore conducting the actual study.