Chapter 10 - Data Collection Methods II

Question 1

Questionnaire

Answer 1

a preformulated written set of questions to
which respondents record their answers, usually
within rather closely defined alternatives

Question 2

5 general steps to produce
reliable and valid data

Answer 2

– Initial considerations
– Clarifying concepts
– Determining question types, format, wording, and sequence
– Pretesting the questionnaire
– Administering the questionnaire

Question 3

Principles of Wording of the questions

Answer 3

– Match respondents’ level of understanding
– Define ambiguous or unfamiliar terms
– Avoid jargon
– Keep questions simple, specific, and concise/short
– Avoid complicated syntax

Question 4

Type and form of questions

Answer 4

– Open-ended vs. closed questions
– Positively and negatively worded questions
* E.g., “I am attached to my organization,” and “I do not feel a sense of
belonging to my organization.”

Question 5

Principles of Wording Beware of…

Answer 5

– Double-barreled questions
– Ambiguous questions
* Questions that lend themselves to different interpretations
– Recall-dependent questions
– Leading questions
* Signal how one should respond (e.g., “Wouldn’t you agree that…?”)
– Loaded (emotionally charged) questions
– Social desirability
* Wording elicits socially desirable (acceptable) responses

Question 6

What Principles of Wording is this failing?

The discovery of the Higgs boson has
changed how I view the universe.

Answer 6

• Language and wording
  – Use of jargon/unfamiliar terms
  – Lack of specificity (“view the universe”)

Question 7

What Principles of Wording is this failing?

Learning a new language will add another
string to my bow

Answer 7

• Language and wording
  – Use of a potentially unfamiliar idiom
  (expression)

Question 8

What Principles of Wording is this failing?

How satisfied are you with your pay and your
working conditions?

Answer 8

• Double-barreled question

Question 9

What Principles of Wording is this failing?

In light of the recent change in oil prices,
don’t you think that Canada should invest
more in renewable technologies?

Answer 9

• Leading question

Question 10

What Principles of Wording is this failing?

To what extent do you think that workforce
diversity could harm an organization?

Answer 10

• Social desirability
• Leading question

Question 11

Issues to consider Principles of Measurement

Answer 11

• Categorization and coding of data (Chs. 15 & 17)
• Scales and scaling (Ch. 13)
  – Nominal, ordinal, interval, and ratio scales
  – Response options should be mutually exclusive and
  collectively exhaustive
• Reliability and validity (Ch. 13)

Question 12

Principles of Measurement Issue

Answer 12

Unbalanced response options

Question 13

Principles of Measurement Issue

Your age
A. Under 25
B. 25 to 50
C. 50 to 75
D. Over 75

Answer 13

Response options are not mutually exclusive

Question 14

Principles of Measurement Issue

Your gender
A. Male
B. Female

Answer 14

Response options are not collectively exhaustive

Question 15

General Appearance and Sequencing

Questionnaire sections and formatting

Answer 15

– Professional appearance and copy-editing
– Good introduction (see example on p. 150)
* May include consent information (separate letter?)
– Organized sections and clear instructions
– (Some) open-ended question(s) at the end
– Questionnaire conclusion (see p. 153)
* Courteous note thanking respondents

Question 16

General Appearance and Sequencing

Sequencing of questions (p. 153)

Answer 16

– Funnel approach
* From general to more specific; easy to answer to more difficult
– May sequence questions randomly to reduce item context
effects/bias
* BUT: questions are usually ordered by topic to avoid confusion
when categorizing, coding, and analyzing responses

Question 17

General Appearance and Sequencing

Classification data/personal information/demographics

Answer 17

– E.g., age, gender, education (maybe marital status, income)
* Important for sample description and statistical control
– Should attempt to preserve participant anonymity
– Typically appear at the end of the questionnaire

Question 18

Example Question Issue

The present study explores the relationship between
active engagement in physical activities and
psychological well-being. Please answer the questions
below as accurately as possible.

What is your annual personal income (gross)?
Please round to the nearest thousandth.
$____________

Answer 18

• Sensitive personal data
  – Relevance to the study?

Question 19

Questionnaire

Answer 19

A preformulated written set of questions to which the respondent
records the answers, usually within rather closely delineated
alternatives.

Question 20

Open‐ended questions

Answer 20

Questions that the respondent can answer in a free‐flowing
format without restricting the range of choices to a set of specific
alternatives suggested by the researcher.

Question 21

Closed questions

Answer 21

Questions with a clearly delineated set of alternatives that confine
the respondents’ choice to one of them.

Question 22

Double‐barreled question

Answer 22

Refers to the improper framing of a question that should be
posed as two or more separate questions, so that the respondent
can give clear and unambiguous answers.

Question 23

Ambiguous questions

Answer 23

Questions that are not clearly worded and are likely to be
interpreted by respondents in different ways.

Question 24

Leading questions

Answer 24

Questions phrased in such a manner as to lead the respondent to
give the answers that the researcher would like to obtain.

Question 25

Loaded questions

Answer 25

Questions that elicit highly biased emotional responses from
subjects.

Question 26

Social desirability

Answer 26

The respondents’ need to give socially or culturally acceptable
responses to the questions posed by the researcher even if they
are not true.

Question 27

Classification data (Questions)

Answer 27

Personal information or demographic details of the respondents
such as age, marital status, and educational level.

Question 28

Pretest

Answer 28

A test given to subjects to measure the dependent variable before
exposing them to a treatment.

Question 29

Electronic questionnaire

Answer 29

Online questionnaire administered when a microcomputer is
hooked up to computer networks.

Question 30

Delphi technique

Answer 30

A forecasting method that uses a cautiously selected panel of
experts in a systematic, interactive manner.