Prelims Flashcards
(48 cards)
measurement tools (e.g., questionnaires or
scales) designed to obtain data on a topic of interest from research subjects.
Research Instruments
total number of the expected participants
population
representative of the population
sample
list of numbers of population
sampling frame
preferred mode of data collection in social
science research particularly quantitative studies
Survey
often take the form of questionnaires
Survey
the difference between survey and questionnaire?
Survey is the process
Questionnaire is the material
useful when the unit of analysis is individuals
or persons
Survey
Why Survey?
- generalizes information from the sample when the population is too large
- enables to collect of quantitative or numerical descriptions of trends, attitudes, behaviors, or opinion
- preferable alternative to disclosing information about sensitive issues ensuring confidentiality and anonymity
Anonymity vs Confidentiality
Anonymity - on the participants, who did not disclose who they are
Confidentiality - the researcher knows who the participant is but will not disclose the information to others.
Why not survey?
- has tendencies to permit biases of social desirability (where the participant chooses an answer that will satisfy the expectation of others)
- Misinterpretation compels respondents to select possible item for their response due to predetermined list of possible answers, limiting data acquisition.
- Ambiguity occurs when subjects misunderstand the meaning of an item providing their own interpretation rather than the researcher’s intent
Basic Principles in Designing Survey Questionnaire
- address survey fatigue
- Survey must be clear and unambiguous
- Avoid double-barreled questions/multiple parts
How does survey fatigue occur?
respondents weigh the questionnaire length when answering a survey
Possible outcomes of a survey fatigue
- tend to lose interest
- answer hastily without clearly understanding the items
- reject participating in the survey
Solution to survey fatigue
keep surveys at minimum length without comprising the quality of item
How to tell if the survey is clear and unambiguous?
respondents quickly understand the purpose of the survey and provide answers without difficulty
how to achieve a clear and unambiguous survey?
Do not compress several questions into a single item, abbreviate words, and disregard proper formatting to shorten questionnaires which may result in confusion or error
how to Avoid double-barreled questions/multiple parts
- examine items with the word “and”
(ex. “Were you able to register and vote for the 2022 Presidential elections? Yes or No?”) - substitute clearly defined, familiar terms instead of unfamiliar terms and jargon
Methods to reduce errors and biases
- Pretesting
- Pilot testing
How can pretesting help reduce errors and biases?
- detect problem in the questionnaire and survey administration process
- reviewing the questionnaire through focused group discussion by a selected panel
- help establish the variables or indicators of interest
How can pilot testing help reduce errors and biases?
- testing survey questionnaire in the same circumstances the researchers intend to carry it out:
1. determine how long the survey will take
2. determine possible problems the researchers and respondents might encounter
3. gauge (guide) respondents’ behavior toward answering the survey - share findings and experiences with others to enhance knowledge and research process
Characteristics of a Good Research Instrument
- Valid and Reliability - The instrument should pass the validity and reliability tests.
- Concise - Must be brief enough to elicit the needed data based on the research questions. (answers the research question)
- Sequential - Items are logically arranged.
- Easily Tabulated - Do away (avoid) with questions that will require long responses
Validity vs Reliability
Validity - from professionals and experts
Reliability - consistency / consistent results
Parts of the Questionnaire
I. Title of the survey
II. Introduction
A. Purpose of the Questionnaire
B. Confidentiality Statement
C. Voluntary Participation
D. How to Submit the Questionnaire
III. Demographic Profile
IV. Body
A. General Directions
B. Specific Directions
1. How to respond
2. Explain the response categories
V. Closing Statement