Chapter 9 - Constructing & Administering Flashcards
(52 cards)
1
Q
Surveys
A
- Focus on group outcomes.
- Results are presented at the group level
- Surveys are scored by the percentage of respondents who selected each answer.
2
Q
Psychological Tests
A
- Focus on individual outcomes.
- The results are reported at the individual outcome.
- Reported in terms of overall derived scores or scaled scores.
- Sample the behaviours thought to measure an attribute or thought to predict an outcome.
3
Q
Survey Research Firms
A
- Companies that specialize in the construction and administration of surveys and analysis of data.
4
Q
Survey Researchers
A
- People who design and conduct surveys and analyze their results.
5
Q
What are good characteristics of surveys?
A
- Specific and measurable objects
- Straightforward questions
- Pretested
- Good sample
- Appropriate analysis
- Accurate reporting of results
- Reliability and Validity
6
Q
Experimental research techniques vs descriptive research techniques
A
- Experimental: Help determine cause and effect.
- Descriptive: Help describe a situation or phenomenon.
7
Q
What research technique are surveys typically used for?
A
- Descriptive Research Techniques
8
Q
What are Helmstadter’s Six Methods for Acquiring Knowledge?
A
- Tenacity: Based on something we already believe.
- Intuition: Without any reasoning or inferring.
- Authority: From a highly respected source.
- Rationalism: Through reasoning.
- Empiricism: Through personal experience.
- Scientific Method: By using the scientific method.
9
Q
What are the five steps associated with the scientific method while constructing a survey?
A
- Identifying - Presurvey issues
- Designing - Construct the survey
- Conducting - Administer the survey
- Analyzing - Analyze data
- Communicating - Communicate the findings
10
Q
What’s the first step in preparing a survey?
A
- Planning the survey objectives
- The purpose of the survey and what the survey will measure.
11
Q
What is the second step in preparing a survey?
A
- Establish operational definitions
- Specific behaviours that represent the purpose
12
Q
What is the third step in preparing a survey?
A
- Constructing a plan
- Includes a list of all the phases and steps necessary, a cost estimate, survey’s development and administration, analysis of data, a timeline
13
Q
What is involved in the second phase of creating a survey?
A
- The construction of a survey
- Involves writing survey questions, preparing the survey instrument, and pretesting the survey
14
Q
Self-Administered Surveys
A
- Those that individuals complete themselves.
15
Q
Mail Surveys
A
- Mailed to respondents with instructions for completing and returning them.
16
Q
Individually Administered Surveys
A
- Administered by a facilitator in person for respondents to complete in the presence of the facilitator.
17
Q
Personal Interviews
A
- Surveys that involve direct contact between the survey researcher and the respondents in person or by phone.
- Can include face-to-face surveys or telephone surveys.
18
Q
Face-to-Face Surveys
A
- The interviewer asks a series of questions in respondents’ homes, a public place, or the researcher’s office.
19
Q
Telephone Surveys
A
- Interviewer calls respondents and asks them questions over the phone.
20
Q
Structured Record Reviews
A
- Forms that guide data collection from existing records.
21
Q
Structured Observations
A
- Forms that guide an observer in collecting behavioural information.
22
Q
What are the stages people go through when answering survey questions?
A
- Comprehension
- Retrieval
- Judgment
- Response Communication
23
Q
Qualities of good survey questions
A
- Purposeful and straightforward
- Unambiguous
- Correct syntax
- Appropriate response options
- Appropriate categorical alternatives
- Written at a comfortable reading level
-
24
Q
Double-Barreled Questions
A
- A question that is actually asking two or more questions in one.
25
What happens after we write our survey questions?
- We prepare the survey instrument
- Create the survey so people want to complete it.
26
What should the front page of a survey include?
- State the purpose of the survey
- Explain who is sponsoring or conducting the survey
- Explain why it is important for respondents to complete the survey to the best of their ability
- Explain how to complete the form
- Assure confidentiality
- Thank them for their cooperation
27
What should a survey include?
- Appeal and instructions
- Headings and subheadings
- Transitions
- Response instructions
- Bold typeface
- Justification of response spaces
- Shading/White spaces
- Good printing/Font
28
Nonsampling Measurement Errors
- Errors associated with the design and administration of the survey
29
What does pretesting allow us to do?
- Identify sources of error
- Examine the effectiveness of the questions/survey
- Examine the effect of alternate versions of a question
- Assess the final version of a survey for understanding, time, and ease
- Obtain data and make format changes to make analysis more efficient
30
Focus Group
- Bring together people who are similar to the target respondents in order to discuss issues related to the survey.
31
Field Test
- An administration of the survey or test to a large representative group of individuals to identify problems with administration, item interpretation, and so on.
32
Split-Sample Tests
- This method involves field-testing two or more versions of a question, sets of questions, or surveys.
- Its objective is to find which version gives the most accurate results.
33
Item Nonresponse Rate
- How often an item or question is not answered.
34
What is the third step in administering a survey?
- Actually administering the survey.
35
Probability Sampling
- A type of sampling that uses statistics to ensure that a sample is representative of a population.
36
Simple Random Sampling
- Every member of a population has an equal chance of being chosen as a member of the sample.
37
Systematic Sampling
- A variation of simple random sampling.
- Every -nth (e.g., every fifth) person in a population is chosen as a member of the sample.
38
Stratified Random Sampling
- Population is divided into subgroups or strata.
- A random sample is selected from each stratum.
- The strata should be based on some evidence that they are related to the issue or problem the survey addresses.
39
Cluster Sampling
- Used when it is not feasible to list all of the individuals who belong to a particular population and is a method often used with surveys that have a large target population.
40
Nonprobability Sampling
- A type of sampling in which not everyone has an equal chance of being selected from the population.
- Often used because they are convenient and less expensive than probability sampling.
41
Convenience Sampling
- The survey researcher uses any available group of participants to represent the population.
42
The Homogeneity of the Population
- How similar the people in your population are to one another.
43
What is the last step of the third phase of creating a survey?
- Distributing the survey.
44
What is the fourth phase of survey development?
- Involves coding and entering the survey data into computer software for analysis.
45
Database
- A matrix in the form of a spreadsheet that shows the responses given by each participant and for each question in the survey.
46
Response Rate
- The number of individuals who responded to the survey divided by the total number of individuals to whom the survey was sent.
47
Univariate Analyses
- Computation of statistics that summarize individual question responses.
48
Bivariate Analyses
- Provide information on two variables or groups.
49
Multivariate Analyses
- Provide information on three or more variables or groups.
50
What are the steps to survey development?
- Preparing the survey
- Pre-testing the survey
- Administering the survey
- Coding, entering, and analyzing data
51
What are the three sets of instructions?
- For the person administering the test
- For the person taking the test
- For the person scoring/interpreting the results
52
Testing Environment
- The circumstances under which the test is administered that affect how one may respond.
