test 1, survey research Flashcards

(58 cards)

1
Q

Identify the steps in the survey research process.

A
1. Data collection 
(1) Sampling
(2) Questionnaire design or survey instrument design)
(3) Conducting the survey
 Survey modes:
(a) mail
(b) telephone
(c) in-person
(d) Internet
2. Data entry and data processing
3. Data analysis
4. Survey report (description of the survey process, major findings, conclusions, etc.; diagrams, charts, tables, etc.will be used)
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

Define and find examples of sample.

A

part” or subset of population

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

What are the major similarities between census and survey?

A

Both census and survey use the same basic techniques and methods for data collection, data entry and processing, data analysis, and findings reporting.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

Discuss the widespread use of sampling and survey by other academic disciplines and professions.

A

costco, schools, marketing

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

When can errors occur in the survey process?

A
  1. Using “part” (sample) to estimate or project
  2. Using a “whole”( population )to estimate or project
  3. Respondent answers are not accurate measures of the characteristics of the respondents.
  4. Sample does not represent population.
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

Discuss various types of biases in surveys.

A
  1. Incomplete sample frame: Sample frame does not include all the people to be sampled.
  2. Sampling is not random.
  3. Incomplete answers, non-response, and low completion rate.
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

Differentiate between random error and systematic error in sampling Find real life examples for each.

A

sampling is concerned with the selection of a subset of individuals from within a statistical population to estimate characteristics of the whole population

systematic error is called a bias ex. is an internet survey

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

Define sampling.

A

sampling is concerned with the selection of a subset of individuals from within a statistical population to estimate characteristics of the whole population

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

What is the relationship between a sample and the population

A

a sample is a subset of a population

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

Identify and find examples of the major sampling methods. And discuss their appropriate uses.

A

1 stage sampling

a. Simple random sampling:
b. . Systematic sampling
c. Stratified sampling
2. multistage sampling
a. Area probability sampling
b. Random-digit dialing (RDD)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

Why is stratified sampling needed

A

When the distribution of the target population on a particular indicator (e.g., gender, grade level) is known, stratified sampling can give all sub-groups equal representation in the sample through unequal weighting of different strata

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

What does the chance of selection refer to?

A

Each individual in the population of interest has an equal likelihood of selection.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

What are the factors affecting sample quality?

A

Feasibility
Cost
Precision (how large a sampling error can be tolerated)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

What are the characteristics of a good sample frame?

A

Comprehensiveness (must include all the people to be sampled)
A person’s probability of selection (to be selected) can be calculated.
Efficiency (the people to be sampled can be found easily and cost-effectively)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

Identify the major causes of non-response.

A

Interviewee cannot be reached.
Interviewee refuses to answer questions.
Interviewee cannot provide data due to difficulties (e.g., illness, language problems, etc.)
sensitive questions

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

How samples are drawn in Systematic sampling

A
  1. Decide sample size.
  2. Divide the total population into equal “blocks” by the sample size.
  3. Select a random number within the boundaries of one block and use it SYSTEMATICALLY throughout for ALL BLOCKS.
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

Under what circumstances do people are most likely to respond to a survey?

A

interest and relevance

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

How to calculate response rate

A

people who complete the survey / total number of people surveyed.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

Generally speaking, which groups (in terms of age, education, immigration status, etc.) are more likely to respond in surveys?

A

older educated natives

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

Generally speaking, which area (urban vs. suburban) tends to have a higher response rate?

A

suburban

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

How to reduce non-response in interviewer-administered surveys?

A

make appointments, know your timing

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
22
Q

Discussthe nature and effects of non-response

A

Non-response error is hard to measure. There is still no clear evidence on when and how much non-response will or will not affect survey estimates.
The effect of non-response on one variable can be different than for others in the same survey.
No one knows how biased non-response is, but you have to assume it is biased.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
23
Q

Discuss the merits and weaknesses of internet surveys.

A

most biased
reach only part of the population
people have multiple email accounts
cheap can get to a lot of people

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
24
Q

How to reduce non-response in mail surveys?

A

(1) Questionnaire must be easy to see, easy to read and easy to answer.
(2) Small cash payment improves response rate significantly.
(3) Repeated contacts and telephone follow-ups are needed.

25
What are the good practices to boost response rate?
(1) Combine 2-3 modes or methods to produce a higher response rate. For example: use mail or email for first phase of data collection, followed by telephone interviews with non-respondents. (2) Data collected from follow-ups using a different mode need to analyze to make sure they are comparable with previously collected data.
26
 Identify self-administered, surveys.
mail, internet, and computer-assisted surveys.
27
 Identify interviewer-administered, surveys.
telephone and personal interview surveys.
28
 Identify group-administered surveys.
college classroom
29
Identify the major answer errors respondents are likely to make.
(1) Misunderstanding of survey questions (2) No knowledge or not sure (3) No standard measure for subjective feelings (4) Overstatement, understatement or pure lying
30
What does reliability refer to?
providing CONSISTENT measures
31
Define and find examples of validity.
measure what it is supposed to measure; using the right measure
32
What are the ways to increase reliability?
1. Ask the same set of questions for each respondent. 2. Wording of the questions must be universally understood 3. AVOID complicated and unfamiliar words and phrases, poorly defined terms, and incomplete sentences. 4. Use optional wording as needed. 5. Avoid asking multiple questions in a single sentence. 6. In case translation is needed, use special wording for special subgroups to avoid misunderstanding or loss of meaning. 7. Whenever possible, use closed questions and provide respondents with a list of acceptable or expected answers.
33
 How to increase validity?
1. Validity: Right measure for right subject. 2. Validity is somewhat different for subjective and objective measures. 3. Validity of opinions and feelings is hard to assess. It can only be assessed in relation to other answers a respondent gives. 4. Whenever possible, use closed questions. 5. Provide definitions to complex terms to reduce answer error. 6. change the question to ask information that is less detailed and easier to recall or estimate. 7. Tuse self-administered survey methods and assure confidentiality and anonymity. 8. Ask several questions with different question forms that measure the same subjective matters.
34
What are open-ended questions and their appropriate uses?
This type of question allows participants to respond in any way they choose used in exploratory research.
35
What are the major types of closed-ended questions and their appropriate uses?
Multiple-choice-Use a multiple-choice question when you want your respondents to choose the best possible answer among all options presented. Nominal (categorical or dichotomous)-Use a categorical question when the possible answers are categories, and the respondent must belong to one category. Ordinal-Sometimes you may want your respondents to rank order their responses. A ranking indicates the importance assigned by a participant to an attitudinal object. Likert scale- one standardized form of ordinal question format. Use a Likert-scale question when you are trying to determine respondents’ attitudes or feelings about something. Semantic differential (one form of ordinal question format)-opinions very much like to very much hate Guttman scale (one form of Semantic-Here, the respondent checks each item with which they agree. The items themselves are constructed so that they are cumulative -- if you agree to one, you probably agree to all of the ones above it in the list. Numerical- Ordinal provide primarily quantitative data, and are frequently used in confirmatory research.
36
What are contingency questions and their appropriate uses?
Sometimes you have to ask the respondent one question in order to determine if they are qualified or experienced enough to answer a subsequent one
37
What are matrix questions and their appropriate uses?
The matrix question is an efficient format for presenting several items sharing the same response categories.
38
What are the major differences between census and survey? With the subject matter
   Census                Survey Subject:   Individuals      Individuals, organizations, or other
39
What are the major differences between census and survey? With the data collected
Census Survey | Data collected: Facts only Opinions, facts, or both
40
What are the major differences between census and survey? With the cycle(how often)
Census Survey | Cycle: Every 10 years Anytime
41
What are the major differences between census and survey? With the sponsors
Census Survey | Sponsor: Census Bureau Any organization or individual
42
What are the major differences between census and survey? With the expense
Census Survey Expense: Expensive Inexpensive
43
What are the major differences between census and survey? With the scale
Census Survey | Scale: Large Small
44
Identify the major answer errors respondents are likely to make.
(1) Misunderstanding of survey questions (2) No knowledge or not sure (3) No standard measure for subjective feelings (4) Overstatement, understatement or pure lying
45
How samples are drawn in Stratified sampling
Before sampling, the population is divided into characteristics of importance for the research. For example, by gender, social class, education level, religion, etc. Then the population is randomly sampled within each category or stratum. If 38% of the population is college-educated, then 38% of the sample is randomly selected from the college-educated population.
46
How samples are drawn in Simple random selection
In a simple random sample (SRS) of a given size, all such subsets of the frame are given an equal probability. Each element of the frame thus has an equal probability of selection
47
How samples are drawn in multistage selection
Stage 1: Select a small number of "clusters" (geographic areas, organizations, etc.)--NOT INDIVIDUALS--from all the "clusters" as sample. At this stage: Population---all "clusters" Sample--some "clusters" Stage 2: Select individuals from the selected "clusters" At his stage: Population--all individuals in the selected "clusters" Sample--some individuals selected from these clusters
48
How to calculate non-response rate?
total number of people surveyed/people who complete the survey
49
In group-administered surveys, respondents answer questions (record answers) just like in _______.
self report
50
Discuss the suitable uses for each survey mode.
mail  telephone in-person Internet
51
Discuss issues about questions format,
open-ended-coding is impossible, only use when exploring new issues, and a small population close ended-yes no questions
52
What is the difference between error and bias
error is random it can go both ways. bias is consistent can go only one way
53
What kind of errors are there
1. human 2. equipment 3. answer either lack of knowledge or misunderstanding 4. unrepresented sample
54
what is a sample frame
as close to the population as you can get
55
Discuss issues about , costs,
costs from high to low: personal interview survey telephone survey group-administered survey mail survey Internet and computer-assisted surveys.
56
Discuss issues about response time,
the order of response rate--from high to low-- looks like the following: group-administered survey personal interview survey telephone survey Internet and computer-assisted surveys mail survey Mail and personal interview surveys are not suitable for fast response.
57
Discuss issues about equipment requirements,
Internet and computer-assisted surveys have higher requirements on facilities and are not suitable for sparsely populated areas and small cities where high-speed Internet service and computer labs are not readily available.
58
Discuss issues about content
Closed-end questions are preferable, especially for mail survey. Break down complex questions into a set of simpler ones. Sensitive questions are more suitable for mail, Internet and computer-assisted surveys.