Chapter 4 & 5 Flashcards

Concepts to Models and Evaluating Research (65 cards)

1
Q

Absolute standard

A

specific quantitative assessment of assets that apply to all people regardless of context
(Poor = lack of basic needs)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

relative standard

A

can be poor even if you have less than others, regardless of what you have overall (compared to society)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

conceptualization vs. operationalization

A

concept: defining ideas and turning them into variables
operation: linking conceptualized variables to procedures that measure them

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

levels of conceptualization

A
  1. concept in hypothesis
  2. dimension
  3. variable
  4. indicator
    Abstract -> specific
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

variable

A

capture presence or absence of a concept

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

aggregation

A

counting individual level data in some context to capture individual level concepts at group level

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

Operationalization involves two steps: (1) converting a conceptual definition into an operational definition that sets the parameters for measurement, and (2) ____.

A

Using the operational definition to collect data

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

dimensions

A

component of concept that represents particular angle or unit

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

In the concept (idea) of parental discipline, what are the dimensions and variables?

A

Dimensions- negative or postitive reinforcement
variables -
neg: punishment/ spanking
pos: reward/ moral teaching

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

types of variables

A

nominal
ordinal
interval
ratio

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

an ordinal variable is what type?

A

categorical: finite set of possible values (fixed)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

nominal variable

A

categorical
has parallel categories
Ex. hair color

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

ordinal variable

A

categorical
has ranked categories
school quality

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

interval variable

A

continuous
continuum with NO true 0
time of day

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

ratio variable

A

continuous
continuum with true 0
body weight

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

concept

A

abstract ideas that summarize social phenomena and are linked to hypothesis

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

What are the concepts here:
“Access to counselling services improves students’
mental health.”
How can we define and operationalize them?

A

Define: students frequency of visiting a counsellor
presence of mental health symptoms
Operationalize: # of times a month

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

hypothesis

A

testable statement of relationship between 2 variables
IV
DV

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

ecological fallacy

A

assumptions about micro level based on macro level data

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

reductionism

A

assumption about macro level based on micro level data (reverse of ecological fallacy)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

Basic 4 forms of measurement

A

reports
observation
artifact counts (quant or qual)
manipulation

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
22
Q

response categories

A

preset answers to questions

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
23
Q

Closed-ended measures must provide response categories that are _____ and ______.

A

exhaustive: has at least 1 accurate response available
mutually exclusive: able to select 1 response that captures their views

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
24
Q

types of response categories

A
  1. binary/ dichotomous
  2. non-ordered categories (nominal but not ranked)
  3. frequency (ordinal)
  4. frequency (interval/ ratio)
  5. degree (extent/ magnitude)
  6. agreement (Likert scale)
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
25
control group vs. experimental group
control: not exposed to manipulation experimental: exposed to manipulation
26
types of hypotheses
1. difference (diff. between 2 or more groups) 2. association (relationship between variables) 3. causal (prediction that 1 variable causes specific outcome) 4. proposition (statement of suggested link) 5. null (effect doesn't exist) 6. research (introduces research question and proposes result)
27
reliability
how dependable
28
validity
how accurate
29
Qualitative research needs....
credibility and dependability
30
measures of reliability
1. internal reliability 2. intercoder 3. precision 4. robustness a. split half b. test-retest c. pilot testing
31
internal reliability
variables lead to consistent response
32
intercoder reliability
how much different observes agree with one another on same data
33
precision reliability measure
quality: how detailed and specific
34
robustness measure of reliability
how well it worked split-half: split items into 2 sets to create 2 measures then the same people respond to both measures test-retest: administered to sample and again to same sample later pilot testing: same version to smaller sample
35
way to calculate internal reliability
Cronbach's alpha (composite variable, 1= perfect, below 0.6 unreliable
36
composite variable
averages set of items to measure concept (surveys)
37
way to calculate intercoder reliability
Cohen's kappa (measures based on agreement between coders on concept)
38
measures of validity
internal - face - criterion-related - content - construct external - representativeness - how real the study is
39
internal validity definition
establishes a causal effect of IV with DV
40
face validity
does it seem valid
41
criterion validity
concurrent: correlate with well established measure of same concept predictive: correlate with measure that it should predict
42
content validity
does it cover all meanings of concept
43
construct validity
do items in measure connect to underlying concept convergent and discriminant
44
two dimensions of construct validity
convergent: whether concepts that should be associated are discriminant: whether concepts that shouldn't be associated are not
45
external validity definition & types
can be generalizable 1. how representative 2. how real
46
vignette
hypothetical situations people are asked to put themselves in or think of others in then asked how they'd respond
47
how to link internal and external validity
internal: how well study is conducted (experimental design) external: generalizable
48
A survey presents respondents with the following question: "In the past 24 hours, how many times have you interacted with your friends? (circle one) None; 1 to 2 times; 3 to 5 times; 6 to 10 times, 10 or more times" Which problem does this question suffer from?
It is not mutually exclusive
49
Dr. Charles conducts a panel study but finds that respondents seem to answer a particular question quite differently over time. He thinks this may be an issue with their memories rather than the fact that their true answers actually change. What concept captures Dr. Charles's problem?
Low reliability
50
How many levels are there to conceptualization?
4 concept in hypothesis, dimension, variable, and indicator.
51
If a question has an ordinal outcome as the possible response, it must be which type of question?
Close-ended A question that provides an ordinal outcome category, meaning that a few ordered options are available, such as "never," "sometimes," or "always," is close-ended because subjects can only respond in pre-set ways.
52
In general, there is (are) usually ____ correct way(s) to define or measure a concept.
No single. The range of possibilities for conceptualizing and operationalizing poverty seems infinite
53
Match each response category set with the type that best fits. 1) Non-ordered categories (nominal) 2) Frequency (ordinal) 3) Binary or dichotomous (nominal) 4) Degree (ordinal) A) 0 times, 1-3 times, 4 or more times B) Not at all, a little, somewhat, very much C) None, baseball, dancing, basketball, other D) Yes/no
1) C 2) A 3) D 4) B
54
Moving from the stages of conceptualization to operationalization requires increasing levels of ____.
Specificity
55
Dr. Gonzales is concerned that including income, education, and occupational status, but not wealth, into a measure of socioeconomic status is problematic. Which type of validity is Dr. Gonzales concerned with?
Content validity
56
Dr. Jackson has designed a survey to examine the mental health of college students. One measure he includes in the survey is a composite measure of happiness. Which type of reliability should Dr. Jackson be concerned about with this measure?
Internal reliability
57
Dr. Jackson has designed a survey to examine the mental health of college students. One measure he includes in the survey is a composite measure of happiness. Which would be appropriate to examine in order to address Dr. Jackson's concern?
Cronbach's alpha
58
Dr. Larsen has employed multiple observers to record the race of people portrayed in different pictures. Which type of reliability should Dr. Larsen be concerned about with this measure?
Intercoder reliability
59
Dr. Washington conducts a panel study and finds that although respondents answer a particular question about poverty consistently over time, other data on the respondents suggest they may be lying about their answers. He think this may be an issue because respondents are embarrassed to report their true poverty status. What concept captures Dr. Washington's problem?
Low validity
60
Dr. White has discovered that one of his indicators of popularity--how often you speak on the phone with your friends--is not highly correlated with other indicators of popularity. Which type of validity is Dr. White concerned with?
Construct validity
61
Match each dimension of internal validity of measures with the key question that best fits. 1) Does it seem appropriate and sensible? 2) Does it correlate with a measure that is should predict? 3) Does it cover all of the different meanings of a concept? 4) Do the items in a measure connect to the underlying concept? A) Construct B) Content C) Criterion D) Face
1) D 2) C 3) B 4) A
62
The split-half measure could only be used to evaluate robustness with which type of measure?
Composite variable The split-half method is appropriate when dealing with a measure consisting of multiple items
63
Which of the following is usually considered the most internally valid method?
Experiments Experimental designs tend to be the most internally valid method, as their primary advantage over other methods is that they can establish causality.
64
Which statement about reliability and validity is true? 1. Valid measures are relatively easy to construct but reliable measures are much more difficult to construct. 2. The trade-off between reliability and validity is a zero-sum game. 3. Reliability and validity are independently important standards for evaluating the link between conceptualization and operationalization. 4. Reliable measures are relative easy to construct but valid measures are much more difficult to construct.
3. Reliability and validity are independently important standards for evaluating the link between conceptualization and operationalization.
65
what is the most internally valid method of research?
Experiments