Chapter 2: Research Tools Flashcards

1
Q

What do Research Resources consist of?

A

1) Library & Resources
2) Techniques of measurement
3) Statistics, computers & languages.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

What can Measurement do? (4)

A
  • Provide limits to data
  • Measure both substantial and insubstantial data
  • Examine relationships mathematically
  • Set acceptable qualitative / quantitative standards
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

Measurement can generally be considered as a ___________.

A

Comparison

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

Define Measurement:

A

It is a thing or concept measured against a point of limitation.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

What are the 6 types of Validity in Measurement?

A

1) Face or Subjective Judgement
2) Criterion
3) Content
4) Construct
5) Internal
6) External

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

Define Face Validity or Subjective Judgement:

A

The degree to which a procedure appears effective in terms of its stated aims (IQ)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

Define Criterion Validity:

A

Two measures of validity where the second checks the accuracy of the first and become a sort of standard. (SAT, MCAT)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

When is Content Validity used?

A

Where data is unsubstantial.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

Provide an example of Content Validity:

A

Does the exam ask questions about material that was taught.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

Define Construct Validity:

A

How well a test measures the concept it was designed to study, any concept that cannot be measured / observed easily
- Honesty

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

Define Internal Validity:

A

Making certain that a change in the dependent variable is the result of independent variable, and not how you measured it.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

Define External Validity:

A

A process where conclusions are drawn from your sample may be generalized / extrapolated.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

Provide an example of an External Validity:

A

Can the methodology and results be repeated, transferable, and replicable by others.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

What is the bottom line in relating Measurement and Validity?

A

Is the measurement we are making actually measuring what we think we are measuring?

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

We use _______ to measure outcomes and draw inferences about the study subjects based on the ________ of our measurements.

A

Tools, interpretations

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

It is important to measure the _____________ things.

A

Obvious (Ex. Horizontal v. Vertical lines)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

What can measurements be considered as?

A

A comparison

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

What are the types of measurements?

A
  1. Nominal Level
  2. Ordinal Level
  3. Interval Level
  4. Ratio Level
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

Define the Nominal Level of measurement:

A

One object is different from another

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

Define the Ordinal Level of Measurement:

A

One object is bigger / better than the other.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

What is an example of a Nominal Level of Measurement?

A
  • Assign a name to items or groups
  • Divide data into discrete categories (%)
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
22
Q

What is an example of an Ordinal Level of Measurement?

A
  • Example: Elementary, high school, college, etc.
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
23
Q

Define Interval Level Measurement:

A

Equal units of measurement and a zero point established. arbitrarily assigned values.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
24
Q

What is an example of an Interval Level Measurement?

A
  • Degrees
  • cm, m, etc.
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
25
Define Ratio Level Measurement:
One object is so many times taller/heavier/brighter.
26
Is Ratio Data and Interval Data quantitative or qualitative?
Quantitative
27
Is Ordinal Data and Nominal Data quantitative or qualitative?
Qualitative
28
What are some ways we would know to use a Nominal Measurement?
If one object is different from another.
29
How would we know to use Ordinal Measurement?
If one object is bigger or better or more of anything than the other.
30
How would we know to use an Interval level Measurement?
If one object has so many units (cm, m, etc.) more than another
31
How would we know to use a Ratio Level Measurement?
If one object is so many times as big or bright or as tall as another.
32
What do we depend on from the measurement instrument to collect data we need?
Soundness and effectiveness
33
What are the 6 types of validity in measurement?
1. Face Validity or Judgement 2. Criterion Validity 3. Content Validity 4. Construct Validity 5. Internal Validity 6. External Validity
34
What is Face Validity or judgement?
Does our measurement tool record what it is supposed to and is our sample representative (can be a subjective judgement call)
35
What is Criterion Validity?
Two measurements, with the first being confirmed by the second, or one predict the other.
36
What is an example of Criterion Validity?
SAT vs GPA vs. MCAT
37
What is Content Validity?
Whether the measurement is valid in getting the information needed.
38
Provide an example of Content Validity:
Final exam of a course to assess learning - should cover all topics that was taught in the class and not include anything that was not covered.
39
What is Construct Validity?
For concepts that cannot be measured or observed easily (honesty, intelligence) but can be measured by observing other indicators that are associated with it. - Valuable in social sciences, where there is a lot of subjectivity to concepts.
40
What is Internal Validity?
Change in dependent variable is truly a result of change in the independent variable.
41
What is External Validity?
The extent to which you can generalize the findings of a study to other situations, people, settings and measures. - In other words, can you apply the findings of your study to a broader context?
42
What does it mean to have a reliable research tool?
How accurate is the research tool you’re using to measure your variable of interest.
43
____________ is simply a tool of research for looking at data from different angles.
Statistics
44
What tool can we use to help us lessen the degree of uncertainty in our understanding of relationships and causes we investigate.
Statistics
45
What needs to be clearly stated when developing the research proposal and executing research activities?
Goals and objectives
46
What type of thinking is required when resolving a problem & deriving new meaning about the problem by interpreting the results of your research efforts?
Analytical Thinking
47
What are six key things to do when formulating a research problem?
1. Use the least amount of words 2. Use the exact word 3. Use short words instead of long words as much as possible 4. Ensure a logical, step-wise connection between ideas 5. Discard superfluous words 6. Be prepared to modify
48
Define a Subproblem:
Small questions and challenges leading to your main question.
49
How can we minimize subproblems?
Define terms of the research focus and state assumptions around the topic in question.
50
What can we use to target a question?
Hypothesis
51
Define a Null Hypothesis:
Any apparent relationship you find is due to chance (it is not real).
52
When do we use a Null Hypothesis?
We use the null hypothesis because statistical analysis tests the validity of the null hypothesis
53
Define an Alternate Hypothesis:
There is a predictive pattern or relationship between variables that is not due to chance
54
When do we accept a null hypothesis?
We accept the null hypothesis unless definite evidence of a pattern/relationship exists and we significantly minimize our speculation on what the relationship or outcome we found means.
55
What are Multiple Hypotheses?
When you have competing hypotheses in your study and you can have combinations that are true and false.
56
True or False: You may need more than one hypothesis to confirm your findings.
True.
57
______________: We call these sub-hypothesis.
When you need more than one hypothesis to confirm your findings.
58
When is a sub-hypothesis addressed in your study?
In the Problem Statement and the Introduction.
59
How do we test a hypothesis?
1. Directly measure the variables of interest 2. Assess if the struggle surrogate variable(s) are strong indicators of a key variable that you cannot measure
60
Define a Surrogate Variable:
Indirect or related variables when we cannot directly measure key variable.
61
What kind of results can we get?
- Positive - Negative - None at all
62
IF your study is well designed, scientifically valid and well implemented the outcome will be useful as long as your hypothesis is __________.
Defensible.
63
What are 6 benefits to running Pilot / Preliminary study?
1. Validate question 2. Practice study techniques 3. Standardize approach to data collection. 4. Add data to study 5. Estimating study size 6. Statistical analysis & change to practice some analysis on a small set of data.
64
What are the two types of Data Collection Approaches?
- Observational - Manipulative
65
Define a Correlation Study:
A type of research design that looks at the relationships between two or more variables
66
Define an Observational / Correlation Approaches:
Simply observing the focus variable (E.g., Tail feathers of long tailed birds)
67
What kind of variation does Observational Studies use?
Natural Variation
68
Define Manipulative Approaches:
Using artificial variation to examine data.
69
True or False: Using both Observational and Manipulative Data Collection in a study is better than simply using one approach.
True
70
Why is it important to be aware of Reverse Causation?
Because the association between two variables can be the reverse than you expect.
71
If we cannot directly measure key variables then our indirect or related variables are called ____________.
surrogate variables
72
Define Content Validity:
It evaluates how well an instrument (like a test) covers all relevant parts of the construct it aims to measure
73
What does Validity determine?
That the results are reflective of the thing you are interested in.
74
Provide an example of Reverse Causation:
Instead of X causing Y, as is the case for traditional causation, Y causes X
75
What does the Problem Statement Identify?
It is the broad overarching issue, it does not specify any variables generally speaking.