Chapter 8 Flashcards

1
Q

Logic model -

A

Graphic representation of a program showing the intended relationships between investments and results.
Ways to help you depict what the program they are going to do.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

Inputs -

A

Resources that go into a program including staff time, materials, money, equipment, facilities, volunteer time

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

Outputs

A

The activities, products, and participation generated through the investment of resources. Goods and services delivered.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

Outcomes -

A

Results or changes from the program such as changes in knowledge, awareness, skills, attitudes, opinions, aspirations, motivation, behavior, practice, decision-making, policies, social action, condition, or status.
Outcomes may be intended and/or unintended: positive and negative.
Outcomes fall along a continuum from immediate (initial; short-term) to intermediate (medium-term) to final outcomes (long-term), often synonymous with impact

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

Distal and Proximal

A

Distal (long-term); Proximal (short term)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

program theory

A

composed of the impact theory and the process theory.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

Impact theory

A

This is the theory showing the results or outcomes that are supposed to be produced by the program activities.

The action theory (or action hypothesis) specifies the expected immediate or proximal outcomes of the program actions; the conceptual theory (or conceptual hypothesis) specifies the expected distal or longer term outcomes.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

_________(or action hypothesis) specifies the expected immediate or proximal outcomes of the program actions; the conceptual theory (or conceptual hypothesis) specifies the expected distal or longer term outcomes.

A

Action Theory

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

Note the possibility of ______ (the program is implemented, but the theory is faulty; hence, the expected results do not occur) an___________(the planned program services are not delivered; hence, the expected results do not occur).

A

Theory failure; implementation failure

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

The next two components of the program theory (service utilization and organizational plan) are known as the _____________ and they require process evaluation.

A

Program process theory

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

You need to work with ____________ is to develop a program theory.

A

stakeholders
Program evaluators make implicit theory explicit
Work with stakeholders to adjust the theory to make it a good theory.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q
  • is defined as the “approximate validity with which we infer that a relationship between two variables is causal” (Cook and Campbell, 1979. P.37).
A

Internal validity

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q
  • is defined as the “approximate validity with which we infer that a relationship between two variables is causal” (Cook and Campbell, 1979. P.37).
A

Internal validity

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

A good synonym for the term internal validity is ___________ because that is what internal validity is all about.

A

causal validity

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

What are the 3 required conditions for causation?

A

Condition 1- A is related to B. (the relationship condition)
Condition 2-proper order must be established (the temporal ancedence condition )
Condition 3-The relationship b/w A and B must not be due to some confounding or extraneous variable or “third variable”(the lack of alternative explanation)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

____________- has to do with the degree to which the results of a study can be generalized to and across populations of persons, settings, times, outcomes, and treatment variations.

A

External Validity

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

A good synonym for external validity is________ because it always has to do with how well you can generalize research results.

A

generalizing validity

18
Q

What are the major types of external validity?

A

population validity, ecological validity, temporal validity, treatment variation validity, and outcome validity.

19
Q

ISD and evaluators prefer which kind of assignment for research subjects?

A

Random Assignment over random selection

20
Q

The ________ variable is the variable that is assumed to be the cause of the effect. It is the variable that the researcher varies or manipulates in a specific way in order to learn its impact on the outcome variable.

A

Independent

21
Q

The_____________ is a situation in which a researcher objectively observes phenomena which are made to occur in a strictly controlled situation where one or more variables are varied and the others are kept constant.

A

experiment

22
Q

When an experimental research study is conducted, the researcher’s interest in always in determining___.

A

cause and effect

23
Q

_____________ is the most important technique used to control for confounding variables because it has the ability to control for both known and unknown confounding extraneous variables.

A

Random Assignment

STRONG experimental research design

24
Q

Random selection helps ensure ______ validity.

A

external

25
Q

Random assignment helps ensure_____validity.

A

internal

26
Q

Altschuld and Kumar present a model that involved three phases of a needs assessment. What are these three phases?
A. Planning, Conducting, and Assessing.
B. Preassessment, Assessment, and Postassessment
C. Attitudes, Learning, and Behavior
D. Input, Output, and Moderation

A

B

27
Q

When is there a lack of treatment fidelity?
A. When the evaluator conducts more than one study at a time.
B. When the evaluator does not implement the program/study as intended
C. When the evaluator relies on an external auditor.
D. When the evaluator is part of the organization that is conducting the evaluation.

A

B

28
Q

Cost Analysis is defined as an evaluation’s determination of whether a program’s effect was worth its cost.
A. True
B. False

A

A

29
Q

The majority of evaluations are conducted for more than one purpose.
A. True
B. False

A

A

30
Q
Which evaluation type or types are associated with the transformative paradigm?
 A. Outcome Evaluation
 B. Country-Led Evaluation
 C. Deliberative Democratic Evaluation
   D. B & C
A

D

31
Q
In international development evaluation, how is the “gaining insight” purpose of evaluation typically labeled?
   A. Needs assessment
 B. Impact
 C. Relevance
 D. Responsiveness
A

C

32
Q

The second major category of evaluation purposes is to figure out areas in need of improvement. What types of evaluations fall in this category?
A. Implementation, responsive, process, and developmental evaluation
B. Context, capacity, needs and assets assessment, and relevance evaluation
C. Impact, policy exportability, and sustainability evaluation
D. Gender analysis, deliberative democratic, and country-led evaluation

A

A

33
Q

Which of the following is NOT a purpose for an evaluation?
A. To identify needed inputs, barriers, and facilitators to program development or implementation.
B. To determine inequities on the basis of gender, race, ethnicity, disability, and other relevant dimensions of diversity.
C. To determine how a program can be made to look positive despite its lack of impact/effect.
D. To demonstrate that accountability requirements are fulfilled.

A

C

34
Q
When the researcher can draw clear causal conclusions from what went on in a study, this is called:
   A. Internal validity
 B. Internal reliability
 C. Internal consistency reliability
 D. External Validity
A

A

35
Q

The Solomon four-group design is commonly used in evaluation.
A. True
B. False

A

False

36
Q

What are the purposes of Evaluation?

A
  1. Gain insights or to determine necessary inputs
  2. Find areas in need of improvement or to change practices
  3. To assess program effectiveness
  4. To address issues of human rights and social justice
37
Q

Which types of evaluation gain insight or determine necessary inputs?

A
Context evaluation
Capacity Buidling
Needs and assets assessment
Organizational Assessment
Relevance evaluation
38
Q

Which types of evaluation find areas in need of improvement or to change practices/

A
Implementation evaluation
responsvie evaluation
participatory evaluation
process evaluation
monitoring
formative evaluation
developmental evaluation
39
Q

What evaluations are used to assess program effectiveness?

A
outcome/impact
summative
policy
replicability/exportability/transferability
sustainability
cost analysis
40
Q

Which evaluations address issues of human rights and social justice?

A
DDE
CLE
CRT
Indigenous
Culturally responsive
Dsiability and deaf rights based
feminist
gender analysis
transformative participatory