Brainscape's Knowledge GenomeTM

Browse over 1 million classes created by top students, professors, publishers, and experts.


See full index

IDE 660 > Chapter 3 > Flashcards

Chapter 3 Flashcards

1
Q

How can you identify learning in Kirkpatrick’s model?

A

Examine pretest to posttest change on learning scores

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

What might be a disadvantage of using an experimental approach in evaluation?

A

A. The variables and interactions between variables are complex to be worked out in advance.
B. The variables and interactions between variables are complex to be worked out in advance.
C. Ensuring that treatment and control groups are separate during the study

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

You can use Kirkpatrick’s evaluation model for any kind of program.

A

False

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

Positivists and postpositivists believe that ___________ the object of study reduces bias.

A

A. distance from

B. limiting contact with

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

Which of the following adds some justification of the methodological choice of a randomized design?

A

A. When you want to establish a cause-and-effect-relationship
B. When random assignment is not problematic.
C. When there is uncertainty about the effect of an intervention.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

What are the four levels (in order) of the Kirkpatrick model of evaluation?

A

C. reaction, learning, behavior, results

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

If a randomized experimental approach is not feasible, what are some other alternatives?

A

A. In-depth case studies
B. Statistical analysis of observational data
C. Quasi-experimental comparison group studies

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

One of Donald Campbell’s major contributions to the field of evaluation is his work on experimental and quasi-experimental designs.

A

True

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

The methodological assumption(s) in the postpositivist-and-methods-branch of evaluation includes which of the following?

A

Scientific method, quantitative methods, and hypothesis

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

Ralph Tyler

A

1930s- Educational evaluation-established education, object, then determine whether those objectives had been met

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

Donald Campbell

A

The use of experimental and quasi-experimental designs and their role in controlling for extraneous variables in determining causal relationships

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

Gary Henry & Melvin Mark

A

Use of causal modelling for evaluation with attention to ethical issues.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

Emergent Realist Evaluation

A

philosophy of neorealism in that a reality exists independent of the observer & regularities in the pattern of events can be explained by generative mechanisms

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

What are 5 environments that affect transfer of training?

A
  1. Preventing-supervisor doesn’t allow
  2. Discouraging-supervisor discourages use of new training
  3. Encouraging-supervisor encourages new use of skills
  4. Neutral-supervisor doesn’t acknowledge new training
  5. Requiring-supervisor monitors and requires use of training
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

National Comm. for the pRotection of Human Subjects of Biomedical and Behavioral Research (1979( identifies 3 ethical principles, what are they?

A
  1. Beneficence (unnecessary risk or harm)
  2. Respect
  3. Justice (those who bear risk are the benefactors)
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

NCforProt of Human Subjects identifies 6 norms. what are they?

A
  1. valid research design
  2. research must be competent
  3. Consequences must be identified.
  4. Sample must be appropriate for the study, rep. the population
  5. Volunteer signs informed consent
  6. Researcher must inform the participant whether harm will be compensated.
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

What are Kirkhart’s 5 justifications for considering validity from a multicultural perspective?

A
  1. Interpersonal-quality of interactions b/w part. in eval. process
  2. Consequential-
  3. Experiential
  4. Theoretical
  5. Methodological
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

You will need to ___________ the evaluation questions. Then ___________________. Give high priority to evaluation questions that are likely to lead to the ________.

A

prioritize, eliminate decreased priority questions for your final evaluation plan, utilization of the evaluation.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

THeory Failure

A

Program is implemented but the theory is faulty hence the expected results do not occur.

20
Q

Implementation Failure

A

the planned program services are not delivered hence the expected results do not occur

21
Q

Backward Mapping

A

Identifying desirable endpoints or outcomes and then determining what must be done to get there

22
Q

What are the 5 major evaluation domains in the RLF evaluation model (Rossi, Lipsey, freeman)

A 
1. Needs Assessment
2 .Theory Assessment
3. IMplementation Assessment
4. IMpact Assessment
5. Efficiency Assessment
23
Q

Independent Variable

Dependent Variable

A

the program, policy or process that is implemented in hopes of serving a change in knowledge, beh. attitude (the dependent variable).

24
Q

When are quasi-experimental used?

A

when evaluators are not able to assign participants randomly to treatment groups
case studies
stat analysis of observ. data

25
Q

Theory Based Evaluation

A

Chen & Rossi, lipsey, Donaldson, an approach that focuses on the theories people have about what it takes to have a successful program

26
Q

Positivists hold the belief ontologically that_____.

A

One reality exists that is independent of the observer, bias in the research can be reduced by distance from the object of study, and limited interactions with object of study

27
Q

What might be a disadvantage of using an experimental approach in evaluation?

A

A. The variables and interactions between variables are complex to be worked out in advance.
B. Inability to control exposure to the intervention.
C. Ensuring that treatment and control groups are separate during the study

28
Q

You can use Kirkpatrick’s evaluation model for any kind of program. T or F

A

False

29
Q

Which of the following adds some justification of the methodological choice of a randomized design?

A

A. When you want to establish a cause-and-effect-relationship
B. When random assignment is not problematic.
C. When there is uncertainty about the effect of an intervention.
D. All of the above

30
Q

If a randomized experimental approach is not feasible, what are some other alternatives?

A

A. In-depth case studies
B. Statistical analysis of observational data
C. Quasi-experimental comparison group studies
D. All of the above might be an alternative

31
Q

One of Donald Campbell’s major contributions to the field of evaluation is his work on experimental and quasi-experimental designs. T or F

A

True

32
Q

Which of the following names is NOT associated with theory-based evaluation?

A

A. Huey-Tsyh Chen
B. David Fetterman
C. Mark Lipsey
D. Stewart Donaldson

33
Q

The methodological assumption(s) in the postpositivist-and-methods-branch of evaluation includes which of the following?

A

Scientific method, quantitative methods, and hypothesis

34
Q

RLF Model

A

Rossi, Lipsey, Freeman, 2004
Each evaluation should be tailored to fit local needs, resources, and type of program.
Eval. questions are the core.

35
Q

Black-box evaluation

A

focus only on desired outcomes and not the processes between input and output

36
Q

Method driven evaluation

A

prioritized research methods and focuses only on impact

37
Q

A _____ theory includes and action model and change model.

A

Program

38
Q

The _____ is a program’s systematic plan for organizing resources, settings, staff, and support organizations to deliver intervention services and to teach the target pouplation.

A

Action model

39
Q

The ____ is the program’s description of the causal processes and outcomes required to resolve the identified problems.

A

change model

40
Q

Brinkerhoff’s Success case method

A

Finding out what about a training or other organizationl intervention worked
Examine successful cases and compare them to other cases

41
Q

__________ involves interviewing or having trainees and their supervisors, peers, and subordinates fill out questionnaires several weeks and months after the training event to measure their perceptions about whether the trainees are appllying what they learned.

A

Retrospective Survey Design

Included in Level 3-Behavior or Transfer of Training in Kirkpatrick’s 4 levels of evaluation

42
Q

_____evaluation focuses on improving the evaluation object.

A

Formative

43
Q

_____evaluation focuses on determining the overall effectiveness , usefulness, or worth of the evaluation object.

A

Summative

44
Q

What is “Law enforcement training in southeast Asia-a theory driven evaluation about?”

A

Johnson, Young, Foster, & shamblen
Assessed an international law enforcement training progaram designed to aid law enforcement officials in combating international crime
Example of Kirkpatrick’s 4 Levels of Eval.

45
Q

___________ means that one can listen to and use more than one paradigm in the same evaluation study

A

dialetical pluralism

46
Q

“Evaluation of the Suicide Prevention Program in Kaohsiung City Taiwan”

A

HO, Chen, Ho, Lee, Chen, Chou
CIPP example
Evaluate effectiveness of the Kaohsiung Suicide Prevention Center

The most improtant purpose is not to prove, to improve an idea
Underreporting of suicide, financial constraints, Universal strategies

IDE 660 (14 decks)

Brainscape helps you reach your goals faster, through stronger study habits.
© 2024 Bold Learning Solutions. Terms and Conditions