Policy Evaluation Exam 2 Flashcards

(45 cards)

1
Q

Who are the stakeholders involved in the evaluation?

A

School board members, principals, teachers, students, Little Rock Mothers for Progress, Community Advocates for Public Education, Classroom Teacher Association, Teachers Union, Concerned Citizens United

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

What are the key components of Brooks’ reform plan?

A

Staff reorganization through centralization, consultant, closure of elementary schools, pilot merit pay program

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

What are the pros of the reorganization noted in the article?

A

Greater accountability, more efficiency and effectiveness, reduced top-heavy administration, cost savings

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

What are the cons of the reorganization noted in the article?

A

Moved too quickly, negative impact on African American personnel, secret communication, failure to connect with AA community, poor relationship with teacher’s union

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

What is the purpose of the research?

A

Explore the reorganization policy of the LRSD and analyze data collected from the school district to understand barriers to successful implementation

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

How is the LRSD reorganization policy described?

A

Create a more efficient bureaucracy by establishing a clear line of authority from the superintendent to principals and streamlining organizations by eliminating central office positions

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

What is the implementation type for superintendents and executive staff?

A

Administrative implementation

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

What is key to success for principals during implementation?

A

Power of district leadership to force compliance

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

What is the experimental implementation type for teachers?

A

Providing sufficient resources, understanding that additional resources were a result of reorganization

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

What are Freeman’s 4 points of a Needs Assessment?

A

Constructing a precise problem definition, assessing the extent of the problem, identifying and defining the target of the intervention, describing the nature of the service needs

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

What should be assessed when determining the extent of the problem?

A

Size, how widespread, surveys, focus groups, forums, indicators of need

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

Why is defining the target population important?

A

Sets boundaries and differing definitions can arise

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

How can you define the target population?

A

By setting boundaries of who is included and not included

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

What does understanding the nature of the target population’s service needs reveal?

A

Cannot improve program without knowing what is needed

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

How is monitoring different from normal process/outcome evaluations?

A

It is a continual measurement

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

What does service utilization refer to?

A

Understanding the extent to which the target population receives the services

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

What is program organization?

A

Comparison of what the program should be doing and what it is actually providing

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

How can levels of program performance be approached?

A

Based on past experience, comparable programs, program management goals, enabling legislation

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

How is process monitoring useful for program management?

A

Collects a lot of information, common source of information, and can be cost-effective

20
Q

What are the perspectives of Process Monitoring?

A

Evaluators, Sponsors, Managers

21
Q

What is the evaluator’s perspective in process monitoring?

A

Implementation of rules

22
Q

What does the sponsor’s perspective in process monitoring focus on?

A

Using resources in the intended way and program expansion

23
Q

What is the manager’s perspective in process monitoring?

A

Ability to make corrective actions

24
Q

What information does process monitoring provide?

A

Information about individual clients, services provided, staffing needed, and costs

25
What does coverage refer to in program evaluation?
Extent to which participation by the target population achieves the specified level
26
What is bias in the context of program evaluation?
Degree to which some subgroups participate in greater proportions than others
27
What is meant by specification of services?
The actual service provided by the program in operational terms
28
What does accessibility refer to in program evaluation?
Extent to which the program provides services to the target population
29
What are the three areas one wants a process evaluation to provide data/information?
Description of program operation, comparison between sites, conformity of the program to its design
30
What are ways to develop relevant outcomes?
Stakeholders, Program Theory/Impact Model, prior research, process monitoring
31
What is the main difference between qualitative and quantitative research?
Qualitative is narrative; quantitative is numerical
32
How can qualitative methods be used together?
Study different parts and stages, help evaluate design and measures, multiple methods, interpretation of results
33
What are two characteristics of outcome evaluation according to Rossi?
Outcomes are observed characteristics of the target population/social conditions and do not imply program targets have changed
34
What are advantages of qualitative research?
Greater awareness of participant perspective, sensitivity to context, flexibility of perspective
35
What are the range or types of qualitative inquiry?
Ethnography, Participant-Observation, Observation, Informal Interviewing, Focus Groups, Documents
36
What are ethical issues with qualitative research?
Deception, confidentiality, bias
37
What are Emison's key points for control?
Have a real work plan, meet deadlines, expect issues, use multiple perspectives, know core values
38
What are characteristics of a work plan/timeline according to Emison?
Complete, specific, connects people to assignments, flexible
39
What ongoing problem do evaluation studies face regarding timelines?
Data collection can take longer, funding is limited, deadlines are fixed
40
Why does academic research time differ from evaluation time?
Evaluation often requires more time than sponsors want
41
What are Emison's key points for communication?
Lead ideas not details, use short words and sentences, PPR messages, supportive visuals
42
What should an evaluation presentation address?
Evaluation purpose, program/participants description, main methods, main results and findings, conclusion with limitations and recommendations
43
What are Solomon and Shortell's communication points?
Understand cognitive styles of decision makers, timely and available results, utilization by teaching strengths and weaknesses, overcoming organizational resistance
44
What are two issues evaluators might face in communicating results?
Organizations favor the status quo and convincing them of new outcomes
45
How are evaluation findings Fox and Grimm?
-shape future intervention -inform future policy/program decisions -provide context for which aspects of the program are causing certain issues or positive outcomes (“manipulate aspects of the programme… in order to gain a better understanding of which… are the active ingredients in the intervention”)