Week 12 (E)

Question 1

Three types of evaluation

Answer 1

Impact, outcome and process

Question 2

Impact evaluation

Answer 2

-aims to assess the immediate effects of an intervention and can involve individual or environmental determinants

Question 3

Individual determinants

Answer 3

-behaviour
-knowledge
-attitudes
-beliefs
-values
-perceptions
-skills
-resources

Question 4

Environmental determinants

Answer 4

-physical
-behaviour, knowledge, attitudes, beliefs, values, perceptions, skills, and resources of others
-characteristics, norms, practices, regulations, laws, resources, or services present in a grouping of people

Question 5

Outcome evaluation

Answer 5

aims to asses longer-term intervention effects, including morbidity (disease), mortality (death), or disability

Question 6

Process evaluation

Answer 6

aims to assess what happened or is happening during implementation of the intervention

Question 7

Purpose of process evaluation

Answer 7

provide context for the results of the summative evaluation an to help improve the operation and activities of the intervention

Question 8

Baranowski & Stables list of data that may be collected as part of a process evaluation

Answer 8

• recruitment of participants
  -maintenance of participants
  -context within which program operates
  -resources available to program
  -implementation of program
  -reach into target group
  -barriers to implementing program
  -receptivity of target group to program
  -initial and continued use of program activities
  -exposure of participants to program activities

Question 9

starting point for evaluation

Answer 9

well written objectives

Question 10

what will well written objectives tell you

Answer 10

what you need to measure, as well as the benchmarks for a successful intervention

Question 11

what elements can you add to factors to turn them into objectives

Answer 11

who, what, how much, when

Question 12

what criteria do good objectives follow

Answer 12

specific, measurable, achievable, realistic and time bound

Question 13

data collection

Answer 13

refers to how health promoters plan to collect or record information concerning the project’s objectives

Question 14

what data collection methods differ

Answer 14

collection methods for impact and outcome evaluation differ from process evaluation

Question 15

Impact and outcome evaluation data

Answer 15

quantitative

Question 16

possible sources of impact and outcome evaluation data

Answer 16

-self completed queationaire
-interviews
-self-completed diaries/logs
-physiological measures
-direct observations
-data already collected
-project records
-clinical exams

Question 17

Process evaluation data

Answer 17

qualitative

Question 18

possible sources of process evaluation data

Answer 18

-structured interviews
-focus groups
-observations
-checklists
-attendance records
-self administered evlautation forms
-meeting minutes
-reports
-protocol checklists
-project records

Question 19

research designs

Answer 19

stragety health promoters use to evalaute their projects

Question 20

designs differ depending on

Answer 20

whether participants are randomized into experimental and control groups, and when the data are collected

Question 21

RCT

Answer 21

-the gold standard of quantitative research
-pretest-posttest design (data collecton before and after)
-randomly assigned to experimental or control group

Question 22

Observation 1 of RCT

Answer 22

allows researcher to assess if the only difference between the two groups is that one group recieved intervention and one group did not

Question 23

Observation 2 of RCT

Answer 23

allows researcher to infer that differences in the experimental groups observation 2 compared to 1 are due to intervention effects

**also allows for comparisson of control group observation 1 and 2 to verify nothing changed

Question 24

Experimental Post-Test Design Only

Answer 24

-identical to experimental-no data collected prior to intervention
-relies on randomization to produce two groups that are equal on relevant measures
-differenences between two groups at measure are inferred to be due to intervention

Question 25

Quasi-Experimental Pretest-Posttest Design

Answer 25

-participants are NOT randomly assigned -pretest-posttest design

Question 26

two groups in Quasi-Experimental Pretest-Posttest Design

Answer 26

treatment group and comparison group

Question 27

why is Quasi-Experimental Pretest-Posttest Design an issue in heath promotion

Answer 27

-may not be ethical or practical to randomly assign participants to groups, or they may already be in groups -selecting appropriate comparrison group is important and can be difficult

Question 28

Nonexpreimental one group, pretest-posttest design

Answer 28

-used frequently when appropriate comparison group cant be found -involved assessing the group BEFORE the intervention and AFTER -any differences are attributable to intervention

Question 29

what is it important the researchers pay attenting to during nonexperimental one group

Answer 29

the wider context during the intervention to rule out any alternative explanations for differences

Question 30

a health promotion intervention will typically have

Answer 30

one or two broad claims and multiple impact, outcome and process objectives

Question 31

a health promotion intervention plan will include

Answer 31

the determinants to be targeted, objectives related to determinants, data to collect, data collection methods and data collection timing

Question 32

Steps to writing an evaluation plan

Answer 32

1. engage community and review published research 2. identify determinants to target 3. decide on intervention activities 4. write process, impact and outcome objectives & overall aim and plan for assessing each objective