Rural 5 - Evaluation

Question 1

Imagine you have some results, some show an increased change, some show a decreased, are they reliable?

Answer 1

Probably not, but it depends on the question…

Question 2

What’s wrong with asking about people’s perception?

Answer 2

It may not accurately reflect reality

Question 3

What’s wrong with giving people options on a survey?

Answer 3

It might not have included all the options someone might have included if they were given a free choice

Question 4

What’s wrong with asking randomly selected residents?

Answer 4

You might not get a sample that accurately reflects the population, e.g. wrong distribution of age / gender / ethnicity

Question 5

What’s helpful about a randomly sampled sample?

Answer 5

It’s unlikely you’ve asked the same person twice

Question 6

What’s the problem with going on a ‘Wednesday’?

Answer 6

Only certain type of people will be present in your survey location, e.g. more elderly because families are at work/school

Question 7

Identify problems with using bi-polar scoring systems?

Answer 7

Relies on subjective judgements, not a pre-calibrated scores. Hard to compare scores.

Judgements are not weighted on their importance (e.g. some types of deprivation are worse than others)

Descriptors mean different things to different people, so can be unreliable.l

Question 8

What’s wrong with using random sampling?

Answer 8

You unintentionally introduce bias

Might be drawn to a particular social group - and over sample them - unreliable results

Question 9

What’s wrong with systematic sampling?

Answer 9

You might miss groups of people - you’re sampling every nth interval - some views might not be recorded, could skew the results

Question 10

What’s wrong with stratified sampling?

Answer 10

Need to access background population information (e.g. census) to identify the groups you want to sample
Don’t want to over-sample a particular group / want to remove bias.