Validity And Reliability

Question 1

What is construct validity?

Answer 1

Does the test measure what it’s supposed to measure?

Question 2

What is validity definition?

Answer 2

Does the test do what it is supposed to do

-the extent to which a test measures what it is meant to measure

Question 3

What is reliability

Answer 3

Does the test do what it does every time, is the test and it’s results consistent every time or do they vary?

Question 4

What is criterion related validity? What is it made up of?

Answer 4

Whether our scale/measure does what it is supposed to do, given our theoretical knowelefge of the construct we are measuring

It is made up of predictive and concurrent validity

Question 5

What is predictive validity?

Answer 5

Do the scores on the measure predict future behaviour on the criterion variable?

E.g someone with high high school grades would be predicted to achieve high university grades than someone with low scores

Question 6

What gives us an index or the validity of a predictor test?

Answer 6

The results of the correlation that is run between the first test and the later test

Question 7

In predictive validity, how do you measure the variance in the criterion that’s caused by the predictor?

Answer 7

We measure using the r2 value

Question 8

For a good evaluation of predictive and concurrent validities what does r2 and the correlation need to be

Answer 8

Over 16% and over .55

Question 9

What are some cons of predictive validity?

Answer 9

• time lag (participants may leave)

- redirection of range of variables: only best participants hired

Question 10

What does concurrent validity compare with?

Answer 10

Indepdent criterion measure

Question 11

What is concurrent validity?

Answer 11

How well a test correlates with a previous measure that’s been validated. It takes place at the same time, e.g. Students take an iq test and then take a validated one the next day

Question 12

What is a construct?

Answer 12

A construct is the idea behind an attribute that has been made from research

Question 13

What is construct validity

Answer 13

Does the test measure what it’s meant to measure? Does a Depression test measure the construct of depression or does it measure the love of kittens?

Question 14

What is convergent validity?

Answer 14

A subtype of construct validity. It measures to see if a test designed to measure a construct is actually measuring that constructs; it shows that the two predictor variables are related.

Question 15

What is discriminat validity?

Answer 15

Shows the two measures aren’t related and aren’t measuring what it’s supposed to measure

Question 16

What is face validity?

Answer 16

Does the test have validity for those completeting it

Question 17

What is content validity

Answer 17

Does it have items relating to the construct

Question 18

What three types of validity does a test need to have for a Trinidadian approach to test development?

Answer 18

Predictive, concurrent and construct validity

Question 19

What are three sources of validity

Answer 19

Factors in the test, individual characteristics and scoring factors are sources of error

Question 20

What two types of reliability measure the internal consistency of a scale

Answer 20

Split half and inter item reliability

Question 21

What’s inter rarer reliability

Answer 21

The ratings of two or more people are analysed, the correlations between the two are analysed by two examiners that come to an agreement

Question 22

What is test retest reliability

Answer 22

Assessing the reliability to see if the test comes to the same conclusion every time

Question 23

When doing test retest, what measure should be preformed? What value should be a good test retest reliability?

Answer 23

You need to use Pearson r correlation analysis, y

R > .85 is good reliability

Question 24

What is “>” mean

Answer 24

Greater than

Question 25

What are some problems with test-retest?

Answer 25

- deciding on an approriate time to retest - carryover effects - may be genuine changes in participants over time - is it practicable to retest participants?

Question 26

What three conditions must be satisfied for test retest to give an accurate result?

Answer 26

1) first test can't influence second one 2) reliability measures must be the same for both tests 3) no change in the true score

Question 27

What are parallel forms of reliability?

Answer 27

A measure of giving different version of the Tesco to the same group of people. The scores of the different versions are then correlated together to see the consistency of the results

Question 28

How are parallel forms measured?

Answer 28

They are measure using Pearson r correlation

Question 29

What is internal consistency with reliability?

Answer 29

Do all the items measure the same construct

Question 30

What is split half reliability

Answer 30

Comparing the performance on half of the test with performance on the other half

Question 31

What should the reliability be to claim split half realibility

Answer 31

> .75 it should be greater than 0.75

Question 32

What does cronbachs Alpha measure

Answer 32

Measures the extent to which items responses correlate

Question 33

What value does cronbachs Alpha have to be to be considthe rthe e internally consistent

Answer 33

More than 0.60

Question 34

What table in SPSS do you see for the degree to which exch item correlated with the total score?

Answer 34

You look at the item total statistics table. If there is a low score (0.3) it indictatee it's measuring something different

Question 35

What should the variance and correlation be for predictive and concurrent validity to be inadequate?

Answer 35

Under 4% and under 0.2

Question 36

What is content validity?

Answer 36

Does it measure all aspects of a construct?