reliability and validity Flashcards

1
Q

what is reliability

A

the quality of being trustworthy

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

what is inter-rater reliability in terms of diagnosis

A

more than one clinician found the same diagnosis

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

what is test re-test reliability

A

same tool or test used for the same individual

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

what is validity

A

precise and represents some truth outside of the study

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

what is construct validity

A

whether a test or scale represents and accurately measures what it’s supposed to

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

what is concurrent validity

A

reaching the same diagnosis with 2 different classifiction systems

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

what is predictive validity in terms of diagnosis

A

ability to test a future diagnosis

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

what is cohens kappa

A

refers to the proportion of people who receive the same diagnosis when reassessed at a later time (test re-test reliability) or with a different practitioner (inter-rater reliability)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

what did Regier et al (2013) find
(reliabilty)

A

reported that 3 disorders including PTSD had a rating of 0.6-0.79 (very good)
while 7 more disorders including schizophrenia had a rating of 0.4-0.59 (good)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

what did Cooper (2014) find

A

what counts as an acceptable level has dropped over the last 35 years
the DSM-V classified levels of 0.2-0.4 as ‘acceptable’
major depressive disorder has a kappa value of 0.28
not reliable

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

how does Rosenhan show that the classification systems are not valid

A

all but one of 8 pseudo-patients got discharged with a diagnosis of schizophrenia ‘in remission’ even though they were not ‘insane’ and the symptoms they showed resembled existential psychosis

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

what did lee (2006) find in terms of concurrent validity

A

compared the DSM-IV-TR and a questionnaire to diagnose ADHD amd found the same diagnosis

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

what is a reductionist point surrounding symptoms
(validity)

A

they sort disorders into symptoms and features which is reductionist and doesn’t look into a persons life a case formulation may be more beneficial

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

what did Jansson (2002) find
(validity)

A

questions the vailidty of the ICD-10 and the ICD-9 as it is not clear on what the boundaries are concerning specifically different symptoms and features of schizophrenia

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

what do the classification symptoms lack (validity)

A

they don’t state anything surrounding the cause of the disorder which limits effectiveness of treatment

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

what did Andrews (1999) find
(reliability)

A

only a 68% agreement between the DSM and the ICD

17
Q

what did Cheniaux find (2009)
(reliability)

A

2 psychiatrists used DSM-IV and the ICD-10 to test diagnosis and found only 0.5 agreement for schizophrenia
the duration in the DSM is 6 months but in the ICD it’s 1 month

18
Q

what did Ponizovsky (2006) find
(reliability)

A

PPV score increased for 26% for schizophrenia from the ICD-9 to the ICD-10