reliability and validity Flashcards
what is reliability
the quality of being trustworthy
what is inter-rater reliability in terms of diagnosis
more than one clinician found the same diagnosis
what is test re-test reliability
same tool or test used for the same individual
what is validity
precise and represents some truth outside of the study
what is construct validity
whether a test or scale represents and accurately measures what it’s supposed to
what is concurrent validity
reaching the same diagnosis with 2 different classifiction systems
what is predictive validity in terms of diagnosis
ability to test a future diagnosis
what is cohens kappa
refers to the proportion of people who receive the same diagnosis when reassessed at a later time (test re-test reliability) or with a different practitioner (inter-rater reliability)
what did Regier et al (2013) find
(reliabilty)
reported that 3 disorders including PTSD had a rating of 0.6-0.79 (very good)
while 7 more disorders including schizophrenia had a rating of 0.4-0.59 (good)
what did Cooper (2014) find
what counts as an acceptable level has dropped over the last 35 years
the DSM-V classified levels of 0.2-0.4 as ‘acceptable’
major depressive disorder has a kappa value of 0.28
not reliable
how does Rosenhan show that the classification systems are not valid
all but one of 8 pseudo-patients got discharged with a diagnosis of schizophrenia ‘in remission’ even though they were not ‘insane’ and the symptoms they showed resembled existential psychosis
what did lee (2006) find in terms of concurrent validity
compared the DSM-IV-TR and a questionnaire to diagnose ADHD amd found the same diagnosis
what is a reductionist point surrounding symptoms
(validity)
they sort disorders into symptoms and features which is reductionist and doesn’t look into a persons life a case formulation may be more beneficial
what did Jansson (2002) find
(validity)
questions the vailidty of the ICD-10 and the ICD-9 as it is not clear on what the boundaries are concerning specifically different symptoms and features of schizophrenia
what do the classification symptoms lack (validity)
they don’t state anything surrounding the cause of the disorder which limits effectiveness of treatment