definitions Flashcards
(16 cards)
What is inter rater reliability
The extent to which two or more observers agree
What is internal reliability
A measure of the extent to which something is consistent within itself e.g. all questions on an IQ test should be measuring the same thing
What is external reliability
A measure of consistency over several different occasions. E.g. if interviewer conducted an interview then conducted the same interview a week later the answers would be the same
What is the split half method
Used to assess internal reliability. One group of participants given a test once. Participants answers are divided in half and compared e.g. by comparing all answers to odd number questions and their scores should be similar by calculating correlation coefficient
What is the test retest method
Used to assess external reliability. Group given a test/interview/questionnaire once then again some time later. The answers can be compared and should be the same
How to deal with issues of reliability in observations
Observers should be trained in the use of a coding system/behaviour checklist and practice using it then check reliability
How to deal with issues of reliability in self reports
For internal reliability, questions can be removed to see if split half test returns a high reliability score. For external, may be poorly written questions are causing confusion and need to be rewritten
What is face validity
Concerns the issue of whether a self report measure looks like its measuring what the researchers intended to measure
What is content validity
Involves looking at your method of measurement and deciding whether it measures the intended content.
What is concurrent validity
Involves comparing the current method of measuring stress with a previously validated one on the same topic
What is construct validity
Assesses the extent that a test measured the target construct
What is predictive validity
Whether the scores on a test predict what you’d expect them to predict
Dealing with issues of internal validity
The items on the questionnaire/interview/test need to be revised e.g produce a better match between scores on the new test and an established one
Dealing with issues of external validity
The sampling method used in a questionnaire may produce an unrepresentative sample and this can be improved
What is reliability
Consistency of data
What is validity
Whether an observed effect is a genuine one
