Deciding on a research question, reliability and validity Flashcards
1
Q
Aim of research
A
A broad statement of the purpose of the research.
2
Q
Alternative hypothesis
A
A testable statement that a piece of research attempts to support or reject.
3
Q
Directional hypothesis
A
A hypothesis that suggests there will be a difference/relationship between variables, where the IV will affect the DV** in one specific direction/outcome.**
4
Q
Non- directional hypothesis
A
A hypothesis that suggests there will be a difference between variables, the IV will affect the DV, but does not state a specific direction/outcome for results.
5
Q
Null hypothesis
A
There will be **no causal relationship **between an independent variable and a dependent variable and and relationship is due to chance.
6
Q
Independent variable
A
The variable that the psychologist manipulates and controls to see how it effects behaviour.
7
Q
Dependent variable
A
The variable that is measured by the psychologist.
8
Q
Operationalise
A
A precise definition of the behaviour being manipulated, observed or measured. This allows for repetition and raises reliability as it is an agreed value that has been attributed to the measurement.
9
Q
Co-variables
A
Two or more quantities being measured in a correlation by the researcher that may or may not vary with each other.
10
Q
Extraneous variable
A
These are variables that are not being measured but affect the behaviour of all the participants equally.
11
Q
Co-founding variables
A
Variables in a study which might affect some individuals behaviour but not others, having negative consequences for validity.
12
Q
Internal validity
A
The findings are accurate and the study measured what it intents to measure.
13
Q
External validity
A
The study paints a picture of real life behaviours.
14
Q
Researcher bias
A
The researcher either directly or indirectly influences the results of the study, through the process of designing the study or through the way the research is conducted/analysed.
15
Q
Demand characteristics
A
Participants unconsciously work out the aim of the investigation and act differently.
16
Q
Social desirability bias
A
Participants give the response they think is required to show them in the best possible light. This may mean that they are not a true reflection of the real thoughts.
17
Q
Content validity
A
Ask an expert in an area of behaviour to check the test is valid.
18
Q
Predictive validity
A
The degree to which a test accurately predicts the future outcome on a more broadly related topic.
19
Q
Concurrent validity
A
Validating a measurement by comparing it with an established measurement that has known validity. If similar results occur on both tests, then the new test has concurrent validity.
20
Q
Construct validity
A
The extent to which a test measured the intended theoretical concept.
21
Q
Face validity
A
Whether the test appears to measure what it claims to and hence is subjective. Tests where the purpose is clear, even to naïve respondents are said to have high face validity.
22
Q
Specific validity issues
A
Factors that could cause problems with validity such as researcher bias, social desirability bias and demand characteristics.
23
Q
Ways of dealing with issues of validity
A
Improving validity through methods such as double or single blind procedures, or through changing the location/nature of the blind research task to make them more reflective of real life.
24
Q
Assessing validity
A
Methods of checking the internal or external validity of a study.
25
Experiments
A research method where cause and effect is measured, through the control and manipulation of key variables, and where the participants are randomly allocated to experimental/control groups.
26
Quasi-experiments
A research where the experimenter has NOT deliberately manipulated the IV and participants are NOT randomly allocated. Methods within this category include natural experiments and difference studies.
27
Natural experiments
A research method where the IV arises naturally, although the DV can still be measured in a laboratory or any other location of the researcher’s choice. This method would be used when it is unethical to directly manipulate the IV.
28
Participant observations
A research method where the researcher takes on the role of a participant and whilst observing other participants’ behaviour around them.
29
Non-participant observations
A research method where the researcher watches and records participants behaviour without interfering in any way (from a distance).
30
Content analysis
A research method which involves exploration of behaviour to see what categories, codes or themes emerge, and tallying each time material fits a theme. It converts qualitative data into quantitative data so that it can be more easily compared.
31
Structured interviews
A research method that includes standardised questions (like in a questionnaire), which are known as an interview schedule, and are usually asked face to face.
32
Questionnaires
A research method that includes a list of written questions, which generate closed and/or open answers. These can be used in person, on-line or through other methods e.g. postal.
33
Semi-structured interviews
A research method which involves asking participants questions, usually face to face. These can be in the form of an interview schedule, but could also include follow up questions to expand on answers of the questions asked.
34
Correlational studies
A research method which involves a comparing two continuous variables (co-variables) to see if there is an association/relationship between them.
35
Case studies
A method which involves an in-depth investigation of a phenomenon, which uses a descriptive analysis of a person, group or event. It is a holistic study through one or more methodologies that is usually longitudinal.
36
Self-reports
A method which involves a participant reporting on their own thoughts and feelings though methods such as interviews or questionnaires.
37
Quantitative date
A type of data that can be measured numerically by the psychologist, so that statistical analysis can be completed e.g. scores on an IQ test.
38
Qualitative data
A type of data that can be **observed** , but not measured numerically. It usually takes the form of words, thoughts and feelings, and is difficult to analyse e.g. a participants feelings about school.
39
Primary sources
Information sources/data that is directly collected by the researcher first-hand e.g. they collect data through a questionnaire, experiment, interviews etc. for their research.
40
Secondary sources
Information sources/data that have not been directly collected/created by the researcher e.g. use of methods such as content analysis of existing data, or literature reviews.
41
Cross-sectional studies
A method which involves comparing one group of participants, representing a cross-section of society, against another at the same point in time.
42
Brain scans
A research method which involves taking images of the living brain to investigate brain function e.g. PET, fMRI and CAT scans.
43
Longitudinal studies
A method which involves conducting research over a long period of time in order to observe long-term effects of X on a specific behaviour. It may utilise a range of other methodologies such as case studies, interviews etc.
44
Conducting research in a laboratory environment
A location of research where scientific research and measurement can be taken using specialist/large equipment (which would not be practical in the field). Conditions and variables are controlled, and procedures are standardised.
45
Conducting research in the field
A location of research outside of the laboratory, in a natural setting e.g. school, hospital, workplace etc. It has lower levels of control over confounding variables than the laboratory, but can still utilise a standardised procedure.
46
Conducting research on-line
A location of research where participants are accessed via the internet/social networks/mobile apps etc. Often involves questionnaires but can also be experimental, correlational etc.
47
Target populations
The group of individuals that a researcher is interested in studying e.g. people in the UK.
48
Sampling frames
A group/population that is identified when it is unrealistic to study the whole target population e.g. people in London.
49
Random sampling
A sampling technique where participants are selected from the sampling frame, where everyone has an equal chance of being selected. E.g. Names are pulled out of a hat, or a computer is used to randomly select participants.
50
Opportunity sampling
A sampling technique where participants are selected at the researcher’s convenience without knowing any details about the sample in advance e.g. picking people who were there at the time, in your specific location.
51
Systematic sampling
A sampling technique where every nth person on a list is selected by the researcher e.g. every 3rd house on a street, or 5th person on a register.
52
Stratified sampling
A sampling technique where the target group is divided into subgroups, e.g. by sex, and then the participants are selected randomly from each subgroup.
53
Quota sampling
A sampling technique where the target population is divided into subgroups, e.g. by sex, and the participants are chosen from each subgroup at the convenience of the researcher.
54
Self-selected sampling
A sampling technique where participants volunteer (select themselves) for research e.g. they come forward/respond to the psychologist after reading an advertisement in a newspaper or on a notice board.
55
Snowball sampling
A sampling technique where participants are initially recruited by the psychologist and then those participants recruit further participants from people they know, therefore the sample group appears to ‘snowball’.
56
Observational sampling techniques
A sampling technique that is used to collect data about specific behaviours or events within specific time frames.
57
Event sampling
Where participants are observed by the psychologist, who records a specific behaviour (event) each time it occurs to create a total score.
58
Time sampling
Where the psychologist observes and records behaviour (such as a score) at specific time intervals, e.g. every 15 minutes, and then creates an average score for each participant being observed.
59
Independent groups
An experimental design where participants take part in only one experimental condition.
60
Repeated measures
An experimental design where participants take part in both the control and experimental conditions.
61
Matched pairs
A form of independent groups design where the experimental and control conditions are deliberately similar e.g. there are balance between gender and IQ levels in each group/condition.
62
Nominal data
The level of measurement that shows categories of data represented by frequencies. The data sets have no relative numerical value e.g. boys and girls.
63
Ordinal data
The level of measurement where data can be placed into ascending or descending order, but the intervals between data not necessarily equal e.g. the times for first, second and third in a race.
64
Interval data
The level of measurement that has equal numerical intervals between scores e.g. temperature. The interval between 1 and 2 degrees is the same as between 21 and 22 degrees.
65
Ratio data
The level of measurement that has equal intervals between scores and has an absolute or true zero point e.g. speed (mph)
66
Frequency tables
A chart/table which shows the rate of occurrence (frequency) for a number of measured values/categories.
67
Graphical representation
A range of diagrams that show the rate of occurrence for a number of measured values/categories.
68
Bar chart
A diagram that represents frequencies of non-continuous data.
69
Line graphs
A diagram that shows a linear representation of frequencies of data.
70
Histograms
A diagram that represents the distribution of frequencies for continuous data.
71
Pie charts
A diagram that represents data proportionately, as part of a whole picture of responses.
72
Scatter diagrams
A diagram that represents a relationship/correlation between two or more co-variables.
73
Distribution curves
Linear representations of data that include a mean, median and modal score to show a spread of data.
74
Normal distribution
A type of distribution where the mean, median and mode are equal. This can be referred to as a bell curve.
75
Negative skewed distribution
A type of skewed distribution, where the mode is greater than the mean.
76
Positive skewed distribution
A type of skewed distribution, where the mode is less than the mean.
77
Measures of central tendency
A form of estimation of a mid-point/average in a set of data.
78
Mean
The average that is shown by all scores in the data set when they are divided by n.
79
Median
The id-point in a set of data that has been placed in order.
80
Measures of dispersion
A measure that shows the spread of data, whether it is tightly clustered or has a broader spread.
81
Range
A value which shows the spread of data, representing the difference between the lowest and highest scores.
82
Standard deviation
A value which represents the amount of variation of results from the mean score.
83
Internal reliability
The extent to which a test or measure is consistent within itself e.g. the use of a standardised instructions and procedure for all participants.
84
External reliability
The extent to which a test produces consistent results over several occasions.
85
Ways of dealing with reliability
A measure which improves consistency and accuracy within the results e.g. the use of a standardised procedure or measures such as counterbalancing.
86
Assessing reliability
Measures used to check the consistency of a set of results.
87
Inter-rater reliability
Where two or more psychologists produce consistent results by using a standardised procedure, agreed coding system, or correlation of their data.
88
Test-retest reliability
Involves testing and retesting the same participants over time, with the same test, and comparing their scores. If the scores are the same the test has external reliability.
89
Split-half reliability
Involves splitting a pp’s test answers in half and seeing whether s/he got the same or similar scores on the two halves. If so, internal reliability is high; if not, it is low and individual questions would need to be redesigned.
90
Confidentiality
Third parties should not be able to trace information back to individual participants. This is usually achieved through providing anonymity e.g. using participant numbers not names.
91
Deception
Deliberately misleading or falsely informing participants about the nature of research.
92
Risk of stress, anxiety, humiliation or pain
Research could induce more than minimal pain through repetitive or prolonged testing. Invasive testing, such as the administration of drugs, or vigorous physical exercise, would not usually be encountered in everyday life, thus is unethical.
93
Risk to the participants' values, beliefs, relationships, status or privacy
Research that is likely to face this type of risk focuses on socially sensitive topics (e.g. sexuality) and includes potentially sensitive data (e.g. confidential documents).
94
Valid consent
Includes giving participants enough information (in a form they can understand) so that they can make an informed choice about whether they wish to participate.
95
Working with vulnerable individuals (including children)
Children under the age of 16, those lacking in mental capacity, people in care, people in custody (prison) or on probation, and people engaged in illegal activities, such as drug use, would be categorised in this way.
96
Working with animals
Research with non-human species is strictly controlled. Restrictions on type of animal, care, number of animals required etc. are all controlled by ethical guidelines and laws such as the Animals Act (1986).
97
Ways of dealing with ethical issues
Methods such as ethical committees and guidelines.
98
Ethics committees
Provide a set of moral principles that guide research from its inception through to completion and publication of results.
99
Ethical guidelines
The board that is in place to ensure that proposed research meets the standards of the current ethical codes of conduct and guidelines.
100
Debriefing
A method which aims to ensure participants are aware of the true nature of the study (overcoming any deception). It should return the participant back to their original state.
101
Chi-squared test
A statistical test that is used when the experimental design is independent groups, when the level of data is at least ordinal and when the hypothesis is predicting a difference between variables. The observed value must be higher than the critical value for results to be considered statistically significant.
102
Mann Whitney U test
A statistical test that is used when the experimental design is repeated measures/matched pairs, when the level of data is at least ordinal and when the hypothesis is predicting a difference between variables. The critical value must be higher than the observed value for results to be significant.
103
Sign test
A statistical test that is used when the experimental design is repeated measures/matched pairs, when the level of data is nominal and when the hypothesis is predicting a difference. The critical value must be higher than the observed value for results to be considered statistically significant.
104
Spearman's rank order correlation coefficient
A statistical test that is used when the level of data is at least ordinal and is related, and when the hypothesis is predicting a correlation/relationship between variables. The observed value must be higher than the critical value for results to be considered statistically significant.
105
Wilcoxon matched pairs signed ranks test
A statistical test that is used when the experimental design is repeated measures/matched pairs, when the level of data is at least ordinal and when the hypothesis is predicting a difference between variables. The observed value must be higher than the critical value for results to be significant.
106
Probability values
A numerical value that gives an indication of the likelihood that results are due to a real difference/correlation and not due to chance e.g. in psychology we accept a probability value of 95%, where results are due to chance in 5% of cases.
107
Significance levels
A numerical value that is usually expressed in value including two decimal places. This level tells you the margin of error that could occur in your results e.g. 0.05 suggests that there is a 5% possibility that results are due to chance and not the difference/correlation between variables.
108
Observed (calculated) values
The numerical value that is created as a result of inferential statistical analysis of your data. This will be compared to the critical values for the test to calculate level of significance.
109
Critical values from tables
The tabulated numerical values that have been assigned to a particular inferential statistical test. It is compared to the observed value for your set of data to calculate significance.
110
Peer review
1. Researcher submits article to journal.
2. Article assessed by editor of journal.
3. If accepted by editor, article is sent to anonymous reviewers (who are also experts in the field).
4. Reviewers submit their comments to the editor.
5. Editor may reject the article, or return it to the author to make revisions.
6. Revised article is re-submitted to editor for publication.
111
Format of reporting psychological investigations
1. Broad aim and purpose of the research is stated along with key definitions of terms (potentially including hypotheses) as part of an introduction.
2. A literature review is included to create a context for the research.
3. The methodology and sampling of the research is described.
4. The results are reported; use of frequency tables and or graphical representation is included.
5. A discussion of the results and consequent conclusions are drawn. Comments about areas of further research are usually included.
