Peer review- RESEARCH METHODS Flashcards
Peer review process
- Happens BEFORE publication in a journal
- Researcher submits paper to journal
- If the paper meets the journal’s aims and scope it is sent to external reviewers
- The reviewer is a researcher deemed an exspert in the particular field that the paper is on
- The reviewers do not know who ahs written the paper and likewise the author does not know who the review is (double- blind)- maximises objectivity
The reviewers read the draft carefully- and what do they comment on?
- Appropriateness of the method used (to test aim)
- Ethical issues
- Sources of bias
- Operationalisation and control of key variables
- Reliability, validity and interpretation of findings
- Appropriateness of conclusions (conclusions = valid)
- The reviewer decides whether or not the research is worthy of publication in the journal
- The reviewers have a crucial role as controllers of the quality of published research that enters the public domain
- They consider validity, significance and originality
- A weak research design is unlikely to be published (rejected)
- Poor reporting may mean that minor or major changes have to be made by the researcher
Publication of the research findings
- The research is now in the public domain
- Other researchers can attempt to replicate the findings with different samples etc
- Other research based on the findings can further the field
- Applications/ interventions may be based on the findings
- Other researchers can write into the journal to comment on the article and the original author may respond
Why is peer review important for the scientific process?
- Researchers cannot spot every mistake in their own work- can’t trust there will be error- free work
- Increases probability that errors will be detected
- Prevent the dissemination of irrelevant findings, unsupported claims, unacceptable interpretations, personal views and deliberate fraud
Main feature of science- What is objectivity?
- Not biased by personal opinions or viewpoints
- Not affected by the explanations of the researcher
- Systematic collection of measurable data
Example of where Objectivity has been used?
- Loftus and Palmer- when they changed verbs
How did they achieve objectivity?: - Random allocation to conditions
- Filler activiies- didn’t know what the critical question was- reduces demand characteristics- more objective
- Control of varables- I.V- change of verbs, D.V- estimates of speed in data- quantitative data- less likely to be subjective
How is objectivity achieved?
- Experiments- control of variables, random allocation of participants, observations, inter- rater reliability, double- blind study- another researcher collects data
- In psychology the “gold standard” of maximising objectivity is through carrying out carefully controlled lab experiments
Threats of objectivity?
- Researcher bias (e.g Mead- collected data to support her own theory
- Participant bias- social desirability bias- change answers
- Demand characteristics
Why is objectivity important in psychology?
- Increases validity and replicability
- Can identify cause and effect
Main feature of science- What does replicability refer to?
- Can another observer gain the same outcome?
- What factors increase replicability?
Why is replicability important?
- Guards against scientific fraud
- Allows scientists to check whether the results were a one- off due to the particular way that the study was carried out
- Can be used to assess reliability
Why is replicability important in psychology?
- Make sure other people can get the same results
How is replication achieved in psychology in
1. Experiments
2. Observations
- Experiments:
- Control- participant variables (random allocation), situational variables
- Careful methodology- objective measurements
- Write a detailed procedure- so that someone can carry out your study - Observations:
- Behavioural categories
- Time/ Event sampling
- Training observers
- Covert observation- minimises demand characteristics
Replication is only possible if full and precise details of research are published. What should this include?
- Exactly what they did
- The number of participants, their key characteristics and how they were selected
- Where the study was carried out
- What raw data was collected and how they were analysed
Main features of science- theory construction. What are scientific theories?
- Scientific theories are formulated in attempt to explain behaviour that has been repeatedly observed
- They must then be subject to rigorous testing to see whether the gathered evidence supports or challenges the theory
- Theories need to be tested to add to our body of scientific knowledge
Why is theory construction important in psychology?
- Scientific progress is made when clear and explicitly formulated theories are developed and systematically tested
- If research evidence does not support an exisiting theory that it was designed to test, that theory must be modified or rejected
- Allows testable predictions to be formulated
Steps for a Deductive Approach
- A social phenomenon is observed (observe something in the real world)
- A theory is developed to explain why it occured
- The theory is tested through research and the theory is either accepted, rejected, or revised
Come up with theory first - then collect data
Steps for an Inductive Approach
- A social phenomenon is observed
- Data is collected on the possible reasons why it occurs and trends in the data are examined
- A theory is developed from the data to explain the social phenomenon
Start testing then theory comes at the end
Features of science- hypothesis testing
- Hypothesis- is a precise, testable statement of the expected outcomes of a study
- Psychological theories are tested by generating testable hypotheses and investigating whether the evidence supports them
What happens if the evidence does not support the theory?
- May need to be refined or abandoned
- Specific hypothesis test elements of the theory
- We persist with the theory that provides the best explanation of the available data
- (one- tailed hypotheses are appropriate if previous research suggests the direction of your results)
- Statistical testing allows the researcher to determine whether a particular result is due to chance variation of manipulation of the I.V
Falsification
- Best way to prove a theory is correct is to see evidence of disproof
- E.g we see seek to disprove the null hypothesis in order to accept the alternative hypothesis
Why is hypothesis testing in psychology important?
- Allows predictions based on theories to be tested
- When experimental data confirm predicitons (hypotheses), researchers can be more confident that the theory is valid
- Theories can be refined or rejected
- Confidence level of p < 0.01, likelihood of a type 1 error is reducted (accepting the alternative hypothesis when it is not true
Features of science- What are empirical methods?
- Empirical methods are the use of observations and measurement
- Methods that rely on direct sensory experience- the careful observation and measurement of variables
- Only variables that are publicly observabale and can be agreed upon by others can be validated as knowledge
- All scientific knowledge must be based on evidence collected through direct observation, experience or measurement, rather than on intuition, personal opinions or beliefs
Example of where empirical methods have been used?
- Lab experiments
- Observations
- Questionnaires
- Interviews