Research Methods Flashcards

(197 cards)

1
Q

define experimental method

A
  • concerns the manipulation of an independent variable to have an effect on the dependent variable which is measured and stated in results.
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

Define independent and dependent variable

A
  • DV: the factor measured by researchers in an investigation.
  • IV: the factor manipulated by researchers in an investigation.
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

define operationalisation of variables and their importance

A
  • the process of defining variables into measurable factors.
  • Without it, results will be unreliable and could not be replicated
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

Describe what operationalisation of a DV and IV looks like.

A
  • DV’s would include the measurement scale e.g. time in seconds , score on an assessment
  • IV’s would clearly express each level
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

Define extraneous variables and how they differ from confounding vairables.

A
  • variables other than the IV that might affect the DV. They are controllled so that any variation is due to the IV not the EV.
  • Confounding variables are uncontrolled extraneous variables that affet the DV thus negatively affect results.
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

define demand characteristics

one way it is reduced

this is a means of improving validity

A
  • features of a piece of research whihch allow the participants to work out its aim/hypotheses.
  • Participants may then change their behaviour and so frustrate the aim of the research.
  • the single-blind procedure is a technique tht reduces DC as it invovles participants having no idea which condition of a study they are in.
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

what are laboratory experiements

A
  • experiments performed in a controlled environment, using standardised procedure, with particiapnts randomly allocated to experimental groups.
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

Outline the advantages of lab experiments

A
  • High degree of control : experimenters control all variables and the IV and DV are precisely operationalised and measured, leading to greater accuracy.
  • Replication.
  • Cause and effect relationship can be determined: All other variables are controlled, the effect must be caused soley by the manipulation of the IV.
  • Isolation of variables.
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

Outline the weaknesses of laboratory experiments.

A
  • risk of experimenter bias ; interaction with participants may affect their behaviour
  • Low external (ecological) validity: high degrees of control make situations aritifican and unlike real life.
  • Demand characteristics: Participants are aware theyr’re being tested and so may unconciously alter their behaviour.
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

What is a field experiment?

A
  • experiment conducted in a naturalistic environment where the researchers manipulate the independent variable.
  • e.g. bickman
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

give the strengths of a field experiment

A
  • high ecological validity: behaviour is natural as it occurs in a normal environment
  • no demand characteristics : unaware of experiment
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

What is a natural experiment?

A
  • the IV occurs naturally and is not manipulated, but records the effect on the DV.
  • random alloation of participants is not possible.
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

give the strengths of a natural experiment

A
  • allows research in areas that may be unethical to control
  • high in external validity as example of real world behaviour , free from demand characteristics
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

give the weaknesses of field and natural experiments

A
  • less control: makes it difficult to establish extraneous variables , so causality is harder to establish , as effect of dv cannot be isolated
  • replication: conditions cannot be replicated
  • ethics: unaware that they are in an experiment incurring a lack of informed consent
  • sample bias: no random allocation so samples may not be comprable and results representative
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

What is the Quasi experiment?

A
  • The researcher is unable to freely manipulate the independent variable
  • often because IV is an innate characteristic e.g. gender , age , income
  • random allocation of participants to different conditions is not possible.
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

Outline the advantages of field and natural experiments

A
  • High ecological validity: Due to the real world environment, results relate to everyday behaviour and can be generalised to other settings.
  • No demand characteristics.
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

Outline the weaknesses of the field and natural experiments.

A
  • Less control: it is more difficult to control extraneous variables, so causality is harder to establish.
  • Replication: difficult to repeat as conditions are not the exact same.
  • Ethics: When unawate that they are in an experiment, it incurs a lack of informed consent.
  • Sample bias: not random allocation so samples may not be comparable to each other.
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

define observation

what is a controlled observation?

A
  • a non-experimental technique were the researcher watches and record natural behaviour of participants without manipulating levels of IV.
  • a controlled observation is when aspects of the environment are controlled often in lab setting
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

Describe a naturalistic observation and evaluate.

A
  • recording of natural events
  • high realism: external validity , more generalisable
  • extraneous variables : lower internal validity
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

Outline covert and overt observational techniques.

A

overt: where participants are aware they are being observed.
covert: where participants remain unaware of being observed

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

evaluate overt covert techniques

weakness of one is strength of other

A
  • ethical as the principle of informed consent means partipants agree to take part in the research
  • demand characteristics are likely or social desirability bias ( “ try too look good”) + Hawthorne effect

HE: modify their behavior simply because they are aware they are being observed,

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
22
Q
A
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
23
Q

Outline the two different types of observational techniques

A
  1. Particiapnt observation: involves researchers becoming actively involved in the situation being studied to gain a more ‘hands on perspective.
  2. Non-participant observation: involves researchers recording observations seperate from the participants
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
24
Q

evaluate participant and non observation

eval is twofold

A
  • taking part : the researcher may build rapport, more trust and comfort; greater detailed obserrvation
  • can lose objectivity ; interpretation of bheaviour is biased
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
25
Outline the weaknesses of observational techniques. | THINK CORE
- **cause and efect** : causality can not be inferred , since variables are not manipulated , and there is little control of extraeous variables. - **Observer bias**: May see what they want to see , can be reduced by establishing inter-observer reliability. - **Replication** : lack of control over variables means conditions can never be repaeated exactyly to check the results. - **Ethics**: If participants are unaware of being observed, issues of invasion of pricacy and informed consent arise.
26
Why are behavioural categories used in observational studies?
- Behavioural categories break down complex behaviours into smaller, more manageable units. - making behaviour clearly identifiable and measurable - e.g: aggression = number of kicks , screams etc
27
Give the 2 types of sampling procedures used in observational studies.
Event sampling: Couning the number of times a behaviour occurs in a targer individual or group. Time sampling: Counting behaviour within a set time frame (e.g. every 30 seconds).
28
Evaluate time sampling and event sampling
**time**: - more flexibbility to record unexpected types of behaviour - can miss behaviour that happens outside of the recording periods **event**: - may miss relevant behaviour that has not been categorised. + may struggle to record everything accurately - Useful for studying infrequent or specific behaviours as you record what is categorised
29
What is inter-observer reliability?
- Where two or more trained observers conduct the same observation - use the same coding and behavioural catergories - compare the two data sets ( correlation) - This lessens the chance of observer bias , where an observer sees and records behavior in a subjective way.
30
Define self-report techniques
- participants reveals information about themselves without researcher interference. - in response to a series of questions
31
What are questionnaires and describe the difference between closed and open questions?
- self-report method where participants record their own answers to a pre-set list of questions. - closed: involve yes/no answers. - Easy to quantify but restrict participant's answers. - Open: allow participants to answer in their own words.. More difficult to anlayse , but allow freedom of expression and greater depth of answers.
32
Outline the advanatges of questionnares
- Quick: compared to other methods, large amounts of information can be gathered in a short period. - **Lack of investigator effects**: Questionnaers can be completed without researchers present. - Quantitative and qualititative analyses : closed questions are **easy to analyse statistically**, while open questions provide richer fuller detail. - **Replication**: as questionnares use **standardised questions**, they are easy to replicate.
33
Outline the 6 weaknesses of questionnares.
- **Misunderstanding**: participants may misinterpret questions. - **Biased samples**: questionnares are suitable for people who are willing to fill in questionnares and not be respresentative of the whole population. - **low response rates**: uneconomical method as they can get very low return rates. - not suitable for topics which require deep understanding. - **social desirability/idealised answer**: pariticpants may lie in order to give ansers expected of them rather than how they actually feel. - **acquiesce bias**: particpants may respond yes irregradless of the question ( ask the same question again but in reverse to prevent this)
34
Describe the way questionnares and interviewers should be structured
- **avoid complex terminology** to prevent guessing and inaccuracy - **prevent leading questions**: these bias the responses in one direction. questions should not feel like they have a correct response. - **piloting questions**: run a small scale version of the interview to identify confusing , or unccesary responses - these can then be changed - **filler questions**: add to build rapport, act as red herrings to hide research aims, and reduce demand chaacteristics.
35
what are interviews and outline the three main types.
- Self-report method where particiapants answer questions in face to face situations - **Structured**: involves reading out a list of prepared questions - **Unstructured**: involves an open informal discussion on a particular topic. Can ask follow-up qs. - **Semi-structured**: involves combining techniques, providing quantitative and qualitative data.
36
Evaluate each type of interview.
**structured**: - easy to compare responses as questions are standardised - no follow up questions that can provide more detail can be asked. **unstructured**: - builds rapport: feeling comfortable to answer+ follow up q's - comparisons difficult as answers differ
37
Outline the advantages of interviews.
- complicated or **sensitive issues** can be dealt with in face-face interviews by making **participants feel relaxed and able to talk.** - **Ease misunderstandings**: individual questions can be adapted so they are understood by all participants. - **Data Analysis**: Semi-structured interviews produce both quantitative and qualitiative data, allowing for comprehensive analysis
38
Outline the weaknesses of interviews.
- **Inteviewer effects**: may be unconciously bias answers, like by their apperance. - **Interview training**: a lot of skill is required to carry out unstructured interviews, particulary concerning sensitive issues. - **Participant answers**: interviews are not suited to participants who have difficulty putting their feelings, opinions , etc into words.
39
Describe the difference between correlations and experiments
- experimental designs require manipulation of the IV and a measurement of the DC - in a correlational study , no variables are manipulated, 2 co variables are measured and compared to look for a relationship
40
What are co variables? Give examples
- the two factors/variables that are measured/collected by the researcher and **then compared** - age, IQ , reaction time, height
41
What is a scattergram?
- a graph used to plot the measurement of two co variables - the co variables can have no correlation , positive C or negatie
42
How can a relationship between co-variables be analysed?
- can be described visually with a scattergram or numerically with a correlation coefficent - a CC represents both the strength and direction of the relationship between the co-variables as a number between -1 (perfect negative and +1(perfect positive) - correlation coefficents are calculated using stats tests such as spearman's rho or pearson's - strong correlation = 0.8 , no correlation = 0
43
Evaluating correlations
- correlaton does not show causation. Whilstit may suggest a relationship exists, it does not show what change led to the change in the second covariable. - there is a possibility that an unknown third variable caused the change in both covariables. - However it cna highlight potential causal relationships which can be tested with experimental methods to discover cause and effect relationships.
44
what is content analysis
- an indirect observational method that is used to summarise the main ideas presented in human artefacts ( the things people make) - a method used to analyse qualitative data by turning it into quantitative data
45
Describe how to perform a content analysis | use chatgpt for examples
1. **Determine your Research Question** What’s your focus? (e.g., aggression in TV shows? 2. **Select Corpus** Which materials? (e.g., 10 episodes) 3. **Unitising** * break down data into meaninful units (e.g., analysing sentences, scenes, tweets) 4. **Coding Categories** * List clear, exclusive categorie (e.g., hitting, shouting) 5. **Pilot Scheme** * Test on a small sample & refine 7. **Code Data** * Assign each unit to a category 8. **Quantify** * Count/category frequencies (and percentages or rates) 9. Analyse and report
46
describe how to test for reliability for content analysis
- test-retest reliability: run the content analysis again on the same sample and compare the two sets of data - inter-rate reliability: a second rater also performs the content-analysis , with the same set of data and the same categories. Compare and calculate a correlation - a high correlation of 0.8 - indicates reliability
47
Evaluate content analysis as a method | GIVE STRENGTHS
- the "artefacts" are usually not created for research but are taken from the real world. This meanes it has **high external validity** , and findings are generalisable. - come from real world: easy to gather a sample - **replicable**: use the same coding units and categories with an easy access sample
48
Evaluate content analysis as a method | GIVE LIMITATIONS
- researcher will often need to interpret subjective text which may lead to observer bias. - sampling methods - lead to a lack of context - inaccurate conclusions. - lacks validity as the data was not created for study under controlled conditions thus historical records like diaries may not contain an accurate record of the past
49
what is thematic analysis
- an qualitative research method which allows researchers to identify, analyse and report common/key themes from a data set - Themes emerge from the data, there is no hypothesis-testing involved. - A theme is any feature of the data (e.g. an idea, a motif, a topic) which recurs throughout
50
Describe how to perform a thematic analysis
- collect text/ turn recordings into text through transcription - The researcher familiarises themselves with the data by reading it over and over again to spot patterns which can be coded and collected - Themes within the data **emerge** - categorises and defines each theme - and analyses it
51
What is a case study?
- detailed and in-depth investigations of a small group or an individual. - allow researchers to examine individuals who have undergone a unique or rare experience or who are unusual in some way. - Qualitative data may be collected using interviews, observations, open-ended questions on a questionnaire - can also generate quantitative data: memory tests, IQ tests , closed questions
52
Give uses and examples of case studies
- use in clinical psychology: Tan was able to commuunicate only using the word Tan. Other functions were left unaffacted: Helped identify Broca's area. - use in psychodynamic psychology: freud used a number of case studies including Little Hans - use in childhood psychology: Genie was deprived of care until the age of 13
53
Give the strengths of case study
- a holistic, idiographic approach,favoured by humanists who believe that this gives valid insight and true reflection of a person's experience. - Often the way to investigate very unusual or extreme human behaviour
54
Give limitatons of case studies
- unique to the individual : thus cannot be generalised to wider populations - interviews: weaknesses - case studies can suffer fro researcher bias; choose what to write. - close relationship: may lose objectivity
55
what is an aim?
- a clearly phrased general statement about what is intended to be researched - can include the purpose of the study
56
What is a hypothesis? Give the two types.
- a testable statement written as a prediction of what the researcher expects the results to be. - includes the variables being tested - null + alternative hypothesis
57
what is the: - null hypothesis - alternative hypothesis
- NH: states that there is no change ( difference) in the measurement of the dependent variable as a result of the IV - AH: states that there is a change ( difference) in the measurement of the DC as a result of the manupulation in the IV.
58
Give the two types of alternative hypothesis
- non directional hypothesis (two-tailed testing) - directional hypothesis
59
What is a directional hypothesis?
- predicts the direction of the difference in conditions - states there is a difference and directs where the results were going/
60
# w What is a non-directional hypothesis?
- does not predict the direction of the difference in conditions i.e. it simply predicts that a difference will be shown - there will be a difference in the number of correctly recalled items... not how many how large of a difference
61
What is random sampling?
- each member of the target populaition has a mathematically equal chance of being in the experiment's sample - researcher needs a full list of the entire target population. All names are randomly generated selected from the sample.
62
Evaluate random sampling. Give strengths.
- eliminates researcher bias as the researcher has no control over who is being selected - Each member of the population has an equal chance of being selected, so the sample is more likely to reflect the diversity of the target population. - | more likely then oppurtunity or volunteer
63
Evaluate random sampling. Give limitations.
- random sampling can be time-consuming and impractical. ( compared to oppurtunity) - can result in a non-representative sample; equal chance may not reflect the diversity of a population especially in small samples
64
define systematic sampling
- participants are chosen from a list of the target population. Every nth participant is chosen to form a sample.
65
Evaluate systematic sampling.
- avoids researcher bias as the researcher cannot choose the participants they want in their sample. - quick method of selecting sample, follows a systematic method - By chance this method could result in an unrepresentative sample. - more of one social group then another?
66
What is an oppurtunity sampling?
- the researcher directly asks available members of the target population to take part in the research. - Individuals who agree to take part are added to the sample.
67
Evaluate oppurtunity sampling. Give strengths and weaknesses
- less time consuming and cost inducing. - prone to uncious bias when approaching people ; may select those whom they feel comfortable with - unlikely to be representative as represents those who were available; so not possible to generalise
68
what is volunteer sampling
- self-selecting; participants offer to take part after finding out about the research - likely after seeing an ad/poster - ads are placed near target population e.g gym for fitness ,or pubs for alcholics
69
Evaluate volunteer sampling
- strengths: - can reach a large number of participants if ad is widely read - easy sample to collect and more motivated as directly volunteer weaknesses: - volunteer bias , types of people who volunteer to take part may not be from target population - not generalisable - volunteer bias
70
what is stratified sampling?
- generates a small-scale reproduction proportional to the target population. - Identify the target population - Divide the population into strata based on a decided characteristic. - Calculate the number of participants needed from each stratum so that their proportions match the real population. - Use random sampling within each stratum to select participants.
71
Evaluate stratified sampling
- sample is representative of the target population - researcher has control over the chosen categories - participanrs are randomly slected - no research bias - x: More time-consuming and complex to organize, as must have access to info about target population.
72
Name the three types of experimental design
- repeated measures design - independent groups design - matched pairs design
73
What is an independent group's design?
- Participants are randomly assigned to one level of the independent variable. - Each person experiences only one condition, producing a single data set. ( unrealted data) - e.g. participant A learns a poem with music playing (condition 1) (participant B learns the same poem in silence (condition 2)
74
Give the strengths of an independent groups design | give strengths
- demand characteristics are unlikely to act as a confounding variable. As participants only take part in one condition of the IV they are less likely to guess the aim of the study. This increases the internal validity of the study - order effects are eliminated as participants only experience one condition - random allocation - less bias?
75
Give the weaknesses of an independent groups design
- Participant variables may affect the results — because different participants take part in each condition. - individual differences (e.g., intelligence, motivation, mood, prior experience) could influence the outcome rather than the independent variable.
76
What is a repeated measures design?
- participants experience all conditions of the IV - Each participant completes each of the experimental conditions, generating related data
77
Give the stregnths of a repeaed measures design/
- Participant variables are not an issue as each participant's performance in one condition is measured against their own performance in another condition. increase in internal validity. - fewer participants are needed , generates two scores as experiences each condition. | ask chatgpt to explain
78
Give the weaknesses of repeated measures design
- Demand characteristics may become a confounding variable. As participants take part in both conditions of the IV , they may guess the aim of the study. - order effects may lowert the validity of the study so researcher cannot be confident that the IV has affected the DV.
79
What are order effects?
- the effect of the sequence in which participants experience conditions of an experiment can have on their performance. e.g: - fatigue: may tire the participants which could result in impaired performance - boredom: lose interest in the experiment which could result in reduced effort - practice : may improve their performance in the second condition, if tasks are similar.
80
How can order effects be controlled?
- using counterbalancing. - where the order of conditions is varied between participants so half the participants complete condition A then B , and the other half do the opposite. **- this means that order effects are balanced and occur equally for both groups** ## Footnote compare results from prior to order effects have been established e.g. group 1's condition a with group 2's condition b
81
What is matched pair design?
- matched pairs design, participants are matched in pairs based on variables that are likely to impact the DV (e.g. age, IQ, gender) - each member of the pair is placed in a different condition. - controls for indivdiual differences as any difference in performance is due to the IV
82
Give the strengths of matched pair design
- reduces participant variables as results are more likely to be due to the change in IV , as individual differences are more controlled. - no order effects as pariticpants only take part in one condition
83
Give the weaknesses of matched pair design
- longer to set up - needs 2x as many participants as a repeated measures deisgn - matched on similar characteristics , still not the same , so still some participant variables
84
Name the three types of extraneous variables
- Participant variables - Situational variables - Experimenter/Investigator effects
85
What are investigator effects?
- occur when the researcher's behaviour interferes with the research process and becomes a source of bias. - characteristics, such as age, gender and ethnicity, accent could influence how participants interact with them. - researcher could be biased in the way that they instruct participants
86
Describe how to control for investigator effects ## Footnote this is a means of improving validity
- use a double-blind procedure - This means that the participants and the researcher do not know which condition each participant has been assigned to - Therefore the researcher is not able to exercise any forms of bias during the procedure and data analysis
87
What are participant variables? | give examples
- refer to characteristics of participants that may affect the outcome of the study - e.g : age, gender, intelligence , mood , personality , experience
88
Describe how participant variables can be controlled.
- Random allocation – randomly assign participants to conditions to spread variables evenly. - Matched pairs design – match participants in each group based on key characteristics (e.g. same age, IQ).
89
What are situational variables?
- environmental factors that might influence participants’ behaviour - e.g. noise, lighting , time of day, temperature, instructions
90
Describe how to control situational variables?
- Keep the environment standardised (same room, same lighting, same instructions, etc.). - Use controls
91
What is randomisation? | its purpose and examples
- describes a lack of predictability where outcomes are due to chance - deliberate avoidance of bias to keep research objective. - e.g. random allocation to the levels of the IV, procedural aspects: random list of words
92
What is standardisation? Give examples of standardisation in research.
- describe the identical procedure set up in an experiment across all conditions/participants. - allows the research to be replicated which in turn makes it reliable - e.g. **equal number of participants** , same **instructions** , same **time spent in conditon**. same **material**.
93
what are pilot studies
- **small-scale trials** that are run to **test** aspects of the proposed investigation.
94
What are the aims of pilot studies?
- enable the researcher to identify problems in the proposed study - if any problems are exposed by the pilot study the researcher then has the opportunity to fix them or to find suitable alternatives. - and then conduct a final pilst study to test the new measures. - e.g. ethics , flaws in design issues , practicality, relaibility and validity.
95
Why are ethical guidelines important in psychological research? | and who proposes them
- To protect participants and researchers, and ensure research is conducted responsibly and professionally - ethical guidelines are provided by the British Psychological Society (BPS
96
What are the four key ethical principles in the BPS Code of Conduct? | and their purpose
- Respect, Competence, Responsibility, Integrity - ensure research approval and maintenance of professional reputation
97
Name the ethical issues in the design and conduct of research
- informed consent - right to withdraw - protection from harm - confidentiality - debriefing - deception
98
What is informed consent? | links to deception
- Participants should have detailed information about **the nature , the length and hazards of the task.** - to be able to make an **informed decision** about taking part in the research - if under 16 - needs parental consent. | e.g Milgram
99
What is the right to withdraw?
- should be told they can withdraw at any stage with no adverse consquences - includes withdrawing data collected from them
100
What does protection from harm refer to?
- researcher is responsible for designing research that does not risk the psych + physical well-being , personal values and dignity of the participants
101
What does privacy + confidentiality refer to?
- participant's personal data should be secure and not shared. - It should be anonoymous and not reveal info about the participant's identity.
102
what is debriefing and its purpose?
- the process of informing participants about the true aims and nature of the study after it has ended. - reveal any deception , asnwer questions, ensure participants leave w/o harm, offer the right to withdraw data
103
Describe how researchers can deal with ethical issues in research
- if the research requires harm or deception , the researcher can perform a cost benefit analysis by assessing harm to participants and the potential benefits of the research to societty
104
define peer review
- independent assessment of research by experts in the same field before it is published
105
What is the aim of peer review in the research process?
- ensure that only credible, scientifically acceptable research is published. - check the validity of the findings - assesses the appropriateness of the research - suggest or provide recommendations/amendments
106
What is the process of peer review?
- paper is assessed by independent experts "peers" - they consider the quality of the paper and conduct the aims ( F105) - peers decide if they can recommend the paper for puplication ( decide on an outcome)
107
What are the four possible outomes of peer review
1. Accept the work unconditionally 2. Accept the work as long as the researcher makes specific improvements/amendments 3. Reject the work, but suggest amendments for re-submission of the work 4. Reject the work outright
108
What are the three types of peer review?
1. **Open Review**: The researchers and reviewers are known to each other- believed to reduce plagiarism 2. **Single-blind Review**: researcher's name is not revealed to the reviewers 3. **Double-blind Review**: The researcher and the reviewers are anonymous to each other
109
what are some economic implications of psychological reaearch?
- research influences how money is spent at both governmental (macro) and individual/employer (micro) levels. - has implications on; health (mental health funding) , education ( student learning) , law and order ( effect of EWT) , family policy ( MDH - childcare policies).
110
define reliability
- refers to whether the results are consistent - If a standardised procedure is replicated, the study should show similar results.
111
Describe the reliability of lab , field and natural experiments.
- lab experiments occur under controlled conditions , with standardised procedure, random allocation. - high reliability - field susceptible to extraneous variables, not allow for consistent results - less reliable - natural , no control over IV as naturally occuring - less reliable
112
What is internal relaibility and how can it be measured?
- **Internal reliability**: The extent to which a measure is consistent with itself. e.g. the questions should consistently measure the variable. - can be measured using the split half method ## Footnote is about how well the questions lead to answers that match up — not just in one person, but across a bunch of people.
113
What is the split half method?
- The researcher splits the test in half and analyses the responses given to the first half of the questionnaire compared to the second half of the questionnaire - If similar responses are given in both halves then internal reliability is established. - Test strength of the correlation
114
What is external reliability? | and how can it be assessed
- The extent to which a measure is consistent when repeated e.g over time or different participants - can be assessed through test-retest + inter-rater reliability
115
What is test-retest reliability?
- The same participants are given the same questionnaire at separate time intervals. e.g. a week - If the same result is found per participant then external reliability is established
116
What is inter-rater reliability? | hint: think observation!
- the level of consistency between two or more trained observers when they conduct the same observation - using the same agreed-upon categories - Then compare the two independent data sets (often a tally chart and test the correlation . - a strong positive correlation = reliable and categories are well operationalised.
117
How can one improve the reliability of observation?
- ensure the categories: - are operationalised - measure only observable behaviour - are distinct, with no overlapping
118
How can one improve the reliability of interviews?
- using the same trained interviewer for each separate interview - ensure no leading questions with a script, for similar experiences thus structured interviews are favoured
119
How can one improve the reliability of questionnares
- running the test-retest method andsplit half method, excluding any questions which do not show consistency - use closed questions to reduce the range of possible resources - if there is an established questionnare , use it instead of creating a new test e.g. the ones used for therapy
120
How can one improve the reliability of experiments?
- all aspects of the procedure are controlled and standardised - ensuring that the IV and DV are operationalised - use established testing measures ( have already been used can compare data)
121
define validity
- the extent to which the findings of a study are representative of what it is measuring - does it actually measures what it claims to be measuring?
122
define internal validity
- measures the extent to which the results are due to the manipulation of the IV rather than the influence of uncontrolled confounding variables
123
Describe 4 factors that affect internal validity
- social desirability bias - demand characteristics - investigator effects - uncontrolled extraneous variables - all of them may effect the validity of the claim that the IV does indeed affect the DV ## Footnote may be that instead of age affecting social behaviour - a participant pretends to be more social ...
124
What is external validity?
- measures the extent to which the results can be generalised beyond the research setting | is it still valid in different cirumstances?
125
Give examples / measures of external validity
- **ecological validity** : can the findings be generalised to different environements? - **mundane realism**: are the tasks similar to those experienced in the real world? - **population validity**: is the sample used representative of the target population? - **temporal validity**: can the results be generalised to other time periods?
126
Name the three methods of **assessing** validity
- face validity - predictive validity - concurrent validity
127
What is face validity?
- This measure assesses whether a test or study appears to measures what it set out to measure - e.g. does this maths test look like it could test maths skills | whether on the surface it looks right?
128
What is predictive validity?
- assesses validity by measuring how well a test or study can predict future behaviour - e.g. gcse scores can predict a level results ## Footnote relevant when the aim of the test is to predict/ influence a future outcome
129
What is concurrent validity?
- assesses how closely two different tests of the same variable are similar to one another - This is assed by a test of correlation , if there is high concurrent validity , a strength of the correlation is 0.8 and higher - usually used to test it against a test of gold standard - a well established test
130
How can we **improve** internal validity?
- improved by demonstrating a high level of control over variables to ensure IV is the sole cause of the change in the DV. - random allocation: controls participant variables - standardisation: controls extraneous variables - counterbalancing: controls order effects - single and double blind trials: controls research bias and demand characteristics - peer review: controls researcher bias
131
How can we improve external validity?
- ensure findings are generalisable. - ensure that the cause and effect relationship is not specific to the original set up of the investigation - use diverse groups - population validity - use realisitc tasks: mundane realism - use multiple settings: ecological validity
132
Name the features of science
- empircisim - objectivity - replicability - falsifiability - paradigm shift -
133
What is the empirical method?
- it is a philosophical psoition that factual knowledge is limited to our sense experience - collect data from direct experience , in psychology this can be thorugh the different research methods
134
# w What is objectivity and how can it be improved?
- data should avoid bias and not be influenced by opinion. Should not produce subjective conclusions - double blind , peer review , systematic data collection
135
what is replicability?
- refers to a piece of research which could be carried out again by the same or another researcher and which would be likely to show consistent results
136
What is falsifiability?
- the ability of a theory to be found to be wrong - for a theory to be scientific , it must be constructed in a manner where it can be tested to be false. - If the theory is true then it should withstand testing. | karl popper!
137
What is a paradigm shift?
- A paradigm is a set of shared assumptions and methods within a particular discipline - A paradigm shift occurs when there is a move away from an existing, accepted paradigm to a different way of thinking
138
Describe the stages of theory construction in science
1. observation ( empirical evidence) 2. construct a testable hypothesis 3. conduct an experiment and gain data ( collect empirical data using controlled condition - conduct a stats test) 4. propose one's theory which explain's the results | e.g. effect of light intensity on plant growth - theory: photosynthesis
139
Name the sections of a scientific report
- abstract + introduction - method + findings - discussion + referencing
140
What is an abstract and an introduction?
- The abstract is a summary of the entire research process which should be 150 - 200 words long. include a brief overview of the study's aim, hypotheses, method, results and conclusion - intro; details what the study is to cover e.g the theory , prior research, hypotheses.
141
What is described in the method and findings stage of a scientific report
- guide outlining in detail how the research was conducted. - includes a justified choice of experimental design - pariticpants , number and sampling technqiues - materials + procedure : how was it conducted; its standardisation - results summarise the data collected - shown descriptive statistics and any statsitical tests performed.
142
What is discussion and referencing in a scientific report?
- involves what the data analysis means, whether the hypothesis should be accepted - implications of the research/ conclusions made and any evaluations of their own research. - references are any studies used to inform the current research - provides credit and avoids plagiairism
143
What is quantitative data? | and which methods tend to generate this data
- data in the form of numbers - can be transformed into tables, graphs, charts, percentages, fractions etc. + statistically analysed through descriptive and inferential statistics. - experiments e.g. scores, observations e.g. tally charts, correlations , through CC, questionares/surveys via closed questions
144
Give the stregnths of quantitative data
- tends to be **reliable** as it is **easy to analyse and compare**. This is because the techniques used to collect it tend to be replicable e.g. standardised procedures, correlational analysis, meta-analysis. - can highlight trends and patterns which is useful when researchers wish to apply general laws of behaviour
145
Give the weaknesses of quantitative data
- Quantitative data lacks explanatory power. Thus it is low in validity. - Quantitative data tends to over-simplify the complex, multi-faceted nature of human behaviour and experience. This limits its usefulness as a means of gaining insight into people's motives, dreams, fears etc.
146
What is qualitative data? | and which methods tend to generate this data and how can it be analysed?
- data in the form of words or images - interviews/diary entries/ naturalistic observations/ open-ended questions - can be analysed using content and thematic analysis
147
Give the strengths of qualititative data
- allows researchers to **gain insight** into the nature of individual experience and meaning. This makes it **high in ecological validity.** - **rich in detail** - collect more info and less limited in their responses e.g. through the use of open ended questions. - inisght into complex and **unique** behaviours. e..g patient HM.
148
Give the weaknesses of qualitative data
- can be open to interpretation and potentially biased - subjective so does not embrace the features of science e.g. objectivity and control , lacks relaibility. - challenging to analyse and summarise
149
What is primary data?
- refers to data **collected at the source** - researcher is responsible for generating the data through conducting experiments, questionnates etc. - has **not been** previously published
150
Give the strengths of primary data
- increased validity as the research is designed to test the intended variable directly - researcher has full control over data collection ; may be more reliable and valid than secondary data as can ensure data quality
151
Give the weaknesses of primary data
- derived from a single study compared to secondary data which can amass huge samples. This limits the potential **statistical power** of the primary data - expensive and time-consuming compared to the use of secondary data which can be gathered very quickly
152
what is secondary data?
- when researchers use information **previously collected by a third party** - consists of any research findings/results which are pre-existing, or previously published - often derived from multiple sources e.g. a meta analysis
153
Give the strengths of secondary data
- have already been peer-reviewed and the significance of each study has already been established thus more cost-effective and less time consuming - may **provide new insight** into existing theories and research As several studies on the same topic are analysed this **allows the researcher to see patterns,and trends** that are unlikely to emerge with the analysis of just one study.
154
What are the limitations of secondary data?
- decreased validity as the data is not collected to may not directly address the aim or the topic of the research - As the researcher has not run the original studies themselves they do not know the degree of control exercised by the original researcher This lack of control affects the reliability of the data.
155
What is a meta-analysis?
- a quantitative research method which collects the results of a range of previously published studies asking similar research questions. - Data is compared and reviewed together , and can include a statistical calculation of the numerical findings , to provide an overall conclusion.
156
Give the strengths of meta-analysis
- less chance of bias confounding the results due to the use of secondary data. - Researchers have not carried out the research themselves so they cannot have influenced the outcome in any way; **increases reliability** - possible to generalise the findings to a wider population due to the number of studies included in the meta-analysis. **increases the external validity**
157
Give the weaknesses of meta-analysis
- has all the weaknesses of secondary data: lower reliability. - may be difficult for the researcher to access relevant studies. process can be time-consuming - choice of which studies to include/exclused could be biased. Studies show stasticially significant data is more likely to be published then not.
158
What does descriptive statistics consist of? | And what do they consist of?
- include measures of central tendency and measures of dispersion
159
What are measures of central tendency? And what do they consist of?
- describe the central or typical value of a data set , are used to summarise large amounts of data into typical mid-point scores - there are three measures of the central tendency ; mean , the median , the mode.
160
What is the mode? | when is it most often used?
- calculates the most frequently occurring score in a data set - identifies the most common score(s) in a data set. - The data set may have no mode , two modes ( bi-modal) , more than two modes ( multi-modal). - the mode is often used when the mean or median cannot be used e.g. how many times something happens - need measure of frequency. | means "most often"
161
Evaluate the use of the mode | give strengths and weaknesses ## Footnote 2/2
- mode is not affected by extreme values (outliers)* - often useful for the analysis of qualitative data; e.g. analysis of frequency of themes in data. **limitations**: - mode cannot give an exact average value in small data sets , as may offer an unrepresentative central measure, thus may lack validity - may include two modes or more which blurs the meaning of the data, making it difficult for the researcher to form conclusions. This means that the mode is the least reliable | * as extreme values are infrequent
162
What is the median?
- calculates the middle value of a data set (the positional average) - data has to be arranged into numerical order first
163
Evaluate the use of the median as a measure of central tendency
- median is not affected by extreme scores, thus can be used on data sets with anomalous scores - best measure when dealing with qualitative data where ranking of categories or themes is used instead of measurement or counting. limits: - less sensitive data as the mean as it does not include all of the data in its calculation e.g. does not account for extreme scores making it less reliable - time consuming to order for large data sets
164
what is the mean ?
- calculates the average score of a data set - indicates what a researcher would expect to find (as the average score) if they were to replicate the procedure of a given study. - calculated using the total score of all the values in the data set divided by the number of values in that set
165
Evaluate the mean as a measure of central tendency
- most sensitive measure of central tendency as it takes all scores in the data set into account - more likely than other measures of central tendency to provide a representative score, makes it is the most reliable weaknesses: - mean is sensitive to extreme scores (outliers) so it can only be used when the scores are reasonably close. - may not be represented in the data set itself
166
In which data types are the mean , mode and median most appropriate for?
- **Nominal** (categories like eye colour, gender): **mode** - **Ordinal** (ranked, e.g. pain scale 1–10): **Median** (gives the middle rank) - **Interval/Ratio** (numerical data like test scores, time): **Mean**, unless the data is skewed or has outliers |
167
What are measures of dispersion? Give the two examples | and the characteristics of low and high dispersion
- calculate **the spread of scores** and how much they vary in terms of how distant they are from the mean or median - **low dispersion** will have scores that cluster around the measure of central tendency ( mean or median) - **high dispersion** will have scores that are spread apart from the central measure with **much variation** among them - **no dispersion**: exact same scores as no variation. - **range and standard deviation** | think less dispersed ( less spread out)
168
what is the range?
- describes the difference between the lowest and the highest scores in a data set - provides information as to the gap between those scores.
169
Evaluate the range as a measure of dipersion. Give strengths and weaknesses.
- range provides a broad overview of the data which can be useful for some research purposes - simple easy to calculate - lacks validity as no indication of **the degree of variation** from the mean. no info of other scores in data set. - extreme scores easily distort the value
170
What is standard deviation? | what does a high or low SD tell us?
- calculates how a set of scores deviates from the mean - provides insight into how clustered or spread out the scores are from the mean. - **low SD**: the scores are clustered tightly around the mean thus high reliability of the data set. ( consistent around the average) - **high SD**: the scores are more spread out from the mean which indicates lower reliability
171
How is the standard deviation calculated?
1. Calculate the mean 2. Subtract the mean from each score in the data set 3. Square the scores which have just been calculated. 4. Add all of the squared scores together 5. Divide the total squared score by the number of scores minus 1 6. Work out the square root of the variance (using a calculator)
172
Give the strengths of standard deviation
- provides information as to how the scores are distributed across a data set. Thus can indicate to what extent the data set is reliable and consistent. - more sensitive than the range as it uses all the scores in the data set: a more valid representation
173
Give the limitations of standard deviation as a measure of dispersion
- onerous and time-consuming to calculate. CA: however can calculate using an online tool. - can be skewed by extreme outliers; may inflate or depress the standard deviation, giving a misleading representation of the spread of values in the data set
174
When are tables used?
- use a raw data table : a record of each participants data - frequency table: a log of the frequency of observations of beheaviural categories - tally charts - summary of descriptive stats: large amounts of raw data can be summarised into measures of dispersion and central tendency.
175
When is a bar chart is used?
- summarises the frequency of **categorical/nominal** data. - frequency is found on the y axis and the category on the X axis. - data on the x axis is **DISCRETE** | discrete: distinct, separate values, often integers or categories
176
What is a pie chart?
- a circular graph - the size of each slice is proportional to its representation in the data
177
What is a scattergram?
- display the results of correlations - shows the point at which two separate pieces of data meet - Each co-variable can be presented along the x-axis or the y-axis -
178
What is a line graph and when is it used?
- allow for the display of a comparison of two sets of continious data on the same graph - frequency is placed on the Y axis and variable on the X axis
179
What is a histogram and when is it used?
- the x-axis represents the categories that have been measured - the y-axis represents the frequencies of each category occurring - shows continuous data, where the bars touch each other
180
What is distribution, give the three types of distribution of data on a histogram?
- refers to the spread of data around the mean - positive skey - negative skew - normal distribution
181
What is a normal distribution. Refer to mean , median ,mode.
- most of the data points cluster around the mean - the mean , mode and median are the same - mean = mode=median ( perfect distribution)
182
Describe the characterstics of a **positve skew** on a distribution
- **most** of the values are found towards the **left side** - *tail* is found on the *right* and *peak* on the **left** - **Mode < Median < Mean** (from lowest to highest) - The mean gets pulled right (higher) by high outliers. - remember **mean follows the tail**.
183
Describe the characteristics of a **negative skew** on a distribution
- most of the values are found towards the right side of the graph, giving a long tail on the left. - Mean < Median < Mode (from lowest to highest) - mean gets pulled left (lower) by extreme low outliers. ## Footnote Mean follows the tail
184
Name the level of measurements?
- nominal - ordinal - interval
185
What is nominal data?
- often referred to as categorical data - variables are discrete with no natural order - colour of hair , career choice , ethnicity
186
What is ordinal data?
- when participant scores can be arranged in a **rank order** - represents categories with a meaningful order - e.g. how happy do u feel ; 1-7 ; positions in a competition - discrete data
187
What is interval data?
- has **equal intervals between each value** - provides the most sensitive and sophisticated level of measurement - e.g. weight in grams , length in mm, temperature in celcius , time in seconds. - can be converted to ordinal data as the interval values can then be ranked, e.g hottest day - coldest ( temp)
188
What are the levels of signifiance/ probability and why are they used?
- **p < 0.05**: probability of chance factors producing the observed result is less than or equal to 5%) - a more stringent level of significance, e.g. **p < 0.01** - They are used to determine whether the null or alternative hypothesis should be accepted.
189
What are type I errors? | how can it be reduced?
- whenn researcher's accept the alternative hypothesis and reject the null hypothesis in error - So the data was due to chance, but seen as signtificant - can use a more stringent P level e.g. P=<0.01, this does increase the likelihood of a type 2 error.
190
What are type 2 errors?
- when researchers reject the alternate hypothesis and accept the null , in error - The data collected is significant but were dismissed as due to chance. - to reduce type 2 error , use a more lax Proability = 0.05
191
What are inferential statistics?
- use the data collected from the sample , to make inferences about the behaviour of the entire target population.
192
Describe the method of determinging what statistical test to use
- what kind of data is e.g. nominal , ordinal , interval - what is the experimental design? independent groups design ( unrelated data) or repeated measures ( related data) - Is it a test of difference or a test of correlation/association?
193
What are parametric tests?
assume the following: - A normal distribution - use of interval data - Homogeneity of variance (similar in terms of their dispersion/standard deviation) - more statistical power - you **reject the null** if your observed value is **greater than** or equal to critical value.
194
What are non-parametric tests?
- no assumption of a normal distribution - use nominal or ordinal data - For **non-parametric** tests (e.g., Sign Test, Mann-Whitney), you **reject the null** if your observed value is **equal to or less than the critical value.**
195
Give the table of statistical tests
**Parametric tests:** - Unrelated t-test - Related t-test - Pearson’s r **Non-parametric tests:** - Mann-Whitney U - Wilcoxon T - Chi-squared - Spearman's rho - The Sign Test
196
Desribe how to interpret data using a stats test
1. State the Hypotheses ; null + alternative 2. Choose the appropriate test 3. Calculate the value 4. Find the critical value 5. Compare the observed value to the critical value 6. Make a decision based on what type of test it is. Either reject or accept the null.
197
How do you calculate the sign test?
1. State the hypotheses. 2. Calculate the differences between pairs (A - B). 3. Exclude zero differences. 4. Count positives and negatives. 5. Find the smaller count (observed value, S). 6. Look up the critical value from the table. 7. Compare observed value (S) to the critical value. 8. Draw a conclusion based on the comparison. | practice it - save my exams