TOPIC: RESEARCH METHODS Flashcards

(173 cards)

1
Q

What is laboratory experiment and how can reliability be improved?

A

Defined by the high level of control the researcher has over all the variables in the study except the independent variable which what you alter to see what the effect is

The reliability of lab experiments can be improved by:

ensuring that all aspects of the procedure are controlled and standardised to test the reliability of the method

ensuring that the IV and DV are operationalised

testing participants using conditions which differ slightly from the original procedure to test the reliability of a specific finding

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

What are the pros and cons of laboratory experiments?

A

PROS:
- Control - the effects of confounding variables of interest are minimised
- Replication - strict controls mean you can run the study again to check the findings

CONS:
- May lack ecological validity ( experiments might not measure real-life behaviour )
- Demand characteristics - participants may respond according to what they think is being investigated = bias
- Ethics - deception is often used, making informed consent difficult

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

What is field experiments?

A

These are conducted outside of the laboratory
Behaviour is measured in a natural environment
Where the researcher manipulates the IV and records the effects of the DV

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

What are the pros and cons of field experiments ?

A

PROS:
- High ecological validity, so they can realte to real life better
- Demand characteristics - can be avoided if participants don’t know they’re in a study

CONS:
- Less control - confounding varaibles may be more likely in a natural environment
- Ethics - Participants who didn’t agree to take part might experience distress and often can’t be debriefed. Observation must respect privacy

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

What is a natural experiment ?

A

Looks how an independent variable, which isn’t manipulated by the researcher affects the dependent variable

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

What are the pros and cons of natural experiments ?

A

PROS:
- Ethical - possible to study variables that wouldn’t be ethical to manipulate
- Demand characteristics - They don’t know they are in the study&raquo_space; so acts more natural
- High ecological validity

CONS:
- Ethics - deception is often used, making informed consent difficult
- Can’t be replicated exactly to test for reliability

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

What is the quasi experiment ?

A

Where the researcher isn’t able to use random allocation to put partcipants in and the naturally occurring IV is a difference between people that already exists (i.e. gender, age). The researcher examines the effect of this variable on the dependent variable (DV).

e.g. gender or the existence of a mental disorder

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

What is the pros and cons of quasi experiments ?

A

PROS:
- Control - often under controlled conditions
- High ecological validity

CONS:
- Participant allocation - can’t randomly allocate participants to each condition, and so confounding results may affect results
» hard to say what’s caused by what as you have no control over these variables
- Casual relationships - hard to establish cause and effect because the independent variable isn’t being directly manipulated

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

SELF REPORT:
What are questionnairs and how can reliability be improved ?

A

A set of written questions that can be answered easily&raquo_space; useful in gathering information from large number of people

The reliability of questionnaires can be improved by

running the test-retest method and excluding any questions which do not show consistency

running the split-half method and excluding any whole questionnaires that do not show consistency

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

What are closed questions ?

A

Where there is a pre-determined set of answers to choose from
Produce quantitative data
e.g. Do you exercise ? Yes/No

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

What are open questions ?

A

Where there are no restrictions on how participants make their response
Produces qualitative data
e.g. How does the sight of seeing dogs in a public place without a lead make you feel

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

What are the pros and cons of open questions ?

A

PROS:
- Qualitative data ( descriptive )
- Very rich in detail

CONS:
- No fixed range
- Can answer in any way

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

What are the pros and cons of closed questions ?

A

PROS:
- Produces both quantitative and qualitative data

CONS:
- Fixed number of responses

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

What are the types of closed questions ? ( Give detail )

A

Likert Scale - Their agreement or disagreement with a statement using a scale of usually five or seven points. Produce ordinal data

Rating scale - A value that represents their strength of feeling about a particular topic. Produce ordinal data

Fixed choice options - A list of possible answers and the respondent has to indiacte which applies to them. Produce norminal data

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

What are the things to consider when designing a questionnair ?

A
  • Length
  • Pilot study
  • Question order
  • Terminology
  • Ethical issues
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

What the pros and cons of self-reports ?

A

PROS:
- Cost effective
- Easy to analyse
- Can collect large amounts of data
- Convient to carry out

CONS:
- Social desirability bias
- Response bias
- Low response rate
- Acquiescene bias

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

What are unstructured and structured interviews ?

A

Unstructured - Can be formal or informal with no set questions and the interviewee is encouraged to expand on their answers

Structured interviews - Comes with pre-determined which are asked in a set order

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

What are things to consider part of the interview design?

A
  • Gender and age
  • Personal characteristics
  • Ethnicity
  • You develop an interview schedule, or a list of questions you intend to cover&raquo_space; this should be standardised to avoid interviewer bias
  • They should be reminded that that the information will be kept confidential ( especially sensitive issues )
  • They should be aware that they can leave at any time
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

What are the pros and cons of interviews ?

A

PROS:
- More detailed information can be gathered than by a questionnaire
- Flexibility - Can tailor questions to the response of an interviewee so that issues can be explored in depth
- Unstructure are more fexible as points can be followed up on
- The person being interviewed can ask for clarification if they don’t understand a question
- Structured interviews are easy to replicate due to standardised form so can check reliability easily

CONS:
- Senstive topics - the interviewer can explore complex issues that maybe difficult to study any other way
- Training - Interviewers often need to be trained. Can take time and money
- People may be embarrased to speak face to face to someone
- It is harder to analyse unstructure data compared to structured so drawing conclusions can be difficult
- Time and effort - needed by the person being interviewed

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

CORRELATIONS:
What is a correlation and what are the different types?

A
  • A correlation checks to see if two sets of numbers are related
  • In psych = the numbers being analysed in relation to behaviour
  • Positive correlation - where they both coordinate and rise
  • Negative correlation - where one variable rises other falls
  • Zero correlation - no relationship between co-variables
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

CORRELATIONS:
What is the difference between correlations and experiments?

A
  • The most fundamental difference between experiments and correlations is that experiments assess the effect of one variable, (I.V.) on another variable which is measured (D.V.)
  • Correlations assess how much of a relationship exists between two co-occurring variables which are related.
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
22
Q

CORRELATIONS:
What are the pros and cons of correlations ?

A

PROS:
- Useful as a preliminary research technique, allowing researchers to identify a link that can be further investigated through more controlled research.
- Can be used to research topics that are sensitive/ otherwise would be unethical, as no deliberate manipulation of variables is required

CONS:
- Only identify a link; they do not identify which variable causes which. There might be a third variable present which is influencing one of the co-variables, which is not considered.
E.g. stress might lead to smoking/ alcohol intake which leads to illness, so there is an indirect relationship between stress and illness

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
23
Q

CASE STUDIES:
What is a case studies ?

A

A case study is a method involving the detailed study of one individual, institution or event. They provide rich information about that particular individual.
Data = qualitative but can be quantitative
Data = primary or secondary
Case studies usually take place over a long period of time

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
24
Q

CASE STUDIES:
What are the pros and cons of case studies?

A

PROS:
- Data gathered is detailed and in-depth so more valid conclusions can be drawn
- Can be used to investigate rare behaviour or behaviour that can’t be studied an other way as it would be unethical to do so

CONS:
- Can be time consuming and it can be years before conclusions can be drawn
- Sample is limited and not representative of wider population. Difficult to generalise results from the individual as each case is unique
- Important ethical issues regarding privacy and confidentiality - which is why initials are often used. Also, psychological harm can be caused by repeated testing over decades as in the case of HM

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
25
OBSERVATIONAL TECHNIQUES: What is observations and how can reliability be improved?
Where a researcher observes and records participants' behaiour, with no manipulation or condition can be used as part of an experiment The reliability of observations can be improved by: ensuring that the behavioural categories are operationalised measure only observable behaviour are distinct, with no overlapping
26
OBSERVATIONAL TECHNIQUES : What is naturalistic as an observation and what are the pros and cons?
- Involves observing subject in their natural environment PROS: - High ecological validity as the researcher records naturally occuring behaviour in a natural environment, without any outside interference from the researcher CONS: - Cannot be replicated to check reliabilty, as the researcher is not in control of variables
27
OBSERVATIONAL TECHNIQUES: What is controlled as an observation and what are the pros and cons?
-Where researchers watch participants in a contained environment such as laboratory PROS: - Can be replicated to check reliability, as the researcher is in control of variables and therefore can repeat the method as they wish CONS: - Low ecological validity as the researcher records behaviours in an artificial ( manipulated ) environment, with potential outside interference from the researcher
28
OBSERVATIONAL TECHNIQUES: What is overt as an observation and what are the pros and cons?
- Where those being observed are aware of the fact PROS: - It is possible to inform participants in advance and obtain informed consent CONS: - Behaviour can be distorted through invetigator effects in which the participants changes their behaviour through social disirability bias
29
OBSERVATIONAL TECHNIQUES: What is covert as an observation and what are the pros and cons?
- Where the researcher is "undercover " the ppts are unaware they are being observed PROS: - Investigators effects are unlikely meaning that participants' behaviour will be genuine CONS: - Less ethical as participants are not aware they are taking part and cannot give fully informed consent
30
OBSERVATIONAL TECHNIQUES: What is participant as an observation and what are the pros and cons?
- When the researcher is immersed in the day - to - day activities of the participants PROS: - The researcher can obtain in-depth data as they are in close proximity to the partcipants and so are unlikely to overlook or miss any behaviours CONS: - The researchers' presence might influence the partcipants' behaviour due to evaluation apprehension
31
OBSERVATIONAL TECHNIQUES: What is non-participants as an observation and what are the pros and cons?
- Obersing ppts without actively participating PROS: - Investigator effects an evaluation apprehension are less likely as the researcher is not visible CONS: - Due to lack of proximity the researcher might overlook or miss behaviour of interest
32
OBSERVATIONAL TECHNIQUES: What are the challenges to observational techniques?
- The behaviours that the researcher is interested in need to be clearly defined ( operationalised ) [usually producing a behaviour checklist or behaviour categories] so that the observer knows what to look out for and measure - Data collected could lack internal validity and if there is more than one oberserver it may lack inter observer reliability
33
OBSERVATIONAL TECHNIQUES: What is strucutured observation and what are the pros and cons?
- An observation study using predetermined coding scheme to record the partcipants behaviour PROS: - Easier to record data and easier to establish inter-observer reliability CONS: - Reductionist - reduces behaviour to basic units. Open to observer bias - may only record what they want to see
34
OBSERVATIONAL TECHNIQUES: What is unstructured observations and what are the pros and cons?
- An observation where there is no checklist so every behaviour seen is written down in an much detail as possible PROS: - Increase validity as more detail is collected - Can be used in a number of contexts CONS: - Harder to record what is observed - Harder to establish reliabilty as hard to repeat - Open to observer bias - may miss things
35
OBSERVATIONAL TECHNIQUES: What is time sampling and what are the pros and cons ?
- Where there are behavioural trends that occur over a particular time periods PROS: - Effective in reducing the number of observations that have to be made CONS: - Sample may be unrepresentive of the observation as a whole
36
OBSERVATIONAL TECHNIQUES: What is event sampling and what are the pros and cons ?
- Where you simply tally all co-operative behaviour over the full 1 hour lesson to gather an overall impression of the amount of co-operative behaviour. PROS: - Useful when target behaviour or evnt happens quite infrequently, and could be missed if time sampling was used CONS: - It is too complex, the observer may overlook important details if using event sampling
37
OBSERVATIONAL TECHNIQUES: What is reliabilty and how is it related to observations ?
Reliability - When using two observers, to ensure that they are observing and recording behaviour in the SAME way >> to check inter-observer reliability TO DO THIS: - Plot data from one observer against another - if carried in a similar way = strong positve correlation
38
OBSERVATIONAL TECHNIQUES: How can internal validity be affected and how it can be improved ?
- Behavioural categories not being operationalised enough - Observer bias where what the observer sees is influenced by their expectations IMPROVEMENTS: - Using double blind techniques where the observer doesn't know the aim of the reseacher and so can't have any expectations - Can be checked and improved by using more than one observer
39
OBSERVATIONAL TECHNIQUES: How can external validity be affected and how can it be improved ?
- Ecological validity - where the observation takes place ( naturalistic VS controlled ) but it will depend on the particular study and what was being observed - Population validity - can be a problem if the observation is only done on a limited sample IMPROVEMENTS: - By carrying out the observation on a variety of people in different environments
40
OBSERVATIONAL TECHNIQUES: What are the ethical guidlines in observations ?
- People can be observed in an environment where they would expect to be observed by strangers without any informed consent - CAN'T observe people in their homes or other private places without their consent << confidentiality should be maintained at all times, where possible consent should be obtained - COVERT observations do not necessarily breach informed consent ethics because you can observe people without consent in areas where they expect to be observed
41
AIMS: What is the difference between aim and hypotheses ?
Aim : The general statement of what the researcher intends to investigate or the purpose of the study e.g. We want to investigate whether there is a difference in the short-term memory of children aged 10yrs and 6yrs . Hypotheses : Defined as a clear, precise, testable statement
42
HYPOTHESES: What is directional hypothses?
- States the direction in which we expect the results to go >> we use this when we are confident about what will happen in the study H1[ Children aged 10yrs will recall significantly more words correctly from a list than children aged 6yrs ] Operationalised IV = whether children are 6yrs or 10yrs Operationalised DV = Number of words correctly recalled
43
HYPOTHESES: What is an alternative hypotheses ?
- State that there will be a significant difference between our two conditions - An alternative hypothesis must contain an operationalised IV and DV - ( operationalised means clearly defined )
44
HYPOTHESES: What is non- directional hypothesis?
- States that there will be a difference between the two conditions but doesn't state the direction in which it will go H1 = There will be a significnt difference in the number of words correctly recalled from a list by children aged 6yrs and those aged 10yrs. Operationalised DV - number of words correctly recalled Operationalised IV - whether children are 6yrs or 10yrs
45
HYPOTHESES: What is a null hypothesis?
- States that there will be no significant difference between our two conditions and that any difference wwe did find was due to chance H0 - There will be no significant difference in the number of words correctly recalled from a list b children aged 6yrs and those aged 10yrs. Any difference found will be due to chance.
46
HYPOTHESES: How do we know if the hypothesis is true ?
- You put it through a stastical test, which will tell us if the difference we have found is significant or not - If the difference is significant = accept alternative hypothesis - If the difference is NOT significant = accept null hypothesis
47
SAMPLING: What is the difference between sample and population ?
- Sample is a smaller group selected from a target population. A target population is all the people a psychologist wants to study. - A population is the entire group of people that you want to draw conclusions about
48
SAMPLING: What is random sampling and what are the pros and cons?
- A sample for which everyone in the target population has an equal chance of being chosen PROS: - No bias > evryone has an equal chance of being selected > drwas a representative sample and a good cross- section of people - High internal validity as the sample is representative CONS: - No control over who is being selected - Not always practical, especially when the population is large - Difficult to get a list e.g a list of homeless people
49
SAMPLING: What is opportunity sampling and what are the pros and cons ?
- A sample drawn from the target population because they are avilable and conveinient PROS: - Quick,easy and straightforward as the researcher selects people who are available at that time - Convenient because people take part who are willing at the time CONS: - The sample does not tend to be representative because some participants ahve chosen because they're friends/family of the researcher or they were in a certain locality - May not be represenative as they may use psychology students, and may be keen to please the researcher ( show demand characteristcs ) and therefore comprise the results of the study >> giving it low internal validity
50
SAMPLING: What is volunteer sampling and what are the pros and cons ?
- Also called as self-selecting. Individuals who ahve chosen to be involved in the study. Often find out about the study through some sort of advertisement PROS: - Often achives a large smaple size through reaching a wide audience e.g. online advertisement CONS: - Those who respone to the call for voluteers may display similar charateristics // increasing the chances of yielding and unrepresentative sample
51
SAMPLING: What is stratified sampling and what are the pros and cons?
- Dividing the target population into important subcategories. Then selcting members in proportions that they occur in the population PROS: - It avoids the problem of misrepresentation sometimes caused by purely random sampling CONS: - It takes more time and resources to plan - Care must be taken to ensure each key characteristic present in the population is selected across strata otherwise this will design a biased sample
52
SAMPLING: What is systematic sampling and what are the pros and cons ?
- Systematic sampling is a sampling technique that uses a predetermined system to select the participants from a target group. PROS: - Assuming the list order has been randomised, this method offers an unbiased chance of gaining a representative sample CONS: - If the list has been assembled in any other way = bias may be present e.g. is every fourth perosn in the list was male, you would have only males in your sample
53
PILOT STUDIES: What is pilot studies and the aims of piloting?
-Pilot studies are small, trial versions of proposed studies to test their effectiveness and make improvements. - Helpful in identifying potential issues early - Allows the validity and reliability of the test to be assessed in advance which then gives the opportunity for improvement to be made - Problems can be talkd before running the main study > save money + time
54
EXPERIMENTAL DESIGN: What is independent measures and the pros and cons?
-Different participants are used in each condition of the experiment -Should be done by random allocation, which ensures that each participant has an equal chance of being assigned to on group or the other PROS: ~ Avoids order effects > which means they are less likely to guess the aim of the experiment CONS: ~ More participants are required ~ Participants variables e.g three of the participants in one of the condtion, might be super intelligent
55
EXPERIMENTAL DESIGN: What is repeated measures and what are the pros and cons ?
- The same participants take part in both conditions of the experiment - This means that eachcodtionof the experiment includes the same group of partcipants PROS: ~ Fewer participants are required, as they take part in all condtions CONS: ~ Order of effects - the order of the conditions may have an effect on the participants behaviour e.g. the performance in condi.2 might be better, because the participants know what to do >> researchers avoid this by "counterbalancing "
56
EXPERIMENTAL DESIGN: What is matched pairs and what are the pros and cons ?
- Pairs of participants are matched in terms of key variables such as age. One member of each pair is then placed in two different conditions. PROS: ~ Reduces participant variables because th researcher has tried to match the participants in each condition ~ Avoids order effects as the participants are ony in one condition CONS: ~ Very time consuming and expensive ~ Impossible to match people exactly, unless idenical twins
57
VARIABLES: What is the independent variable?
Is the thing that is diferent between the two conditions, what has been manipulated by the researcher
58
VARIABLES: What is the dependent variable?
- Is what is being measured by the resercher
59
VARIABLES: What is an extraneous variables ?
- These are variables other than the independent variable that may have affected the dependent variable
60
VARIABLES: What is confounding variables?
- If we do not eliminate or control the EVs they can become CONFOUNDING variables > they affect the results (DV)
61
VARIABLES: What is operationalisation variable?
- The process of defining and measuring variables in a study Steps for operationalizing variables: Identify the concepts to be studied Choose a variable to represent each concept Select indicators to measure each variable e.g. Anxiety A researcher might measure anxiety levels using a questionnaire or by observing physiological changes like heart rate
62
CONTROL: What are the three types of extraneous variables that should be controlled?
Situational variables - Control of the setting where the experiment takes place Participant variables – minimizing differences between participants (e.g. their ability such as IQ). Researcher variables – factors such as researcher behaviour, appearance or gender could affect participant responses, so should be made consistent throughout the experiment.
63
CONTROL: What is random allocation ?
- Random allocation of participants to their groups - Decreases the possibility of participant variables in the form of individual differences, such as mathematical ability = affects results
64
CONTROL: What is counterbalancing ?
- Used to deal with order of effects when using repeated measures design - When the sample is split in half completing the two conditions in the reverse order -Any order effects should be balanced out E.g., the first 10 participants would complete condition A followed by condition B, and the remaining 10 participants would complete condition B and then A. Any order effects should be balanced out by this technique.
65
CONTROL: What is randomisation ?
Randomisation is used in the presentation of trials in an experiment to avoid any systematic errors that might occurs as a result of the order in which the trials take place
66
CONTROL: What is standardisation?
- Standardisation refers to the process in which procedures used in research are kept the same - Changes in data can be attributed to the IV. - It is far more likely that results will be successfully replicated on subsequent occasions.
67
What is demand characteristics
- A high risk that participants will change their natural behaviour in line with their interpretation of the aims of a study = affects the results - Controlled by not allowing the participants to guess the aim/ identify the IV = achieved by using single blind experimental technique - Measure of deception has been used / so they can't easily guess the aim
68
What is investigator effects ?
* Investigator effects occur when a researcher unintentionally, or unconsciously influences the outcome of any research they are conducting * These are best controlled by not allowing both the ppts and the researcher to know the aim of the research . This is achieved by double blind technique. -Measure of deception has been used as the researcher and ppts don't know the aim.
69
ETHICS: What is the role British Psychological Society ? ( BPS )
Is a document produced by the BPS, which details the general principles that apply to the use of human participants in all research contexts. It focuses on four major principles: respect, competence, responsibility and integrity.
70
ETHICS: How does consent link to ethical guidlines ?
- Need to be informed of what will happen, what they are expected to do, told of risks - Ppts decide and give their consent - Issue >> informed about the aims of the study and may show demand characteristics = invalid results ... ppts may not be given all the facts of the study = deception - Some research methods require that ppts are unaware that they have been in a study - Researchers do need to be careful that their methods do not evade privacy of the ppts except in public.
71
ETHICS: What is the limitations of consent?
- Giving a ppt information concerning the nature and purpose of the study may invalidate the results - Even if the researcher has gained informed consent, ppts may not understand what they are doing - No universal agreement about what constitutes a public place
72
ETHICS: What is deception?
- Sometimes necessary to deceive parents, as if they knew the full aims of the study = alter behaviour > invalid results - Deception is unethical as ppts have the right not to be lied to - If information about the aims of the study is withheld to the ppts = unable to give informed consent > could lead to distress as the ppts don't know what they have volunteered for. - Causes no harm as its minor
73
ETHICS: What is the limitations to deception?
- PPTS may feel bad or embarrassed - Weighing up the costs-benefits of deception is sometimes hard as the cost are not always apparent until after the researcher has been carried out
74
ETHICS: What is confidentiality?
Confidentiality refers to the protection of the ppts' data
75
ETHICS: What is the limitations to confidentiality?
It is sometimes possible to work out who the ppts were by the information that is provided
76
ETHICS: What is debriefing?
When ppts take part in an experiement, the experimenter is obliged to disclose to the ppts the real and actual nature of the experiment and to answer any questions the ppts may have . This occurs AFTER the experiment is completed
77
ETHICS: What is the limitations of debriefing?
Harder to debrief in field or natural experiment The damage is already done, the ppts may feel bad or embarrased
78
ETHICS: What is protection from physical or psychological harm?
Making sure design studies which ensure the ppts come to no more harm than they would in everday life Any potential harm needs to be communicated to the ppts so that they can give informed consent Ppts should leave a study in the same state that they entered it
79
ETHICS: What is the limitation of protection from physical and psychological harm?
Researchers are not always able to predict accurately the risks of taking part in the research
80
PEER REVIEW: What is peer review?
Part of the scientific process of carrying out research and getting work published Also referred to as refereeing Is the assessment of scientific work by another expert in the same field
81
PEER REVIEW: What is the process of peer review?
Idea, theory, hypthesis --> Research and Write --> Manuscript (proposed article) --> Send to Jornal editor --> Reviewed by 3-5 experts in the field --> Decision is made to accept, revise or reject
82
PEER REVIEW: What is aims of peer review?
- To ensure that work being published is of high quality - Peer review process checks: - Validity of the research - Orginality checks for plagarism, falsification and fabrication of data - Quality of the procedure and methodology - Importance of the researcher to the wider community
83
PEER REVIEW: What is purpose of peer review?
Any research that is published should be of high quality It helps to allocated research funding - the UK government currently spends £5.8 billion on research, and this needs to go to worthwhile studies In order to be published in a journal, articles must be peer reviewed Peer review also contributed to the research rating of university departments It is meant to spot fraudulent research, so that any research that is published can be trusted by the general public
84
PEER REVIEW: Evaluation of peer review process
The peer review process is not infallible and sometimes the system breaks down. Cases of fraud are rare but they have included plagiarism, falsification of data and fabrication of data EXAMPLE ONE: Andrew Wakefield published a study staying that the MMR vaccination was linked with the development of autism It turned out that he was wrong - his method were faulty, and the conclusions based on unscientific work. There was a conflict of interest He has been struck off the medical council, and can no longer be a doctor However, the rumours about MMR persist, and many parents chose not to vaccinate their children. The rate of measles infections has shot up, and it can be fatal in young children Smith 1999 - Gender bias: male researchers tend to be favoured - Institution Bias: Research from prestigious universities is favoured - Reviewers doesn't always habe suffcient expertise - The publication of postive results tends to be favoured, but negative results can be just as important = file draw effect - Allows for obejectivity, however rivalry between clinicians could be a motive for foul play - Many reviewers will ensure that research they are reviewing is in line with existing theory, thus can prevent a resolution of paradgim in science
85
PEER REVIEW: Answering exam questions
First check if they are asking about the process or the purpose of peer reveiw PROCESS: What happens during a peer review - the different stages PURPOSE: Why do we do per reviews? Consider things like funding, university ratings etc
86
ECONOMY & PSYCHOLOGY: How is the economy related to psychology?
The implications of psychological research for the economy are concerned with how the knowledge and understanding gained from psychological research (theories and studies) may contribute towards our economic prosperity.
87
ECONOMY & PSYCHOLOGY: How is each area of topics in psychology help with the economy?
Memory --> EWTs + Use cognitive interviews -no leading questions, gather more correct information --> Arrest the correct the person -> saves money and time Attachment --> Ideas of John Bawley are inccorect --> Women can go back to work men can stay at home --> Children can go to nursery -> creates jobs --> good for the economy Stress --> Stress causes people to become ill = off work --> If we can treat/manage stress people can continue to work --> good for the economy Psychpathology --> Treatment of disorders e.g phobia --> If treated, people are able to go to work, good for the economy -> paying taxes, spending money Biopschology --> use of brain scans to diagnose disorders e.g. cancer --> Can treat earlier + learn more about the illness --> People happier for longer --> can work more + less pressure in the NHS Social influence --> Process of social change can get people to change behaviour --> e.g if we can get people to eat healthier food + exercise they are less ill e.g Jamie Oliver --> Less pressure in NHS --> Saves money Forensic Psychopathology --> custodial sentencing --> if ineffective people reoffend --> is it good use of money? { Expensive to put people in prison --> miscarriage of justice --> Compensation Restorative justice --> Cheap alternative Offender profiling --> Arrest correct person quicker --> saves polices time + money
88
ASSESSING RELIABILITY: How does the test-retest work?
The test-retest method measures external reliability: The same participants are given the same questionnaire at separate time intervals (e.g. with a 6-month gap between testing sessions) If the same result is found per participant then external reliability is established and see if there is a positve correlation between the two
89
ASSESSING RELIABILITY: How does inter-observer reliability work?
It is very important to establish inter-observer reliability when conducting observational research. It refers to the extent to which two or more observers are observing and recording behaviour in the same way. All observers must agree on the behaviour categories and how they are going to record them before the observation begins The observation is conducted separately by each observer to avoid conformity (i.e. one observer may be influenced by one or more other observers) After the observational period: The observers compare the two independent data sets (often designed as a tally chart) They then test the correlation between the two sets If there is a strong positive correlation between the sets then this shows that there is good inter-observer reliability and that the behaviour categories are reliable Establishing good inter-observer reliability means that there is less chance that researcher bias has interfered with the observation
90
AESSSING RELIABILITY: What is reliablity?
Reliability refers to the consistency of research study or measuring test. Reliability can be divided into two categories: internal and external reliability. Internal reliability describes the internal consistency of a measure, such as whether the different questions (known as ‘items’) in a questionnaire are all measuring the same construct. External reliability assesses consistency of a measure from one use to another. For example, if a participant took an IQ test one year, and then took the same test a year later and gained a very similar score, this would show external reliability.
91
92
How to improve reliability of interviews?
The reliability of interviews can be improved by using the same interviewer for each separate interview using trained interviewers (which is particularly important for the cognitive interview used with eyewitnesses) ensuring that leading questions or ambiguous, double-barreled questions are omitted from the questioning
93
RELIABILITY AND VALIDITY: What is reliability?
Refers to whether something is consistent
94
RELIABILITY AND VALIDITY: What is internal reliability?
This is about whether something is consistent within itself
95
RELIABILITY AND VALIDITY: What is validity?
This is about whether an observed effect is an accurate one
96
RELIABILITY AND VALIDITY: What is internal validity?
This is concerned with control
97
RELIABILITY AND VALIDITY: What is external validity?
This is concerned with generalising
98
RELIABILITY AND VALIDITY: What are the three types of external validity?
- Temporal - Ecological - Population
99
RELIABILITY AND VALIDITY: How is ecological validity different from mundane realism?
If we are referring to whether a study mirrors the real world or everyday experiences = mundane realism If we are asking whether the results of the study can be generalised to other settings = generalisability
100
RELIABILITY AND VALIDITY: Assessing and improving reliability self report techniques
RESEARCH METHODS: SELF-REPORT TECHNIQUES ASSESSING EXTERNAL RELIABILITY : Test retest reliability , Inter-interview reliability IMPROVING EXTERNAL RELIABILITY: Ensures items on the self-report are not ambiguous - rewrite questions if necessary, training of interviewers
101
RELIABILITY AND VALIDITY: Assessing and improving reliability on observations
RESEARCH METHODS: OBSERVATIONS ASSESSING EXTERNAL RELIABILITY : Inter-observer reliability IMPROVING EXTERNAL RELIABILITY: better operationalisation of behavioural categories, Training of observers
102
RELIABILITY AND VALIDITY: Assessing and improving reliability on experiments
RESEARCH METHODS: EXPERIMENTS ASSESSING EXTERNAL RELIABILITY : Is the measurement of the DV consistent IMPROVING EXTERNAL RELIABILITY: Ensure procedures are detailed so research can be replicated, Ensure procedures are standardised
103
RELIABILITY AND VALIDITY: Assessing and improving reliability on internal reliability
RESEARCH METHODS: Split-half ASSESSING INTERNAL RELIABILITY : Split-half reliability IMPROVING INTERNAL RELIABILITY: Remove some questions and then retest the correlation between the two halves of questions
104
RELIABILITY AND VALIDITY: How do we asses internal validity?
Face validiy - does it look valid Concurrent validity - how does it compare to an existing measurement
105
RELIABILITY AND VALIDITY: What could affect internal validity
- Investigator effects - Demand characteristics - Confounding variables - Social desirability bias - Poorly operationalised behavioural categories
106
RELIABILITY AND VALIDITY: How do you improve internal validity?
- Poor face validity - revise questions and rewrite if necessary - Poor concurrent validity - remove irrelevant questions and then check the concurrent validity again - Tighter controls of extraneous varaibles will increase internal validity - Can also use double blind techniques to avoid demand characteristics and investigator effects
107
RELIABILITY AND VALIDITY: How do you improve external validity?
Carrying out research in more natural settings or with different populations or in different time periods will help to improve the external validity if the results are the same
108
FEATURES OF SCIENCE: What is science?
Science tries to explain how and why things happen It tests hypotheses adn contruct theories by asking questions A theory can only be scientifit it it can be tested Science has a number of key features e.g. empirical evidence, objectivity, replicability, theory construction, hypothesis testing and falsifiability
109
FEATURES OF SCIENCE: What is empirical evidence?
Empical evidence is collected through direct observations or experiment; it does not rely on opinion or belief Experiments and observations can be repoted in detail so that other investigatiors can repeat and attempt to verify the work
110
FEATURES OF SCIENCE: What is objectivity?
Researchers remain unbiased in theory observations and all sources of bias such as personal or subjective ideas are eliminated If they manage to maintain objectivity, then they should be able to establish cause and effect
111
FEATURES OF SCIENCE: What is replicability?
Procedured are carefully recorded so that other researchers can repeat the research to see it the results are the same Replication of research is vital in establishing a scientific theory The peer review process is used to test for replicability
112
FEATURES OF SCIENCE: What is theory construction?
Theories are explanations of observations and findings They emerge from observations or hypothesis testing Once a scientific theory has been contruucted, it must be subjected to testing to see if its possible to gather eveidence to support or challenge it A theory can never be regarded as the absolute truth - it is provisional and can be supported, modified or abandoned in light of new research evidence
113
FEATURES OF SCIENCE: What is hypothesis testing?
A hypothesus serves as a prediction and comes from a theory Hypotheses are stated in a form that can be tested i.e operationalised If a hypothesis is supported then the theory will be strengthened If the hypothesis is rejected, then the theory needs to be amended or rejected
114
FEATURES OF SCIENCE: What is falsifability?
Karl Popper (1935) suggested that in science theories should come first and then from these we generate hypotheses which can then be falsified by observations and experiments He believed you could not confirm a theory only disconfirm it e.g. seeing lots of white swans does not prove the alternative hypothesis that "all swans are white" as the sighting of just ine black swan would disprove this Therefore we must test the null hypothesis that 'not all swans are white' and if we cannot support this null hypotheisi then we can accept the alternative hypothesis According to Popper a scientific theory must be falsifiable which means approached like Freudian gender developement (Oedipus complex etc) is not scientific as it is not falsifiable - it can' t be proved wrong as it is based on the unconscious mind and we cannot objectively test that
115
FEATURES OF SCIENCE: Is psychology a science?
- Kuhm believed that for something to be a science, it needed to have a paradigm ( a world view or general theoretical orientation that is accepted by the majority of scientists working in a given discipline, such as psychology ) 3 stages to the developement of any scientific discipline: Prescience - the subject isn't a true science because it has lots of different, competing approaches Normasl science - an overall paradigm is established. This means there's general agreements about theories, and appropriate research is used to develop knowledge Paradigm shift - Research evidence that challenges the current paradigm ends up changing the paradigm and then the subject returns to the normal science stage These ideas resulted in two different opinions as to whether psychology is truly a science: - Some belive that psychology has a paradigm - It was initially behaviourism, but then it underwent a change to cognitive psychology - This change in principles and practices is known as a paradigm shift - Others argue that psychology might be made up of mini-paradigms, and so psychology is in the prescience stage and not yet a normal science scientific revolution - Researcher evidence that challenges the current paradigm ends up changing the paradigm, so the subject returns to the normal science stage
116
REPORTING ON PSYCHOLOGICAL INVESTIGATIONS: What is needed in the title on psychological investigation reports?
Should say what the study's about and include the IV and the DV e.g. An investigation into the the effects of hunger on reaction times
117
REPORTING ON PSYCHOLOGICAL INVESTIGATIONS: What is needed in the abstract on psychological investigation reports?
- Concise summary of the report - brief description of aims and hypotheses - method - summary of the results - interpretations of the findings and any significant flaws in the study - all written in third person
118
REPORTING ON PSYCHOLOGICAL INVESTIGATIONS: What is needed in the introduction on psychological investigation reports?
General overview of the area being studied Include existing theories Discuss a few studies closely related to the current study
119
REPORTING ON PSYCHOLOGICAL INVESTIGATIONS: What is needed in the aim and hypotheses on psychological investigation reports?
Aim is a sentence stating the purpose of the study Hypothesis is what's actually going to be tested, should include IV and DV
120
REPORTING ON PSYCHOLOGICAL INVESTIGATIONS: What is needed in the method on psychological investigation reports?
Describes how the research was carried out Someone should be able to replicate the study by following the method, needs to be detailed
121
REPORTING ON PSYCHOLOGICAL INVESTIGATIONS: What is needed in the results on psychological investigation reports?
The study can be reported as descriptive or inferential statistics
122
REPORTING ON PSYCHOLOGICAL INVESTIGATIONS: What is needed in the discussion on psychological investigation reports?
- The implications of the study - An explanation of the findings - The limitations and modifications of the study - The relationships to background research
123
REPORTING ON PSYCHOLOGICAL INVESTIGATIONS: What is needed in the references on psychological investigation reports?
Contains a list of: Books Articles Websites References should be presented in alphabetical order of first author's surname
124
REPORTING ON PSYCHOLOGICAL INVESTIGATIONS: What is needed in the appendices on psychological investigation reports?
Any materials used Raw materials and statistical test calculations also go here
125
REPORTING ON PSYCHOLOGICAL INVESTIGATIONS: The correct way to write a reference
surname(s), date,title,city and publisher e.g. Eysenck,H.J. (1947). Dimensions of Personality. London. Routledge and Kegan Paul
126
QUANTITATIVE VS QUALATATIVE: What is quantative data and what are the pros and cons?
- Quantative data is data that is numerical and it is easy to compare and anaylse and find patterns in PROS: - Relatively simple to analyse - Less open to bias and more subjective CONS: - May fail to represent 'real-life'
127
QUANTITATIVE VS QUALITATIVE: What is qualitative data and what are the pros and cons?
- Qualitative data is data that can't be reduced to numbers and have lots of detail PROS: - To have greater validity - provides more meaningful insight into the ppts CONS: - Often difficult to analyse - Patterns and comparisons may be hard to identify - May be bias
128
PRIMARY VS SECONDARY What is primary data and what are the pros and cons?
Primary data is collected by the researcher dealing directly with the ppts. Can be done via observation experiments, surveys etc PROS: - Authentic data obtained - Can be designed to specifically target information that the researcher requires CONS: - Requires time and effort - Needs planning, preparation and resources
129
PRIMARY VS SECONDARY What is seondary data and what are the pros and cons?
- Secondary data is collected form external sources such as television, radio, magazines, internet etc.. Also often used in correlations PROS: - Inexpensive and eaily acced requiring minimal effort CONS: - The substantial variation in the quality and accuracy of secondary data, therefore could be out of data
130
PRIMARY VS SECONDARY What is meta analysis?
- Meta-analysis is when using a particular for of research method that uses secondary data - This refers to a process in which data from a large number of studies, which involve the same research questions and methods of research, are combined - May involve quantitative analysis of the conbined data - this produces an effect size - May also involve a qualitative review of the conclusions of the different studies - A problem with meta-analysis is publication bias > This is when the researcher may not select all relevant studies, just the ones that have positive or significant results, meaning the meta-anaylis is biased
131
MEASURES OF CENTRAL TENDENCY: How do you calculate the mean and what are the pros and cons ?
the mean is calculated by adding up all the avilable data scors, and dividing by the number of actual data scores EXAMPLE: 6,5,2,4,6,5,1,4,4,3 Mean = 40 /10 = 4 PROS: The mean uses al available data in the caluclation which means that no data or participant contribuions to a study are left out CONS: The mean can be skewed by anomalies, such as a particularly high or low score. Since the mean uses all data, even these anomalies have to be included
132
MEASURES OF CENTRAL TENDENCY: How do you calculate the mode and what are the pros and cons?
- To calculate the mode, you look for the most frequently occuring score in a data set, and this becomes your mode EXAMPLE: 5,3,6,4,3,6,6,4,4,6,6,7 Mode = 6 PROS: The mode is not affected by anomalouse scores because the most frequent score is not rare or extreme CONS: On most occasions, the mode only uses one figure to work out an average of data set, which means that this single number is used to represent a whole set of results
133
MEASURES OF CENTRAL TENDENCY: How do you calculate the median and what are the pros and cons?
It is calculated by ranking all scores from smallest to largest, and then working out which is the middle value If there are two score that sit in the middle, then the median is the sum of the two scores, divided by two EXAMPLE: 4,4,5,6,6,7,7,8,9,9,9 Range = 7 PROS: The median only uses the middle figure in a data set, which means that by nature, it does not become skewed by anomalous results in a study CONS: The median does not use all available scores in the calculation, which mean that it may not always be as representative as other methods such as the mean
134
MEASURES OF CENTRAL TENDENCY: How do you calculate the range and what are the pros and cons ?
- A measure of dispersion - Calculated by looking at the highest score and the lowest score and working out the difference EXAMPLE: 10,13,5,2,8,9,11,4,7 Range = 11 PROS: The range is easy to calculate and can provide an insight into the variance of results quicker than other methods such as standard deviation CONS: The range only uses two sets of data in the calculation, and both of these could potentially be extreme scores - low or high. This means the range may not be the most accurate measure of dispersion
135
MEASURES OF CENTRAL TENDENCY: How do you calculate the standard deviation and what are the pros and cons ?
Do not need to calculate for exams but displayed on graphs like normal distribution graphs PROS: Unlike the range, the full data set is used to calculate standard deviation, so more data is taken into account CONS: It is more complex to work out than the range, and relies on the mean calculation being accurate and unaffected by anomalous results
136
GRAPHS & TABLES: What are tally charts?
Tally marks are used for counting things These are used in content analysis and observations They record the number of times something is seen
137
GRAPHS & TABLES: What are bar charts?
Can be used to represent the data from tally charts, mean scores or the totals They are used with norminal or ordinal levels of measurement The bars must be seperate from each other
138
GRAPHS & TABLES: What are pie charts?
Are used when we have percentages in categories (norminal data) Each segemnt represents a percentage of the total
139
GRAPHS & TABLES: What are histograms?
Should be used to present continious/interval data such as weight, height and temperature Histograms unlike bar charts also have no gaps between the bars Histograms always have equal sized intervals of data on the x axis and the y axis always represents the frequency within each interval
140
GRAPHS & TABLES: What are line graphs?
Are used with continuous/ interval data and use points connected by lines to show how something changes in value, for instance over time Line graphs do not need to have equal sized intervals of data on the X axis, like histograms Typically the IV will be on the X axis and the DV on the y axis
141
GRAPHS & TABLES: What are scattergrams?
Are used with correlations where the relationship of two variables is summarised They illustrate the direction of the relationship (postive, negative or zero correlation) and can indicate the potential strength of the relationship
142
DISTRIBUTIONS: What is distribution and what is normal distribution?
Shows us the frequency if something as it occurs in the population Distribution graphs are histographs with the measured variable along the bottome and the frequency up the side normal: In the normal distribution mean,mode and median will all be at the same point The data is symmetrical about the mean (50% of scores are above and 50% are below) It will also be a bell shaped curve - this can look different from above but still be a normal distribution curve
143
DISTRIBUTIONS: What are skewed distribution?
These are non-symmetrical as the scores are not equally distributed above and below the mean A postive skew results from scores that are mainly below the mean A negative skew from scores that are mainly above the mean
144
145
CORRELATIONS: What is correlation?
Means association - more precisely it is a measure of the extent to which two variables are related
146
CORRELATIONS: What are correlation coefficients?
Where it an be expressed numerically as a coeffecinet, ranging from -1 to +1 Gives us the information about the strength (weak, moderate, or strong) and direction (positive or negative) of the correlation
147
CORRELATIONS: What are the differences between experiments and correlations
An experiment isolates and manipulates the independent variables to observe its effects on the dependent variable, and controls the environment in order that extraneous variales may be eliminated, experiments establish cause and effect A correlation identifies variables and looks for a relationship between them. An experiement tests the effect that an independent variable has upon a dependent variable but a correlation looks for a relationship between two variables Correlation = predict relationships Experiment = can predict cause and effect
148
CORRELATIONS: Correlation in realtion to hypotheses
Correlation hypothese are written differently than ones where we are looking for a difference Hypothesis will still either be directional or non directional Directional = positive or negative Non-directional = just a significant correlation Null hypothesis = no significant correlation
149
CORRELATIONS: What are the strengths of correlations?
- Allows to investigate naturally occuring variables that maybe unethical or impractical to test experimentally. For example, it would be unethical to conduct an experiment on whether smoking causes lung cancer - Correlation allows the researcher to clearly and easily see if there is a relatioship between variables. This can be displayed in a graphical form
150
CORRELATIONS: What are the limitations of correlations?
- Is not and canot be taken to imply causation. Even if there is a very strong association between two variables we cannot assume that one causes the other - Correlation does not allow us to go beyond the data that is given
151
LEVELS OF MEASUREMENT: What is interval/ ratio data?
The most precise Uses standardised unots where the intervals between data pointes are always exactly the same EXAMPLE: How far in cm did each of the aeroplanes go Heart rate in babies The time taken for ppts to complete questionnaire
152
LEVELS OF MEASUREMENT: What is ordinal data?
Means the data points can be put into rank order However, with data that is ranked we don't knw how big the gap is between each scores EXAMPLE: patients ratings of satisfaction with the service of their dentists Ratings of how happy each student feels about their psychology test score
153
LEVELS OF MEASUREMENT: What is norminal data?
The lease precise form of data collection; here we are simply counting up frequencies Sometimes called category data or naming data EXAMPLE: A study of the main mode of transport to school of YR7 How many boys and girls each choose to do either an apprenticeship or a degree
154
LEVELS OF MEASUREMENT: In measure of central tendency and measure of dispersion which one goes to each level of measurement?
Measure of central tendency: Norminal - Mode Ordinal - Median Interval/Ratio - Mean Measure of dispersion Norminal - N/A Ordinal - Range Interval/ Ratio - Standard deviation
155
CONTENT ANALYSIS: What is content analysis?
It is an observation Studies human behaviour indirectly, usually observing the things we produce e.g web sites, television programmes Used to analyse qualitative data Allows a researcher to take quanlitative data and to tranform it to quantitative data The counting serves two purposes: - to make analysis more objective - to identify trends
156
CONTENT ANALYSIS: What is content?
Content is something that peole have created = called artefacts EXAMPLES OF ARTEFACTS: Books Drawings Films Newspaper items
157
CONTENT ANALYSIS: How to carry out content analysis?
Data is collected Researcher reads through or examines the data, making themselves familiar with it The researcher identifies coding units The data is analysed by applying the coding units A tally is makde of the number of times that a coding unit appears Sample: artefacts that are to be analysed. needs to be representative Coding systems: researcher creates a coding system, breaks down the information into coding units or behavioural categories - units vary depending on the artefact used Results: The reasearcher then looks at the data and draws conclusions
158
CONTENT ANALYSIS: Evaluating content analysis
generalisability - if the artefacts are limited to a particular culture or group then the findings won't be generalised to wider society reliability - can be easily replicated by others - as long as artefacts are available to others, the analysis could be repeated and reliability measured using inter-rater reliability application - easy technique and not too time consuming , allows a statistical analysis to be conducted as there is usaully quantatie data as a result of the procedure which can be anlaysed using the mode and chi-squared test validity - tends to have high ecological validity because they are based on observations of what people actually do; real communication that are current and relevant -no chance of demand characterisitcs as the artefacts that are being analysed already exist - observer bias: different observers might interpret the meanings of the categories in the coding system differently - can be culture bias as the interpretation will be affected by the language and culture of the observer and the coding system used Ethics - no risk to content analysis - artefacts are normally public documents like news articles, TV shows or music videos - no need for consent and no one will be harmed - social responsibilty is important in some content analyses -> hate material might infalme anger and offence and might be emotionally difficult for the researcher
159
CONTENT ANALYSIS: How to do thematic analysis?
The data is transcibed The data is reviewed repeatedly so that the researcher can identify trends in the meaning conveyed by language The themes identified are re-analysed so that they become more refined and relevant and given short hand codes. The researcher can then annotate the transcript with the codes that have been identified The themes identified can ebused to support or challenge exisiting theories, with specific examples of data or quotes being used as supporting evidence
160
CONTENT ANALYSIS: What is thematic analysis?
Thematic analysis is a method for analysing qualitative data that involves identifying and reporting patterns within the material to be analysed. The material to be analysed might be a diary, TV advertisements, or interview transcripts.
161
INFERENTIAL TESTING: What is meant by the term levels of significance?
Is the probability that the results reported happened by chance e.g. a level of significance of 0.05 means that there is a 5% chance that the results is insignificant, or that it just happened by chance alone
162
INFERENTIAL TESTING: Can you explain what p<_ 0.05 means?
When we use the p<_ 0.05 signifcance level we are saying that probability of our results occuring by chance is equal to or less than 5% In other words, we are at least 95% confident that the results we have obtained are due to the manipulation of the independent variable rather than chance factors
163
INFERENTIAL TESTING: What is type 1 error?
occurs when we conclude that there is a significant difference or significant correlation when really ther isn't accept the alternative hypothesis but we should have accepted the null hypothesis this occurs when the significant level is too lenient Caused by poor experimental design or confounding variables
164
INFERENTIAL TESTING: What is type 2 error?
occurs when we conclude that there isn't a difference or correlation when really there is accept the null hypothesis but we should have accepted our alternative hypothesis occurs wehn the level of significance is too stringent
165
INFERENTIAL TESTING: Levels of significant
More stringent >>>> TYPE 2 ERROR MORE LIKELY Confidence level, that result was due to IV Risk result was due to chance p = 0.001 99.9% result due to IV 0.1% result due to chance p = 0.01 99% result due to IV 1% result due to chance p = 0.5 95% result due to IV 5% result due to chance MORE LINIENT >>>>> TYPE 1 ERROR MORE LIKELY p = 0.1 90% result due to IV 10% result due to chance p = 0.2 80% result due to IV 20% result due to chance
166
INFERENTIAL TESTING: Parametric VS Non- parametric tests
Parametric tests are prefered as they are more powerful but in order to use them the data must: - be interval or ratio - must be drawn from a population which must be normally distributed - the two sets of data must be similarly spread out
167
INFERENTIAL TESTING: When do we use a sign test?
we are looking for a difference between two conditions we have repeated measures or match-pairs design we have collected norminal (category)
168
INFERENTIAL TESTING: How to calculate a sign test?
1. Work out the 'sign'. Has the score gone up ( + ) or down ( - ) 2. Calculated the value of 'S'. The lowest score, excluding any 'nill' scores 3. Calculated the value of 'N'. The total number of scores, excluding any 'nill' scores 4. Find the critical 'S' value ... using the critical value table 5. Determine whether the results are significant is your calculated value for S less than or equal to the critical value for S?
169
INFERENTIAL TESTING: Template for signifcance statement
For a ONE/TWO tailed test with p value of p = ... and a sample size of N=.... , the critcal table value is .... As the observed value of S= .... is LESS THAN/ EQUAL TO/ MORE THAN the critical table value, it is SIGNIFICANT/ NOT SIGNIFICANT and so the ALTERNATIVE/NULL hypothesis is accepted and the ALTERNATIVE/NULL hypothesis is rejected
170
INFERENTIAL TESTING: How to calculate degrees of freedom
df = (number of rows - 1) X (number of columns - 1)
171
INFERENTIAL TESTING: How to do a correlation test?
Are you looking for a difference or a correlation? If yes... What kind of data was collected?
172
INFERENTIAL TESTING: EXAMPLES
Using critical values table Ppts will perform better in a memory test in the afternoon than in the morning ppts : 28 students observed value: 153 ( ppts scored higher in the afternoon) - Direction - S = Critical Value = 130 - Non-significant For a one tailed with a P value of 0.05 and a sample size of N = 28, the critical value 130. So it is non- significant Ppts will achieve a different score on self-esteem test after eating a packet of Hob Nobs ppts: 9 women observed value : 4 ( ppts self- esteem was lower) - one tailed - S = 4 - Critical value = 8 - Significant
173
INFERENTIAL TESTING: Statistical test Examples
Research is carried out to see of boys run faster than girls. They are timed running a 100m course Which test do you use and why? Difference Interval/Ratio Independent measures Unrelated t-test A study to see if there is a link between calories consumed and risk of coronary heart disease - Correlation - Ordinal - Spearman Rho