Section 5: Experimental Design Flashcards
1
Q
Experimental Control
A
(Functioanl Relations; Analysis; Control)
- When a predictable change in behavior [dependent variable-DV] can be reliably produced by the systematic manipulation of some aspect of the individual’s environment [independent variable-IV]
- The analysis dimension of the 7 dimensions of ABA
2
Q
4 Important Elements of Behavior
A
DICE
- Behavior is DETERMINED
- the occurrence of any event is determined by the functional relations it holds to other events
- behavior is a natural phenonmenon and subject to the same natural lawas as other natural phenomena
- Behavior is INDIVIDUAL
- behavior is defined as a person’s interaction with the environment
- Groups of people do not behave
- Experimental strategy of ABA is based on single subject methods of analysis
- Behavior is CONTINUOUS
- behavior changes over time
- behavior requires continuous measurement over time
- Behavior variability is EXTRINSIC to the organism
- variability (change in behavior) is the result of environemnt:
- the IV under investigation
- some uncotrolled aspect of the experiment (e.g. the behavior of another child in the classroom)
- uncontrolled factor outside of experiment (e.g. weather changes)
- variability (change in behavior) is the result of environemnt:
3
Q
When we see variability in our data, what should we do?
A
- we should attempt to experimentally manipulate factors suspected of causing the variuability in the data to look for causal factors
- seek treatment variables robust enough to overcome variability
4
Q
6 Components of Experiments in ABA
A
MS. BEST
- a measurement system and ongoing analysis of data
- at least one subject
- at least one behavior (DV)
- an experimental design
- at least one setting
- at least one treatment (IV)
5
Q
Experimental Question
A
- a brief but specific statment of what the researcher wants to learn from conducting the experiment
- ex. what are the effects of the IV on the DV for what population and in what setting?
- ex. the purpose of the study was to see the effects of the IV on the DV.
6
Q
At Least One Subject (Single-Subject Designs)
A
(Single-Case Designs; Within-Subject Designs; Intra-Subject Designs)
(one of the 6 components of ABA experiments)
- ABA uses single-subject designs but thats does not mean there’s only 1 subject in the research
- it’s called single subject because the subject as as their own control
- repeated measures of the subject’s behavior during each phase of the study provide the basis for comparing experimental variables as they are presented or withdrawn in subsequent conditions (ie the presence and absence of the IV)
- the individual is exposed to each condition several times over the course of a study
- it’s called single subject because the subject as as their own control
- studies usually involve more than 1 subject– usually 4 to 8
- Each subject’s data is graphed seperately
- ABA does not use group comparison designs (traditionally used in psychology) because group designs mask individual progress
7
Q
At Least One Behavior
A
(Dependent Variable)
(one of the 6 componenets of ABA experiments)
- The behavior is the dependent variable.
- DEPENDENT VARIABLE is the variable in the experiment measured to determine if it changes as a result of manipulations of the independent variable. In ABA, the DV must be a socially signficant behavior.
- some studies measure more than 1 DV. Reasons:
- provide data patterns that can serve as controls for evaluating and replicating the effects of an IV
- Assess if any COLLATERAL EFFECTS occured (a phenomenon in which the IV effects behaviors other than the targeted behavior)
- determine whether changes in the behavior of a person other than the subject occur during the course of an experiment and if such changes can explain changes in the subject’s behavior
- Ex. you are implementing an intervention for your client and the behavior of his brother changes as well
- Ex. you are implementing an intervention for your client and the behavior of his brother changes as well
8
Q
Collateral Effect
A
A phenomenon in which the IV effects behaviors other than the targeted behavior
9
Q
At Least One Setting
A
(one of the 6 components of ABA experiments)
- Control 2 sets of enviornmental variables to demonstrate experimental control:
- IV (present, withdraw, or vary its value)
- Extraneous Variables (prevent unplanned environmental variation)
- In labs, we can control enviornments better
- When unplanned variations take place, you can wait them out or incorporate them into the design
- repeated measures of behavior tell us whether unplanned environmental changes are of concern
10
Q
At Least One Treatment
A
(Independent Variable; Intervention; Experimental Variable)
(one of the 6 components of ABA experiments)
- The IV is the variable that is systematically manipulated by the researcher in an experiment to see whether changes in the independent variable produce reliable changes in the dependent variable.
- …. a particular aspect of the environment that the experimenter manipulates to find out whether it affects the subject’s behavior
11
Q
A Measurement System and Ongoing Analysis of Data
A
(one of the 6 components of ABA experiments)
- observation and recording procedures must be conducted in a standardized manner
- standardization involves every aspect of the measurement system (e.g. from the behavior definition to scheduling of observations)
- behaviorists must detect changes in level, trend, and variability
12
Q
Experimental Design
A
- the particular arrangement of conditions in a study so that meaningful comparisons of the effects of the presence, absence, or different values of the IV can be made
- Important Rules of Experimental design
- change only one variable at a time
- if you are examining a treatment package (behavioral package), ensure the entire package is presented or whithin drawn at the same time
- select and combine designs that best fit the research question
- change only one variable at a time
13
Q
Two Types of Experimental Designs
A
Para = Pyramid of Values
Nonparametric Analysis- the IV is either present or absent during the study (ex. medication is either given or not given in a drug study)
Parametric Analysis - The value of the IV is manipulated. This seeks to discover the differential effects of a range of values. (ex. various doses of medication are given throughout the study)
14
Q
Treatment Package
A
- (Behavioral Package)*
- when multiple IVs are bundled together into one program (e.g. a token economy with praise and time out procedures)
15
Q
Component Analysis
A
- a process that looks at the effect of each part of a treatment package
- used to determine the effective components of a treatment package
16
Q
Steady State Responding
A
(Stable State Responding)
- a pattern of responding that exhibits very little variation in its measured dimensional quantities over a period of time
- Provides the basis for baseline logic
17
Q
Baseline Logic
A
- refers to the experimental reasoning inherent in single subject experimental designs
- 3 elements (PAVR)
- Prediction
- Affirmation of the Consequent
- Verification
- Replication
- each of these elements depends on an overall experimental approach called steady state strategy
18
Q
Steady State Strategy
A
repeated exposure of a given subject to a given condition while trying to eliminate extraneous influcences on behavior and obtaining a stable pattern of responding before introducing the next condition
19
Q
Function of Baseline Data
A
It serves as a control condition but does NOT imply the absence of intervention–it can be the absence of a specific IV.
20
Q
Benefits of Baseline Data
A
- to use the subject’s performance in the absence of the IV as an objective basis for detecting change
- to obstain descriptions of ABC correlations for the planning of an effective treatment
- to guide us in setting the initial criteria for reinforcement
- to see if the bheavior targeted for change really warrants intervention
21
Q
4 Patterns of Baseline Data
A
DAVS
- Descending Baseline - don’t implement the IV unless its a behavior (functional skill that is being lost) that you need to increase
- Ascending Baseline - don’t implement the IV unless it’s a behavior you need to decrease (challenging behavior)
- Variable Baseline - don’t implement the IV until you’ve controlled all of the environmental variables that may be causing the variability
- Stable Baseline - implement the IV when all of the values of the DV small in a fall range of values
22
Q
Prediction
A
(the first part of baseline logic)
- the anticipated outcome of a presently unknown measurement
- data should be collected until stability is clear–the more data the better the predictive power
- main question to ask yourself: are data stable enough to serve as the basis for experiental comparison?
23
Q
Affirmation of the Consequent
A
PREDICT THEN AFFIRM YOUR PREDICTION
(the 2nd part of baseline logic)
- Inductive Logic
- If the IV were not applied, the behavior (as indicated by baseline data) would not change
- the experimenter predicts the IV will change the behavior
- if the IV is controlling the DV, the data path in the presence of the IV will show that the DV has changed
- when the IV is present, data show DV has changed
- thus the IV is controlling the DV
24
Q
Verification
A
VERIFY THE EFFECTS OF THE IV
(the third part of baseline logic)
- Verification of a previously predicted level of baseline responding by termination or withdrawal of the treatment variable
25
Q
Replication
A
(the fourth part of baseline logic)
- replication is the essence of believability
- shows reliability of behavior change
- replication is accomplished by reintroducing the IV
28
Q
Multiple Baseline Design
A
- most widely used design
- highly flexible
- staggered implentation of the intervention in a step wise fashion across behaviors, settings, and subjects
- do NOT have to withdraw a treatment variable in the design
- ETHICS WARNING- when it is unethical or impractical to reverse conditions or when the behavior is irreversible, use this design instead of a reversal design
- 3 Main Types
- Multiple Baseline Across Behaviors
- Multiple Baseline Across Settings
- Multiple Baseline Across Subjects
- Two Weaker Variations- used when extended baseline measurement is unnecessary, impractical, too costly, or unabailable
- Multiple Probe Design
- Delayed Multiple Baseline Design
- Two Weaker Variations- used when extended baseline measurement is unnecessary, impractical, too costly, or unabailable
29
Q
Prediction, Verification, and Replication in the Multiple Baseline Design
A
- a functional relation requires a change in behavior with the onset of the intervention
- apply the IV to behavior 1 when you can confidiently predict that the behavior would remain the same in constant conditions
- if behaviors 2 and 3 remain unchanged after the application of the IV to behavior 1, this verifies the prediction
- if the IV changes behavior 2 like it did behavior 1, the effect of the IV has been replicated
- the more replications, the more convincing the demonstration
- most mutliple baseline designs have 3 to 5 tiers
30
Q
Multiple Baseline Across Behaviors
A
- two or more different behaviors of the SAME SUBJECT
- each subject serves as their own control
- after steady state baseline responding, the IV is applied to the first behavior while other behaviors are kept in baseline
- when steady state responding is reached for the first behavior, then the IV is applied to the next behavior
31
Q
Multiple Baseline Across Settings
A
- a single behavior is targeted in two or more settings or conditions
- after steady state baseline responding, the IV is applied to the first setting while the other settings are kept in baseline
- when steady state responding is reached for the first setting, then the IV is applied to the next setting
32
Q
Multiple Baseline Across Subjects
A
- one target behavior for two or more subjects in the same setting
- after steady state baseline responding is reached, the IV is applied to the first subject, while other subjects are kept in baseline
- when steady state responding is reached for the first subject, then the IV is applied to the next subject
- most widely used multiple baseline design
33
Q
Multiple Probe Design
A
- analyzes relation between the IV and acquistion of skill sequences
- instead of stimultaneious baselines, probes provide the basis for determining if behavior change has occured prior to intervention
34
Q
Delayed Multiple Baseline Design
A
- initial baseline and intervention begin and subsequent baselines are added in a delayed or staggered fashion
- effective when
- reversal design is not possible
- limited resources preclude a full scale design
- when a new behavior, subject, or setting becomes available
- limitations- shorter baselines do not show interdependence of DVs
37
Q
Changing Criterion Design
A
- Experimental design in which an initial baseline phase is followed by a series of treatment phases consisting of successive and gradually changing criteria for reinforcement or punishment
- only one behavior in this design
- behavior must be in the subjects repertoire already
- evaluates treatment that is applied in a graduated or step wise fashion – can be changes in rate, accuracy, duration, or latency of a single target behavior
- technically, it is a variation of the multiple baseline design
41
Q
Reversal Design
A
(A-B-A; B-A-B Design)
- any experimental design in which the researcher reverses responding to a level obtained in a previous condition
- the most powerful within subject design for demonstrating function
- each reversal strengthens experimental control
- eivdence of a functional relation is strengthened with each reversal switch from one condition to the other with a corresponding change in trend and level
- for a reversal to occur, the behavior must approximate the initial baseline levels
- Requires at least 3 consecutive phases
- Initial Baseline (A)
- Intervention (B)
- Return to Baseline (A)
- 5 Reversal Designs
- Repeated Reversals
- BAB
- ETHICS WARNING- if your client is displaying sever and dangerous behaviors, then do NOT spend time just taking baseline data. it is your ethic responsiblity to start treatment immediately. So, use the BAB design
- Multiple Treatment Design
- NCR Reversal Technique
- DRO/DRA/DRI reversal technique
42
Q
Prediction, Verification, and Replication in the Reversal Design
A
- the IV is responsible for behavior change if repetition of baseline and treatment phases approximate the original phases
47
Q
Alternating Treatments Design
A
(SCAMM:
Simultaneous Treatments Design; Concurrent Schedules Design; Alternating Treatments Design; Mutli Element Baseline Design; Mutli Element Design; Multiple Schedules Design)
- an experimental design in which two or more conditions are presented in rapidly alternating succession independent of th elevel of responding and the differential effects on the target behavior are noted
- compares two or more iVS to one another to see which IV would be best to utilize with a client
- based on stimulus discrimination - each IV has an obvious SD which is in effect
- For each IV, data are plotted separately on the same graph
- IVs may be
- alternated across daily sessions
- given in sessions occuring the same day
- implemented during each portion of the same session
49
Q
3 Variations of Alternating Treatments Design
A
- Alternating Treatment Designs Single Phase Without Baseline
- does not require an initial baseline
- Alternating Treatment Designs With Baseline
- whenever possible, you should use a baseline
- Alternating Treatment Designs With Baseline and Final Best Treatment Phase
- most widely used
54
Q
Two Types of Validity in Experimental Designs
A
Internal Validity
External Validity
60
Q
How to Assess and Ensure a High Level of Treatment Integrity
A
- Ensure high level of treatment integrity by:
- use precise operational defintion of treatment procedures
- simplify, standardize, and automate treatments–more likely to be consistently delivered and also socially validated
- training and practice for individuals who will conduct the experimental sessions (e.g. detailed scripts and instructions)
- Assessing:
- collect treatment integrity data to measure how the actual implementation of the conditions matches the written methods
- observation and calibration give the researcher the ongoing ability to use retraining and practice to ensure high treatment integrity
- reduce, eliminate, or identify the influence of potential confounding variables
