Measurements of Behavior

Question 1

Operationalism

Answer 1

belief that scientific concepts must be defined in terms of observable operations

Question 2

Operational Definition

Answer 2

a precise description of a procedure used to empirically test a theoretical concept

Question 3

Scientific Method

Answer 3

• make observations
• develop hypothesis
• test hypothesis
• gather data
• evaluate data
• evaluate results
• replicate

Question 4

Variables

Answer 4

aspect of a testing condition that changes with different conditions

Question 5

Types of Variables

Answer 5

• independent variables (IV)
• dependent variable (DV)
• confound variable (anything happening at the same time as the IV; undesired)

Question 6

Writing Criteria for Operational Target Behavior Definitions

Answer 6

• accurate
• complete
• concise
• inclusions
• exclusions

Question 7

Characteristics of Good Definitions

Answer 7

• objective : refers only to the observable
• clear : readable and unambiguous
• complete : delineate boundaries of definition

Question 8

Purpose of Good Definitions

Answer 8

• precise and concise description
• reliable observation
• accurate recording
• agreement and replication

Question 9

Testing a Definition

Answer 9

1. can you count the number of occurrences? (should be yes)
2. will a stranger know what to look for based on definition alone? (should be yes)
3. can you break the target behavior down to smaller, more specific components? (should be no)

Question 10

Behavioral Measurement

Answer 10

• frequency / rate
• duration
• latency
• locus
• topography
• force

Question 11

Taking data

Answer 11

• event recording
• timing
• time sampling

Question 12

Event Recording

Answer 12

procedures for detecting and recording the number of times a behavior is observed

Question 13

Time Sampling

Answer 13

variety of methods for observing and recording behavior during intervals or at specific moments in time

observation is divided into intervals, presence or absence of behavior recorded for each interval

Question 14

Partial Interval Recording

Answer 14

record whether the behavior happened at any time during the interval.

tends to underestimate high-frequency behavior and overestimate duration

Question 15

Whole Interval Recording

Answer 15

at the end of each interval it is recorded if the behavior happened during the whole interval.

the longer the interval the more whole interval will underestimate the occurrence of the behavior

Question 16

Momentary Time Sampling

Answer 16

recorder notes whether the behavior happens at the moment each interval ends.

not recommended for low frequency, short duration behaviors

Question 17

PLACHECK (Planned activity check)

Answer 17

momentary time sampling for group engagement

Question 18

Measuring Behavior by Permanent Product

Answer 18

measuring behavior after it has occurred by measuring its effects on the environment

all previous procedures can be applied to permanent product measurement

products can be a natural or contrived

Question 19

Advantages of Permanent Product Recording

Answer 19

• practitioner free to do other tasks
• measurement of complex behavior
• easier data collection
• possible measurement of inaccessible behavior
• more accurate, complete, continuous

Question 20

Inter-Observer Agreement (IOA)

Answer 20

• used in direct observation/recording of behavior
• determines whether the target behavior is being recorded consistently
• agreement does NOT equal accuracy
• aka: inter-observer reliability or inter-rater reliability*

Question 21

Inter-Observer Agreement

Answer 21

IOA Procedure -

two people independently observe and record the same target behavior (DV) of the same individual during the same observation period

recordings of the two observers are compared

% of agreement between observers is calculated

Question 22

Types of IOA Data Collection

Answer 22

1. continuous measurement - frequency + duration
2. discontinuous measurement - interval recording

Question 23

IOA Calculations

Answer 23

frequency recording - divide smaller frequency by the larger (ex. 9/10 = 90% agreement)

duration recording- divide smaller duration by the larger (ex. 48/50 = 96% agreement)

interval recording- session is broken up into short intervals (ex. agreement/(agreement + disagreement) = 4/(4+1) = .80 = 80%)

Question 24

IOA Target %

Answer 24

80% = minimal acceptable level
90% or higher is preferred

Question 25

Indicators of Trustworthy Measurement

Answer 25

1. validity 2. accuracy 3. reliability

Question 26

Validity

Answer 26

- directly measures a socially significant behavior - measures a dimension of the behavior relevant to the question - ensures the data are representative

Question 27

Accuracy

Answer 27

observed values match the true values of an event

Question 28

Reliability

Answer 28

measurements yields the same values across repeated measurement of the same event

Question 29

Threats to Validity

Answer 29

indirect measurement - measuring a behavior other than the behavior of interest - requires inferences be made about the relationship between those behaviors - must provide evidence that the behavior measured is directly related to behavior of interest

Question 30

Measurement Artifacts

Answer 30

misleading data that result from the way behavior is measured: - discontinuous measurement - poorly scheduled observations - insensitive or limiting measurement scales

Question 31

Threats to Measurement Accuracy and Reliability

Answer 31

- human error - poorly designed measurement system 1. cumbersome 2. difficult to use 3. complex - inadequate observer training 1. explicit and systematic 2. careful selection 3. train to competency standard 4. on-going training to minimize observer drift - unintended influences on observers 1. observer expectations of what the data should look like 2. observer reactivity when she/he is aware that others are evaluating the data 3. measurement bias 4. feedback to observers about how their data relates to the goals of intervention

Question 31

Assessing the Accuracy of Measurement

Answer 31

1. determines if data are good enough to make decisions 2. discovery and correction of measurement errors 3. reveal consistent patterns of measurement error 4. assure consumer that data are accurate

Question 32

Assessing the Quality of Measurement

Answer 32

indicators of the quality of data include: - IOA - accuracy - reliability can report multiple indices to assess data quality