Research: lecture 3

Question 1

what measures effect size

Answer 1

Cohen’s D

Question 2

explain Cohen’s D

Answer 2

is the difference in two means divided by the pooled standard deviation

Question 3

t/f larger difference in groups … larger ES

Answer 3

true

Question 4

less variability _____ ES

Answer 4

larger

Question 5

what is power

Answer 5

the chance of finding a significant difference if there is one to be found

Question 6

what is power affected by?

Answer 6

-a number of variables:
1. effect size goes up; power goes up
2. number of participants goes up; power goes up

Question 7

where would you find the flowchart in an article?

Answer 7

methods?

Question 8

what does intention to treat mean

Answer 8

DONT USE THIS IN RESEARCH

Question 9

what is the difference b/w quasi-experimental and experimental?

Answer 9

quasi: no random assignment and typically involve the use of cohort groups
experimental: participants are randomly assigned to at least two comparison groups

Question 10

what is key to true experimental design?

Answer 10

randomization

Question 11

one group has how many assessments

Answer 11

more than one assessment per participant

Question 12

two or more groups have how many assessments

Answer 12

one assessment per participants

Question 13

design that randomly assigns participants to different groups, such as an experimental group (receiving a new treatment) and a control group (receiving a placebo or standard treatment). The goal is to determine the effectiveness of an intervention or treatment by comparing outcomes between groups

Answer 13

randomized control trial

Question 14

what are key features of an RCT? (4)

Answer 14

1. randomization
   2.control group
   3.prospective study
   4.blinding if possible

Question 15

what study follows particpants forward in time, observing outcomes as they occur

Answer 15

prospective study

Question 16

what is blinding?

Answer 16

partipants and researchers are unaware of which group (txt or control) partipants are in to minimize bias

Question 17

where are reputable journals listed?

Answer 17

pubmed
cinahl

Question 18

if you have a smaller ES what do you need more of?

Answer 18

subjects

Question 19

differences between groups
comparing post data vs comparing change scores

Answer 19

comparing post data: outcome values AFTER the intervention

-posttest values analyzed directly

comparing change scores: difference between pre and post for each subject

-pretest subtracted from posttest for each subject, then compares changes

Question 20

what test compares means between two groups?

Answer 20

t-test

Question 21

why is comparing post data often better?

Answer 21

-less measurement error (more noise, less reliable)
-regression to the mean for changing scores

Question 22

what is experimental research design

Answer 22

-participants are randomly assigned to at least two comparison groups

Question 23

what is quasi experimental

Answer 23

-no random assignment
-typically involve the use of cohort groups

Question 24

one group-

Answer 24

more than one assessment per partipant

Question 25

two or more groups

Answer 25

one assessment per participant

Question 26

what is posttest only randomized group (can be more than two groups)

Answer 26

control group can be a diff intervention or standard of care or simply compare w/o any intervention

Question 27

what is posttest only non randomized (can be more than 2 groups)

Answer 27

control group can be a diff intervention or standard of care or simply compare w/o any intervention

Question 28

what is measurement theory?

Answer 28

psychometrics -provides the foundation for evaluating tests, their uses and interpretation "how"

Question 29

what is a methodological study?

Answer 29

any research study that investigates the reliability and or validity of clinical and research measures "why"

Question 30

variables such as aggression, cognition, pain, self esteem, strength , coordination, etc must be specifically defined in research.

Answer 30

operational definition

Question 31

were is operational definition included?

Answer 31

manuscript

Question 32

amt of change in an instrument that is beyond error *outside of error range

Answer 32

MDC minimally detectable change

Question 33

MCID-minimal clinical important difference

Answer 33

amt of change in an instrument that results in a clincially relevant change in the pt Ex: TUG decrease in time >5 secs is important (meaningful) change to avg of pt diagnosed with MS!!

Question 35

accuracy of the degree of correspondance b/w the concept being measured and the variable used to represent the concept

Answer 35

validity

Question 36

inter tester

Answer 36

can different raters get the same score

Question 37

intra tester

Answer 37

can the same rater get the same score

Question 39

difference between reliability vs agreement?

Answer 39

reliability: if there are 2+ ratings... do they vary in a similar way? or ... can the raters distinguish pt in the same way? agreement: if there are 2+ ratings, do the scores agree? match exactly.

Question 40

parallel forms reliability

Answer 40

equivalent forms reliability -questions are divided into two equivalent sets. The two sets of questions are given to the same sample of people and the realiability bw the sets is calculated

Question 41

What form of reliability is SAT an example of

Answer 41

parallel forms reliability

Question 42

split half reliability

Answer 42

the questions are split into two sets.... and both sets are given to one group of individuals ex: create a depression questionnaire with 100 items... you would hope that someone with min depression would score low on both sets of questions

Question 43

what is face validity

Answer 43

does an instrument measure what it is suppose to measure based on simple observation?

Question 44

what is content validity

Answer 44

the systematic examination of an instrument to determine whether it covers entire domain to be measured

Question 45

an IQ questionnaire have items covering all areas of intelligence discussed in the scientific lit is an ex of what validity?

Answer 45

content validity

Question 46

what is criterion based validity?

Answer 46

degree to which the outcomes of one test correlate with the outcomes on a gold standard test ex; MRI vs clinical test to determine RCT

Question 47

what is concurrent validity?

Answer 47

the degree to which the outcomes of one test correlate with the outcomes on another test (either a criteron meausure or another similar test), when both tests are given at ~ same time

Question 48

you have a new self report tool to measure quality of sleep and another more established tool.....compare the two tools.... but neither are the gold standard

Answer 48

concurrent validity

Question 49

what is predictive validity?

Answer 49

can an instrument be used to predict some future performance/outcome

Question 51

what is construct validity?

Answer 51

the degree to which a theoretical construct is measured by an instrument. how many diff constructs are measured? are extra items needed?

Question 52

the extent to which signficant changes in the participants are relfected substantive changes in observed values

Answer 52

responsiveness to change

Question 53

what two effects limit responsiveness

Answer 53

floor effects and ceiling

Question 54

typically the more items or response choices... the more responsive

Answer 54

TRUE