T3 Slide W5 Flashcards

Question

Types of Reliability - Parallel Forms

Answer 1

* Different forms of the same test given to the same group of participants * You might see this in a practice effects test

Answer 2

* Evidence of reliability when multiple raters agree in their observations of the same thing * Rater to Rater, rather than time to time eg: observational research

Answer 3

* Uses responses at only one time * Focusses on consistency of items

Answer 4

* Test-Retest * Parallel Forms * Interrater * Internal Consistency

Answer 5

* Our measues should be reliable and valid * Validity refers to the results of the test * It is never all or nothing * Validity of the results interpreted in teh context where the test occurs * Are the results understood within the context of the purpose of research?

Answer 6

* Face Validity * Content Validity * Criterion-related Validity * Construct Validity

Answer 7

* Extent to which items on a test appear to measure the construct * Does it look like the items are asking relevant questions * Will the test taker understand what is being measured

Answer 8

* The content of the measure compares with the universe of content that defines the construct * are the items a representative sample of all possible items

Answer 9

* A score indicates the level of performance on an external criterion against which it is compared. * A measure of the extent to which a test is related to a criteria * Two Types of Criterion Validity. * Predictive - the future * Concurrent - the present eg: GPA predictive validity for performance in Honours? - Beware the importance of identifying the criterion

Answer 10

* An assessment corresponds to other variables , as predicted by some rationale or theory. * Links the practical components of a test score to some underlying theory or model of behaviour * Firstly, similar to criterion validity, you will look for correlations between your newly developed test and test already shown to tap the target construct

Answer 11

* If a measure has convergent validity, it should correlate with questionairres that measure: * The same construct * Related Constructs * eg: Beck Depression Inventory II positivley associated with Hamilton Depression scale * If a measure has discriminant validity it should not correlate questionairre that measure * Different Constructs * Unrelated Constructs

Answer 12

Reliability is a necessary but not sufficient condition of validity.

Answer 13

* Mental Measurements Yearbook * Tests in Print * Buros Institute of Mental Measurements - http://www.unl.edu/buros/ * Test Link – ETS Test Collection - http://www.ets.org/testcoll/index.html * APA - http://www.apa.org/science/testing.html) * PsycINFO * Test manuals

Answer 14

# * Choose a research question and decide how to test it * Decide who you will ask to participate in your research * Vital Stage of researh development * Who should I study eg: I want to look at attitudes toward taking drugs in sport * Success of your research hinges on the way in which you select participants.

Answer 15

* Population = the collection of units to which we want to generalise our research findings. * Populations can be large or narrow * Generally, researchers aim to infer about general populations * rare to access all members * Data collected from a subset of the population is the Sample

Answer 16

* A smaller collection of observations from a population that are used to infer characteristics about the population * The bigger the sample the more likely it is an accurate reflection of the population * Results vary slightly from sample to sample but tend to average out as similar * Results have meaning when they can be generalised from sample to population

Answer 17

1. Probability Sampling 2. Non Probability Sampling

Answer 18

* The likelihood of any one member of population being selected is known eg: If 4,000 students are at ACAP and 20 of them are in the Psychology Honours year, then the odds of selecting one Honours student as part of a sample is 20/4,000 → 0.005

Answer 19

* The likelihood of selecting any one member from the population is not known * If I don't know how many Psychology Honours students are at ACAP, then likelihood of one being selected cannot be computed

Answer 20

1. Simple Random Sampling 2. Sustematic Sampling 3. Stratified Sampling 4. Cluster Sampling

Answer 21

* Each member of the popluation has an equal chance of being selected to be part of the sample * Equal - No bias that one individual will be chosen over another * Independent - The choice of one individual does not create bias the reasearch nor is there bias in choosing another participant

Answer 22

1. Definition of the population 2. List all members of that population 3. Assign numbers to each members of the population 4. Use of criterion to select sample that is wanted

Answer 23

* Every kth name on the list is chosen * where k = any number 0 and the size of the sample to be selected 0 and the size of the sample to be selected. * Easier than random sampling * However * less precise * violates the assumption that each unit has equal chance of being selected Procedure: * We want a random sample of 8 names–Divide size of population by size of desired sample → 32 / 8 = 4 * 4 is the size of the step we want. * Select one name from the list at random, and use this as your starting point (again, use table of random numbers) * Then select every 4th name until a sample of 8 has been achieved

Answer 24

* Individuals in sample are **_NOT_** equal and * these unequal characheristics are related to what is being studied in the research * Can be done through SPSS * Ensures profile of sample matches the population * layers (or Strata) are fairly represented in the sample

Answer 25

* All males and females are listed separately * Each member of each group receives a number * From a table of random numbers, four males are selected at random from the list of 13 using the procedure outlined for simple random sampling * From a table of random numbers, six females are selected at random from the list of 22 using the procedure outlined for simple random sampling

Answer 26

* Probability of selecting a single individual or unit is not known * Impedes ability to generalise results obtained from sample to the larger population * TWO primary types: * Convenience * Quota

Answer 27

* Uses a captive audience, * i.e., much psychology research uses first year university students who must participate for credit •THEREFORE: * Sample is convenient, but not random * Sears (1986) cautions a “A narrow database…”

Answer 28

* Used where research requires stratified sample but proportional stratified sampling is not possible * Selects individuals with characteristics desirable for the research but does not randomly select from the population a subset of all individuals * Researcher continues to enlist participants in each strata until quota for research is achieved * Easier than stratified sampling * Less precise than stratified sampling * Limits ability to generalise to population of interest

Answer 29

* You want to have a sample representative of the population; less representative more error, and the less precise your test of the null hypothesis * Sample size also has implications to the power of your test; its sensitivity in detecting a significant result….