Week 1 Flashcards
What is the “journal impact factor”?
An estimate of how many times you will be cited yearly after being published in a particular journal.
What is the “h-index”?
A RATIO of how many publications to how many times you’ve been cited.
What are the most difficult things to evaluate in the peer-review process?
Novelty & impact
What is the most critical part of peer review?
Evaluating the soundness of the science.
What is a problem with the peer review process and what does this problem lead to?
Personality and politics coming into play
- Politics might lead publications to be rejected unfairly
- Friendship leads to lower-quality papers being approved
What is the advantage of PLoS ONE and other open access journals?
People can comment on the impact a publication has had even years later.
What is the basic assumption of the Scientific Approach?
That events are governed by some lawful order (and that lawful order is what is generally being researched).
What was the problem with facilitated communication, and how did they finally disprove its efficacy?
The facilitators were biasing the responses, and the best way they finally disproved the usefulness was by using a machine as a facilitator (to remove all potential human bias).
What is the most critical factor in making research “scientific”?
Relying on EMPIRICAL evidence gathered thru the scientific method.
What is the name for “an organized system of assumptions that aims to explain phenomena and their interrelationships”?
A theory.
What is the name for “an attempt to predict or account for a set of phenomena, specific relationships among variables, and are empirically tested”?
A hypothesis.
What is required in an “operational definition”?
A definition of the term that specifies the operations for observing AND measuring the term in question.
What was the very important principle that Karl Popper established as a requirement for scientific theories?
The “Principle of Falsifiability”:
- Theories must make predictions that are specific enough that they CAN be disproved.
- Theories must predict what WILL happen, and what will NOT happen.
In scientific research, what is reliability? What is Validity? and which is a requirement for the other?
Reliability refers to the CONSISTENCY of a measurement.
Validity refers to the fact that the measure truly measures what it is supposed to.
Reliability is needed before validity, because first you need to make sure your measure repeatedly assesses the same thing –> THEN you need to make sure the thing being repeatedly measured is the RIGHT thing.
What exactly is the “correlation coefficient”?
A measure of how strongly two variables are related to one another - goes from -1 to 1.
What exactly is the “correlation of determination”?
An index of the predictive power of the correlation. A simple measure of “effect size”. It’s the square of the correlation coefficient.
What is the biggest pitfall of experimental studies?
There can be confounding variables that interfere with making valid conclusions from results.
What is “hindsight bias”?
The feeling that “I knew it all along!”
What is a way of preventing the placebo/nocebo effect aside from blinding?
Using a “switched-over” design where subjects receive the control AND experimental condition at different timepoints.
What is the “Hawthorne Effect”?
When subjects’ knowledge that they’re being studied affects their behavior.
If your sample isn’t representative of the population, is the validity of your study completely ruined?
Not completely - You can’t generalize with much certainty, but if the effect size is very large then it is a good indication that something is going on.
In a normal distribution, how far from the mean do most scores fall?
68% of scores will fall within plus or minus 1 standard deviation.
What do inferential statistics allow us to do?
Determine whether we can generalize from the study sample to the population.
What does “statistical significance” refer to?
The probability that the finding has occurred by chance (ex. p<0.05 means that the finding would occur by chance less than 5% of the time).