2: Exploratory Data Analysis: Single Variable Flashcards
cases
objects described by a set of data (companies, subjects, customers)
label
variable used in some data sets to distinguish different cases
variable
characteristic of a case
distribution
of a variable tells us what values it takes and how often it takes these values
distribution of categorical variable
lists the categories and gives either the count or the percent of cases who fall in each category
stemplot
steam and leaf plot. gives quick pic of distribution shape while includes actual numerical values in graph. separate each observation into a stem consisting of all but the final (rightmost) digit and a leaf – the final digit. write stems in vert. column with smallest at top and draw vert line at right. write each leaf in the row to the right of them stem, in increasing order out from the stem
histogram
breaks range of values of a variable into classes and displays only the count or percent of the observations that fall into each class. classes = equal width.
tails
extreme values of a distribution
modes
major peaks in a distribution
time plot
of a variable plots each observation against the time at which it was measured. time is on horiz.. scale of plot and variable measured is on vert. scale
mean vs. median
mean is average value.
(x1 + x2+ x3 + xn / n)
median is middle value.
(1) if number of observations is odd – medium’s LOCATION can be found by counting (n+1)/2 observations up from bottom of the list
(2) if even – median is the mean of the two center observations in the ordered list. location is (n+1)/2 observations up from bottom of the list
quartile
upper quartile = median of the upper half of the data. lower quartile = median of lower half of the data
pth percentile
the value that has p percent of the observations fall at or below it
five number summary
set of observations consists of the smallest observation, the first quartile, the median, the third quartile, the largest observation - from small to big.
Min Q1 M Q3 Max
boxplot
graph of five-number summary
interquartile range IQR
distance b/w first and third quartiles. IQR = Q3-Q1
1.5 X IQR rule for outliers
observation = outlier if it falls MORE than 1.5 X IQR above third quartile or below first quartile
standard deviation
measures spread by looking at how far the observations are from their mean.
variance
s^2 of a set of observation is the average of the squares of the deviations from their mean. OR, the average of the squared differences from the mean.
(1) Work out the Mean (the simple average of the numbers)
(2) Then for each number: subtract the Mean and square the result (the squared difference).
(3) Then work out the average of those squared differences
standard deviation
= square root of the variance
degrees of freedom
the number n-1 is called the degrees of freedom of the variance or standard deviation
properties of standard deviation
(1) s measures spread about the mean and should be used only when the mean is chosen as the measure of center
(2) s = 0 only when there is no spread. this happens only when all observations have the same value. Otherwise, s > 0. As the observations become more spread out about their mean, s gets larger
(3) s, like the mean, is not resistant. a few outliers can make s very large.
Which is better for describing a skewed distribution or a distribution with strong outliers: five number summary, mean, or std deviation?
five number summary
linear transformation
changes the original variable x into the new variable xnew given by this equation:
xnew = a + bx
they don’t change the shape of the distribution
