Biostatistics (Correlation and Regression)
Biostatistics (Correlation and Regression)
( xi x )( yi y )
r
(( xi x ) 2 )(( yi y ) 2 )
Additional points
Low correlation does not necessarily mean a low
degree of association (relationship may be non-
linear).
Method comparison studies.
Causal effects.
Problem
If the correlation between body weight and annual
income were high and positive, we would conclude
that…
(a) High incomes cause people to eat more food
(b) Low incomes cause people to eat less food
(c) High income people tend to spend a greater
proportion of their income on food than low
income people, on average
(d) High income people tend to be heavier than low
income people, on average
(e) High incomes cause people to gain weight
Hypothesis Testing
The linear relationship between two variables is
significant if there is evidence to suggest that r is
significantly different from zero.
Null hypothesis: r=0
Alternative hypothesis: r≠0
Observed value of r has an associated p-value.
Conclusion: if p<0.05, reject the null hypothesis and
conclude that there is evidence to suggest that there
is a linear relationship.
Summary
Correlation () is a measure of the linear relationship
between two variables.
It gives an actual measure of the strength of the
linear relationship seen in a scatter plot.
Values range from –1 to +1
The closer r is to ±1, the stronger the linear
relationship.
Note: high correlation does not indicate a causal
effect!
Correlation is not an appropriate measure for testing
the equivalence of two methods.
Correlation vs. Regression
Regression
Develop an equation to predict the dependent variable
from knowledge of predictor variable(s).
Linear regression fits a straight line to the data.
General equation of a straight line …
y a bx
Where a is the intercept and b is the slope, or gradient,
of the line.
Fit this line by eye – subjective.
Method of least squares.
Growth of a Foetus
Practical Example
Practical Example
Data from a study of foetal development.
Date of conception (and hence age) of the foetus is
known accurately.
Height of the foetus (excluding the legs) is known
from ultrasound scan.
Age and length of the foetus are clearly related.
Aim is to model the length and age data and use this
to assess whether a foetus of known age is growing
at an appropriate rate.
Graphical Assessment of Data
Linear Regression Model
From the plot it would appear that age and length are
strongly related, possibly in a linear way.
A straight line can be expressed mathematically in
the form
y a bx
Where b is the slope, or gradient of the line, and a is
the intercept of the line with the y-axis.
Modelling a Straight Line
y
y=a+bx
b
a 1 unit
x
Fitting a Regression Line
If the data lay on a straight line and there was no
random variation about that line, it would be simple to
draw an approximate straight line on the scatter-plot.
This is not the case with real data.
For a given value of the explanatory variable there
will be a range of observed values for the response
variable.
Different assessors would estimate different
regression lines.
In order to have objective results, it is necessary to
define some criteria in order to produce the ‘best
fitting straight line’ for a given set of data.
Method of Least Squares
Define the position of the line which, on average, has
all the points as close to it as possible.
The method of least squares finds the straight line
which minimises the sum of the squared vertical
deviations from the fitted line.
The best fitting line is called the least squares linear
regression line.
The vertical distances between each point and the
fitted line are called the residuals and are used in
estimating the variability about the fitted line.
Least Squares Line
y
y=a+bx
ei
a
x
Parameter Estimates
The least squares estimates of a and b are obtained
by choosing the values which minimise the sum of
squared deviations ei
The sum of squared deviations is given by …
n n 2
S ei2 yi (a bxi )
i 1 i 1