Learn / Biostatistics / Correlation and linear regression
Multiple regression: adjusting for several variables
14 minute read · 6-question quiz
What you will learn
Interpret coefficients in a model with several predictors, including binary and categorical ones
Explain how adjustment changes an estimate and how to decide which variables to include
Recognise overfitting, multicollinearity and the importance of model checking
Real outcomes depend on many things at once. Multiple linear regression extends the model:
Y = β_0 + β_1 X_1 + β_2 X_2 + … + β_k X_k + ε
Each coefficient β_j is the expected change in Y for a one-unit increase in X_j, holding all the other predictors constant. That 'holding constant' is what lets us adjust for confounders.
Predictor types
- Continuous (age): coefficient per unit.
- Binary (sex, coded 0/1): the coefficient is the difference between the groups at the same values of other variables.
- Categorical with k levels (district): create k − 1 dummy variables against a reference level; each coefficient is the difference from the reference.
Choosing variables
- Confounders: include variables related to both exposure and outcome, chosen from subject knowledge and a causal diagram (see chapter 5), not from p-values.
- Do not add everything. Variables that lie on the causal path (mediators) or are consequences of the outcome bias the estimate.
- Stepwise selection (automatically adding or dropping variables by p-value) produces optimistic, unreliable models and is discouraged for explanatory work.
- Events-per-variable: in regression, avoid more than roughly one predictor per 10 to 15 participants (for continuous outcomes) to prevent overfitting, where the model describes noise and fails on new data.
Problems to watch for
- Multicollinearity: predictors that are strongly correlated with each other (weight and BMI, or systolic and mean arterial pressure) give unstable coefficients with huge SEs. Check variance inflation factors (VIF > 5 to 10 is a warning), and keep one of the pair.
- Interaction: the effect of one predictor depends on another. Add a product term (age × sex) and test it.
- Influential points: a few observations pulling the line (check Cook's distance).
- Missing data: most software drops any person with a missing value in any variable (complete-case analysis). If many are dropped, bias and loss of power result; consider multiple imputation (chapter 10).
Summary
Each coefficient is the change in Y per unit of that X holding other variables fixed.
Dummy variables handle categorical predictors against a reference level.
Compare crude and adjusted coefficients to see confounding.
Choose variables by causal reasoning, not automatic p-value selection; limit the number of predictors.
Watch multicollinearity, interactions, influential points and missing data.
Check your understanding
Draft study guide. Spotted an error or something unclear? Tell us at hello@scintria.com. This is educational material, not clinical or regulatory advice.