Skip to content
Statistical RethinkingStatistical Rethinking

10.4 Summary

Chapter 10 in review

Chapter 10 applied GLMs to count data — binary outcomes, count outcomes, and the extensions needed when real data violate the standard assumptions.

We covered:

  1. Binomial regression (Section 10.1): Logit link for binary and aggregated binomial outcomes. Coefficients are log-odds; interpret on the probability scale.

  2. Poisson regression (Section 10.2): Log link for count outcomes. Use offsets for varying exposure. Always check for overdispersion (variance > mean).

  3. Other count regressions (Section 10.3): Negative binomial for overdispersion, zero-inflated Poisson for excess zeros, hurdle models for two-stage processes. Choose based on the data-generating process.

Key formulas

  • Logit link: log⁡pi1−pi=α+βxi\log\frac{p_i}{1-p_i} = \alpha + \beta x_i
  • Log link: log⁡(λi)=α+βxi\log(\lambda_i) = \alpha + \beta x_i
  • Offset: log⁡(λi)=log⁡(exposurei)+α+βxi\log(\lambda_i) = \log(\text{exposure}_i) + \alpha + \beta x_i
  • Negative binomial variance: Var(yi)=λi+λi2/ϕ\text{Var}(y_i) = \lambda_i + \lambda_i^2 / \phi
  • ZIP: P(y=0)=π+(1−π)e−λP(y=0) = \pi + (1-\pi)e^{-\lambda}

Key lessons

  • The likelihood must match the data-generating process, or the model will mislead.
  • Overdispersion is the rule, not the exception — always check.
  • Interpret coefficients on the natural scale (probabilities, counts), not the link scale.
  • Use posterior predictive checks to verify the model reproduces key features.
  • Choose among Poisson, NB, ZIP, and hurdle based on theory, not just fit.
Rethinking

The likelihood is the model. In Chapter 10, the choice of likelihood — binomial, Poisson, negative binomial, ZIP, hurdle — is the choice of model. Each likelihood encodes different assumptions about the data-generating process. The linear predictor and link function are the same; the likelihood is what changes. This is the power of the GLM framework: it separates the structural model (linear predictor + link) from the stochastic model (likelihood), allowing us to choose each independently. But this power comes with responsibility: the likelihood must match the data. If it does not, no amount of clever coding will save the model.