← Tags

Poisson Regression

Mathematics Machine learning

[Generalized linear models] Deriving GLMs from the exponential family (Rewritten from an earlier blog post)

Derive generalized linear models (GLMs) from the exponential family. Differentiate the normalization condition to obtain means and variances, and compare normal, Bernoulli, and Poisson distributions. Derive iteratively reweighted least squares (IRLS) from maximum likelihood with a canonical link, implement Poisson regression on artificial data in Python, and check the result against SciPy optimization.