← Tags

Machine Learning

Mathematics Machine learning

[Across fields] Why is the exponential family important in statistics and machine learning? (Rewritten from an earlier blog post)

Derive statistical and machine-learning calculations from the common exponential-family form. Use Bernoulli, Poisson, and normal distributions to connect log-partition derivatives, sufficient statistics, and maximum likelihood. Compute beta-prior updates and logistic regression in Python, and distinguish convexity of the loss from the existence of a finite estimate.

Mathematics Physics and quantum computing

[Across fields] What does least squares do in physics, statistics, and machine learning? (Rewritten from an earlier blog post)

Derive the normal equations shared by least-squares methods and compare their roles in physics, statistics, and machine learning. Estimate a spring constant from artificial measurements, examine precision-weighted estimation and maximum likelihood with normal errors, then use Python polynomial regression to choose Ridge regularization on validation data and evaluate predictions on unseen data.