Mathematics Physics and quantum computing
[Across fields] What does least squares do in physics, statistics, and machine learning? (Rewritten from an earlier blog post)
Derive the normal equations shared by least-squares methods and compare their roles in physics, statistics, and machine learning. Estimate a spring constant from artificial measurements, examine precision-weighted estimation and maximum likelihood with normal errors, then use Python polynomial regression to choose Ridge regularization on validation data and evaluate predictions on unseen data.
