Lecture: Smoothing Methods in Regression (Advanced Data Analysis from an Elementary Point of View)

February 7, 2013
By

(This article was originally published at Three-Toed Sloth , and syndicated at StatsBlogs.)

Lecture 4: The bias-variance trade-off tells us how much we should smooth. Some heuristic calculations with Taylor expansions for general linear smoothers. Adapting to unknown roughness with cross-validation; detailed examples. How quickly does kernel smoothing converge on the truth? Using kernel regression with multiple inputs. Using smoothing to automatically discover interactions. Plots to help interpret multivariate smoothing results. Average predictive comparisons.

Reading: Notes, chapter 4 (R)
Optional readings: Faraway, section 11.1; Hayfield and Racine, "Nonparametric Econometrics: The np Package"; Gelman and Pardoe, "Average Predictive Comparisons for Models with Nonlinearity, Interactions, and Variance Components" [PDF]

Advanced Data Analysis from an Elementary Point of View



Please comment on the article here: Three-Toed Sloth


Subscribe

Email:

  Subscribe