[Question] Techniques of resampling does not make sense to me.
I am studying about a bunch of resampling methods such as jackknife, bootstraping, etc.
What I don't understand is how resampling makes sense in a high level perspective.
From my understanding, since resampling uses a subset of the sample, it essentially throws out some of the information, therefore any interesting statistical measures estimated through this method should have its quality degraded.
I'm sure there are explanations with calculations but I would like to know if there are any intuition level explanations on it.
Posted Oct 15, 2020, 12:44 AM UTC
The analogy is that population is to sample as sample is to subsample. If the DGP is such that your parameter estimate is biased in a certain way, you expect the same type of bias to show up when you resample. So we can use the latter relationship -- which we fully observe -- to learn about the former.
You're not tossing out information in that you resample many times. In a sense, resampling uses more information: you're using the empirical CDF to approximate the true CDF, rather than just looking at some set of parameters.