Variable Selection LASSO vs Stepwise
I have a dataset with a rare binary outcome of 500 out of 20,000. We want to create a predictive model for this outcome. Using a logistic regression with LASSO selection optimizing for BIC spits out no predictors, while a traditional stepwise selection optimizing for BIC as well gives us a handful of predictors.
I'm looking for some intuition as to why this is happening. I can only assume it has to do with case imbalance?
Posted Aug 30, 2024, 6:15 PM UTC
30