Variable Selection LASSO vs Stepwise

I have a dataset with a rare binary outcome of 500 out of 20,000. We want to create a predictive model for this outcome. Using a logistic regression with LASSO selection optimizing for BIC spits out no predictors, while a traditional stepwise selection optimizing for BIC as well gives us a handful of predictors.

I'm looking for some intuition as to why this is happening. I can only assume it has to do with case imbalance?

Posted Aug 30, 2024, 6:15 PM UTC

30

Comments aren't archived yet

Comments for this period haven't been loaded into the archive yet.