Thoughts on those "vegan but [non-vegan food]" people?

I've seen some posts of people suggesting that if someone says something like "I'd be vegan but for bacon" then they should be vegan but with bacon, so cutting out all non-vegan foods but bacon. Or whatever other non-vegan food they don't want to give up. And I was just wondering what y'all's thoughts are on this.