Best way to expand an empire by war?

So I've been playing a lot of Stellaris recently and I'm having trouble expanding out after my initial five planets. I know I can just continue and create sectors but I've always been a fan of taking down my neighbors and stealing their land. I always run into faction trouble, and if I purge then I end up loosing all of the land. How do you guys usually go about this?