Losing chest fat

I've been searching a lot about this online, but I'm not sure I've come to the right conclusion. So some people say that If you have a bit of man boobs, it's better to work only the upper chest (which is what I did until now). This way, the chest kinda gets a bulky look and it doesn't look like hanging monkey boobs. I was convinced if I worked the lower chest, my chest would become even more women-like. So, what to believe? Am I doing it right?