Reducing estrogen to reduce chest fat?

40, male here.

As far as I can tell from touching my chest, I do not feel any hard tissue behind my nipples. If this is correct then my gynecomastia (grade 2) is mostly fat.

I read that estrogen puts fat in the chest, and I have high estrogen - 39 units when the lab's normal is 10-30.

I've had grade 1 gynecomastia since I was 8 or so, and about 3 years ago I gained about 5 kg weight which made my gynec look grade 2. I haven't been able to lose this weight for certain reasons. With grade 1 I didn't really feel uncomfortable.

If I work on reducing my estrogen, will my gynecomastia reduce or go away, if it is only fat - and estrogen apparently is responsible for depositing fat in the chest?