Neighbor hunting close(ish?)to house

Hi all, We own about 3 acres. About 1 acre of that is wooded and on the back of the property line. Our next door neighbor owns 40 acres behind us and in the last weeks has put up a hunting shack right on the edge of the property line and has been shooting a lot. Which, whatever, normally I wouldn’t care (and am glad for him to take out any deer that might have been the culprits behind my garden decimation.)

I do think this is far enough from our dwelling to be legal but over the summer I cleared a spot in the woods for my kids to camp/hang out in and it’s right next to that. Like you could throw a stone and hit his shack. We also have most of our outdoor activities close to that area. I dunno, it’s all pretty obvious stuff like their little tent/trampoline/swing-set.

I guess I’m just not thrilled about my kids being so close to this. He’s a nice neighbor and we’re on good terms but I’m nervous about asking him to potentially move his set up. I also don’t understand why he’d set up so close when there’s a ton more land he has access to. Or why if he wants to be close to home why he wouldn’t set up behind his own house.

Am I crazy to ask him to move? Or should I just let it be? And maybe just move our stuff to the other side of the house?