Is there a way to stop other factions from patrolling your systems?

I just started playing about 2 weeks ago, its mainly vanilla with QOL mods. I wanted to have a vanilla playthrough before adding a bunch of other mods.

I have a system that is constantly being hounded by hegemony inspectors and persean enforcers and commerce raiders. There are 2 planets that are level 5 and have fully upgraded defensive structures and I have a high command on one.

I have a few patrol fleets but the hostile fleets aren't "openly hostile" and mainly there disrupting trade. The other thing is that these fleets are all massive with 2-3 capitals, a bunch of cruisers/carriers and a host of destroyers/frigates.

I've destroyed a bunch of these fleets already like 15-20 and they just keep coming. Is there anything else I can do to keep them out aside from babysitting the jump point?

Theres no "active crisis" or anything either. Its just bothering the hell outta me that the NPCs are just sending infinite fleets to harass my colonies and I never feel like I have space to leave and do bounties or explore. Ive pretty much been baby sitting my colonies since I founded them.