Eye of Cuthulu won't leave me alone, I've killed him 5 times, this is getting ridiculous.

Title. Playing skyblock on expert mode, and eye of cuthulu keeps naturally spawning, regardless if i kill it. What's the deal? some weird bug?? Anyone else experienced this?