Sorcery buffing items

I’m currently mid-game, 51 Int, and using a combination of scar seal, stargazer heirloom, and/or the queen’s crescent crown or one of the glinstone crown to get to 60 int so I can use the carian regal scepter and comet azure. As I continue to level int, which items should I discard first? I know there are penalties for using the scar seal and glinstone crowns. Which is worse?