Controller battery casing little lose, causing control it lose power

Is there a easy fix for this?
The control randomly shuts off, new batteries, and opened and cleaned it up, it's in perfect order.
Noticed tonight that if i bang the control or more interestingly hold the battery casing towards the controller and down, I feel like the batteries are getting a lose connection from the casing not holding them solid in place.

Is there a fix for this? Is it common?
Want to avoid taping it, is there a hack for this problem people have discovered over the years?

Thank you.