Controller battery draining much faster than before

Just as the title says, my series x controller used to run fine but recently it has been draining insanely fast. I use rechargable batteries but in that controller they last maybe an hour fully charged and the same with AA batteries. Using another controller the batteries are fine, anyone know what I can do to stop the drain on my controller?