Ebf question

FTM - EBF 5 week old. If he goes longer than 3 hr stretch napping during the day or at night, should I be pumping or if he only wants one side ? I feel my supply regulating as I don’t get engorged like I used to and breast are softer. Have anxiety that I will impact my supply.