My cat hasn't pooped since Saturday

My 6 year old cat has been dealing with gastrointeritis and had his last bowel movement on Saturday. He is still eating, drinking and moving around but still hasn't pooped. The Er vet said it could be 3-5 days but we're on day 4 and it's getting worrying. I feel like I should take him back and see if things are moving.