Lifting restrictions after colonoscopy?

I had a colonoscopy 2 days ago (on Thursday) and had 4 polyps removed. 3 were precancerous and the largest was 8mm. When I asked my doctor about when I could return to working out (specifically lifting), he told me the next day. This seems odd based off what I’ve read and I am nervous of a delayed GI bleed. Curious what others have been told by their GI after a polypectomy?