Unsure about room temp safety

Today is my second day back at work and when I got home and put some of my pumped milk in a bottle for tomorrow and some in a bag I ended up leaving the bag on the counter for three hours </3. Does the four hour safety rule apply to already refrigerated milk? Or is it bath milk now?