We're having a heat wave...
I work at [NGO]. Because of the global nature of our operation, the weeks between Christmas and New Years are a paid holiday for all - it lets EVERYONE go home, recover, and thoroughly enjoy their family time.
Monday of the new year is kind of a rush as everyone spins back up from the holidays. In IT, we're checking to ensure everything really is working as advertised.
Tuesday, I head for the server room to pull a bad drive from a system - second one in a server from a new lot of drives. Hit the RFID pad, open the door - and stagger back two steps as I'm hit with a blast of HEAT.
Poke my head back in once I recover from my BSOD to realize, no there's no smoke to accompany it. Look at the three thermostats (one for each AC unit) - the lowest reads 99.8F, the highest 103.4F.
Well, crap.
I call my boss (who's on a coffee run and not answering) and start blatantly stealing every fan from every desk, conference room, and open area to move air into the room.
Once it's down to 90F I venture in to see what's damaged - all the Cisco gear is flashing its I'M MELTING lights. About half of the ancient kit is too, if it has that functionality.
My ears pick up a change in sound among the white noise. The main - nee, only - server everyone uses for file storage goes quiet.
Oh, &*^(%^&%$!
I see this as the beginnings of a beautiful cascade of failure. Through the magic of angling file cabinets, using fans to create Hot an Hotter aisles, and powering down dev/test equipment, we get the place to a somewhat reasonable 86 degrees. The fileserver springs to life on its own thanks to its thermal shutdown sensors paying attention.
Facilities is called. AC techs will be out tomorrow.
In the meantime, an ancient and potnetially noit working floor AC unit is put into service, finally dropping the room to an acceptable 72F while taking up a hallway because the server room was built like a hotbox and air dumped into the pluenum space above can't escape.
Final analysis: The heat and cold cycles of weather killed the condensor unit on one AC unit, the other froze up because they were too cheap to put a heater on the condensing unit from the get go. Three weeks to get it all repaired.
Posted Apr 13, 2016, 7:12 PM UTC