New video card installed, now I have an extremely high pitched sequel coming from my PC.

As the title says I bought and installed a new Nvidia GTX 460 from evga. When I went to install the card I noticed my case was a little dusty so I pulled all the parts and fans and cleaned everything before even starting the computer with the new card.

I now have an extremely clean case with a new graphics card (thanks a lot Fallout New Vegas!) but now it has a very high pitched noise blasting out that sounds 'electronic', kinda like when you turned on an old tube TV. I don't think its a fan because when I start to play games the noise pitch drops and I can hardly hear it and as soon as I exit it raises back up to the nosebleed inducing pitch level.

I tried to pop the side of the case off and determine exactly what component it was coming from but I really can't seem to nail it down. It could be the power supply or the videocard but its pretty much impossible to tell.

Anyone have any ideas on how to fix this? I'm about to install the nvidia overclocking utility and mess with that to see if anything changes, will report back.

**UPDATE:

Ok, I had to leave for a few minutes, when I came back my computer had put the display to sleep. The noise was a lot quieter but still there. I put my ear up to the card and I'm now certain its coming directly from the it. I stopped the fan from spinning on it with my finger (only for a second!) and it does not stop the noise at all. After moving the mouse to wake the monitor it came right back to 'nails on a chalkboard' annoying levels. I think an RMA is in order.

Thanks everyone!