Exterior panel material?

I need to install an exhaust fan in a window opening. (I can't cut a hole in the wall). Can anyone recommend a material that will hold up to rain / the weather and is durable so it can't simply be pushed in. (As rugged as possible is ideal).

The opening is ~20" x 48".

I'm thinking that some sort of cement siding panel might work?