I have a domain and a host, now I need to make a simple webpage just establishing my company's presence on the internet. Do I need/can I use WordPress?

I've already logged into the back-end of my page and as I set it up via WordPress it's all about themes. I don't want a theme, I want basic HTML that says "X Company was established on x date to do x, y, and z. More information will come soon" or something like that.

I can figure out HTML code but I just don't know how to get rid of the theme and/or where to enter my HTML code.

Can someone help?