Can you enjoy Matcha like Regular Tea?

I've decided to buy matcha and give it a go but all I'm seeing online is 'Matcha Latte' recipes and also 'make sure you don't use boiling water'.

Is Matcha not meant to be enjoyed like a warm cup of tea? I.e. Just Matcha and water... no milk.

I want to enjoy Matcha like a hot cup of tea/coffee.

Let me know if I got it all wrong or if it is possible :D

Thanks