No https, will my VPN still protect me?

I recently went to a website that I use to visit all the time. Years later I noticed that the website tells me / gives a warning that it doesn't have https anymore.

Someone told me that I can use my VPN but it will only protect me / info / identify from

My device to the VPN servers, but will give me no protection from the host website back to the VPN.

But I have also heard other say that a VPN will protect me / my identity no matter what way the information is sent.

Which is correct?

If the website doesn't use a https for protection will my VPN still protect me ?