New User- day 3. Crazy headaches?

Just started wearing contacts about 3 days ago. First time with contacts and I have had glasses for about 15 years. I have astigmatism and I got fitted with the acuvue oaysis for astigmatism (2 week ones). I've been wearing them about 6 hours a day. They're pretty ok now wearing them but when I take them out and put my glasses on I am getting intense headaches behind my eyes, in my forehead and temples. Is this normal and will it subside? It's so bad- been lasting all day :/ prescriptions are pretty similar and I don't notice a difference there.