Need to wean off of my medication

Would love some advice here. I’m going to call my doctor about weaning off of Topiramate on Tuesday. I started taking it about 2-3 months ago. I was taking 25mg at night at it was great for the first two weeks than I forgot to take my medication for two days and I had the worse migraines I ever had in my life for about week after. I called my doctor about it and they explained that I was actually supposed to increase to 25mg twice a day. It helped a bit but it never got back to how it was those first two weeks. I called them again and they increased my dose to 50mg twice a day now my sensitivity is so bad that I cannot even watch videos I’ve been to urgent care twice and to the hospital last week and I’m having panic attacks because almost as soon as one migraine ends I start to feel the warning signs of another migraine. Sometimes it does work but when it doesn’t it really doesn’t and I’m just done with the whole thing. I already scheduled an appointment with a neurologist for December and I’m going to call them about weaning off the medication but is there anyone else who weaned off this thing that can tell me what helped them.