Cut caffeine two weeks ago to help nocturia frequent urination at night and still waking up at 4 am

I have a toddler and she's now 26 months and sleeping through the night almost every night now. I never drank coffee before having an infant but I started heavily drinking 2-3 cups a day when I went back to work off paternity leave. After a few months I started having horrible nightly bouts of nocturia waking me up having to get up 3-4 times per night.

I went to my urologist and they did all kinds of tests. Bladder scan, blood work, examined prostate, etc all came back normal they couldn't figure out anything wrong. Also went general practitioner to check pre diabetes they ruled that out stated I am not overweight and my blood sugar readings were normal.

Two weeks ago I cut caffeine and it has helped some I now only wake up once at 4 am. Quitting caffeine was not hard I just switched to Nespresso decaf. So I have my decaf coffee in the morning and then have water at lunch and dinner (before 7 pm).

But it's the 4 am wake that's still really hurting my sleep and mental health. When I get up to pee I have a very hard time falling back asleep.

Is it just going to take longer for the caffeine withdrawal? Or is it something else? Is my body just conditioned to wake up at 4 am since it was doing it every night while my daughter was an infant?