AITA for telling my colleague to stop interfering with my life?

i'm 37f and work at a school. about a month ago, a new teacher 32m joined my department. we often share free periods and have gotten to know each other. After a late staff meeting, we went to a 24-hour burger place. we were getting along well, and I opened up about my mum’s mental health and my role caring for her and my brother growing up. he was kind and supportive. despite knowing i was oversharing abit too much. the following monday, he me asked if I was okay, I said I was just tired because i had a hectic weekend with my mum. after school he invited me to the burger place again, but I declined. i drove home after stopping at an off licence first. when i got home, i lay on the couch, i knew i had assignments to finish marking, so i had a swig from my bottle as it helps me focus. about 15 minutes later, i heard a knock at my door. i never gave him my address, so I was confused. he admitted he followed me after school as he was worried about me, he saw me buy a bottle, and waited outside my house before deciding to check in. i was stunned. i've struggled with alcohol in the past and went to rehab in my 20s this is something the school knows but I’ve never discussed with him,and its classified. i care deeply about my job and students and would never drink at school. while I understand concern, following me home and confronting me like that feels like a huge violation of my privacy.im still trying to process and still don't understand how he even found out