Everyone is harassing me about homeschooling. Need support please.

Literally people I don't even know have been harassing me about how come my my daughter isn't in school yet since she was barely 2 years old. I have never told anyone that I'm going to homeschool and yet I'm getting harassed about my daughter who's only 3-1/2 now. From her pediatrician to literally neighbors and acquaintances. How am I going to deal with this when she's older and people see me on a weekday during school hours and realize that she's not in school. What do I say or do please? I'm extremely sensitive and feel very threatened in these types of situations. I don't want to give a snide response. My plan has been to say "oh she is in school. today she had an appointment." Because i will have her in some group afterschool activities or a dropin 1dy/wk. but what if bluffing doesn't work? Thank you (dictated; please excuse typos.)