Accused of being high at work

throwaway! this happened about a week ago, and the night before the incident i was having a rough night due to some personal things in my family and was up until about 5am crying pretty consistently. i didn’t have work until after 3pm the next day so i did get a bit of sleep, but im sure i did look a bit rough (i didn’t think i looked too bad, and got ready like i usually do lol?) i considered calling off but it was pretty late notice and i figured id be fine once i was up and moving. when i got to the families house, the dad asked if i had just woken up, i very casually mentioned i didn’t get great sleep the night before but thought that was the end of it. the rest of the day went by normal until it was time for me to leave. he walked me out and asked to talk to me and said him and his wife “noticed i looked high coming into work.” i was pretty taken aback as i havent done anything like that in a very long while, and would never smoke or come into work in the middle of the week under the influence of anything. i told him i was not high, but it seemed pretty clear he didn’t believe me and left it at “this can never happen again” im pretty hurt honestly. ive worked for them for just over a year now and thought we got along pretty well. not sure if i should just leave it alone or say anything else