is it ok to question sexuality while in relationship??

ive been with my partner and i am extremely loyal however part of me has been wondering if i might also swing both ways. however i feel extremely guilty thinking about this because then that by default means ive been thinking about other people????? am i terrible for pondering my sexuality in a relationship, i dont want to be with anyone else but i think my attraction goes both ways but then that means ive been paying attention to others.... which then makes me a terrible partner :( is it okay to question that?