I, 22F and my boyfriend 23M, seem to have a lot of differences, is it a good enough reason to call it off even if we love eachother a lot?

hi, im 22F and dating this guy 23M

im an ex-muslim, now athiest (no hate to islam or any religion, it's just not for me). and he's a god fearing, believing jain. we have a lot in common, we love art, music, architecture, film, novels and sm more. but we differ a lot too for example

i love drinking, partying, socialising-he hates it

he loves temples, prayers-i hate it

he won't even touch non vegeterian food-my meal is incomplete without it

i wanna fuck- he wants to wait to get married idk if i even wanna get married

it feels like he is just adjusting to me i don't want that i want to be someone he doesn't wanna change someone he thinks is perfect

he thinks our differences aren't that big, i think they are. we once went to a temple together and i quickly realised it was not for me at all.

i don't wanna leave i love him really, we've been friends since we were 5.

but i should leave like better sooner than later?