Dating short man 5.6 ....

I was dating a guy he was totally loyal really nice cute... and really calm but I wasn't sure about him coz of his height...im myself not talk im 5.3 only but that's the problem i was im always been insecure about my height so I always dated a taller guys ... but its seem really unworthy I mean it should be matter ... but I always think about my future what if because of our height our children will be short and I don't want that insecurities for them. ... idk what to do ...