Will I ever get used to the size difference?

I'm in my Mid 20s, this is my 3rd partner (late 20s) and we have been active for just over 2 months. He's noticeably smaller than my ex and my toys. I don't know his size but my ex was big and so naturally I bought big toys. It's not that I can't finish and everything else is nice and he is so considerate but right now I just really prefer to finish with my toys. I am completely over my ex but I had spent months alone and I just got used to the size. Does anyone else have this issue? Is it too soon in the relationship to bring in a toy? Will it hurt his feelings? Do you ever really get used to it?