Need help finding this manga

I'm, trying to find this manga about a guy who gets isekai’d and becomes a sword master’s apprentice or something. His sister, the main heroine, also serves as a royal handmaiden. While he tries to live a peaceful, ordinary life, he keeps getting entangled with 4 of king’s concubines—who unexpectedly start falling for him.