Baby wearing in winter

I’ll be travelling to Melbourne this winter where it’s generally around 5-15 degrees Celsius during the day, windy and rainy. How does one babywear in the cold? Do you just tuck blankets around them?? How do I dress the baby?

I have a caboo carrier and and baby bjorn one air. Also have woven wrap as an option but I don’t like how long it takes me to do up haha