Would I be rude I told him no because we both decided to let him choose?

My husband and I had a boy two years ago and we spoke about him deciding when he is older to decide what religion he is going to choose now all of a sudden my husband wants to baptise him without speaking to me what do I do?