Help with night wakings

My son is 5 months 1 week. He constantly wakes up in the middle of the night and will not chill out unless I pick him up and nurse him or rock him to sleep. We follow an age appropriate schedule 2/2.5/2.5/2.75 and have had the same bedtime routine since he was born basically. I always feed 30 mins before bed time. He falls asleep independently in his crib with a pacifier between 7:30-8pm with a morning wake up of 7:00am. The problem is he wakes up every 1.5-2 hours nightly. Should I ditch the pacifier? Do you let them cry when they wake up like this? How do I stop the constant night waking? Any advice would be greatly appreciated!