What is the process for ousting property managers?

England:

Grey area here, my understanding is you need 51% of all leaseholders to oust the home builders provided service company. My query is, is that limited to a single physical location/building or does it encompass the whole development?

Context is my building has 100 apartments, however there’s 500 apartments across 5 different buildings. Can we blexit from the other 4??