Is it possible to kick out your newest villager?

I heard some people say its not, some say it is but you would have to kick out one of your other villagers, then get a new one in the empty plot, then you could kick out the villager you wanted out originality. Do you have to do that?