Remove up and down vote ability from user overview page

I've never personally understood why the option is even there. The only people who would use the option to vote on someone's overview page would be trolls, looking to further down vote a user for something they said. If you removed the option, the trolls would have to click on each comment to down vote it, and that would act as a deterrent. The only people who should be up voting or down voting someone should be the people reading the post, and not someone reading an out of context comment on someone's "profile page." Although, this should also apply to links, which you'd have to click, and hopefully read, to vote. Does karma really matter? No, but I still question why this feature exists.