Can Valve remove restrictions for communication score due to leaving the game? My internet is bad

I understand that my internet is my problem, but why take away my ability to chat? I've already served my time in low priority.