Any special configuration changes I can make to reduce VoIP chop on a dedicated server?

It's running 16 GB RAM and 16 Xeon Cores. Should be more than enough, yet max players still introduces stuttering or VoIP choppiness where it cuts out for players. Any server administrators know of a fix?