Attack speed on weapon and pet builds

I am unsure how attack speed or attack speed on weapon affects pet builds. I think it is just a damage increase and does not provide a faster swing timer. I'm asking cause i just rolled a nice SMK and Sacred Harvester and am curious what the impact would be. Any information would be great, thanks!