Why is the H1b VISA so problematic to people and such a big talking point?

Workers under this VISA make up about 0.4-0.5% of the entire US workforce, which is about 700k out of 160-168 million. Why do they make it seem like this group is somehow holding every job from everyone? I just saw the huge layoffs chart being tied to H1b hires today (at this number currently), and then I saw a whole sub of people dedicated to hating on H1b.

Why is it so over represented when there are more obvious problems out there? I get that it is abused and that can be handle, but feels like the problem is being intentionally spun out of proportion.