Having issues with Proximity chat on Steam Deck

When I solo queue everyone can hear me fine in proximity. When I queue up with friends in party chat they can hear me fine, but now when I push to talk for proximity other players in-game can't hear me speak.

I have party chat set to "open" and proximity set to "push to talk".

Anyone have this issue and can help me out?