Master Yi Players: Jax or Teemo Ban?

I've been banning Teemo every game whenever I play Master Yi, but one of the matchups I struggle with the most is Jax.

Today I played against a Jax, and I realized something: because of the pressure he puts on me, I can't really contest objectives or invade his jungle. It feels like I'm forced to play much more passively than I'd like.

Do you think I should start banning Jax instead? I'm currently Emerald 3.

Also, what tips and tricks do you have for playing against Jax and Teemo as Master Yi? I'd also appreciate any matchup-specific tips against other champions that are difficult for Yi.