How would you build attraction with someone you don't speak the same language as?

The tittle says it all. I didn't realize how dependent I was on verbal communication to make me confidant in non-verbal communication. Has anyone tried this? How do you build attraction, but also have an interesting time together when you can't verbally communicate very well?

I haven't really seen much advice on this.