Cocktail/blacktie dresses

I'm a recent convert and I have a bunch of black tie/cocktail dresses that I love but they're either sleeveless or strapless. I've tried putting on an undershirt but it looks tacky. Any suggestions for what I can use to cover my arms that looks nicer. Or even any brands that have cute modest colourful dresses I have a spring wedding to go to soon!!