History and art

I'm coming to Hattiesburg for a weekend can someone point me to a good historical museum, somewhere to eat with I've music, and a art museum. Just looking for some culture.