When should I do Kvatch?

I'm getting close to the priory at lvl 6 and I'm wondering if I should do that asap? I've heard it can get really hard if you wait but I was planning to go through chorral and do some quests, should I just do kvatch first so I don't get steamroller by deadra?