How useful is the primary weapon?

Is it gonna play alot on your accuracy, damages etc even if you only use the awakened weapon? Should I try to get a really good one early on?