The energy recharges really slowly.

You can burn through 500 energy in under an hour with triple rewards for sword trials so I don't think that over 72 hours is a reasonable amount of time to recharge all of it. 24 hours I could understand or better yet if single rewards didn't cost energy and only multiplying them did