Rerolling Ascended item bonuses is awful

my current mats

So I've been playing my Pooper char and improving him, I'm at a point where I have full new epic set and try to get all my items ascended, but it takes forever and half the time I get +5% chance to use a skill I dont have, because I have 6 skills like that (Dervish - Nightblade and Oathkeeper).

I Ascended 5 items so far and need to do 8 more, but ideally I would have to reroll 3 of my 5 items, and rerolling them cost 3 Soul Fragments now. The problem comes from time played to improving character even a little bit, because I end up not getting anything out of this mechanic most of the time.

The way I see it being fixed is hard capping reroll cost to 2 Soul Fragment per use or change it to use Ashes of Awakening instead. Or change it so it doesnt roll a bonus to skill which you dont have if the item is soulbound. Or buff droprates of Souls from Ascention Altar bonuses. Or provide exchange of materials, Ashes to Souls. There are different ways to make it better and fun.

I already see the best setup for my build with Ascending all my items, but reaching it is impossible, which is fine, as there are some other okay or good bonuses to be had, but when I spend hours farming and just reroll bonuses that give me nothing, that feels bad. It gets to a point where it would take me so many hours trying to min max my character with no guarantee for increase in power, that I can level and gear up couple characters more, which makes this mechanic bad in my opinion.

Just wanted to add that a similar reroll system, but for stats on items, seems fine, as I can farm plenty of Ashes fast, and when it gets too expensive I can look for another similar item to start again.