Is the original usually fare higher when you are charged wait fee?

Context: I live at an intersection. Many drivers take the turn off from the roundabout. It has been closed for months due to major construction.

Every time I take an uber, I have a message copied ready to paste into chat to notify the driver of the alternative route up (basically to head around the block). On the two occasions it has happened, the drivers failed to read the message and tried to pull up, realised they couldn't and had to take a detour that adds 3-5mins onto their journey.

On both of these cases, I was incorrectly charged a waiting fee despite me always being stood waiting outside. Uber reverses this charge pretty much instantly - but on both occasions I notice that the fare itself is actually higher than originally advertised which almost makes the fee refund pointless as the fee being returned only accounts for ~75% of the 'extra' undeclared increase on the fare itself.

Is this done intentionally to prevent Uber losing anything from wait fees?