Papers on Reward Function evaluation

I've been looking for papers where different parameters of reward functions have been tested and evaluated with each other.

Especially, I am trying to look for possible metrics to quantify the outcome of the learned policy (PPO).

Other Framing: What are the Effect / Impact of tuning my reward function? (learning behaviour/what makes my learned policy efficient/optimal?)

Another framing: How does the reward function "curve" effect the learning?

I.e. Time to Complete the Task, probability of success,...?