Do people have a responsibility to accept legal punishment if they've done something illegal?

I'm asking if people can look back on crimes they committed and resolve on improving as a person - and if it would be morally wrong if they did not willimgly face an external punishment for the behavior, if they know that's the only way they will be punished.

Is moving along with life, while not continuing the behaviors, turning your back on what should be done?