Simple ECU programming question

When tuning fuel or ignition maps, does the engine need to be shut off between tweaks? Can it be left at idle? can it be at revs? Looking to understand the actual process of making a parameter change.

Starting research into ECU tuning and I can't find a definitive answer to this question. Driving me nuts