Invasion time limit

Is there a time limit for an invader to kill me before they are removed from my world? I've brought this guy down to low health a number of times now (he's a 4 shot for me), but he keeps running away and would obviously rather waste his and my own time than die.