If we have a low clear mid, should i just start at my speed buff since we will lose it if i dont do it?

surely if were going to be under tower, might as well let mid have solo farm, right? wrong? i dunno, im shit at this game, dont understand it