Beating the Lych in contested territory

Has anyone managed to kill Lych in their contested territory games? The tiles he is on aren't being taken, and when i try i can barely get a skull off him before I die