Question: Offsetting a layer while keeping mask in place?

Is there a way I can animate layer movement while keeping its mask in place without having to precompose? Working with some 3D tracked footage and making a precomp might mess the track up but would also be useful to know in other situations.