Simple advice on how to Pan Football/Soccer video footage

I shoot the whole pitch/field using an action camera mounted in the stand in 4K 4:3 which I then crop to a down to an 'Ultrawide' format approx. 1920x520 which is used for analysis e.g. formation/positioning.

However, this ultrawide video, is only half the height of the screen which means the players are very small. I would also like to create an alternative video of the same game/training but one that fills the full height of the screen (or even closer) but this would then only fit in half of the pitches length so I would need to 'Pan' the footage to follow the play.

Using Dynamic zoom and keyframes, would take me hours/days unless there is a technique to do it that I am unaware of. In the past, I have played the video on a tablet while doing a screen recording and using the touchscreen to pinch zoom and scroll to follow the ball but the results are not great.

Ideally, I would play back the footage and then maybe use the Cursor keys, Mouse or joystick to Pan from left to right to produce a video similar to what you would normally see when watching a game on TV.

Anyone have any ideas on how this can be achieved?
I'm willing to explore different solutions if you can point me in the right direction.

Many thanks, Gary