Computer Vision for Mouse Movement Estimation in FPS Games

Good evening,

I am an undergraduate student conducting research for my senior year. My goal is to use computer vision to estimate how much a player's mouse has moved frame to frame. This data will be used to later on train a machine learning algorithm to detect legit v cheating players. I have ground truth data extracted from gameplay using pynput library.

My idea is to have a program that can watch gameplay and estimate mouse movements based on changes in lighting, feature points, etc. I have tried many methods such as lucas kanade, dense optical flow, homgraphy and am stuck. My data still isnt accurate and useful to compare to the ground truth. Please give me any ideas or new paths to go down. Thank you!