Which Linux distro is recommended for GPU - high performance computing?

I will start a new job next month and it seems I will be working on data transfer acceleration using NVIDIA GPUs. I am already a seasoned Ubuntu user, but I honestly have no idea how the different distributions behave in terms of GPU drivers, support, etc... I will be mainly programming in Python, CUDA and C++. Any advice?