How would you load JSON data from heavily nested folders on S3?

I need to pull JSON data from AWS connect on an S3 bucket into delta tables in a lakehouse. Setting up an S3 shortcut is fairly easy.

My question is the best way to load and process the data which is in a folder structure like Year -> Month -> day -> hour. I can write a PySpark notebook to use NoteBook Utils to recursively traverse the file structure but there has to be better way that's less error prone.