Looking for Courses on Spark Internals, Optimization, and AWS Glue

Hi all,

I’m looking for recommendations on a good Spark course that dives into its internals, how it processes data, and optimization techniques.

My background:

• I’m proficient in Python and SQL.
• My company is mostly an AWS shop, and we use AWS Glue for data processing.
• We primarily use Glue to load data into S3 or extract from S3 to S3/Redshift.
• I mostly write Spark SQL as we have a framework that takes Spark SQL.
• I can optimize SQL queries but don’t have a deep understanding of Spark-specific optimizations or how to determine the right number of DPUs for a job.

I understand some of this comes with experience, but I’d love a structured course that can help me gain a solid understanding of Spark internals, execution plans, and best practices for Glue-specific optimizations.

Any recommendations on courses (Udemy, Coursera, Pluralsight, etc.) or other resources that helped you would be greatly appreciated!

Thanks in advance :)