Extending Mac to 2 displays

Hi, My setup: MacBook Pro M4 Aorus FI27Q-P Dell UltraSharp U2724DE Thunderbolt

I want to connect the Mac to both displays with a single cable. With the TB cable I got with the Dell monitor, the monitors are duplicated and I couldn't find a way to change it.

If I buy Apple's official TB 4 (or most likely TB 5, since it's shorter [1M] and thus cheaper) will it work? I'm connecting the Mac to the Dell, and connecting the Dell to the Aorus with DP.