Is there really not much point of upgrading? M1 -> M4

I bought my macbook M1 a long time ago, and I just got a new M4 air. Honestly, it feels very nice but after comparing it side by side, I am just wondering if I even see any difference. Yes, apps load slightly faster most of the time as well as websites, but you probably won't see it the difference that much. Additionally, I was comparing my macbook that is already polluted with a ton of data, and it works just as fine. External monitors also work well in both cases. My use case is mostly browsing, opening PDF files, and VSCode. I do most of my work on the server with big gpu, so I guess it really doesn't make sense to upgrade.

Am I missing something? Do you think the difference will just accumulate with more time using the device? I think it might be better to have a more powerful device just in case you need that power, but it seems like M1 is still pretty good? Just trying to see if anyone actually felt the difference after switching a more powerful device. I would imagine if you do rendering/video/on-device compiling, that would matter.