Zen on Windows: How to stop the update screen to keep popping up?

Basically every day or so I try to open Zen and the "Allow Zen Updater to make changes" pops up.

I already have the option "Automatically install updates > when Zen is not running" toggled on, yet the popup still only shows up when I need it the least.

Have anyone here faced this issue? How can I fix it?

\"When Zen is not running\" checked on