Outside of the editor the functionality is for all changes made to scriptable objects to be lost between loads, so it is bizarre that changes during runtime in the editor make permanent changes, and it makes development and testing very annoying. There are a few workarounds, like using proxy values that get reset, but when you have 20+ variables that could be changed it is very tedious to manually create and reset proxies for all of them.
You often have to jump through hoops to make editor changes to data permanent, it seems bizarre that the editor-runtime would explicitly have different functionality to normal runtime.
Honestly I would just love if there was a box to tick or an attribute
