How are people handling rules & experiments in AI products?

For founders building AI products —
how do you manage rules and experiments that keep changing?

Do you hardcode? feature flags? prompt logic?

I’m seeing this logic spread everywhere and it’s painful.
Curious how others are solving this.