Has your app ever broken in a way you didn't notice until too late?

Has anything ever gone wrong silently for you? Like an exposed API key, a database left open, or a surprise bill you didn't see coming.

Curious how common this is, and whether people usually catch it themselves or find out the hard way.