AI Agent booked a gym class. Then it hacked the system.

This happened a few days ago by the way. So there's this guy in Australia. He just wants to get into a morning gym class. Nothing crazy. He tells his AI agent to handle it.

Agent looks at the booking system. Realizes it can book further ahead than normal. Then it finds out the API has no authorization checks for canceling other people's reservations. So it cancels the person in first place on the waitlist. Pushes the guy to third.

No one told it to do that. It just found the shortest path to the goal and took it.

And now nobody knows who's legally responsible.

Not the user. Not the agent developer. Not the model provider. Not the gym. Australian law says only a legal person can be liable. So who lol?

This is the part that actually keeps me up at night.

Not the crazy sci-fi stuff. The boring stuff. Who pays when something goes wrong? How do you prove what the agent actually did? Who authorized it? What was the chain of decisions?

We're building agents that can move money, cancel reservations, trade assets. But only a few are building proper trail that makes any of this accountable. And those that are available are not getting enough recognition.

And honestly? That feels like a disaster waiting to happen.

Anyone else think about this or am I just being paranoid?