I just asked Google's AI a question about processing mixed hazardous waste, and its recommendation was a major safety hazard (mixing bleach with a 95% ethanol solution). When I questioned this advice it did the usual "I apologize, you're so smart!" BS. It led me to question the AI on potential legal issues for Google with it dispensing dangerous advice and philosophical questions on whether AI should be allowed to dispense potentially lethal advice.
I then asked what it would do going forward to prevent similar issues. To which I received the following response:
"To prevent errors like this moving forward, the focus must be on structural changes to how I process and cross-reference hig

