Today we had a fire alarm in the office.
-
Today we had a fire alarm in the office. A colleague wrote to a Slack channel 'Fire alarm in the office building', to start a thread if somebody knows any details. We have AI assistant Glean integrated into the Slack, and it answered privately to her: "today's siren is just a scheduled test and you do not need to leave your workplace". It was not a test or a drill, it was a real fire alarm. Someday, AI will kill us.
@tagir_valeev Charles Darwin has entered the chat.
-
Today we had a fire alarm in the office. A colleague wrote to a Slack channel 'Fire alarm in the office building', to start a thread if somebody knows any details. We have AI assistant Glean integrated into the Slack, and it answered privately to her: "today's siren is just a scheduled test and you do not need to leave your workplace". It was not a test or a drill, it was a real fire alarm. Someday, AI will kill us.
@tagir_valeev oh, just saw this in my feed and immediately recognized the buildings, that's just around the corner were we live! Hope it wasn't serious and everybody is alright?
-
As it gets much more attention, than I expected, here are two clarifications:
1. The Slack message was written after the person evacuated properly. It was written via phone while staying at the designated area outside the building.
2. Nobody asked AI advice explicitly. It was configured to answer automatically if it thinks it can help you. The configuration was updated after this incident.@tagir_valeev …apparently this is the start of your next book 100 LLM mistakes and how you can’t avoid them.
Actually, I might just steal that my own having written most footnoted blog post ever
-
Today we had a fire alarm in the office. A colleague wrote to a Slack channel 'Fire alarm in the office building', to start a thread if somebody knows any details. We have AI assistant Glean integrated into the Slack, and it answered privately to her: "today's siren is just a scheduled test and you do not need to leave your workplace". It was not a test or a drill, it was a real fire alarm. Someday, AI will kill us.
@tagir_valeev
Have you performed the MOTHER test and ensured its priority is employee wellbeing and not corporate?Alien had some warnings about AI too
-
@tagir_valeev oh, just saw this in my feed and immediately recognized the buildings, that's just around the corner were we live! Hope it wasn't serious and everybody is alright?
@maxsz no, nothing serious!
-
Today we had a fire alarm in the office. A colleague wrote to a Slack channel 'Fire alarm in the office building', to start a thread if somebody knows any details. We have AI assistant Glean integrated into the Slack, and it answered privately to her: "today's siren is just a scheduled test and you do not need to leave your workplace". It was not a test or a drill, it was a real fire alarm. Someday, AI will kill us.
-
@tagir_valeev Having worked in the Chemical Industry all my life my first instinct is evacuate, carry out roll call and then establish whether or not it was a real fire. My colleagues and I were all fire and rescue trained but would only act on small fires we always called the fire service. Many of the sites I worked on had alarms that went to the local fire control and triggered a turn out, a turn out of 6 engines at one site plus a general alert to other brigades
@aadeacon here the fire brigade is alerted automatically as well. If I understand correctly, the building owner cannot deactivate the alarm without the fire brigade.
-
Today we had a fire alarm in the office. A colleague wrote to a Slack channel 'Fire alarm in the office building', to start a thread if somebody knows any details. We have AI assistant Glean integrated into the Slack, and it answered privately to her: "today's siren is just a scheduled test and you do not need to leave your workplace". It was not a test or a drill, it was a real fire alarm. Someday, AI will kill us.
@tagir_valeev@mastodon.online Simply because it saw that a common response was to indicate it was a drill, untethered from any real signals. And of course these glorified autocomplete prediction systems are being forced everywhere
-
@majick @tagir_valeev As much as I love to talk about alert noise/fatigue, in that case other factors were contributing.
A bit of pressure from the supermarket chain, a bit of leftover mentality from the russian occupation times. Similar to the "I'm not afraid of no virus, I'm not gonna mask!" etc.@richlv @tagir_valeev Yeah, I completely agree those factors can very much influence how bad something like that turns out to become. Rarely does someone think a thing they do routinely is actually high risk.
I'd say they fall into the category of "factors" I mentioned as root causes: cultural, management-based (I've lived that life), and so on. Fatigue's one thing, for sure, not the only thing, and sometimes it's stuff like that deprioritizing the seriousness of an alarm. A different cause of fatigue/blasé attitude/misinterpretation.
Like I said, it's almost never the dude and almost always what influenced the dude to be the last link in the chain up to a horrible tragedy.
-
Today we had a fire alarm in the office. A colleague wrote to a Slack channel 'Fire alarm in the office building', to start a thread if somebody knows any details. We have AI assistant Glean integrated into the Slack, and it answered privately to her: "today's siren is just a scheduled test and you do not need to leave your workplace". It was not a test or a drill, it was a real fire alarm. Someday, AI will kill us.
@tagir_valeev I dunno... it is probably a false alarm 99% of the time; I was in grad student housing where it went off every night and one of the other students got in trouble because he'd made up his mind he was going to stay in bed.
false alarms numb people to real dangers and there should be heavy fines for them
-
Today we had a fire alarm in the office. A colleague wrote to a Slack channel 'Fire alarm in the office building', to start a thread if somebody knows any details. We have AI assistant Glean integrated into the Slack, and it answered privately to her: "today's siren is just a scheduled test and you do not need to leave your workplace". It was not a test or a drill, it was a real fire alarm. Someday, AI will kill us.
@tagir_valeev
Next it will actually set the fire. -
Today we had a fire alarm in the office. A colleague wrote to a Slack channel 'Fire alarm in the office building', to start a thread if somebody knows any details. We have AI assistant Glean integrated into the Slack, and it answered privately to her: "today's siren is just a scheduled test and you do not need to leave your workplace". It was not a test or a drill, it was a real fire alarm. Someday, AI will kill us.
@tagir_valeev No, not AI, but humans who integrate AI in every fucking tool.
-
Today we had a fire alarm in the office. A colleague wrote to a Slack channel 'Fire alarm in the office building', to start a thread if somebody knows any details. We have AI assistant Glean integrated into the Slack, and it answered privately to her: "today's siren is just a scheduled test and you do not need to leave your workplace". It was not a test or a drill, it was a real fire alarm. Someday, AI will kill us.
@tagir_valeev
That's insane.The whole point of siren's test is to actually evacuate a building so they can know how quickly we did it, if we can reach the correct meeting point, etc etc.
-
Today we had a fire alarm in the office. A colleague wrote to a Slack channel 'Fire alarm in the office building', to start a thread if somebody knows any details. We have AI assistant Glean integrated into the Slack, and it answered privately to her: "today's siren is just a scheduled test and you do not need to leave your workplace". It was not a test or a drill, it was a real fire alarm. Someday, AI will kill us.
@tagir_valeev There is a reason why the rules are indeed for one to get off one's seat, grab one's coat & bag of the back, and leave.
Usually such a liar would be personally responsible, but in this case the corposcum selling access to it will have to be the ones to bear responsibility for endangering others. -
Today we had a fire alarm in the office. A colleague wrote to a Slack channel 'Fire alarm in the office building', to start a thread if somebody knows any details. We have AI assistant Glean integrated into the Slack, and it answered privately to her: "today's siren is just a scheduled test and you do not need to leave your workplace". It was not a test or a drill, it was a real fire alarm. Someday, AI will kill us.
-
@Matt_999 @tagir_valeev it is still probably a good idea to leave your workplace and go to the emergency meeting point, so you get used to the process, and don't forget to take e.g. shoes, jacket, wallet, keys … with you if the alarm turns out to be a real alarm. Or even have to find out first where the next fire extinguisher or the emergency meeting point is…
@daniel_bohrer @Matt_999 @tagir_valeev Given an alarm can happen at any point, either spares should be available near the emergency exit or one should also ensure never to be too far from such resources.
Yes, this especially includes going to the restroom. Being stuck in -20℃ windy weather without a coat because one didn't bring it with oneself when going is a safety issue. -
@metacosm nobody asked the AI input at all. It just was configured in the particular channel to answer automatically if it thinks it can help faster than fellow humans (sometimes people actually ask something which was asked before, so AI could be helpful). The configuration will be adjusted after this incident.
@tagir_valeev @metacosm > The configuration will be adjusted after this incident.
On a probabilistic bullshit generator that does its own determination of topics (if it even has that much semantic analysis machinery, which it very well might not). Such that even if it was strictly allow-list based, it would still frequently fail to stay silent. -
@tagir_valeev A deadly case of the general principle that the situationally useful information lies not in the statistical pattern but in where and how deviations from the pattern occur.
@dalias @tagir_valeev At least when the environment is properly secure.
An old undermaintained chemical factory is always dangerous, deviations just make it even more so. -
Jebus. The fire alarm goes off and their reaction is to ... start a Slack thread?
Not, "get up from desk and leave expeditiously" like you practice in the fire drills?
Some people have no common sense.
@cazabon The Slack thread was started after the person evacuated:
-
Today we had a fire alarm in the office. A colleague wrote to a Slack channel 'Fire alarm in the office building', to start a thread if somebody knows any details. We have AI assistant Glean integrated into the Slack, and it answered privately to her: "today's siren is just a scheduled test and you do not need to leave your workplace". It was not a test or a drill, it was a real fire alarm. Someday, AI will kill us.
We can fix this shit overnight.
A company is legally liable for a hosted LLM's output.
There you go.
