I don't want to laugh at someone's real distress but this IS very funny ...
-
@Frank_Juston safeguarding AI is a myth. Fundamentally you can't prevent attacks like that against LLMs.
-
@Natasha_Jay
I had a quick look at the original post for this.What actually happened was that the 80% off code it generated didn't work. The customer placed the order and put the code in a notes field demanding that it be honoured. The chat bot didn't have the ability to actually give discounts.
So while it's funny to read, in this case, the customer is just chancing it and I'd imagine any reasonable small claims court would not side with them.
@gareth @Natasha_Jay the lesson is that the chatbot is always willing to please the user.
Chatbots are only a parrots that have no real knowledge about anything. Why would you put your business at risk with them?
-
@Natasha_Jay
I had a quick look at the original post for this.What actually happened was that the 80% off code it generated didn't work. The customer placed the order and put the code in a notes field demanding that it be honoured. The chat bot didn't have the ability to actually give discounts.
So while it's funny to read, in this case, the customer is just chancing it and I'd imagine any reasonable small claims court would not side with them.
@gareth
Ah, I admit I wondered about it's integration into actual order pricing mechanisms!Accidental mispricing doesn't have to be honoured anyway in most cases I've seen, so the result is not surprising but we will enter into new grey areas of liability in time.
-
@Natasha_Jay
I had a quick look at the original post for this.What actually happened was that the 80% off code it generated didn't work. The customer placed the order and put the code in a notes field demanding that it be honoured. The chat bot didn't have the ability to actually give discounts.
So while it's funny to read, in this case, the customer is just chancing it and I'd imagine any reasonable small claims court would not side with them.
In this case wouldn’t the AI be considered a representative of the company, and any negotiations with them have to be honored?
-
I don't want to laugh at someone's real distress but this IS very funny ...
@Natasha_Jay
I recently found an unfettered #LLM answering customer support email at a printer supplies company. Got it to write heavy metal lyrics, discuss Victor Hugo in French, write me a praise poem where I was described as a beloved father figure for everyone at the company. -
In this case wouldn’t the AI be considered a representative of the company, and any negotiations with them have to be honored?
@EthanR_ @Natasha_Jay
I think it would depend on the court and the actual facts of the case.If the transcription shows that the customer just asked the bot to show it could generate a code, then probably not.
If the chat bot came back with "this is a code that will give you 80% off any order in this store", we'll get a UK case of "is the AI bot considered a representative of the company?"
The site owner would probably argue that the customer placed the order for full price because when they put the code in it didn't work, so the cusomter was accepting the full price order. The fact the put a note in saying "I want 80% off and here's a random string of letters" is probably irrelevant.
I am not a lawyer, however.
I would seriously hope that if the OP is telling the truth about what happened and what was said, that they win the case. If there are other factors I'm not aware of, or if they've misrepresented things, maybe not. We'll have to wait and see (and since it relies on them posting on Reddit, we'll probably never hear about it again...)
-
I don't want to laugh at someone's real distress but this IS very funny ...
@Natasha_Jay Eat the loss and learn the lesson. That's the only way forward.
When the rich (even the micro-rich like the small businesses) actually feel consequences for their actions is when we're on the path back to healthy society.
Pay humans a living wage to run your business or don't run a business at all. That's the solution.
-
@Natasha_Jay
I recently found an unfettered #LLM answering customer support email at a printer supplies company. Got it to write heavy metal lyrics, discuss Victor Hugo in French, write me a praise poem where I was described as a beloved father figure for everyone at the company. -
I don't want to laugh at someone's real distress but this IS very funny ...
Great, what could possibly go wrong!
-
I don't want to laugh at someone's real distress but this IS very funny ...
-
I don't want to laugh at someone's real distress but this IS very funny ...
@Natasha_Jay I'm shocked (sarcasm)!
-
I don't want to laugh at someone's real distress but this IS very funny ...
@Natasha_Jay The end is scary: the user thinks the chatbot tried to impress the customer ...
-
I don't want to laugh at someone's real distress but this IS very funny ...
@Natasha_Jay I hope a lesson was learned.
-
I don't want to laugh at someone's real distress but this IS very funny ...
<<Don't worry. It's AI. It knows what it's doing. Trust it.>> #NOT
-
@Frank_Juston safeguarding AI is a myth. Fundamentally you can't prevent attacks like that against LLMs.
@mxk @Frank_Juston AI firewalls exist.
-
I don't want to laugh at someone's real distress but this IS very funny ...
@Natasha_Jay lol for for using a chatbot
-
@EthanR_ @Natasha_Jay
I think it would depend on the court and the actual facts of the case.If the transcription shows that the customer just asked the bot to show it could generate a code, then probably not.
If the chat bot came back with "this is a code that will give you 80% off any order in this store", we'll get a UK case of "is the AI bot considered a representative of the company?"
The site owner would probably argue that the customer placed the order for full price because when they put the code in it didn't work, so the cusomter was accepting the full price order. The fact the put a note in saying "I want 80% off and here's a random string of letters" is probably irrelevant.
I am not a lawyer, however.
I would seriously hope that if the OP is telling the truth about what happened and what was said, that they win the case. If there are other factors I'm not aware of, or if they've misrepresented things, maybe not. We'll have to wait and see (and since it relies on them posting on Reddit, we'll probably never hear about it again...)
@EthanR_ @Natasha_Jay @gareth it'll be interesting to see the results, if it ever happens, but I believe giving a full refund before fulfilling the order and cancelling it should prevent any possible damages that the consumer could claim. We have pretty good consumer protections, but they're not magic. There are enough differences with the Canada Air case (not just being in the UK) that I can't see this setting a useful precedent.
-
@Natasha_Jay Eat the loss and learn the lesson. That's the only way forward.
When the rich (even the micro-rich like the small businesses) actually feel consequences for their actions is when we're on the path back to healthy society.
Pay humans a living wage to run your business or don't run a business at all. That's the solution.
@gooba42 Total ROTFL at "even the micro-rich like the small businesses."
Micro-rich. That's... rich.
-
I don't want to laugh at someone's real distress but this IS very funny ...
@Natasha_Jay Sadly the only thing it may change is that they will add a legal disclaimer saying the AI chatbot may report false info, anything it says doesn't represent the views of the company or some legaleze wording like that.
Maybe they will also change the prompt like adding "you should not offer discounts! you should not hallucinate" a dozen times.
Once a boss is convinced they need to have 24/7 support and are using AI because they surely will not pay someone to do it for them, it's unlikely for them to change their mind.
-
@Natasha_Jay
I had a quick look at the original post for this.What actually happened was that the 80% off code it generated didn't work. The customer placed the order and put the code in a notes field demanding that it be honoured. The chat bot didn't have the ability to actually give discounts.
So while it's funny to read, in this case, the customer is just chancing it and I'd imagine any reasonable small claims court would not side with them.
Funny how you didn't provide a link to back up what you're claiming. I mean, link was right there in your bar, you could have just pasted it. Why not?
️
