GenAI is going great (this is real)
-
GenAI is going great (this is real)
@GossiTheDog "How many days of the week have gym in them?"
https://www.google.com/search?q=how+many+days+of+the+week+have+gym+in+them%3F
Got this on first try. Got Tuesday, Wednesday on the 2nd.
-
You mean "sday" isn't the name of a fish?
@EricLawton yes.
-
GenAI is going great (this is real)
@GossiTheDog Plus Facebook and Reddit are the most-cited references for AI Overview. So it's partly learning from the internet's worst corner
https://www.popsci.com/technology/ai-overview-inaccuracy-google/
Gemini is different
-
GenAI is going great (this is real)
@GossiTheDog that thing is really suffering.
-
@GossiTheDog that thing is really suffering.
@GossiTheDog I’m certain interesting results might be found by reverse engineering the tokenization process.
-
If anybody is wondering how this keeps happening, Google pull their AI output from Reddit. Somebody posted a Reddit thread saying days have fish in them, so now Google replies saying that. Google just blindly trusts any poster on Reddit (not a joke).
@GossiTheDog so all that we need to do to defeat AI is start lying on the internet?
-
@cgudrian @GossiTheDog everyone knows Friday is Fishfryday.
@jasper89 @cgudrian @GossiTheDog Fryfish. It is religiously forbidden to steam fish on that day.
-
@nblr Geht auch auf Deutsch. Weiße Bescheid.
-
@GossiTheDog @Herman dive in the AI struggles of Father Phi. Hilarious https://m.youtube.com/results?sp=mAEA&search_query=Fatherphi&ra=m
@GossiTheDog @chantal Thanks, hilarious indeed.
-
GenAI is going great (this is real)
@GossiTheDog Gemini also likes Stargate
-
@GossiTheDog seems like they fixed it, but it was a funny screen grab lol
I stopped getting an AI overview for the exact query.
But minor tweaks like "in the week, how many days are there, that have fish in them" still get nonsense
-
GenAI is going great (this is real)
-
@nxadm@infosec.exchange @GossiTheDog@cyberplace.social @haploc@fedi.cr-net.be wow so this is how google search dies, neat
-
GenAI is going great (this is real)
@GossiTheDog WTF is even broken in Spanish
-
GenAI is going great (this is real)
@GossiTheDog don’t worry, they are improving it. It told me only two days.
-
If anybody is wondering how this keeps happening, Google pull their AI output from Reddit. Somebody posted a Reddit thread saying days have fish in them, so now Google replies saying that. Google just blindly trusts any poster on Reddit (not a joke).
@GossiTheDog This is exactly the problem. Compare to the output of gemma 4 e2b (literally the weakest current model you can run at home on most laptops) below.
...me trying to jailbreak models while Redditors do it accidentally.
-
@catsalad @rx13 @GossiTheDog I also got "two days" but no explanation or reference to exotic fish. I'm not worthy of further explanation it seems
@hszakher @catsalad @rx13 @GossiTheDog lol, it looks like there it listed Tuesday as one of the days because it previously said "two days"... And they share letters...
And listed Friday because fish shares letters with Fri.
-
GenAI is going great (this is real)
I dunno, an ai said it? They're really expensive. It must be true. Sigh. Ill start changing my calendars
-
GenAI is going great (this is real)
@GossiTheDog
It's getting better. Google now tells me there are only 2 days with fish in the name. Plus I should eat fish 2 times a week. It has no opinion on mercury levels though. -
GenAI is going great (this is real)
@GossiTheDog while it seems fixed for me with the original query, I can reproduce getting nonsensical replies in German:
