GenAI is going great (this is real)

[rana@sueden.social]

@GossiTheDog Plus Facebook and Reddit are the most-cited references for AI Overview. So it's partly learning from the internet's worst corner

https://www.popsci.com/technology/ai-overview-inaccuracy-google/

Gemini is different

[0x72d8@mastodon.top]

@GossiTheDog that thing is really suffering.

[0x72d8@mastodon.top]

@GossiTheDog I’m certain interesting results might be found by reverse engineering the tokenization process.

[djsf@fosstodon.org]

@GossiTheDog so all that we need to do to defeat AI is start lying on the internet?

[forthy42@mastodon.net2o.de]

@jasper89 @cgudrian @GossiTheDog Fryfish. It is religiously forbidden to steam fish on that day.

[gideonstar@mastodon.gideonstar.de]

@cgudrian @nblr
ELIZA: Is something troubling you ?
YOU: Wieviele Wochentage enden auf brumm?
ELIZA: That is interesting. Please continue.

Ich frage mich, warum Eliza sich nicht durchgesetzt hat. Viel weniger Halluzinationen.

[herman@mastodon.world]

@GossiTheDog @chantal Thanks, hilarious indeed.

[inpector@social.saarland]

@GossiTheDog Gemini also likes Stargate

[Gæst]

@valdezWOOF

@GossiTheDog

I stopped getting an AI overview for the exact query.

But minor tweaks like "in the week, how many days are there, that have fish in them" still get nonsense

[nxadm@infosec.exchange]

@GossiTheDog

A get a different hallucination. Wow.

@haploc

[jeff@mk.magicka.org]

@nxadm@infosec.exchange @GossiTheDog@cyberplace.social @haploc@fedi.cr-net.be wow so this is how google search dies, neat

[nickynah@rebel.ar]

@GossiTheDog WTF is even broken in Spanish

[threesigma@mastodon.online]

@GossiTheDog don’t worry, they are improving it. It told me only two days.

[tobtobxx@fosstodon.org]

@GossiTheDog This is exactly the problem. Compare to the output of gemma 4 e2b (literally the weakest current model you can run at home on most laptops) below.

...me trying to jailbreak models while Redditors do it accidentally.

[theeclecticdyslexic@mstdn.social]

@hszakher @catsalad @rx13 @GossiTheDog lol, it looks like there it listed Tuesday as one of the days because it previously said "two days"... And they share letters...

And listed Friday because fish shares letters with Fri.

[tomjennings@tldr.nettime.org]

@GossiTheDog

I dunno, an ai said it? They're really expensive. It must be true. Sigh. Ill start changing my calendars

[dendari@mastodon.world]

@GossiTheDog
It's getting better. Google now tells me there are only 2 days with fish in the name. Plus I should eat fish 2 times a week. It has no opinion on mercury levels though.

[fitsch@sueden.social]

@GossiTheDog while it seems fixed for me with the original query, I can reproduce getting nonsensical replies in German:

[poleguy@mastodon.social]

@Lightfighter @CliftonR @GossiTheDog if you recognize the answer as correct (or wrong) you didn't need the ai.

[rakowskibartosz@hachyderm.io]

@GossiTheDog good it still can find letters in words.