"I just found out that it's been hallucinating numbers this entire time."

[jwdt@mastodon.social]

@cmthiede @Natasha_Jay in this case I thought what they're paying for was mostly plausible deniability and blame shifting when investors find out that the numbers you showed them were 20x better than reality.

[zl2tod@mastodon.online]

@Natasha_Jay

"When you believe in things
you don't understand
then you suffer"

Stevie Wonder - Superstition

https://www.youtube.com/watch?v=7_tmeHCO1IM

[epic_null@infosec.exchange]

@Natasha_Jay I hope they find they have grounds to sue the creator of the AI agent. And that they do so.

Honetsly, it should not be on non-technical people to realize this shit is bullshit - those selling the bullshit should be held accountable for intentionally misleading their customers.

[drwho@masto.hackers.town]

@ZenHeathen @Natasha_Jay Agreed.

[jeremy_pm@mastodon.nz]

@Natasha_Jay

Remember #NZPol peeps our coalition of corruption have been regularly using ai for research and policy decisions.

[pizzademon@mastodon.online]

@Natasha_Jay
https://mastodon.online/@PizzaDemon/109888098461903861

[ncrazed@fd00.space]

@Natasha_Jay I can't decide if I want to know or not know how much these people are getting paid

[matildalove@wetdry.world]

@Natasha_Jay "i just found out my coal-powered hammer doesn't know how to turn a screw"

[0x0ddc0ffee@infosec.exchange]

@Natasha_Jay I suspect that one of the few applications where a heavily hallucinating LLM can outperform a human would be in replacing board members, C-suite executives, and their direct reports. I propose a longitudinal study with a control group of high level executives using real data, and experimental group using hallucinated, or maybe even totally random data filtered into plausible ranges, using executive compensation deltas as the metric.

[drahardja@sfba.social]

@Natasha_Jay This part in the original post is fantastic:

“The worst part I raised concerns about needing validation in November and got told I was slowing down innovation.”

hxxps://www.reddit.com/r/analytics/comments/1r4dsq2/we_just_found_out_our_ai_has_been_making_up/

[davidr@hachyderm.io]

@Epic_Null @Natasha_Jay That's bad, but honestly--switching to a new system without ever double checking anything?

Everyone involved should be fired, including the #AI

[cholling@bytes.programming.dev]

@Natasha_Jay I didn't think the leopards would falsify MY data!

[tofu@is-a.cat]

@Natasha_Jay if it had no tool to even get said data to begin with, it's even funnier

[overeducatedredneck@bitbang.social]

@cmthiede @Natasha_Jay You get no more than what you pay for. In this case, probably less.

[yakyunightowl@mastodon.world]

@Natasha_Jay It sounds a lot like a baseball analytics department full of charlatans working for an easy mark.

[ghostonthehalfshell@masto.ai]

@Natasha_Jay

I think it is safe to say that we have achieved the heat death of the Internet

[kaito02@mastodon.social]

@Natasha_Jay if the shareholders want to see big numbers it's just better to give them the big numbers /jk

[powerfromspace1@mstdn.social]

@Natasha_Jay grounded human will be needed for oversight for quiet some time

[ghostonthehalfshell@masto.ai]

@dropbear @Natasha_Jay

SHOCKED I TELL YOU

[xethos@mastodon.xethos.net]

@Natasha_Jay "Here's what a functional company's numbers would look like"

Unfortunately, these are not *your* company's numbers