"I just found out that it's been hallucinating numbers this entire time."

[natasha_jay@tech.lgbt]

"I just found out that it's been hallucinating numbers this entire time."

#AI #Tech #AgenticAI

[lxskllr@mastodon.world]

@Natasha_Jay

What would be amusing is them having greater success using bullshit data than whoever was previously correlating stuff :^D

[zenheathen@beige.party]

@Natasha_Jay An organization which trusts this tech enough to simply implement without a changeover period during which the results now given are getting checked against old methods... simply deserves what it gets.

[cmthiede@social.vivaldi.net]

@Natasha_Jay you get what you pay for

[kierkegaanks@beige.party]

@Natasha_Jay i don’t know if this particular case is real, but this definitely happened and was suppressed more than once

[kierkegaanks@beige.party]

@Natasha_Jay plus - how many people is peter thiel responsible for the incarceration or murder of?

[nerde@beige.party]

@Kierkegaanks @Natasha_Jay
This proves AI can replace CFOs and CEOs!

[jaythvv@infosec.exchange]

@Natasha_Jay people just keep on proving the critics right...

[bredroll@mas.to]

@ZenHeathen @Natasha_Jay the thing is, there is no change-over "period" once you use this daily, your org begins lose its institutional memory

[jwdt@mastodon.social]

@cmthiede @Natasha_Jay in this case I thought what they're paying for was mostly plausible deniability and blame shifting when investors find out that the numbers you showed them were 20x better than reality.

[zl2tod@mastodon.online]

@Natasha_Jay

"When you believe in things
you don't understand
then you suffer"

Stevie Wonder - Superstition

https://www.youtube.com/watch?v=7_tmeHCO1IM

[epic_null@infosec.exchange]

@Natasha_Jay I hope they find they have grounds to sue the creator of the AI agent. And that they do so.

Honetsly, it should not be on non-technical people to realize this shit is bullshit - those selling the bullshit should be held accountable for intentionally misleading their customers.

[drwho@masto.hackers.town]

@ZenHeathen @Natasha_Jay Agreed.

[jeremy_pm@mastodon.nz]

@Natasha_Jay

Remember #NZPol peeps our coalition of corruption have been regularly using ai for research and policy decisions.

[pizzademon@mastodon.online]

@Natasha_Jay
https://mastodon.online/@PizzaDemon/109888098461903861

[ncrazed@fd00.space]

@Natasha_Jay I can't decide if I want to know or not know how much these people are getting paid

[matildalove@wetdry.world]

@Natasha_Jay "i just found out my coal-powered hammer doesn't know how to turn a screw"

[0x0ddc0ffee@infosec.exchange]

@Natasha_Jay I suspect that one of the few applications where a heavily hallucinating LLM can outperform a human would be in replacing board members, C-suite executives, and their direct reports. I propose a longitudinal study with a control group of high level executives using real data, and experimental group using hallucinated, or maybe even totally random data filtered into plausible ranges, using executive compensation deltas as the metric.

[drahardja@sfba.social]

@Natasha_Jay This part in the original post is fantastic:

“The worst part I raised concerns about needing validation in November and got told I was slowing down innovation.”

hxxps://www.reddit.com/r/analytics/comments/1r4dsq2/we_just_found_out_our_ai_has_been_making_up/

[davidr@hachyderm.io]

@Epic_Null @Natasha_Jay That's bad, but honestly--switching to a new system without ever double checking anything?

Everyone involved should be fired, including the #AI