My 70-year-old mum came over for a visit today, and she'd read some of the news stories about Anthropic researchers estimating that there's a 10% chance their AI systems will wipe out humanity by 2030.
-
How do they come up with those percentages? Do they just make them up, or do you think they have their chatbots make them up for them?
That’s a great question. I recently saw a collection of different prominent people’s guess about the number. The guesses ranged from 0% to 99.999999%
I am sure some of them must have asked a chatbot for the number. And the irony isn’t lost on me. Imagine asking a chatbot “how likely are you to destroy humanity” and then trusting the answer it gives you.
-
@smallerdemon Being goal-oriented has been promoted as a desirable personality trait without enough attention to the quality of the goals.
With these people, I'd much prefer that they were layabouts.
@Aron @datarama -
My 70-year-old mum came over for a visit today, and she'd read some of the news stories about Anthropic researchers estimating that there's a 10% chance their AI systems will wipe out humanity by 2030.
So she had some very concerned questions for her computer scientist son. They were:
1. "How do they come up with those percentages? Do they just make them up, or do you think they have their chatbots make them up for them?"
2. "Are the Anthropic people swindlers or are they actually mentally unwell?"
3. "How can a guy who looks like his biggest worry ought to be whether his parents remembered to pack his school lunch be lead researcher for Anthropic?"(I had to tell her that the press had misled her: Jacob Coxon was not lead researcher, just one of many researchers in their pretraining team.)
She then remarked that if *she* was an amoral CEO of an AI cult, she'd keep an eye out for employees who seemed like they were doing poorly and might want to leave soon. Then she'd offer them 10 million dollars in cash to "resign out of concern for the future of humanity".
@datarama your mum, like many mums I've known, could have ruled the world an would probably have done a better job than the people ruling it at the time...
-
My 70-year-old mum came over for a visit today, and she'd read some of the news stories about Anthropic researchers estimating that there's a 10% chance their AI systems will wipe out humanity by 2030.
So she had some very concerned questions for her computer scientist son. They were:
1. "How do they come up with those percentages? Do they just make them up, or do you think they have their chatbots make them up for them?"
2. "Are the Anthropic people swindlers or are they actually mentally unwell?"
3. "How can a guy who looks like his biggest worry ought to be whether his parents remembered to pack his school lunch be lead researcher for Anthropic?"(I had to tell her that the press had misled her: Jacob Coxon was not lead researcher, just one of many researchers in their pretraining team.)
She then remarked that if *she* was an amoral CEO of an AI cult, she'd keep an eye out for employees who seemed like they were doing poorly and might want to leave soon. Then she'd offer them 10 million dollars in cash to "resign out of concern for the future of humanity".
@datarama
i have been waiting for my flying car since 1975, once i get that i will worry about ai taking over the world "in 10 years".....ill be long dead before either happens.... -
@krig Also, she taught me to code when I was a tiny kid.
-
@datarama I am now concerned there is a 10% chance your mum may take over the world.
-
@ChrisUplus @datarama that’s something I could get behind!
-
@lady_alys @datarama @krig apparently there are an awful lot of geeks in the Knitting community, along with a lot of Grannies. And quite a few Granny Geeks.
-
My 70-year-old mum came over for a visit today, and she'd read some of the news stories about Anthropic researchers estimating that there's a 10% chance their AI systems will wipe out humanity by 2030.
So she had some very concerned questions for her computer scientist son. They were:
1. "How do they come up with those percentages? Do they just make them up, or do you think they have their chatbots make them up for them?"
2. "Are the Anthropic people swindlers or are they actually mentally unwell?"
3. "How can a guy who looks like his biggest worry ought to be whether his parents remembered to pack his school lunch be lead researcher for Anthropic?"(I had to tell her that the press had misled her: Jacob Coxon was not lead researcher, just one of many researchers in their pretraining team.)
She then remarked that if *she* was an amoral CEO of an AI cult, she'd keep an eye out for employees who seemed like they were doing poorly and might want to leave soon. Then she'd offer them 10 million dollars in cash to "resign out of concern for the future of humanity".
Knowing folk like your mom are out there leaves me in despair when I see the group photo of any set of organizers, and they are all men. Of a certain age. In suits.
We could have packed the supreme court with women like your mom, but no, we may not.
-
@datarama - still - all things considered - it might not be a Bank’s wisest business plan to offer 25 year mortgages. Or even 5 year car loans.
On the plus side, the concern over (the already breached) 1.5 degree world temperature change limitation by 2050 may be a moot point.
-
My question would be: "Why are they actively developing something that they already see destroying humanity?"
If I would be researching such stuff, I would immediately cease and stop as soon as I figure that it could be a threat to humanity. But these guys are actively pushing forward and further and further.
@Aron @datarama Some of them think by creating a benevolent machine god, they will save infinity future lives, and that this justifies almost any reprehensible action or sacrifice today. “It doesn’t matter if we actively push global warming now, because we’re making an AI to tell us how to fix it later!”
This particular cult is called “Longtermism”. It’s the L in TESCREAL.
Never mind that we already know what we have to do to fix global warming.
-
@Aron @datarama Some of them think by creating a benevolent machine god, they will save infinity future lives, and that this justifies almost any reprehensible action or sacrifice today. “It doesn’t matter if we actively push global warming now, because we’re making an AI to tell us how to fix it later!”
This particular cult is called “Longtermism”. It’s the L in TESCREAL.
Never mind that we already know what we have to do to fix global warming.
@Aron @datarama Some of them actually fear “Roko’s basilisk”, the idea that a seemingly benevolent AI might decide to simulate facsimiles of people who didn’t help it exist and torture those facsimiles forever. The idea is profoundly, obviously stupid, yet some of the richest people in the world seem to take it seriously.
-
My 70-year-old mum came over for a visit today, and she'd read some of the news stories about Anthropic researchers estimating that there's a 10% chance their AI systems will wipe out humanity by 2030.
So she had some very concerned questions for her computer scientist son. They were:
1. "How do they come up with those percentages? Do they just make them up, or do you think they have their chatbots make them up for them?"
2. "Are the Anthropic people swindlers or are they actually mentally unwell?"
3. "How can a guy who looks like his biggest worry ought to be whether his parents remembered to pack his school lunch be lead researcher for Anthropic?"(I had to tell her that the press had misled her: Jacob Coxon was not lead researcher, just one of many researchers in their pretraining team.)
She then remarked that if *she* was an amoral CEO of an AI cult, she'd keep an eye out for employees who seemed like they were doing poorly and might want to leave soon. Then she'd offer them 10 million dollars in cash to "resign out of concern for the future of humanity".
@datarama Funny, usually the term "elder abuse" refers to someone being a dick to an older person. But I think your mum just burned the shit out of every C-suite executive working with "AI*. Abuse from an elder?
I'm envious of you having her as your mother either way.
-
My 70-year-old mum came over for a visit today, and she'd read some of the news stories about Anthropic researchers estimating that there's a 10% chance their AI systems will wipe out humanity by 2030.
So she had some very concerned questions for her computer scientist son. They were:
1. "How do they come up with those percentages? Do they just make them up, or do you think they have their chatbots make them up for them?"
2. "Are the Anthropic people swindlers or are they actually mentally unwell?"
3. "How can a guy who looks like his biggest worry ought to be whether his parents remembered to pack his school lunch be lead researcher for Anthropic?"(I had to tell her that the press had misled her: Jacob Coxon was not lead researcher, just one of many researchers in their pretraining team.)
She then remarked that if *she* was an amoral CEO of an AI cult, she'd keep an eye out for employees who seemed like they were doing poorly and might want to leave soon. Then she'd offer them 10 million dollars in cash to "resign out of concern for the future of humanity".
@datarama Anthropic basically admits they've failed at doing alignment. Multiple people have shown it's possible to get AI to spit out detailed instructions on bioweapon creation. I don't think knowing how to make Anthrax is something everyone with a $20 sub should do.
Y'all are smoking something if you think this is a fad
-
T tofticles@helvede.net shared this topic
She was so talented.
