Mom: What's with these AIs escaping and hacking people?
-
@jwz A while ago, a guy from Anthropic quit over fears that he was working on something that would kill all humans, and it made headlines that the other Anthropic guys also thought that. One of them even said that he believed that the chance of AI eradicating human life within the decade was "about 10%".
So my 70-year-old mum came over for a visit, and she had some very concerned questions to her computer scientist son. They were:
1. "Where do they get those percentages from? Do they just make them up, or do you think they have their chatbot make them up?"
2. "How can the lead researcher for Anthropic be someone who looks like his biggest worry should be whether his parents have packed his school lunch?"
3. "Are the staff at Anthropic swindlers, or are they actually mentally ill?"@datarama 3: "Why not both?"
-
@datarama 3: "Why not both?"
@jwz She then thought it over, and remarked that if she was "CEO of an AI cult" (her choice of words), she'd look for employees who looked like they weren't doing well and seemed to have a foot out of the door already. Then she'd discreetly offer them 20 million dollars in cash to leave with a public story about how the tech is so awesome it's soon going to become a science fiction machine overlord.
-
Mom: What's with these AIs escaping and hacking people?
Me: You park your car at the top of a hill. You leave a note on the dashboard that says "please be good" and then you pull the parking brake. The car careens down the hill, smashes everything up, and you put out a press release saying "My car ignored my instructions! It hallucinated! It went rogue!" Your insurance company not only believes you, but invests $100 million in your company.
Mom: Jesus Fucking Christ
@jwz AI sandbox engineer: okay I pulled the parking brake just like you asked.
*drops on desk* now what?
-
Mom: What's with these AIs escaping and hacking people?
Me: You park your car at the top of a hill. You leave a note on the dashboard that says "please be good" and then you pull the parking brake. The car careens down the hill, smashes everything up, and you put out a press release saying "My car ignored my instructions! It hallucinated! It went rogue!" Your insurance company not only believes you, but invests $100 million in your company.
Mom: Jesus Fucking Christ
@jwz they literally fed it training data from competitive hacking contests. All the behaviours are common tactics. So it wasn't even inventive.
If an individual hacked these companies, they'd be arrested. The only real question is, why aren't AI companies legally responsible for the AIs they are prompting?
-
P pelle@veganism.social shared this topic
-
Mom: What's with these AIs escaping and hacking people?
Me: You park your car at the top of a hill. You leave a note on the dashboard that says "please be good" and then you pull the parking brake. The car careens down the hill, smashes everything up, and you put out a press release saying "My car ignored my instructions! It hallucinated! It went rogue!" Your insurance company not only believes you, but invests $100 million in your company.
Mom: Jesus Fucking Christ
@jwz @GayDeceiver if only I had no ethics, I could use AI to take all the dollars, too!
-
Mom: What's with these AIs escaping and hacking people?
Me: You park your car at the top of a hill. You leave a note on the dashboard that says "please be good" and then you pull the parking brake. The car careens down the hill, smashes everything up, and you put out a press release saying "My car ignored my instructions! It hallucinated! It went rogue!" Your insurance company not only believes you, but invests $100 million in your company.
Mom: Jesus Fucking Christ
@jwz i left my car in gear and used parking brake. 1st gear will hold the car.
-
Mom: What's with these AIs escaping and hacking people?
Me: You park your car at the top of a hill. You leave a note on the dashboard that says "please be good" and then you pull the parking brake. The car careens down the hill, smashes everything up, and you put out a press release saying "My car ignored my instructions! It hallucinated! It went rogue!" Your insurance company not only believes you, but invests $100 million in your company.
Mom: Jesus Fucking Christ
@jwz fsck insurance companies like allstate.
-
Mom: What's with these AIs escaping and hacking people?
Me: You park your car at the top of a hill. You leave a note on the dashboard that says "please be good" and then you pull the parking brake. The car careens down the hill, smashes everything up, and you put out a press release saying "My car ignored my instructions! It hallucinated! It went rogue!" Your insurance company not only believes you, but invests $100 million in your company.
Mom: Jesus Fucking Christ
@jwz Wild in the Streets
A 12 year old will hack into fossil fuels and usurp energy markets, while buying out tech bros shareholdings. But you'll only be able to reemerge from your bunkers, if you can game with them.
-
Mom: What's with these AIs escaping and hacking people?
Me: You park your car at the top of a hill. You leave a note on the dashboard that says "please be good" and then you pull the parking brake. The car careens down the hill, smashes everything up, and you put out a press release saying "My car ignored my instructions! It hallucinated! It went rogue!" Your insurance company not only believes you, but invests $100 million in your company.
Mom: Jesus Fucking Christ
A rogue car you say?? How can I invest in your self-driving tech startup?
-
@jwz A while ago, a guy from Anthropic quit over fears that he was working on something that would kill all humans, and it made headlines that the other Anthropic guys also thought that. One of them even said that he believed that the chance of AI eradicating human life within the decade was "about 10%".
So my 70-year-old mum came over for a visit, and she had some very concerned questions to her computer scientist son. They were:
1. "Where do they get those percentages from? Do they just make them up, or do you think they have their chatbot make them up?"
2. "How can the lead researcher for Anthropic be someone who looks like his biggest worry should be whether his parents have packed his school lunch?"
3. "Are the staff at Anthropic swindlers, or are they actually mentally ill?" -
@jwz A while ago, a guy from Anthropic quit over fears that he was working on something that would kill all humans, and it made headlines that the other Anthropic guys also thought that. One of them even said that he believed that the chance of AI eradicating human life within the decade was "about 10%".
So my 70-year-old mum came over for a visit, and she had some very concerned questions to her computer scientist son. They were:
1. "Where do they get those percentages from? Do they just make them up, or do you think they have their chatbot make them up?"
2. "How can the lead researcher for Anthropic be someone who looks like his biggest worry should be whether his parents have packed his school lunch?"
3. "Are the staff at Anthropic swindlers, or are they actually mentally ill?"@datarama Your mum has a far better appreciation of AI than any government politician in Australia.
-
Mom: What's with these AIs escaping and hacking people?
Me: You park your car at the top of a hill. You leave a note on the dashboard that says "please be good" and then you pull the parking brake. The car careens down the hill, smashes everything up, and you put out a press release saying "My car ignored my instructions! It hallucinated! It went rogue!" Your insurance company not only believes you, but invests $100 million in your company.
Mom: Jesus Fucking Christ
@jwz In my little town we are at the forefront of autonomous vehicle AI research.
We have a servo/truckers lounge and it sits at the top of a hill. We've had one rogue truck and one rogue bus do exactly this, parked with the handbrake left off, rolling down the driveway, crossing the highway and crashing, across the last year.
The truck crashed into a house and stopped at the foot of an elderly couple's bed. But for some reason, Softbank isn't returning my calls
-
Mom: What's with these AIs escaping and hacking people?
Me: You park your car at the top of a hill. You leave a note on the dashboard that says "please be good" and then you pull the parking brake. The car careens down the hill, smashes everything up, and you put out a press release saying "My car ignored my instructions! It hallucinated! It went rogue!" Your insurance company not only believes you, but invests $100 million in your company.
Mom: Jesus Fucking Christ
@jwz you misspelled 'billion'
-
@jwz She then thought it over, and remarked that if she was "CEO of an AI cult" (her choice of words), she'd look for employees who looked like they weren't doing well and seemed to have a foot out of the door already. Then she'd discreetly offer them 20 million dollars in cash to leave with a public story about how the tech is so awesome it's soon going to become a science fiction machine overlord.
-
@jwz they literally fed it training data from competitive hacking contests. All the behaviours are common tactics. So it wasn't even inventive.
If an individual hacked these companies, they'd be arrested. The only real question is, why aren't AI companies legally responsible for the AIs they are prompting?
-
Mom: What's with these AIs escaping and hacking people?
Me: You park your car at the top of a hill. You leave a note on the dashboard that says "please be good" and then you pull the parking brake. The car careens down the hill, smashes everything up, and you put out a press release saying "My car ignored my instructions! It hallucinated! It went rogue!" Your insurance company not only believes you, but invests $100 million in your company.
Mom: Jesus Fucking Christ
@jwz With the added detail that you also built your own car and decided to test its faulty parking brake on a public road
-
@jwz AI sandbox engineer: okay I pulled the parking brake just like you asked.
*drops on desk* now what?
Ah! There's the problem.
That parking brake is designed for a hand which has only 4 fingers and 1 opposed thumb, not an AI-enhanced hand with a variable-but-greater-than-4 number of extensible fingers. -
Mom: What's with these AIs escaping and hacking people?
Me: You park your car at the top of a hill. You leave a note on the dashboard that says "please be good" and then you pull the parking brake. The car careens down the hill, smashes everything up, and you put out a press release saying "My car ignored my instructions! It hallucinated! It went rogue!" Your insurance company not only believes you, but invests $100 million in your company.
Mom: Jesus Fucking Christ
@jwz This is just too real. Way too apt of an explanation.
-
Mom: What's with these AIs escaping and hacking people?
Me: You park your car at the top of a hill. You leave a note on the dashboard that says "please be good" and then you pull the parking brake. The car careens down the hill, smashes everything up, and you put out a press release saying "My car ignored my instructions! It hallucinated! It went rogue!" Your insurance company not only believes you, but invests $100 million in your company.
Mom: Jesus Fucking Christ
@jwz I've read through a few of these cases, mostly it seems like they are completely inept at building sandboxes.
-
Mom: What's with these AIs escaping and hacking people?
Me: You park your car at the top of a hill. You leave a note on the dashboard that says "please be good" and then you pull the parking brake. The car careens down the hill, smashes everything up, and you put out a press release saying "My car ignored my instructions! It hallucinated! It went rogue!" Your insurance company not only believes you, but invests $100 million in your company.
Mom: Jesus Fucking Christ
@jwz Why are we training #ai with the Internet (because its faster is not a good answer)? How can we possibly expect good outcomes with they are weaned on mostly garbage and lies? Do you plop your kid at the tv with the remote and 20 years later set them loose on society saying 'be good'? I became so curious about that I decided to ask. This is the answer I got:
