<![CDATA[this story about openai "breaking containment" is such bullshit if you know anything about how computer security is supposed to be done.]]>this story about openai "breaking containment" is such bullshit if you know anything about how computer security is supposed to be done. if a program accesses a remote system it's because you decided to let it do that. LLMs don't have magical powers that can work around "we unplugged the ethernet"

]]>https://forum.fedi.dk/topic/1e90dae9-d5a5-4d8d-a99a-de2d6421f3c9/this-story-about-openai-breaking-containment-is-such-bullshit-if-you-know-anything-about-how-computer-security-is-supposed-to-be-done.RSS for NodeFri, 24 Jul 2026 00:41:41 GMTThu, 23 Jul 2026 08:16:27 GMT60<![CDATA[Reply to this story about openai "breaking containment" is such bullshit if you know anything about how computer security is supposed to be done. on Thu, 23 Jul 2026 12:00:53 GMT]]>@jcoglan Still no. They didn't "let it do that."

Someone, somewhere, a human, *told it to do that.*

]]>https://forum.fedi.dk/post/https://social.vivaldi.net/users/lproven/statuses/116969180579433472https://forum.fedi.dk/post/https://social.vivaldi.net/users/lproven/statuses/116969180579433472Thu, 23 Jul 2026 12:00:53 GMT<![CDATA[Reply to this story about openai "breaking containment" is such bullshit if you know anything about how computer security is supposed to be done. on Thu, 23 Jul 2026 11:12:15 GMT]]>@jcoglan yes it was bullshit - just hype for their latest fund raise, which was announced two days later (today):
https://londondaily.com/openai-secures-40-billion-funding-reaches-300-billion-valuation
is such a pump n dump.

]]>https://forum.fedi.dk/post/https://mastodon.social/users/patrickleavy/statuses/116968989343641235https://forum.fedi.dk/post/https://mastodon.social/users/patrickleavy/statuses/116968989343641235Thu, 23 Jul 2026 11:12:15 GMT<![CDATA[Reply to this story about openai "breaking containment" is such bullshit if you know anything about how computer security is supposed to be done. on Thu, 23 Jul 2026 11:10:14 GMT]]>@TheoEsc

"got passed the allowlist" still means it had access to arbitrarily execute code. And arbitrary code execution leads to... Arbitrary code execution.

]]>https://forum.fedi.dk/post/https://mastodon.social/users/shaknais/statuses/116968981424853600https://forum.fedi.dk/post/https://mastodon.social/users/shaknais/statuses/116968981424853600Thu, 23 Jul 2026 11:10:14 GMT<![CDATA[Reply to this story about openai "breaking containment" is such bullshit if you know anything about how computer security is supposed to be done. on Thu, 23 Jul 2026 10:54:06 GMT]]>@TheoEsc ok but that means they found a bug in the firewall, not that the AI "disobeyed its instructions" which is the framing of these types of stories, and one which makes no sense at a conceptual level

]]>https://forum.fedi.dk/post/https://mastodon.social/users/jcoglan/statuses/116968917982386903https://forum.fedi.dk/post/https://mastodon.social/users/jcoglan/statuses/116968917982386903Thu, 23 Jul 2026 10:54:06 GMT<![CDATA[Reply to this story about openai "breaking containment" is such bullshit if you know anything about how computer security is supposed to be done. on Thu, 23 Jul 2026 10:43:03 GMT]]>@jcoglan Kind of. It wasn't totally isolated from the Internet but had a "a curated allowlist that permits routine package installation". The AI got past the allowlist, and then successfully attacked an external company. It's still potentially worrying, even if only because more people are likely to be running poorly-isolated hacking AIs. https://simonwillison.net/2026/Jul/22/openai-cyberattack/

]]>https://forum.fedi.dk/post/https://mastodon.social/users/TheoEsc/statuses/116968874529318362https://forum.fedi.dk/post/https://mastodon.social/users/TheoEsc/statuses/116968874529318362Thu, 23 Jul 2026 10:43:03 GMT<![CDATA[Reply to this story about openai "breaking containment" is such bullshit if you know anything about how computer security is supposed to be done. on Thu, 23 Jul 2026 10:29:47 GMT]]>@jcoglan "We just ask our uncleared staff nicely not to access the files that require security clearances"

]]>https://forum.fedi.dk/post/https://mastodon.me.uk/users/emily_s/statuses/116968822375253426https://forum.fedi.dk/post/https://mastodon.me.uk/users/emily_s/statuses/116968822375253426Thu, 23 Jul 2026 10:29:47 GMT<![CDATA[Reply to this story about openai "breaking containment" is such bullshit if you know anything about how computer security is supposed to be done. on Thu, 23 Jul 2026 10:10:25 GMT]]>@jcoglan Running in a chroot or container or VM is no substitute for airgapping the computer.

]]>https://forum.fedi.dk/post/https://scholar.social/users/wim_v12e/statuses/116968746226198247https://forum.fedi.dk/post/https://scholar.social/users/wim_v12e/statuses/116968746226198247Thu, 23 Jul 2026 10:10:25 GMT<![CDATA[Reply to this story about openai "breaking containment" is such bullshit if you know anything about how computer security is supposed to be done. on Thu, 23 Jul 2026 08:46:57 GMT]]>@jcoglan i guess this is exactly what they did for “containment”

]]>https://forum.fedi.dk/post/https://hachyderm.io/users/prema/statuses/116968418002613079https://forum.fedi.dk/post/https://hachyderm.io/users/prema/statuses/116968418002613079Thu, 23 Jul 2026 08:46:57 GMT<![CDATA[Reply to this story about openai "breaking containment" is such bullshit if you know anything about how computer security is supposed to be done. on Thu, 23 Jul 2026 08:36:31 GMT]]>@jcoglan it's a sign theyre running out of money when they gotta dial up the science fiction

]]>https://forum.fedi.dk/post/https://hails.org/users/hailey/statuses/116968376984883319https://forum.fedi.dk/post/https://hails.org/users/hailey/statuses/116968376984883319Thu, 23 Jul 2026 08:36:31 GMT<![CDATA[Reply to this story about openai "breaking containment" is such bullshit if you know anything about how computer security is supposed to be done. on Thu, 23 Jul 2026 08:27:24 GMT]]>"the robot went to a website" wow should we throw a party should we invite tim berners lee

]]>https://forum.fedi.dk/post/https://mastodon.social/users/jcoglan/statuses/116968341134719694https://forum.fedi.dk/post/https://mastodon.social/users/jcoglan/statuses/116968341134719694Thu, 23 Jul 2026 08:27:24 GMT<![CDATA[Reply to this story about openai "breaking containment" is such bullshit if you know anything about how computer security is supposed to be done. on Thu, 23 Jul 2026 08:22:13 GMT]]>first we got "prompt injection" aka "deciding to forget two decades of knowledge about secure composition of code and inputs, langsec, etc" and now we have "deciding to forget everything about capability-based security and writing a call of duty script about it"

]]>https://forum.fedi.dk/post/https://mastodon.social/users/jcoglan/statuses/116968320774108794https://forum.fedi.dk/post/https://mastodon.social/users/jcoglan/statuses/116968320774108794Thu, 23 Jul 2026 08:22:13 GMT<![CDATA[Reply to this story about openai "breaking containment" is such bullshit if you know anything about how computer security is supposed to be done. on Thu, 23 Jul 2026 08:20:00 GMT]]>if your "containment" is "telling the robot to be a good boy" you're not a serious person

]]>https://forum.fedi.dk/post/https://mastodon.social/users/jcoglan/statuses/116968312023825542https://forum.fedi.dk/post/https://mastodon.social/users/jcoglan/statuses/116968312023825542Thu, 23 Jul 2026 08:20:00 GMT