<?xml version="1.0" encoding="UTF-8"?><rss xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:content="http://purl.org/rss/1.0/modules/content/" xmlns:atom="http://www.w3.org/2005/Atom" version="2.0"><channel><title><![CDATA[This article starts with a story from someone who tried Claude Code and found it amazing, but then switches to the same person a few months later seeing what a disaster it’s been.]]></title><description><![CDATA[<p><a href="https://calnewport.com/on-ai-coding-and-its-discontents/" rel="nofollow noopener">This article</a> starts with a story from someone who tried Claude Code and found it amazing, but then switches to the same person a few months later seeing what a disaster it’s been. This quote is key:</p><blockquote><p>The problem is that code produced by an AI agent looks reasonable, but can contain ‘hard-to-spot bugs’ that end up causing major problems</p></blockquote><p>LLMs, by their nature, generate <em>statistically plausible</em> output. That is <em>often</em> a set that overlaps with <em>correct</em> output. But the things that are not correct look exactly the same as the ones they are. </p><p>Learning to review code is <em>hard</em>. You look for the bugs that you expect to be possible implementing it by using your theory of mind for the person writing the code and the kinds of things that they might overlook (not necessarily a <em>specific</em> person, but the kinds of things people miss) and also common bug classes.</p><p>And the big help is that the person writing the code is not thinking adversarially. They are not <em>trying</em> to sneak bugs in. Normally. Unless they’re a supply-chain attacker, and we’ve a depressing amount of evidence that code review doesn’t catch supply-chain attacks.</p><p>An LLM is not trying to do anything. It has no intent. But it is a machine that is trained on code that <em>made it past code review</em>. The kind of bugs that it will generate are ones that look like code that appeared in production. This is exactly what an attacker would do: try to write code that looks correct but is subtly wrong.</p><p>I’m only being <em>slightly</em> flippant when I say LLMs are a mechanism for bringing supply chain attacks in house.</p>]]></description><link>https://forum.fedi.dk/topic/23b59779-763f-41f2-a77c-09a47fcd9012/this-article-starts-with-a-story-from-someone-who-tried-claude-code-and-found-it-amazing-but-then-switches-to-the-same-person-a-few-months-later-seeing-what-a-disaster-it-s-been.</link><generator>RSS for Node</generator><lastBuildDate>Sun, 16 Aug 2026 15:18:24 GMT</lastBuildDate><atom:link href="https://forum.fedi.dk/topic/23b59779-763f-41f2-a77c-09a47fcd9012.rss" rel="self" type="application/rss+xml"/><pubDate>Wed, 12 Aug 2026 07:47:53 GMT</pubDate><ttl>60</ttl><item><title><![CDATA[Reply to This article starts with a story from someone who tried Claude Code and found it amazing, but then switches to the same person a few months later seeing what a disaster it’s been. on Sat, 15 Aug 2026 09:27:33 GMT]]></title><description><![CDATA[<p><span><a href="/user/david_chisnall%40infosec.exchange">@<span>david_chisnall</span></a></span> </p><p>AIs are designed to maximise plausibility, not accuracy. Because they can "lie" so convincingly, they are particularly dangerous for anything important.</p><p>Glad that coder eventually came to realise that. We need less hype and more warnings.</p><p>LLM AI should never be used for anything but entertainment purposes.<br /><a href="https://mastodon.social/tags/RegulateAI" rel="tag">#<span>RegulateAI</span></a></p>]]></description><link>https://forum.fedi.dk/post/https://mastodon.social/users/TCatInReality/statuses/117098810810586340</link><guid isPermaLink="true">https://forum.fedi.dk/post/https://mastodon.social/users/TCatInReality/statuses/117098810810586340</guid><dc:creator><![CDATA[tcatinreality@mastodon.social]]></dc:creator><pubDate>Sat, 15 Aug 2026 09:27:33 GMT</pubDate></item><item><title><![CDATA[Reply to This article starts with a story from someone who tried Claude Code and found it amazing, but then switches to the same person a few months later seeing what a disaster it’s been. on Sat, 15 Aug 2026 09:10:41 GMT]]></title><description><![CDATA[<p><span><a href="https://mastodon.social/@ThibaultDu">@<span>ThibaultDu</span></a></span> <span><a href="/user/david_chisnall%40infosec.exchange">@<span>david_chisnall</span></a></span> <span><a href="/user/briankrebs%40infosec.exchange">@<span>briankrebs</span></a></span> team software delivery up to this point has been drive-by anthropology, psychology, and geology, and while we may not have qualifications in any of those things, we at least had footholds. Now we're being asked to climb completely smooth surfaces.</p>]]></description><link>https://forum.fedi.dk/post/https://mastodon.social/users/rgarner/statuses/117098744473870674</link><guid isPermaLink="true">https://forum.fedi.dk/post/https://mastodon.social/users/rgarner/statuses/117098744473870674</guid><dc:creator><![CDATA[rgarner@mastodon.social]]></dc:creator><pubDate>Sat, 15 Aug 2026 09:10:41 GMT</pubDate></item><item><title><![CDATA[Reply to This article starts with a story from someone who tried Claude Code and found it amazing, but then switches to the same person a few months later seeing what a disaster it’s been. on Sat, 15 Aug 2026 07:06:24 GMT]]></title><description><![CDATA[<p><span><a href="/user/lproven%40social.vivaldi.net" rel="nofollow noopener">@<span>lproven</span></a></span> Mmm, salted supply-chain attacks.</p>]]></description><link>https://forum.fedi.dk/post/https://infosec.exchange/users/david_chisnall/statuses/117098255746976223</link><guid isPermaLink="true">https://forum.fedi.dk/post/https://infosec.exchange/users/david_chisnall/statuses/117098255746976223</guid><dc:creator><![CDATA[david_chisnall@infosec.exchange]]></dc:creator><pubDate>Sat, 15 Aug 2026 07:06:24 GMT</pubDate></item><item><title><![CDATA[Reply to This article starts with a story from someone who tried Claude Code and found it amazing, but then switches to the same person a few months later seeing what a disaster it’s been. on Fri, 14 Aug 2026 21:32:50 GMT]]></title><description><![CDATA[<p><span><a href="/user/david_chisnall%40infosec.exchange">@<span>david_chisnall</span></a></span> :%s/brining/bringing/g</p>]]></description><link>https://forum.fedi.dk/post/https://social.vivaldi.net/users/lproven/statuses/117096000449766121</link><guid isPermaLink="true">https://forum.fedi.dk/post/https://social.vivaldi.net/users/lproven/statuses/117096000449766121</guid><dc:creator><![CDATA[lproven@social.vivaldi.net]]></dc:creator><pubDate>Fri, 14 Aug 2026 21:32:50 GMT</pubDate></item><item><title><![CDATA[Reply to This article starts with a story from someone who tried Claude Code and found it amazing, but then switches to the same person a few months later seeing what a disaster it’s been. on Thu, 13 Aug 2026 09:49:03 GMT]]></title><description><![CDATA[<p><span><a href="/user/david_chisnall%40infosec.exchange">@<span>david_chisnall</span></a></span> "His boss told him that if it happened one more time, he’d be fired." Doesn't sound like a place to work at.</p>]]></description><link>https://forum.fedi.dk/post/https://mastodon.social/users/kleisli/statuses/117087570701326503</link><guid isPermaLink="true">https://forum.fedi.dk/post/https://mastodon.social/users/kleisli/statuses/117087570701326503</guid><dc:creator><![CDATA[kleisli@mastodon.social]]></dc:creator><pubDate>Thu, 13 Aug 2026 09:49:03 GMT</pubDate></item><item><title><![CDATA[Reply to This article starts with a story from someone who tried Claude Code and found it amazing, but then switches to the same person a few months later seeing what a disaster it’s been. on Wed, 12 Aug 2026 22:14:35 GMT]]></title><description><![CDATA[<p><span><a href="/user/david_chisnall%40infosec.exchange">@<span>david_chisnall</span></a></span> <span><a href="/user/briankrebs%40infosec.exchange">@<span>briankrebs</span></a></span> I went on a mild anti-AI rant this week before a presentation I was giving about strata management finance.</p><p>Strata management is highly regulated in NSW, has rapidly changing legislation over the last 4 years, and is highly technical, and I made the point that when it came to LLMs providing subtly wrong answers they’re the ones it’s often harder to pin down as wrong.</p><p>I describe LLM outputs as “answer-shaped”, and “correct-adjacent to varying degrees” – pareidolia unfortunately fills in many gaps between those and “correct answer”.</p>]]></description><link>https://forum.fedi.dk/post/https://social.europlus.zone/users/europlus/statuses/117084839985576979</link><guid isPermaLink="true">https://forum.fedi.dk/post/https://social.europlus.zone/users/europlus/statuses/117084839985576979</guid><dc:creator><![CDATA[europlus@social.europlus.zone]]></dc:creator><pubDate>Wed, 12 Aug 2026 22:14:35 GMT</pubDate></item><item><title><![CDATA[Reply to This article starts with a story from someone who tried Claude Code and found it amazing, but then switches to the same person a few months later seeing what a disaster it’s been. on Wed, 12 Aug 2026 20:06:05 GMT]]></title><description><![CDATA[<p><span><a href="/user/rhelune%40todon.eu">@<span>rhelune</span></a></span> <span><a href="/user/david_chisnall%40infosec.exchange">@<span>david_chisnall</span></a></span> I have a lot of stories about bugs in production. Not all are critical. In a non toxic team everybody is in charge about quality and if something goes wrong you work on the cause and don't blame individuals. Also, a lot of companies have external devs. They usually do not care too much about anything (I don't blame them, either). Having defects and regressions is the norm. It is not the exception.</p>]]></description><link>https://forum.fedi.dk/post/https://fosstodon.org/users/demiurg/statuses/117084334677236489</link><guid isPermaLink="true">https://forum.fedi.dk/post/https://fosstodon.org/users/demiurg/statuses/117084334677236489</guid><dc:creator><![CDATA[demiurg@fosstodon.org]]></dc:creator><pubDate>Wed, 12 Aug 2026 20:06:05 GMT</pubDate></item><item><title><![CDATA[Reply to This article starts with a story from someone who tried Claude Code and found it amazing, but then switches to the same person a few months later seeing what a disaster it’s been. on Wed, 12 Aug 2026 19:28:58 GMT]]></title><description><![CDATA[<p><span><a href="/user/david_chisnall%40infosec.exchange">@<span>david_chisnall</span></a></span> </p><p>You forgot the 'pleasing' part.</p><p>A "statistically plausible pleasing machine."  LLMs will give you the answer you want based on your repeated clarification prompts.</p>]]></description><link>https://forum.fedi.dk/post/https://mstdn.social/users/Littlebobbytables/statuses/117084188758363742</link><guid isPermaLink="true">https://forum.fedi.dk/post/https://mstdn.social/users/Littlebobbytables/statuses/117084188758363742</guid><dc:creator><![CDATA[littlebobbytables@mstdn.social]]></dc:creator><pubDate>Wed, 12 Aug 2026 19:28:58 GMT</pubDate></item><item><title><![CDATA[Reply to This article starts with a story from someone who tried Claude Code and found it amazing, but then switches to the same person a few months later seeing what a disaster it’s been. on Wed, 12 Aug 2026 19:01:02 GMT]]></title><description><![CDATA[<p><span><a href="/user/david_chisnall%40infosec.exchange">@<span>david_chisnall</span></a></span> <span><a href="/user/briankrebs%40infosec.exchange">@<span>briankrebs</span></a></span> I also often point out that, with a human colleague, I know what they are good or bad at, I know how they are feeling today, I know how good they understand the context of the task and therefore I know where to look for bugs. LLM-generated code: no idea, just as you wrote.</p>]]></description><link>https://forum.fedi.dk/post/https://mastodon.social/users/ThibaultDu/statuses/117084078875040437</link><guid isPermaLink="true">https://forum.fedi.dk/post/https://mastodon.social/users/ThibaultDu/statuses/117084078875040437</guid><dc:creator><![CDATA[thibaultdu@mastodon.social]]></dc:creator><pubDate>Wed, 12 Aug 2026 19:01:02 GMT</pubDate></item><item><title><![CDATA[Reply to This article starts with a story from someone who tried Claude Code and found it amazing, but then switches to the same person a few months later seeing what a disaster it’s been. on Wed, 12 Aug 2026 17:39:43 GMT]]></title><description><![CDATA[<p><span><a href="/user/dysfun%40social.treehouse.systems">@<span>dysfun</span></a></span> <span><a href="/user/david_chisnall%40infosec.exchange">@<span>david_chisnall</span></a></span> This is a very salty take.</p>]]></description><link>https://forum.fedi.dk/post/https://mastodon.nz/users/rupert/statuses/117083759134805378</link><guid isPermaLink="true">https://forum.fedi.dk/post/https://mastodon.nz/users/rupert/statuses/117083759134805378</guid><dc:creator><![CDATA[rupert@mastodon.nz]]></dc:creator><pubDate>Wed, 12 Aug 2026 17:39:43 GMT</pubDate></item><item><title><![CDATA[Reply to This article starts with a story from someone who tried Claude Code and found it amazing, but then switches to the same person a few months later seeing what a disaster it’s been. on Wed, 12 Aug 2026 17:37:51 GMT]]></title><description><![CDATA[<p><span><a href="/user/bontchev%40infosec.exchange">@<span>bontchev</span></a></span> <span><a href="/user/david_chisnall%40infosec.exchange">@<span>david_chisnall</span></a></span> OP makes a really subtle point there that I think deserves some more reflection; I'm going to be thinking about that angle for a while.</p>]]></description><link>https://forum.fedi.dk/post/https://infosec.exchange/users/darkuncle/statuses/117083751840414247</link><guid isPermaLink="true">https://forum.fedi.dk/post/https://infosec.exchange/users/darkuncle/statuses/117083751840414247</guid><dc:creator><![CDATA[darkuncle@infosec.exchange]]></dc:creator><pubDate>Wed, 12 Aug 2026 17:37:51 GMT</pubDate></item><item><title><![CDATA[Reply to This article starts with a story from someone who tried Claude Code and found it amazing, but then switches to the same person a few months later seeing what a disaster it’s been. on Wed, 12 Aug 2026 17:16:53 GMT]]></title><description><![CDATA[<p><span><a href="/user/david_chisnall%40infosec.exchange">@<span>david_chisnall</span></a></span> Well, I dunno... I've been using Claude since the beginning of the year and it *is* amazing. It has increased my productivity tremendously. Of course, I never trust it blindly and always verify by hand what it generates. And, yes, I sometimes find bugs in the generated code. Nevertheless, and despite the time I have to spend checking its generated code, it is still an amazing productivity-increasing tool.</p>]]></description><link>https://forum.fedi.dk/post/https://infosec.exchange/users/bontchev/statuses/117083669352792175</link><guid isPermaLink="true">https://forum.fedi.dk/post/https://infosec.exchange/users/bontchev/statuses/117083669352792175</guid><dc:creator><![CDATA[bontchev@infosec.exchange]]></dc:creator><pubDate>Wed, 12 Aug 2026 17:16:53 GMT</pubDate></item><item><title><![CDATA[Reply to This article starts with a story from someone who tried Claude Code and found it amazing, but then switches to the same person a few months later seeing what a disaster it’s been. on Wed, 12 Aug 2026 17:00:44 GMT]]></title><description><![CDATA[<p><span><a href="/user/kp%40bsd.network">@<span>kp</span></a></span> <span><a href="/user/david_chisnall%40infosec.exchange">@<span>david_chisnall</span></a></span> </p><p>I think one of the major unintentional lessons of this era (both technically &amp; politically) is the value of deep human experience.</p><p>Edit: Value &amp; intrinsically un-automatability.</p>]]></description><link>https://forum.fedi.dk/post/https://wandering.shop/users/cavyherd/statuses/117083605873158704</link><guid isPermaLink="true">https://forum.fedi.dk/post/https://wandering.shop/users/cavyherd/statuses/117083605873158704</guid><dc:creator><![CDATA[cavyherd@wandering.shop]]></dc:creator><pubDate>Wed, 12 Aug 2026 17:00:44 GMT</pubDate></item><item><title><![CDATA[Reply to This article starts with a story from someone who tried Claude Code and found it amazing, but then switches to the same person a few months later seeing what a disaster it’s been. on Wed, 12 Aug 2026 16:53:42 GMT]]></title><description><![CDATA[<p><span><a href="/user/chemicaleyeguy%40mstdn.science">@<span>ChemicalEyeGuy</span></a></span> <span><a href="/user/david_chisnall%40infosec.exchange">@<span>david_chisnall</span></a></span> </p><p>"Maybe it's more efficient just to burn  it all down &amp; start from scratch?"</p><p>"A case could be made...."</p><p>Oh wait—that was DOGE's rationale, too....</p>]]></description><link>https://forum.fedi.dk/post/https://wandering.shop/users/cavyherd/statuses/117083578189228503</link><guid isPermaLink="true">https://forum.fedi.dk/post/https://wandering.shop/users/cavyherd/statuses/117083578189228503</guid><dc:creator><![CDATA[cavyherd@wandering.shop]]></dc:creator><pubDate>Wed, 12 Aug 2026 16:53:42 GMT</pubDate></item><item><title><![CDATA[Reply to This article starts with a story from someone who tried Claude Code and found it amazing, but then switches to the same person a few months later seeing what a disaster it’s been. on Wed, 12 Aug 2026 16:50:58 GMT]]></title><description><![CDATA[<p><span><a href="/user/david_chisnall%40infosec.exchange">@<span>david_chisnall</span></a></span> <span><a href="/user/taupan%40mastodon.social">@<span>TauPan</span></a></span> </p><p>...like 3-dimensional survivor bias....</p>]]></description><link>https://forum.fedi.dk/post/https://wandering.shop/users/cavyherd/statuses/117083567450686983</link><guid isPermaLink="true">https://forum.fedi.dk/post/https://wandering.shop/users/cavyherd/statuses/117083567450686983</guid><dc:creator><![CDATA[cavyherd@wandering.shop]]></dc:creator><pubDate>Wed, 12 Aug 2026 16:50:58 GMT</pubDate></item><item><title><![CDATA[Reply to This article starts with a story from someone who tried Claude Code and found it amazing, but then switches to the same person a few months later seeing what a disaster it’s been. on Wed, 12 Aug 2026 16:35:49 GMT]]></title><description><![CDATA[<p><span><a href="/user/saua%40troet.cafe">@<span>saua</span></a></span> <span><a href="/user/paco%40infosec.exchange">@<span>paco</span></a></span> <span><a href="/user/david_chisnall%40infosec.exchange">@<span>david_chisnall</span></a></span> </p><p>I suspect this is of a piece with, "that candidate is so obviously evil, nobody could possibly vote for them...."</p><p>Which, um.</p>]]></description><link>https://forum.fedi.dk/post/https://wandering.shop/users/cavyherd/statuses/117083507871796136</link><guid isPermaLink="true">https://forum.fedi.dk/post/https://wandering.shop/users/cavyherd/statuses/117083507871796136</guid><dc:creator><![CDATA[cavyherd@wandering.shop]]></dc:creator><pubDate>Wed, 12 Aug 2026 16:35:49 GMT</pubDate></item><item><title><![CDATA[Reply to This article starts with a story from someone who tried Claude Code and found it amazing, but then switches to the same person a few months later seeing what a disaster it’s been. on Wed, 12 Aug 2026 16:34:46 GMT]]></title><description><![CDATA[<p><span><a href="/user/paco%40infosec.exchange">@<span>paco</span></a></span> <span><a href="/user/david_chisnall%40infosec.exchange">@<span>david_chisnall</span></a></span> </p><p>...depending, of course, on your threshold for "normal person." I've encountered far more people that I would like who are foggy on the distinctions between "network," "computer," "operating  system," "software (application)," &amp; "document," &amp; as a consequence get lost very quickly when trying to understand what a computer can accomplish. Likewise the difference between "The Internet" &amp; "Facebook." (Though I encounter that conflation more rarely. Thank Ghu.)</p>]]></description><link>https://forum.fedi.dk/post/https://wandering.shop/users/cavyherd/statuses/117083503747030426</link><guid isPermaLink="true">https://forum.fedi.dk/post/https://wandering.shop/users/cavyherd/statuses/117083503747030426</guid><dc:creator><![CDATA[cavyherd@wandering.shop]]></dc:creator><pubDate>Wed, 12 Aug 2026 16:34:46 GMT</pubDate></item><item><title><![CDATA[Reply to This article starts with a story from someone who tried Claude Code and found it amazing, but then switches to the same person a few months later seeing what a disaster it’s been. on Wed, 12 Aug 2026 16:31:47 GMT]]></title><description><![CDATA[<p>Yes.<br />There are several possibilities for that somewhere (including programming language design) and they don't have to be mutually exclusive.</p><p><span><a href="/user/david_chisnall%40infosec.exchange">@<span>david_chisnall</span></a></span> <span><a href="/user/db%40magrathea.space">@<span>db</span></a></span> <span><a href="/user/taupan%40mastodon.social">@<span>TauPan</span></a></span></p>]]></description><link>https://forum.fedi.dk/post/https://ieji.de/users/vnikolov/statuses/117083492006525332</link><guid isPermaLink="true">https://forum.fedi.dk/post/https://ieji.de/users/vnikolov/statuses/117083492006525332</guid><dc:creator><![CDATA[vnikolov@ieji.de]]></dc:creator><pubDate>Wed, 12 Aug 2026 16:31:47 GMT</pubDate></item><item><title><![CDATA[Reply to This article starts with a story from someone who tried Claude Code and found it amazing, but then switches to the same person a few months later seeing what a disaster it’s been. on Wed, 12 Aug 2026 16:30:33 GMT]]></title><description><![CDATA[<p><span><a href="/user/david_chisnall%40infosec.exchange">@<span>david_chisnall</span></a></span> </p><p>—Cal Newport—!</p>]]></description><link>https://forum.fedi.dk/post/https://wandering.shop/users/cavyherd/statuses/117083487200286332</link><guid isPermaLink="true">https://forum.fedi.dk/post/https://wandering.shop/users/cavyherd/statuses/117083487200286332</guid><dc:creator><![CDATA[cavyherd@wandering.shop]]></dc:creator><pubDate>Wed, 12 Aug 2026 16:30:33 GMT</pubDate></item><item><title><![CDATA[Reply to This article starts with a story from someone who tried Claude Code and found it amazing, but then switches to the same person a few months later seeing what a disaster it’s been. on Wed, 12 Aug 2026 16:29:37 GMT]]></title><description><![CDATA[<p><span><a href="/user/rzeta0%40mathstodon.xyz">@<span>rzeta0</span></a></span> <span><a href="/user/bms%40mastodon.bsd.cafe">@<span>bms</span></a></span> <span><a href="/user/david_chisnall%40infosec.exchange">@<span>david_chisnall</span></a></span> </p><p>As <span><a href="/user/pluralistic%40mamot.fr">@<span>pluralistic</span></a></span> has frequently pointed out, LLMs are not without good uses. But like any hammer, you maybe don't want to be using them on •everything•, which seems to be the attitude held by the cult-members.</p>]]></description><link>https://forum.fedi.dk/post/https://wandering.shop/users/cavyherd/statuses/117083483517052378</link><guid isPermaLink="true">https://forum.fedi.dk/post/https://wandering.shop/users/cavyherd/statuses/117083483517052378</guid><dc:creator><![CDATA[cavyherd@wandering.shop]]></dc:creator><pubDate>Wed, 12 Aug 2026 16:29:37 GMT</pubDate></item><item><title><![CDATA[Reply to This article starts with a story from someone who tried Claude Code and found it amazing, but then switches to the same person a few months later seeing what a disaster it’s been. on Wed, 12 Aug 2026 16:22:35 GMT]]></title><description><![CDATA[<p><span><a href="/user/raganwald%40social.bau-ha.us">@<span>raganwald</span></a></span> <span><a href="/user/david_chisnall%40infosec.exchange">@<span>david_chisnall</span></a></span> </p><p>Oooo, •nice•  (&amp; subtle!) distinction!</p>]]></description><link>https://forum.fedi.dk/post/https://wandering.shop/users/cavyherd/statuses/117083455857619534</link><guid isPermaLink="true">https://forum.fedi.dk/post/https://wandering.shop/users/cavyherd/statuses/117083455857619534</guid><dc:creator><![CDATA[cavyherd@wandering.shop]]></dc:creator><pubDate>Wed, 12 Aug 2026 16:22:35 GMT</pubDate></item><item><title><![CDATA[Reply to This article starts with a story from someone who tried Claude Code and found it amazing, but then switches to the same person a few months later seeing what a disaster it’s been. on Wed, 12 Aug 2026 15:56:32 GMT]]></title><description><![CDATA[<p><span><a href="/user/david_chisnall%40infosec.exchange">@<span>david_chisnall</span></a></span> funny that this senior developer suggests tests are one of the only things ok to write with LLMs, since those are the one thing I would *never* entrust to a probabilistic machine. With correctly constructed tests, I would at least hypothetically know the slop code’s output is correct, no matter how bad the runtime is.</p>]]></description><link>https://forum.fedi.dk/post/https://defcon.social/users/cwg1231/statuses/117083353443959293</link><guid isPermaLink="true">https://forum.fedi.dk/post/https://defcon.social/users/cwg1231/statuses/117083353443959293</guid><dc:creator><![CDATA[cwg1231@defcon.social]]></dc:creator><pubDate>Wed, 12 Aug 2026 15:56:32 GMT</pubDate></item><item><title><![CDATA[Reply to This article starts with a story from someone who tried Claude Code and found it amazing, but then switches to the same person a few months later seeing what a disaster it’s been. on Wed, 12 Aug 2026 15:43:03 GMT]]></title><description><![CDATA[<p><span><a href="/user/david_chisnall%40infosec.exchange">@<span>david_chisnall</span></a></span> “LLMs, by their nature, generate statistically plausible output. That is often a set that overlaps with correct output. But the things that are not correct look exactly the same as the ones they are.”</p><p>LLMs optimize for verisimilitude, not veracity.</p>]]></description><link>https://forum.fedi.dk/post/https://social.bau-ha.us/users/raganwald/statuses/117083300390187022</link><guid isPermaLink="true">https://forum.fedi.dk/post/https://social.bau-ha.us/users/raganwald/statuses/117083300390187022</guid><dc:creator><![CDATA[raganwald@social.bau-ha.us]]></dc:creator><pubDate>Wed, 12 Aug 2026 15:43:03 GMT</pubDate></item><item><title><![CDATA[Reply to This article starts with a story from someone who tried Claude Code and found it amazing, but then switches to the same person a few months later seeing what a disaster it’s been. on Wed, 12 Aug 2026 15:41:19 GMT]]></title><description><![CDATA[<p><span><a href="/user/rzeta0%40mathstodon.xyz">@<span>rzeta0</span></a></span> <span><a href="/user/bms%40mastodon.bsd.cafe">@<span>bms</span></a></span> <span><a href="/user/david_chisnall%40infosec.exchange">@<span>david_chisnall</span></a></span> That was probably a reference to the recent incident in which a LLM exploited a bug in the theorem prover to make it accept an invalid proof as valid.</p>]]></description><link>https://forum.fedi.dk/post/https://mastodon.social/users/cesarb/statuses/117083293561929808</link><guid isPermaLink="true">https://forum.fedi.dk/post/https://mastodon.social/users/cesarb/statuses/117083293561929808</guid><dc:creator><![CDATA[cesarb@mastodon.social]]></dc:creator><pubDate>Wed, 12 Aug 2026 15:41:19 GMT</pubDate></item></channel></rss>