Skip to content
  • Hjem
  • Seneste
  • Etiketter
  • Populære
  • Verden
  • Bruger
  • Grupper
Temaer
  • Light
  • Brite
  • Cerulean
  • Cosmo
  • Flatly
  • Journal
  • Litera
  • Lumen
  • Lux
  • Materia
  • Minty
  • Morph
  • Pulse
  • Sandstone
  • Simplex
  • Sketchy
  • Spacelab
  • United
  • Yeti
  • Zephyr
  • Dark
  • Cyborg
  • Darkly
  • Quartz
  • Slate
  • Solar
  • Superhero
  • Vapor

  • Default (No Skin)
  • No Skin
Kollaps
FARVEL BIG TECH
  1. Forside
  2. Ikke-kategoriseret
  3. I strongly believe there are entire companies right now under heavy AI psychosis and its impossible to have rational conversations about it with them.

I strongly believe there are entire companies right now under heavy AI psychosis and its impossible to have rational conversations about it with them.

Planlagt Fastgjort Låst Flyttet Ikke-kategoriseret
45 Indlæg 35 Posters 254 Visninger
  • Ældste til nyeste
  • Nyeste til ældste
  • Most Votes
Svar
  • Svar som emne
Login for at svare
Denne tråd er blevet slettet. Kun brugere med emne behandlings privilegier kan se den.
  • mitchellh@hachyderm.ioM This user is from outside of this forum
    mitchellh@hachyderm.ioM This user is from outside of this forum
    mitchellh@hachyderm.io
    wrote sidst redigeret af
    #1

    I strongly believe there are entire companies right now under heavy AI psychosis and its impossible to have rational conversations about it with them. I can't name any specific people because they include personal friends I deeply respect, but I worry about how this plays out.

    I lived through the great MTBF vs MTTR (mean-time-between-failure vs. mean-time-to-recovery) reckoning of infrastructure during the transition to cloud and cloud automation. All those arguments are rearing their ugly heads again but now its... the whole software development industry (maybe the whole world, really).

    It's frightening, because the psychosis folks operate under an almost absolute "MTTR is all you need" mentality: "its fine to ship bugs because the agents will fix them so quickly and at a scale humans can't do!" We learned in infrastructure that MTTR is great but you can't yeet resilient systems entirely.

    The main issue is I don't even know how to bring this up to people I know personally, because bringing this topic up leads to immediately dismissals like "no no, it has full test coverage" or "bug reports are going down" or something, which just don't paint the whole picture.

    We already learned this lesson once in infrastructure: you can automate yourself into a very resilient catastrophe machine. Systems can appear healthy by local metrics while globally becoming incomprehensible. Bug reports can go down while latent risk explodes. Test coverage can rise while semantic understanding falls. Changes happens so fast that nobody notices the underlying architecture decaying.

    I worry.

    pojntfx@mastodon.socialP bnferguson@ruby.socialB T nickynah@rebel.arN slacy@mastodon.socialS 24 Replies Last reply
    0
    • mitchellh@hachyderm.ioM mitchellh@hachyderm.io

      I strongly believe there are entire companies right now under heavy AI psychosis and its impossible to have rational conversations about it with them. I can't name any specific people because they include personal friends I deeply respect, but I worry about how this plays out.

      I lived through the great MTBF vs MTTR (mean-time-between-failure vs. mean-time-to-recovery) reckoning of infrastructure during the transition to cloud and cloud automation. All those arguments are rearing their ugly heads again but now its... the whole software development industry (maybe the whole world, really).

      It's frightening, because the psychosis folks operate under an almost absolute "MTTR is all you need" mentality: "its fine to ship bugs because the agents will fix them so quickly and at a scale humans can't do!" We learned in infrastructure that MTTR is great but you can't yeet resilient systems entirely.

      The main issue is I don't even know how to bring this up to people I know personally, because bringing this topic up leads to immediately dismissals like "no no, it has full test coverage" or "bug reports are going down" or something, which just don't paint the whole picture.

      We already learned this lesson once in infrastructure: you can automate yourself into a very resilient catastrophe machine. Systems can appear healthy by local metrics while globally becoming incomprehensible. Bug reports can go down while latent risk explodes. Test coverage can rise while semantic understanding falls. Changes happens so fast that nobody notices the underlying architecture decaying.

      I worry.

      pojntfx@mastodon.socialP This user is from outside of this forum
      pojntfx@mastodon.socialP This user is from outside of this forum
      pojntfx@mastodon.social
      wrote sidst redigeret af
      #2

      @mitchellh I would love to see someone commission a study on this. It _feels_ like things are in general getting less reliable atm, esp. the stack I rely on for work (GitHub, Linear, Slack, Notion, VSCode, <insert-tui-tool-here>), but then I can't find any data on any of it.

      pojntfx@mastodon.socialP 1 Reply Last reply
      0
      • pojntfx@mastodon.socialP pojntfx@mastodon.social

        @mitchellh I would love to see someone commission a study on this. It _feels_ like things are in general getting less reliable atm, esp. the stack I rely on for work (GitHub, Linear, Slack, Notion, VSCode, <insert-tui-tool-here>), but then I can't find any data on any of it.

        pojntfx@mastodon.socialP This user is from outside of this forum
        pojntfx@mastodon.socialP This user is from outside of this forum
        pojntfx@mastodon.social
        wrote sidst redigeret af
        #3

        @mitchellh One of the best descriptions I've heard lately was that it feels like "losing coworkers to dementia" as people adopt it, where everyone feels like they know everything, but when you talk with them in person or there is a problem that needs to be fixed _now_ it becomes very clear that the capability to do that has atrophied basically completely

        johannab@cosocial.caJ cczona@hachyderm.ioC 2 Replies Last reply
        0
        • mitchellh@hachyderm.ioM mitchellh@hachyderm.io

          I strongly believe there are entire companies right now under heavy AI psychosis and its impossible to have rational conversations about it with them. I can't name any specific people because they include personal friends I deeply respect, but I worry about how this plays out.

          I lived through the great MTBF vs MTTR (mean-time-between-failure vs. mean-time-to-recovery) reckoning of infrastructure during the transition to cloud and cloud automation. All those arguments are rearing their ugly heads again but now its... the whole software development industry (maybe the whole world, really).

          It's frightening, because the psychosis folks operate under an almost absolute "MTTR is all you need" mentality: "its fine to ship bugs because the agents will fix them so quickly and at a scale humans can't do!" We learned in infrastructure that MTTR is great but you can't yeet resilient systems entirely.

          The main issue is I don't even know how to bring this up to people I know personally, because bringing this topic up leads to immediately dismissals like "no no, it has full test coverage" or "bug reports are going down" or something, which just don't paint the whole picture.

          We already learned this lesson once in infrastructure: you can automate yourself into a very resilient catastrophe machine. Systems can appear healthy by local metrics while globally becoming incomprehensible. Bug reports can go down while latent risk explodes. Test coverage can rise while semantic understanding falls. Changes happens so fast that nobody notices the underlying architecture decaying.

          I worry.

          bnferguson@ruby.socialB This user is from outside of this forum
          bnferguson@ruby.socialB This user is from outside of this forum
          bnferguson@ruby.social
          wrote sidst redigeret af
          #4

          @mitchellh God, ALL of this. I worry, too. I really feel "resilient catastrophe machine".

          1 Reply Last reply
          0
          • mitchellh@hachyderm.ioM mitchellh@hachyderm.io

            I strongly believe there are entire companies right now under heavy AI psychosis and its impossible to have rational conversations about it with them. I can't name any specific people because they include personal friends I deeply respect, but I worry about how this plays out.

            I lived through the great MTBF vs MTTR (mean-time-between-failure vs. mean-time-to-recovery) reckoning of infrastructure during the transition to cloud and cloud automation. All those arguments are rearing their ugly heads again but now its... the whole software development industry (maybe the whole world, really).

            It's frightening, because the psychosis folks operate under an almost absolute "MTTR is all you need" mentality: "its fine to ship bugs because the agents will fix them so quickly and at a scale humans can't do!" We learned in infrastructure that MTTR is great but you can't yeet resilient systems entirely.

            The main issue is I don't even know how to bring this up to people I know personally, because bringing this topic up leads to immediately dismissals like "no no, it has full test coverage" or "bug reports are going down" or something, which just don't paint the whole picture.

            We already learned this lesson once in infrastructure: you can automate yourself into a very resilient catastrophe machine. Systems can appear healthy by local metrics while globally becoming incomprehensible. Bug reports can go down while latent risk explodes. Test coverage can rise while semantic understanding falls. Changes happens so fast that nobody notices the underlying architecture decaying.

            I worry.

            T This user is from outside of this forum
            T This user is from outside of this forum
            tobinbaker@discuss.systems
            wrote sidst redigeret af
            #5

            @mitchellh that's an interesting analogy, feels like both vibecoding and "resilience engineering" tend to mask systemic risk by superficially and temporarily mitigating the symptoms

            1 Reply Last reply
            0
            • mitchellh@hachyderm.ioM mitchellh@hachyderm.io

              I strongly believe there are entire companies right now under heavy AI psychosis and its impossible to have rational conversations about it with them. I can't name any specific people because they include personal friends I deeply respect, but I worry about how this plays out.

              I lived through the great MTBF vs MTTR (mean-time-between-failure vs. mean-time-to-recovery) reckoning of infrastructure during the transition to cloud and cloud automation. All those arguments are rearing their ugly heads again but now its... the whole software development industry (maybe the whole world, really).

              It's frightening, because the psychosis folks operate under an almost absolute "MTTR is all you need" mentality: "its fine to ship bugs because the agents will fix them so quickly and at a scale humans can't do!" We learned in infrastructure that MTTR is great but you can't yeet resilient systems entirely.

              The main issue is I don't even know how to bring this up to people I know personally, because bringing this topic up leads to immediately dismissals like "no no, it has full test coverage" or "bug reports are going down" or something, which just don't paint the whole picture.

              We already learned this lesson once in infrastructure: you can automate yourself into a very resilient catastrophe machine. Systems can appear healthy by local metrics while globally becoming incomprehensible. Bug reports can go down while latent risk explodes. Test coverage can rise while semantic understanding falls. Changes happens so fast that nobody notices the underlying architecture decaying.

              I worry.

              nickynah@rebel.arN This user is from outside of this forum
              nickynah@rebel.arN This user is from outside of this forum
              nickynah@rebel.ar
              wrote sidst redigeret af
              #6

              @mitchellh I’ve been thinking a lot about this, and my personal conclusion is that the raise of the attention economy has made nuanced discussion virtually impossible, so nuanced topic (all important problems are nuanced) are impossible to discuss, because all people see is “number go up”
              The only solace I have is that this is unsustainable, and it will collapse, costing us a lot, but it will collapse

              bms48@mastodon.socialB 1 Reply Last reply
              0
              • mitchellh@hachyderm.ioM mitchellh@hachyderm.io

                I strongly believe there are entire companies right now under heavy AI psychosis and its impossible to have rational conversations about it with them. I can't name any specific people because they include personal friends I deeply respect, but I worry about how this plays out.

                I lived through the great MTBF vs MTTR (mean-time-between-failure vs. mean-time-to-recovery) reckoning of infrastructure during the transition to cloud and cloud automation. All those arguments are rearing their ugly heads again but now its... the whole software development industry (maybe the whole world, really).

                It's frightening, because the psychosis folks operate under an almost absolute "MTTR is all you need" mentality: "its fine to ship bugs because the agents will fix them so quickly and at a scale humans can't do!" We learned in infrastructure that MTTR is great but you can't yeet resilient systems entirely.

                The main issue is I don't even know how to bring this up to people I know personally, because bringing this topic up leads to immediately dismissals like "no no, it has full test coverage" or "bug reports are going down" or something, which just don't paint the whole picture.

                We already learned this lesson once in infrastructure: you can automate yourself into a very resilient catastrophe machine. Systems can appear healthy by local metrics while globally becoming incomprehensible. Bug reports can go down while latent risk explodes. Test coverage can rise while semantic understanding falls. Changes happens so fast that nobody notices the underlying architecture decaying.

                I worry.

                slacy@mastodon.socialS This user is from outside of this forum
                slacy@mastodon.socialS This user is from outside of this forum
                slacy@mastodon.social
                wrote sidst redigeret af
                #7

                @mitchellh The story I've heard is the "well, we just rewrite the entire thing every six months so there's no point in fixing/improving because the next iteration/generation will be that much better as the agents improve."

                I can actually sort of see this, and it's somewhat along the lines of "spec-driven-development" but ... ?

                1 Reply Last reply
                0
                • mitchellh@hachyderm.ioM mitchellh@hachyderm.io

                  I strongly believe there are entire companies right now under heavy AI psychosis and its impossible to have rational conversations about it with them. I can't name any specific people because they include personal friends I deeply respect, but I worry about how this plays out.

                  I lived through the great MTBF vs MTTR (mean-time-between-failure vs. mean-time-to-recovery) reckoning of infrastructure during the transition to cloud and cloud automation. All those arguments are rearing their ugly heads again but now its... the whole software development industry (maybe the whole world, really).

                  It's frightening, because the psychosis folks operate under an almost absolute "MTTR is all you need" mentality: "its fine to ship bugs because the agents will fix them so quickly and at a scale humans can't do!" We learned in infrastructure that MTTR is great but you can't yeet resilient systems entirely.

                  The main issue is I don't even know how to bring this up to people I know personally, because bringing this topic up leads to immediately dismissals like "no no, it has full test coverage" or "bug reports are going down" or something, which just don't paint the whole picture.

                  We already learned this lesson once in infrastructure: you can automate yourself into a very resilient catastrophe machine. Systems can appear healthy by local metrics while globally becoming incomprehensible. Bug reports can go down while latent risk explodes. Test coverage can rise while semantic understanding falls. Changes happens so fast that nobody notices the underlying architecture decaying.

                  I worry.

                  pgoultiaev@hachyderm.ioP This user is from outside of this forum
                  pgoultiaev@hachyderm.ioP This user is from outside of this forum
                  pgoultiaev@hachyderm.io
                  wrote sidst redigeret af
                  #8

                  @mitchellh Unfortunately, changing a very convinced person’s view to a different perspective is almost impossible.
                  Not enough things have gone wrong due to AI psychosis for people to augment their perspectives and be open to helpful discussions… yes, databases have been wiped etc., but these examples are (unfortunately) seen as one-offs.
                  I feel like discussing the approach to how to apply AI in the best way can bring perspectives together instead of battling an opposing view.

                  bms48@mastodon.socialB 1 Reply Last reply
                  0
                  • mitchellh@hachyderm.ioM mitchellh@hachyderm.io

                    I strongly believe there are entire companies right now under heavy AI psychosis and its impossible to have rational conversations about it with them. I can't name any specific people because they include personal friends I deeply respect, but I worry about how this plays out.

                    I lived through the great MTBF vs MTTR (mean-time-between-failure vs. mean-time-to-recovery) reckoning of infrastructure during the transition to cloud and cloud automation. All those arguments are rearing their ugly heads again but now its... the whole software development industry (maybe the whole world, really).

                    It's frightening, because the psychosis folks operate under an almost absolute "MTTR is all you need" mentality: "its fine to ship bugs because the agents will fix them so quickly and at a scale humans can't do!" We learned in infrastructure that MTTR is great but you can't yeet resilient systems entirely.

                    The main issue is I don't even know how to bring this up to people I know personally, because bringing this topic up leads to immediately dismissals like "no no, it has full test coverage" or "bug reports are going down" or something, which just don't paint the whole picture.

                    We already learned this lesson once in infrastructure: you can automate yourself into a very resilient catastrophe machine. Systems can appear healthy by local metrics while globally becoming incomprehensible. Bug reports can go down while latent risk explodes. Test coverage can rise while semantic understanding falls. Changes happens so fast that nobody notices the underlying architecture decaying.

                    I worry.

                    lkanies@hachyderm.ioL This user is from outside of this forum
                    lkanies@hachyderm.ioL This user is from outside of this forum
                    lkanies@hachyderm.io
                    wrote sidst redigeret af
                    #9

                    @mitchellh there are so many different crazy things people believe now, almost implicitly.

                    The big one I keep thinking about is that people just seem to think code longevity has zero value any more. Like, we always knew code that doesn’t change for a long time is maybe a bad sign, that it is rotting. But it is also a good sign that it is likely more stable, secure, and valuable than new code.

                    But so many people now just seem to think it is always a good thing to be able to change any code any time. They don’t talk about the gradual hardening that is no longer happening, or the ability for other parts of the system to evolve more because this part is so stable.

                    I assume that over time our industry will learn how to talk coherently and intelligently about all this. But we’re obviously a long ways from there, and there’s a lot of destruction going to happen between then and now.

                    1 Reply Last reply
                    0
                    • christianriegel@digitalcourage.socialC This user is from outside of this forum
                      christianriegel@digitalcourage.socialC This user is from outside of this forum
                      christianriegel@digitalcourage.social
                      wrote sidst redigeret af
                      #10

                      @landelare @mitchellh

                      Same experience here. And it's presented like facts. When asking, they point out that [talky program used] provides sources (which they of course never read).

                      I fear that as society we're to blame at least party after "I googled it" became an accepted answer without actually naming the pages found by the search.

                      ahltorp@mastodon.nuA 1 Reply Last reply
                      0
                      • mitchellh@hachyderm.ioM mitchellh@hachyderm.io

                        I strongly believe there are entire companies right now under heavy AI psychosis and its impossible to have rational conversations about it with them. I can't name any specific people because they include personal friends I deeply respect, but I worry about how this plays out.

                        I lived through the great MTBF vs MTTR (mean-time-between-failure vs. mean-time-to-recovery) reckoning of infrastructure during the transition to cloud and cloud automation. All those arguments are rearing their ugly heads again but now its... the whole software development industry (maybe the whole world, really).

                        It's frightening, because the psychosis folks operate under an almost absolute "MTTR is all you need" mentality: "its fine to ship bugs because the agents will fix them so quickly and at a scale humans can't do!" We learned in infrastructure that MTTR is great but you can't yeet resilient systems entirely.

                        The main issue is I don't even know how to bring this up to people I know personally, because bringing this topic up leads to immediately dismissals like "no no, it has full test coverage" or "bug reports are going down" or something, which just don't paint the whole picture.

                        We already learned this lesson once in infrastructure: you can automate yourself into a very resilient catastrophe machine. Systems can appear healthy by local metrics while globally becoming incomprehensible. Bug reports can go down while latent risk explodes. Test coverage can rise while semantic understanding falls. Changes happens so fast that nobody notices the underlying architecture decaying.

                        I worry.

                        jamesb2147@infosec.exchangeJ This user is from outside of this forum
                        jamesb2147@infosec.exchangeJ This user is from outside of this forum
                        jamesb2147@infosec.exchange
                        wrote sidst redigeret af
                        #11

                        @mitchellh I don't necessarily disagree, but "resilient catastrophe machine" feels an awful lot like Salesforce (and a lot of the rest of the tech industry).

                        I mean, you do have to strike a balance, but in my experience, moving faster has very frequently been the economic winner, even at the expense of quality.

                        I say this as someone that abhors the wasted hours fixing systems that weren't designed properly, and the lost business from features that never actually worked but were already sold. I don't want my experience to teach this lesson, and I desperately want someone to convince me otherwise.

                        1 Reply Last reply
                        0
                        • schtaks@infosec.exchangeS This user is from outside of this forum
                          schtaks@infosec.exchangeS This user is from outside of this forum
                          schtaks@infosec.exchange
                          wrote sidst redigeret af
                          #12

                          @landelare @mitchellh it's the new LetMeGoogleThatForYou butt worse

                          1 Reply Last reply
                          0
                          • mitchellh@hachyderm.ioM mitchellh@hachyderm.io

                            I strongly believe there are entire companies right now under heavy AI psychosis and its impossible to have rational conversations about it with them. I can't name any specific people because they include personal friends I deeply respect, but I worry about how this plays out.

                            I lived through the great MTBF vs MTTR (mean-time-between-failure vs. mean-time-to-recovery) reckoning of infrastructure during the transition to cloud and cloud automation. All those arguments are rearing their ugly heads again but now its... the whole software development industry (maybe the whole world, really).

                            It's frightening, because the psychosis folks operate under an almost absolute "MTTR is all you need" mentality: "its fine to ship bugs because the agents will fix them so quickly and at a scale humans can't do!" We learned in infrastructure that MTTR is great but you can't yeet resilient systems entirely.

                            The main issue is I don't even know how to bring this up to people I know personally, because bringing this topic up leads to immediately dismissals like "no no, it has full test coverage" or "bug reports are going down" or something, which just don't paint the whole picture.

                            We already learned this lesson once in infrastructure: you can automate yourself into a very resilient catastrophe machine. Systems can appear healthy by local metrics while globally becoming incomprehensible. Bug reports can go down while latent risk explodes. Test coverage can rise while semantic understanding falls. Changes happens so fast that nobody notices the underlying architecture decaying.

                            I worry.

                            S This user is from outside of this forum
                            S This user is from outside of this forum
                            spacelifeform@infosec.exchange
                            wrote sidst redigeret af
                            #13

                            @mitchellh

                            Ask them what they will do when their cloud is down.

                            Handwaving ensues. Fog rolls in.

                            immibis@social.immibis.comI 1 Reply Last reply
                            0
                            • christianriegel@digitalcourage.socialC christianriegel@digitalcourage.social

                              @landelare @mitchellh

                              Same experience here. And it's presented like facts. When asking, they point out that [talky program used] provides sources (which they of course never read).

                              I fear that as society we're to blame at least party after "I googled it" became an accepted answer without actually naming the pages found by the search.

                              ahltorp@mastodon.nuA This user is from outside of this forum
                              ahltorp@mastodon.nuA This user is from outside of this forum
                              ahltorp@mastodon.nu
                              wrote sidst redigeret af
                              #14

                              @ChristianRiegel @landelare @mitchellh I posted this a year ago: https://mastodon.nu/@ahltorp/114454413624506937

                              1 Reply Last reply
                              0
                              • mitchellh@hachyderm.ioM mitchellh@hachyderm.io

                                I strongly believe there are entire companies right now under heavy AI psychosis and its impossible to have rational conversations about it with them. I can't name any specific people because they include personal friends I deeply respect, but I worry about how this plays out.

                                I lived through the great MTBF vs MTTR (mean-time-between-failure vs. mean-time-to-recovery) reckoning of infrastructure during the transition to cloud and cloud automation. All those arguments are rearing their ugly heads again but now its... the whole software development industry (maybe the whole world, really).

                                It's frightening, because the psychosis folks operate under an almost absolute "MTTR is all you need" mentality: "its fine to ship bugs because the agents will fix them so quickly and at a scale humans can't do!" We learned in infrastructure that MTTR is great but you can't yeet resilient systems entirely.

                                The main issue is I don't even know how to bring this up to people I know personally, because bringing this topic up leads to immediately dismissals like "no no, it has full test coverage" or "bug reports are going down" or something, which just don't paint the whole picture.

                                We already learned this lesson once in infrastructure: you can automate yourself into a very resilient catastrophe machine. Systems can appear healthy by local metrics while globally becoming incomprehensible. Bug reports can go down while latent risk explodes. Test coverage can rise while semantic understanding falls. Changes happens so fast that nobody notices the underlying architecture decaying.

                                I worry.

                                cstamp@mastodon.socialC This user is from outside of this forum
                                cstamp@mastodon.socialC This user is from outside of this forum
                                cstamp@mastodon.social
                                wrote sidst redigeret af
                                #15

                                @mitchellh We have to stop using human terms to help the tech bros anthropomorphize these pieces of crap. The AI malfunctioned. It’s a machine.

                                bms48@mastodon.socialB 1 Reply Last reply
                                0
                                • mitchellh@hachyderm.ioM mitchellh@hachyderm.io

                                  I strongly believe there are entire companies right now under heavy AI psychosis and its impossible to have rational conversations about it with them. I can't name any specific people because they include personal friends I deeply respect, but I worry about how this plays out.

                                  I lived through the great MTBF vs MTTR (mean-time-between-failure vs. mean-time-to-recovery) reckoning of infrastructure during the transition to cloud and cloud automation. All those arguments are rearing their ugly heads again but now its... the whole software development industry (maybe the whole world, really).

                                  It's frightening, because the psychosis folks operate under an almost absolute "MTTR is all you need" mentality: "its fine to ship bugs because the agents will fix them so quickly and at a scale humans can't do!" We learned in infrastructure that MTTR is great but you can't yeet resilient systems entirely.

                                  The main issue is I don't even know how to bring this up to people I know personally, because bringing this topic up leads to immediately dismissals like "no no, it has full test coverage" or "bug reports are going down" or something, which just don't paint the whole picture.

                                  We already learned this lesson once in infrastructure: you can automate yourself into a very resilient catastrophe machine. Systems can appear healthy by local metrics while globally becoming incomprehensible. Bug reports can go down while latent risk explodes. Test coverage can rise while semantic understanding falls. Changes happens so fast that nobody notices the underlying architecture decaying.

                                  I worry.

                                  shafik@hachyderm.ioS This user is from outside of this forum
                                  shafik@hachyderm.ioS This user is from outside of this forum
                                  shafik@hachyderm.io
                                  wrote sidst redigeret af
                                  #16

                                  @mitchellh

                                  There are some good folks writing some solid pieces. This one has nice graphs laying out the long-term costs in a way that I think most folks can absorb:

                                  https://www.jamesshore.com/v2/blog/2026/you-need-ai-that-reduces-your-maintenance-costs

                                  and honestly if you have spent any time thinking about the software development lifecycle seriously this should hit home b/c there is nothing revolutionary there.

                                  This one talks about the hard cognitive limits human have:

                                  https://techtrenches.dev/p/the-human-cost-of-10x-how-ai-is-physically

                                  and why this means that lines of code is not the correct measure of productivity and in fact this is a terrible measure. What is there I think is less commonly well known and may take a bit more thought to get in the big picture sense.

                                  Anyone who has spent time thinking about software quality, you should be nodding your head b/c it is correct.

                                  shafik@hachyderm.ioS bms48@mastodon.socialB 2 Replies Last reply
                                  0
                                  • shafik@hachyderm.ioS shafik@hachyderm.io

                                    @mitchellh

                                    There are some good folks writing some solid pieces. This one has nice graphs laying out the long-term costs in a way that I think most folks can absorb:

                                    https://www.jamesshore.com/v2/blog/2026/you-need-ai-that-reduces-your-maintenance-costs

                                    and honestly if you have spent any time thinking about the software development lifecycle seriously this should hit home b/c there is nothing revolutionary there.

                                    This one talks about the hard cognitive limits human have:

                                    https://techtrenches.dev/p/the-human-cost-of-10x-how-ai-is-physically

                                    and why this means that lines of code is not the correct measure of productivity and in fact this is a terrible measure. What is there I think is less commonly well known and may take a bit more thought to get in the big picture sense.

                                    Anyone who has spent time thinking about software quality, you should be nodding your head b/c it is correct.

                                    shafik@hachyderm.ioS This user is from outside of this forum
                                    shafik@hachyderm.ioS This user is from outside of this forum
                                    shafik@hachyderm.io
                                    wrote sidst redigeret af
                                    #17

                                    @mitchellh

                                    The conversation I was totally not ready for where the ones where people being totally earnest told me they believed LLMs are intelligent or can reason.

                                    I knew inherently this was wrong b/c I spent time understanding how they work in detail but actually explaining it in a plain way stumped me w/o thinking more deeply about it.

                                    If you spent time learning about Russell, Wittgenstein, Hilbert, Godel and others you should see the flaws in thinking and get why induction can't get you there but that is hard row to explain to anyone who is not familiar.

                                    So I think these two articles hit the right spot:

                                    https://hachyderm.io/@shafik/116468806967961821

                                    and

                                    https://hachyderm.io/@shafik/116468521909545361

                                    but you can go deep on this one.

                                    1 Reply Last reply
                                    0
                                    • shafik@hachyderm.ioS shafik@hachyderm.io

                                      @mitchellh

                                      There are some good folks writing some solid pieces. This one has nice graphs laying out the long-term costs in a way that I think most folks can absorb:

                                      https://www.jamesshore.com/v2/blog/2026/you-need-ai-that-reduces-your-maintenance-costs

                                      and honestly if you have spent any time thinking about the software development lifecycle seriously this should hit home b/c there is nothing revolutionary there.

                                      This one talks about the hard cognitive limits human have:

                                      https://techtrenches.dev/p/the-human-cost-of-10x-how-ai-is-physically

                                      and why this means that lines of code is not the correct measure of productivity and in fact this is a terrible measure. What is there I think is less commonly well known and may take a bit more thought to get in the big picture sense.

                                      Anyone who has spent time thinking about software quality, you should be nodding your head b/c it is correct.

                                      bms48@mastodon.socialB This user is from outside of this forum
                                      bms48@mastodon.socialB This user is from outside of this forum
                                      bms48@mastodon.social
                                      wrote sidst redigeret af
                                      #18

                                      @shafik @mitchellh A cursory reading of Robert Pirsig's "Zen and the Art of Motorcycle Maintenance" betrays how quality has its own ineffable quality. KLOCs are not a useful metric often; McCabe's Cyclomatic Complexity is where I'd start. Dijkstra brought the wisdom yet as Adam Smith has been selectively quoted in econo-political argument, Dijsktra seems to be selectively quoted by members of the deep-learning community.

                                      shafik@hachyderm.ioS 1 Reply Last reply
                                      0
                                      • cstamp@mastodon.socialC cstamp@mastodon.social

                                        @mitchellh We have to stop using human terms to help the tech bros anthropomorphize these pieces of crap. The AI malfunctioned. It’s a machine.

                                        bms48@mastodon.socialB This user is from outside of this forum
                                        bms48@mastodon.socialB This user is from outside of this forum
                                        bms48@mastodon.social
                                        wrote sidst redigeret af
                                        #19

                                        @CStamp @mitchellh Kate Crawford warns about this ~7 pages into "Atlas of AI" and @HalvarFlake covered the topic well last July: https://addxorrol.blogspot.com/2025/07/a-non-anthropomorphized-view-of-llms.html

                                        1 Reply Last reply
                                        0
                                        • mitchellh@hachyderm.ioM mitchellh@hachyderm.io

                                          I strongly believe there are entire companies right now under heavy AI psychosis and its impossible to have rational conversations about it with them. I can't name any specific people because they include personal friends I deeply respect, but I worry about how this plays out.

                                          I lived through the great MTBF vs MTTR (mean-time-between-failure vs. mean-time-to-recovery) reckoning of infrastructure during the transition to cloud and cloud automation. All those arguments are rearing their ugly heads again but now its... the whole software development industry (maybe the whole world, really).

                                          It's frightening, because the psychosis folks operate under an almost absolute "MTTR is all you need" mentality: "its fine to ship bugs because the agents will fix them so quickly and at a scale humans can't do!" We learned in infrastructure that MTTR is great but you can't yeet resilient systems entirely.

                                          The main issue is I don't even know how to bring this up to people I know personally, because bringing this topic up leads to immediately dismissals like "no no, it has full test coverage" or "bug reports are going down" or something, which just don't paint the whole picture.

                                          We already learned this lesson once in infrastructure: you can automate yourself into a very resilient catastrophe machine. Systems can appear healthy by local metrics while globally becoming incomprehensible. Bug reports can go down while latent risk explodes. Test coverage can rise while semantic understanding falls. Changes happens so fast that nobody notices the underlying architecture decaying.

                                          I worry.

                                          rebelgeek99@mastodon.socialR This user is from outside of this forum
                                          rebelgeek99@mastodon.socialR This user is from outside of this forum
                                          rebelgeek99@mastodon.social
                                          wrote sidst redigeret af
                                          #20

                                          @mitchellh @DukeDuke hadn't occurred to me that the AI psychosis may be a factor driving the enshittification of tech, but that makes perfect sense. I swear, COVID and genAI are our civilization's answer to Romans' lead pipes updated for the 21st century

                                          kaffando@mastodon.socialK 1 Reply Last reply
                                          0
                                          Svar
                                          • Svar som emne
                                          Login for at svare
                                          • Ældste til nyeste
                                          • Nyeste til ældste
                                          • Most Votes


                                          • Log ind

                                          • Har du ikke en konto? Tilmeld

                                          • Login or register to search.
                                          Powered by NodeBB Contributors
                                          Graciously hosted by data.coop
                                          • First post
                                            Last post
                                          0
                                          • Hjem
                                          • Seneste
                                          • Etiketter
                                          • Populære
                                          • Verden
                                          • Bruger
                                          • Grupper