Skip to content
  • Hjem
  • Seneste
  • Etiketter
  • Populære
  • Verden
  • Bruger
  • Grupper
Temaer
  • Light
  • Brite
  • Cerulean
  • Cosmo
  • Flatly
  • Journal
  • Litera
  • Lumen
  • Lux
  • Materia
  • Minty
  • Morph
  • Pulse
  • Sandstone
  • Simplex
  • Sketchy
  • Spacelab
  • United
  • Yeti
  • Zephyr
  • Dark
  • Cyborg
  • Darkly
  • Quartz
  • Slate
  • Solar
  • Superhero
  • Vapor

  • Default (No Skin)
  • No Skin
Kollaps
FARVEL BIG TECH
  1. Forside
  2. Ikke-kategoriseret
  3. I just had "the talk" with my 9yo.

I just had "the talk" with my 9yo.

Planlagt Fastgjort Låst Flyttet Ikke-kategoriseret
43 Indlæg 30 Posters 189 Visninger
  • Ældste til nyeste
  • Nyeste til ældste
  • Most Votes
Svar
  • Svar som emne
Login for at svare
Denne tråd er blevet slettet. Kun brugere med emne behandlings privilegier kan se den.
  • momo@social.linux.pizzaM momo@social.linux.pizza

    I just had "the talk" with my 9yo. He came to me asking "Dad, why does AI use so much water just for generating one answer?"

    So I explained to him how LLM works, how GenAI came out of that and why AI is a marketing term and absolutely wrong in that context.

    Then I loaded GPT4All on my laptop and asked the thing what the result of 9+7 is. It took my poor laptop cpu 12 seconds to come up with an answer and another 12 seconds to generate the sentence with the answer. I showed him how fast kcalc (using the CPUs ALU functions) comes up with the answer for that specific question.

    And then I asked a followup question, which almost take 2 minutes to compute. I showed him how the previous question and its answer became part of the prompt which made the calculation longer more complicated just to emulate a dialoge.

    He noticed that my laptops CPU fan stepped up and started to roar to get rid of the core heat. Then I explained to him how AI datacenters solve all this ineffitiency by running millions of servers in parallel and how this generates so much heat that it "uses" cooling water by just boiling it until it vapourizes.

    I then explained the current business model and how the companies currently burn through their cash to be the last one standing on the market when everyone else dropped out or became bankrupt. What we user pay for using this and what we actually would have to (and in the future probably will) pay for this service.

    Needless to say, my kid is not a big fan now.

    wiert@mastodon.socialW This user is from outside of this forum
    wiert@mastodon.socialW This user is from outside of this forum
    wiert@mastodon.social
    wrote sidst redigeret af
    #12

    @momo typo: ineffitiency

    Great post. Very good idea to show it that way.

    1 Reply Last reply
    0
    • olivernoble@mastodon.worldO olivernoble@mastodon.world

      @momo
      I suspect your 9 year old now has a better understanding of #AI than politicians whose stated aim is to "mainline AI into the veins" of the UK
      https://www.theguardian.com/politics/2025/jan/12/mainlined-into-uks-veins-labour-announces-huge-public-rollout-of-ai

      momo@social.linux.pizzaM This user is from outside of this forum
      momo@social.linux.pizzaM This user is from outside of this forum
      momo@social.linux.pizza
      wrote sidst redigeret af
      #13

      @OliverNoble
      Honestly, his dad works for (checks calendar) 28 years in IT now, mostly as sysadmin. And politicians are used to not listen to their specialists if they don't like their explanation. So I guess he has an advantage here. Also, his mum worked as a project manager in IT projects, so he already knows what a business plan is (because I'm not allowed to buy any shit unless I can present a valid usecase and how the benefits outweight the cost of buying it. This household, let me tell you... 😅😭)

      1 Reply Last reply
      0
      • alison@beige.partyA alison@beige.party

        @momo And excellent example! And faster still if you just used the onboard calculator which provides instant results to math questions.

        momo@social.linux.pizzaM This user is from outside of this forum
        momo@social.linux.pizzaM This user is from outside of this forum
        momo@social.linux.pizza
        wrote sidst redigeret af
        #14

        @Alison
        Oh, I use linux and have KDE Plasma installed as my current desktop environment. Kcalc IS the onboard calculator in that scenario. I thought about doing something like ```echo "9+7" | bc``` on the shell, but that felt too much for him in that situation...

        alison@beige.partyA 1 Reply Last reply
        0
        • momo@social.linux.pizzaM momo@social.linux.pizza

          I just had "the talk" with my 9yo. He came to me asking "Dad, why does AI use so much water just for generating one answer?"

          So I explained to him how LLM works, how GenAI came out of that and why AI is a marketing term and absolutely wrong in that context.

          Then I loaded GPT4All on my laptop and asked the thing what the result of 9+7 is. It took my poor laptop cpu 12 seconds to come up with an answer and another 12 seconds to generate the sentence with the answer. I showed him how fast kcalc (using the CPUs ALU functions) comes up with the answer for that specific question.

          And then I asked a followup question, which almost take 2 minutes to compute. I showed him how the previous question and its answer became part of the prompt which made the calculation longer more complicated just to emulate a dialoge.

          He noticed that my laptops CPU fan stepped up and started to roar to get rid of the core heat. Then I explained to him how AI datacenters solve all this ineffitiency by running millions of servers in parallel and how this generates so much heat that it "uses" cooling water by just boiling it until it vapourizes.

          I then explained the current business model and how the companies currently burn through their cash to be the last one standing on the market when everyone else dropped out or became bankrupt. What we user pay for using this and what we actually would have to (and in the future probably will) pay for this service.

          Needless to say, my kid is not a big fan now.

          catboycody@tech.lgbtC This user is from outside of this forum
          catboycody@tech.lgbtC This user is from outside of this forum
          catboycody@tech.lgbt
          wrote sidst redigeret af
          #15

          @momo Guess I should have "the talk" with my 69yo. dad, too...

          1 Reply Last reply
          0
          • momo@social.linux.pizzaM momo@social.linux.pizza

            @Alison
            Oh, I use linux and have KDE Plasma installed as my current desktop environment. Kcalc IS the onboard calculator in that scenario. I thought about doing something like ```echo "9+7" | bc``` on the shell, but that felt too much for him in that situation...

            alison@beige.partyA This user is from outside of this forum
            alison@beige.partyA This user is from outside of this forum
            alison@beige.party
            wrote sidst redigeret af
            #16

            @momo Still over kill when a basic system calculator would do the job. Excellent job showing him the AI is a massive energy burn.

            1 Reply Last reply
            0
            • momo@social.linux.pizzaM momo@social.linux.pizza

              I just had "the talk" with my 9yo. He came to me asking "Dad, why does AI use so much water just for generating one answer?"

              So I explained to him how LLM works, how GenAI came out of that and why AI is a marketing term and absolutely wrong in that context.

              Then I loaded GPT4All on my laptop and asked the thing what the result of 9+7 is. It took my poor laptop cpu 12 seconds to come up with an answer and another 12 seconds to generate the sentence with the answer. I showed him how fast kcalc (using the CPUs ALU functions) comes up with the answer for that specific question.

              And then I asked a followup question, which almost take 2 minutes to compute. I showed him how the previous question and its answer became part of the prompt which made the calculation longer more complicated just to emulate a dialoge.

              He noticed that my laptops CPU fan stepped up and started to roar to get rid of the core heat. Then I explained to him how AI datacenters solve all this ineffitiency by running millions of servers in parallel and how this generates so much heat that it "uses" cooling water by just boiling it until it vapourizes.

              I then explained the current business model and how the companies currently burn through their cash to be the last one standing on the market when everyone else dropped out or became bankrupt. What we user pay for using this and what we actually would have to (and in the future probably will) pay for this service.

              Needless to say, my kid is not a big fan now.

              uair@autistics.lifeU This user is from outside of this forum
              uair@autistics.lifeU This user is from outside of this forum
              uair@autistics.life
              wrote sidst redigeret af
              #17

              @momo

              Good on ya. The youth need facts, not marketing bullshit. Way to raise yours right 🙂

              1 Reply Last reply
              0
              • momo@social.linux.pizzaM momo@social.linux.pizza

                I just had "the talk" with my 9yo. He came to me asking "Dad, why does AI use so much water just for generating one answer?"

                So I explained to him how LLM works, how GenAI came out of that and why AI is a marketing term and absolutely wrong in that context.

                Then I loaded GPT4All on my laptop and asked the thing what the result of 9+7 is. It took my poor laptop cpu 12 seconds to come up with an answer and another 12 seconds to generate the sentence with the answer. I showed him how fast kcalc (using the CPUs ALU functions) comes up with the answer for that specific question.

                And then I asked a followup question, which almost take 2 minutes to compute. I showed him how the previous question and its answer became part of the prompt which made the calculation longer more complicated just to emulate a dialoge.

                He noticed that my laptops CPU fan stepped up and started to roar to get rid of the core heat. Then I explained to him how AI datacenters solve all this ineffitiency by running millions of servers in parallel and how this generates so much heat that it "uses" cooling water by just boiling it until it vapourizes.

                I then explained the current business model and how the companies currently burn through their cash to be the last one standing on the market when everyone else dropped out or became bankrupt. What we user pay for using this and what we actually would have to (and in the future probably will) pay for this service.

                Needless to say, my kid is not a big fan now.

                vnikolov@ieji.deV This user is from outside of this forum
                vnikolov@ieji.deV This user is from outside of this forum
                vnikolov@ieji.de
                wrote sidst redigeret af
                #18

                This nine-year old child is amazingly good at listening.

                1 Reply Last reply
                0
                • lazarou@mastodon.socialL lazarou@mastodon.social

                  @momo they should do this to Government ministers to explain why they shouldn't throw taxpayers money at this hustler. Most of them should get it....most of them.

                  woozle@toot.catW This user is from outside of this forum
                  woozle@toot.catW This user is from outside of this forum
                  woozle@toot.cat
                  wrote sidst redigeret af
                  #19

                  @Lazarou @momo

                  Here in the US, we used to have an "Office of Technology Assesment" which could produce explainers like that for Congress. It apparently had a tiny budget and yet was very useful.

                  It was dismantled in 1995 by the newly-dominant GOP who, according to Science magazine, saw it as "duplicative, wasteful, and biased against their party."

                  The final part of that, to my mind, has always been the tell.

                  lazarou@mastodon.socialL 1 Reply Last reply
                  0
                  • woozle@toot.catW woozle@toot.cat

                    @Lazarou @momo

                    Here in the US, we used to have an "Office of Technology Assesment" which could produce explainers like that for Congress. It apparently had a tiny budget and yet was very useful.

                    It was dismantled in 1995 by the newly-dominant GOP who, according to Science magazine, saw it as "duplicative, wasteful, and biased against their party."

                    The final part of that, to my mind, has always been the tell.

                    lazarou@mastodon.socialL This user is from outside of this forum
                    lazarou@mastodon.socialL This user is from outside of this forum
                    lazarou@mastodon.social
                    wrote sidst redigeret af
                    #20

                    @woozle @momo this explains a lot...

                    1 Reply Last reply
                    0
                    • momo@social.linux.pizzaM momo@social.linux.pizza

                      I just had "the talk" with my 9yo. He came to me asking "Dad, why does AI use so much water just for generating one answer?"

                      So I explained to him how LLM works, how GenAI came out of that and why AI is a marketing term and absolutely wrong in that context.

                      Then I loaded GPT4All on my laptop and asked the thing what the result of 9+7 is. It took my poor laptop cpu 12 seconds to come up with an answer and another 12 seconds to generate the sentence with the answer. I showed him how fast kcalc (using the CPUs ALU functions) comes up with the answer for that specific question.

                      And then I asked a followup question, which almost take 2 minutes to compute. I showed him how the previous question and its answer became part of the prompt which made the calculation longer more complicated just to emulate a dialoge.

                      He noticed that my laptops CPU fan stepped up and started to roar to get rid of the core heat. Then I explained to him how AI datacenters solve all this ineffitiency by running millions of servers in parallel and how this generates so much heat that it "uses" cooling water by just boiling it until it vapourizes.

                      I then explained the current business model and how the companies currently burn through their cash to be the last one standing on the market when everyone else dropped out or became bankrupt. What we user pay for using this and what we actually would have to (and in the future probably will) pay for this service.

                      Needless to say, my kid is not a big fan now.

                      nuintari@mastodon.bsd.cafeN This user is from outside of this forum
                      nuintari@mastodon.bsd.cafeN This user is from outside of this forum
                      nuintari@mastodon.bsd.cafe
                      wrote sidst redigeret af
                      #21

                      @momo That is some good work you are doing, sir.

                      1 Reply Last reply
                      0
                      • momo@social.linux.pizzaM momo@social.linux.pizza

                        I just had "the talk" with my 9yo. He came to me asking "Dad, why does AI use so much water just for generating one answer?"

                        So I explained to him how LLM works, how GenAI came out of that and why AI is a marketing term and absolutely wrong in that context.

                        Then I loaded GPT4All on my laptop and asked the thing what the result of 9+7 is. It took my poor laptop cpu 12 seconds to come up with an answer and another 12 seconds to generate the sentence with the answer. I showed him how fast kcalc (using the CPUs ALU functions) comes up with the answer for that specific question.

                        And then I asked a followup question, which almost take 2 minutes to compute. I showed him how the previous question and its answer became part of the prompt which made the calculation longer more complicated just to emulate a dialoge.

                        He noticed that my laptops CPU fan stepped up and started to roar to get rid of the core heat. Then I explained to him how AI datacenters solve all this ineffitiency by running millions of servers in parallel and how this generates so much heat that it "uses" cooling water by just boiling it until it vapourizes.

                        I then explained the current business model and how the companies currently burn through their cash to be the last one standing on the market when everyone else dropped out or became bankrupt. What we user pay for using this and what we actually would have to (and in the future probably will) pay for this service.

                        Needless to say, my kid is not a big fan now.

                        geonz@mathstodon.xyzG This user is from outside of this forum
                        geonz@mathstodon.xyzG This user is from outside of this forum
                        geonz@mathstodon.xyz
                        wrote sidst redigeret af
                        #22

                        @momo no, needing fans means he's not one....

                        1 Reply Last reply
                        0
                        • suriele@eldritch.cafeS suriele@eldritch.cafe

                          @momo Except none of it us true ... evaporative cooling is almost entirely unused in the AI industry because it doesn't work.

                          Every NVIDIA chip (which is like, almost the entire industry at this point) uses either air cooling with giant fan walls, or closed loop water cooling with heat exchangers (For GB200-GB300s)

                          Not arguing the business model of large AI labs though ...

                          orb2069@mastodon.onlineO This user is from outside of this forum
                          orb2069@mastodon.onlineO This user is from outside of this forum
                          orb2069@mastodon.online
                          wrote sidst redigeret af
                          #23

                          @suriele

                          Except, you know...
                          https://www.datacenterknowledge.com/cooling/evaporative-cooling-in-data-centers-why-the-industry-hesitates-to-move-on

                          @momo

                          suriele@eldritch.cafeS 1 Reply Last reply
                          0
                          • momo@social.linux.pizzaM momo@social.linux.pizza

                            I just had "the talk" with my 9yo. He came to me asking "Dad, why does AI use so much water just for generating one answer?"

                            So I explained to him how LLM works, how GenAI came out of that and why AI is a marketing term and absolutely wrong in that context.

                            Then I loaded GPT4All on my laptop and asked the thing what the result of 9+7 is. It took my poor laptop cpu 12 seconds to come up with an answer and another 12 seconds to generate the sentence with the answer. I showed him how fast kcalc (using the CPUs ALU functions) comes up with the answer for that specific question.

                            And then I asked a followup question, which almost take 2 minutes to compute. I showed him how the previous question and its answer became part of the prompt which made the calculation longer more complicated just to emulate a dialoge.

                            He noticed that my laptops CPU fan stepped up and started to roar to get rid of the core heat. Then I explained to him how AI datacenters solve all this ineffitiency by running millions of servers in parallel and how this generates so much heat that it "uses" cooling water by just boiling it until it vapourizes.

                            I then explained the current business model and how the companies currently burn through their cash to be the last one standing on the market when everyone else dropped out or became bankrupt. What we user pay for using this and what we actually would have to (and in the future probably will) pay for this service.

                            Needless to say, my kid is not a big fan now.

                            sinabhfuil@mastodon.ieS This user is from outside of this forum
                            sinabhfuil@mastodon.ieS This user is from outside of this forum
                            sinabhfuil@mastodon.ie
                            wrote sidst redigeret af
                            #24

                            @momo "When a billionaire and his money love each other very much…"

                            1 Reply Last reply
                            0
                            • momo@social.linux.pizzaM momo@social.linux.pizza

                              I just had "the talk" with my 9yo. He came to me asking "Dad, why does AI use so much water just for generating one answer?"

                              So I explained to him how LLM works, how GenAI came out of that and why AI is a marketing term and absolutely wrong in that context.

                              Then I loaded GPT4All on my laptop and asked the thing what the result of 9+7 is. It took my poor laptop cpu 12 seconds to come up with an answer and another 12 seconds to generate the sentence with the answer. I showed him how fast kcalc (using the CPUs ALU functions) comes up with the answer for that specific question.

                              And then I asked a followup question, which almost take 2 minutes to compute. I showed him how the previous question and its answer became part of the prompt which made the calculation longer more complicated just to emulate a dialoge.

                              He noticed that my laptops CPU fan stepped up and started to roar to get rid of the core heat. Then I explained to him how AI datacenters solve all this ineffitiency by running millions of servers in parallel and how this generates so much heat that it "uses" cooling water by just boiling it until it vapourizes.

                              I then explained the current business model and how the companies currently burn through their cash to be the last one standing on the market when everyone else dropped out or became bankrupt. What we user pay for using this and what we actually would have to (and in the future probably will) pay for this service.

                              Needless to say, my kid is not a big fan now.

                              jackemled@furry.engineerJ This user is from outside of this forum
                              jackemled@furry.engineerJ This user is from outside of this forum
                              jackemled@furry.engineer
                              wrote sidst redigeret af
                              #25

                              @momo There are datacenters that use less water by using actual normal cooling systems, but they still use water too when they "overheat" (so probably all the time) & still too much of it. No matter what, these LLM datacenters are a waste of water, power, & money.

                              1 Reply Last reply
                              0
                              • momo@social.linux.pizzaM momo@social.linux.pizza

                                I just had "the talk" with my 9yo. He came to me asking "Dad, why does AI use so much water just for generating one answer?"

                                So I explained to him how LLM works, how GenAI came out of that and why AI is a marketing term and absolutely wrong in that context.

                                Then I loaded GPT4All on my laptop and asked the thing what the result of 9+7 is. It took my poor laptop cpu 12 seconds to come up with an answer and another 12 seconds to generate the sentence with the answer. I showed him how fast kcalc (using the CPUs ALU functions) comes up with the answer for that specific question.

                                And then I asked a followup question, which almost take 2 minutes to compute. I showed him how the previous question and its answer became part of the prompt which made the calculation longer more complicated just to emulate a dialoge.

                                He noticed that my laptops CPU fan stepped up and started to roar to get rid of the core heat. Then I explained to him how AI datacenters solve all this ineffitiency by running millions of servers in parallel and how this generates so much heat that it "uses" cooling water by just boiling it until it vapourizes.

                                I then explained the current business model and how the companies currently burn through their cash to be the last one standing on the market when everyone else dropped out or became bankrupt. What we user pay for using this and what we actually would have to (and in the future probably will) pay for this service.

                                Needless to say, my kid is not a big fan now.

                                mukto_manob@mastodon.socialM This user is from outside of this forum
                                mukto_manob@mastodon.socialM This user is from outside of this forum
                                mukto_manob@mastodon.social
                                wrote sidst redigeret af
                                #26

                                @momo we are trying to leave a better planet for our kids, so if they realise this AI is actually going to ruin their future (environmentally and also morally, socially and psychologically), we have hope!

                                1 Reply Last reply
                                0
                                • momo@social.linux.pizzaM momo@social.linux.pizza

                                  I just had "the talk" with my 9yo. He came to me asking "Dad, why does AI use so much water just for generating one answer?"

                                  So I explained to him how LLM works, how GenAI came out of that and why AI is a marketing term and absolutely wrong in that context.

                                  Then I loaded GPT4All on my laptop and asked the thing what the result of 9+7 is. It took my poor laptop cpu 12 seconds to come up with an answer and another 12 seconds to generate the sentence with the answer. I showed him how fast kcalc (using the CPUs ALU functions) comes up with the answer for that specific question.

                                  And then I asked a followup question, which almost take 2 minutes to compute. I showed him how the previous question and its answer became part of the prompt which made the calculation longer more complicated just to emulate a dialoge.

                                  He noticed that my laptops CPU fan stepped up and started to roar to get rid of the core heat. Then I explained to him how AI datacenters solve all this ineffitiency by running millions of servers in parallel and how this generates so much heat that it "uses" cooling water by just boiling it until it vapourizes.

                                  I then explained the current business model and how the companies currently burn through their cash to be the last one standing on the market when everyone else dropped out or became bankrupt. What we user pay for using this and what we actually would have to (and in the future probably will) pay for this service.

                                  Needless to say, my kid is not a big fan now.

                                  ramses_x@chaos.socialR This user is from outside of this forum
                                  ramses_x@chaos.socialR This user is from outside of this forum
                                  ramses_x@chaos.social
                                  wrote sidst redigeret af
                                  #27

                                  @momo Thank you for this nice story. I will send it to all my annoying colleagues who love their AI "tools".

                                  1 Reply Last reply
                                  0
                                  • orb2069@mastodon.onlineO orb2069@mastodon.online

                                    @suriele

                                    Except, you know...
                                    https://www.datacenterknowledge.com/cooling/evaporative-cooling-in-data-centers-why-the-industry-hesitates-to-move-on

                                    @momo

                                    suriele@eldritch.cafeS This user is from outside of this forum
                                    suriele@eldritch.cafeS This user is from outside of this forum
                                    suriele@eldritch.cafe
                                    wrote sidst redigeret af
                                    #28

                                    @Orb2069 @momo Great, a lovely article with no reference to what hardware its talking about except "AI data centers" as a label, truly authorative.
                                    No .. Virtually all AI focussed chips, at least the ones NVIDIA makes, are either air cooled or in closed water loops.
                                    You can look up their spec sheets, they're public.

                                    kimsj@mastodon.socialK suriele@eldritch.cafeS 2 Replies Last reply
                                    0
                                    • suriele@eldritch.cafeS suriele@eldritch.cafe

                                      @Orb2069 @momo Great, a lovely article with no reference to what hardware its talking about except "AI data centers" as a label, truly authorative.
                                      No .. Virtually all AI focussed chips, at least the ones NVIDIA makes, are either air cooled or in closed water loops.
                                      You can look up their spec sheets, they're public.

                                      kimsj@mastodon.socialK This user is from outside of this forum
                                      kimsj@mastodon.socialK This user is from outside of this forum
                                      kimsj@mastodon.social
                                      wrote sidst redigeret af
                                      #29

                                      @suriele @Orb2069 @momo
                                      Are you shill for an AI company? What other reason could you have to offer misinformation so authoritatively?

                                      orb2069@mastodon.onlineO 1 Reply Last reply
                                      0
                                      • momo@social.linux.pizzaM momo@social.linux.pizza

                                        I just had "the talk" with my 9yo. He came to me asking "Dad, why does AI use so much water just for generating one answer?"

                                        So I explained to him how LLM works, how GenAI came out of that and why AI is a marketing term and absolutely wrong in that context.

                                        Then I loaded GPT4All on my laptop and asked the thing what the result of 9+7 is. It took my poor laptop cpu 12 seconds to come up with an answer and another 12 seconds to generate the sentence with the answer. I showed him how fast kcalc (using the CPUs ALU functions) comes up with the answer for that specific question.

                                        And then I asked a followup question, which almost take 2 minutes to compute. I showed him how the previous question and its answer became part of the prompt which made the calculation longer more complicated just to emulate a dialoge.

                                        He noticed that my laptops CPU fan stepped up and started to roar to get rid of the core heat. Then I explained to him how AI datacenters solve all this ineffitiency by running millions of servers in parallel and how this generates so much heat that it "uses" cooling water by just boiling it until it vapourizes.

                                        I then explained the current business model and how the companies currently burn through their cash to be the last one standing on the market when everyone else dropped out or became bankrupt. What we user pay for using this and what we actually would have to (and in the future probably will) pay for this service.

                                        Needless to say, my kid is not a big fan now.

                                        netzblockierer@tech.lgbtN This user is from outside of this forum
                                        netzblockierer@tech.lgbtN This user is from outside of this forum
                                        netzblockierer@tech.lgbt
                                        wrote sidst redigeret af
                                        #30

                                        @momo better honest on that one than lying…

                                        1 Reply Last reply
                                        0
                                        • momo@social.linux.pizzaM momo@social.linux.pizza

                                          I just had "the talk" with my 9yo. He came to me asking "Dad, why does AI use so much water just for generating one answer?"

                                          So I explained to him how LLM works, how GenAI came out of that and why AI is a marketing term and absolutely wrong in that context.

                                          Then I loaded GPT4All on my laptop and asked the thing what the result of 9+7 is. It took my poor laptop cpu 12 seconds to come up with an answer and another 12 seconds to generate the sentence with the answer. I showed him how fast kcalc (using the CPUs ALU functions) comes up with the answer for that specific question.

                                          And then I asked a followup question, which almost take 2 minutes to compute. I showed him how the previous question and its answer became part of the prompt which made the calculation longer more complicated just to emulate a dialoge.

                                          He noticed that my laptops CPU fan stepped up and started to roar to get rid of the core heat. Then I explained to him how AI datacenters solve all this ineffitiency by running millions of servers in parallel and how this generates so much heat that it "uses" cooling water by just boiling it until it vapourizes.

                                          I then explained the current business model and how the companies currently burn through their cash to be the last one standing on the market when everyone else dropped out or became bankrupt. What we user pay for using this and what we actually would have to (and in the future probably will) pay for this service.

                                          Needless to say, my kid is not a big fan now.

                                          econproph@mastodon.socialE This user is from outside of this forum
                                          econproph@mastodon.socialE This user is from outside of this forum
                                          econproph@mastodon.social
                                          wrote sidst redigeret af
                                          #31

                                          @momo
                                          Bravo. Brilliant answer to your kid. Not only did you get to the answer, but you modeled how to think. Thanks for sharing.

                                          1 Reply Last reply
                                          0
                                          Svar
                                          • Svar som emne
                                          Login for at svare
                                          • Ældste til nyeste
                                          • Nyeste til ældste
                                          • Most Votes


                                          • Log ind

                                          • Har du ikke en konto? Tilmeld

                                          • Login or register to search.
                                          Powered by NodeBB Contributors
                                          Graciously hosted by data.coop
                                          • First post
                                            Last post
                                          0
                                          • Hjem
                                          • Seneste
                                          • Etiketter
                                          • Populære
                                          • Verden
                                          • Bruger
                                          • Grupper