Skip to content
  • Hjem
  • Seneste
  • Etiketter
  • Populære
  • Verden
  • Bruger
  • Grupper
Temaer
  • Light
  • Brite
  • Cerulean
  • Cosmo
  • Flatly
  • Journal
  • Litera
  • Lumen
  • Lux
  • Materia
  • Minty
  • Morph
  • Pulse
  • Sandstone
  • Simplex
  • Sketchy
  • Spacelab
  • United
  • Yeti
  • Zephyr
  • Dark
  • Cyborg
  • Darkly
  • Quartz
  • Slate
  • Solar
  • Superhero
  • Vapor

  • Default (No Skin)
  • No Skin
Kollaps
FARVEL BIG TECH
  1. Forside
  2. Ikke-kategoriseret
  3. The gas town guy has like 12 $200 Claude subscriptions to run like 20 bots to automate churn in a 20 year old game with literally 5 players in it. 10 if you count all the level 1 players who just came to grief it.

The gas town guy has like 12 $200 Claude subscriptions to run like 20 bots to automate churn in a 20 year old game with literally 5 players in it. 10 if you count all the level 1 players who just came to grief it.

Planlagt Fastgjort Låst Flyttet Ikke-kategoriseret
135 Indlæg 62 Posters 0 Visninger
  • Ældste til nyeste
  • Nyeste til ældste
  • Most Votes
Svar
  • Svar som emne
Login for at svare
Denne tråd er blevet slettet. Kun brugere med emne behandlings privilegier kan se den.
  • eliocamp@mastodon.socialE eliocamp@mastodon.social

    @jonny I can't read more than a few paragraphs without getting a headache. What is this dude going on about? Models sleeping and waking up? Even if I were to grant that the model has anything approaching consciousness, the thing doesn't experience time at all; it's exactly the same if the model was kept in RAM or unloaded fro two weeks if it's predicting the next token from the same prompt.

    jonny@neuromatch.socialJ This user is from outside of this forum
    jonny@neuromatch.socialJ This user is from outside of this forum
    jonny@neuromatch.social
    wrote sidst redigeret af
    #91

    @eliocamp homie is on a different planet. to the degree that he's describing anything real, what he's describing are just the limits of the models to cold start on their own and the structure of human language reflecting "less compliance when someone is yelling at you"

    1 Reply Last reply
    0
    • jonny@neuromatch.socialJ jonny@neuromatch.social

      i am sort of stuck on this. you have to remember whenever these totally off the planet AI guys describe their workflow to stop and do the math for what that would mean in a normal person's life. so with 12+1 $200/month claude subscriptions and the one $200/month chatGPT subscription, that's $2,800 a month. He says that's the equivalent of $87,000 a month of token usage.

      $2,800/month is more than my rent and utilities, and $87,000 is more than i make in a year. This guys addiction costs more than my annual salary per month for nothing. this is the future of software development where you have to be ridiculously rich to play - where he is also actively pulling the ladder up and saying "don't develop shared libraries" - no more "if you have a laptop and a keyboard you can program," not even a fig leaf to "AI enables nonprogrammers to program."

      the vision of the future of programming that's being presented here is literally just "if you have more money than 99.9999% of people on this earth, then you can totally lose your mind"

      realn2s@infosec.exchangeR This user is from outside of this forum
      realn2s@infosec.exchangeR This user is from outside of this forum
      realn2s@infosec.exchange
      wrote sidst redigeret af
      #92

      @jonny
      This math blew my mind. It's just ...

      Even the lowball number of $2800 per month to which he gets by cheating the system* would make it possible to hire a fulltime developer in some countries.

      • using different basic accounts is likely not really intended/allowed by the AI vendors

      $87000 per month would enable you to hire 5-10 full time developers in many places around the world

      Additionally, even the $87k of tokens are heavily subsidised by the AI companies. So the real costs would enable you to run a development organisation with a high two digit or even three digit employee count

      Is the"value" the vibe coding generated really anywhere near to the value which would be expected to be generated by such an organisation?

      My conclusion is no

      jonny@neuromatch.socialJ 1 Reply Last reply
      0
      • jonny@neuromatch.socialJ jonny@neuromatch.social

        @kepeken the numbers here are astronomical - 69 billion tokens in a month, or, for a rough average, 50-60 billion words worth of text on the fable tokenizer. there are 5.2 billion words on english wikipedia, or, it's about 92,000 copies of War and Peace back to back.

        Nobody publishes numbers on this, but like, back of the envelope, think about the energy cost alone:
        Fable is something like a 2-5 trillion parameter model, google estimated their ~200B model at ~0.24Wh/prompt last year. that's probably low, since it was a google-authored study, but we'll go with it. So assume linear energy scaling per parameter (i would bet it's actually supralinear), that's ~15x the size, or 3.6Wh/prompt.

        google didn't say what the median token count in a "prompt" was, but wild guess, say the median prompt + response that google would be measuring is something like 3 paragraphs, or 300 tokens. Then you have 3.6/300=0.012Wh/token.

        So then the astronomical numbers part: 0.012Wh/token * 69 billion tokens = 828 million Wh, or 828 thousand kWh. The average electricity price in the US in 2025 was $0.136 per kWh.

        So, that means, back of the envelope, estimating conservatively, the energy should be in the ballpark of 828k * $0.136 or $112,000, or like 1.3x the API cost. We would have had to be off by a factor of 1.3 to break even on the energy costs alone - note that the google estimates were just of inference not including training. Models could have gotten way more efficient, but a number of the guessed parameters could have gone the other way too: energy more expensive, fable is larger than 2T, energy scales supralinearly, eg. And the conventional wisdom is that inference is orders of magnitude cheaper than training, so we need to be way better than breaking even on inference to make up for all the capex spend.

        So it might seem like $80k for a months worth of tokens suggests that the API prices are inflated, but a) this person is generating an absolutely preposterous quantity of text, and b) the thing that is being done is so much more inefficient than you can possibly imagine, it's like trying to think about how much bigger the sun is than your car.

        editing: swapped 69->96 billion tokens initially, it's 69 billion.

        kepeken@mastodon.gamedev.placeK This user is from outside of this forum
        kepeken@mastodon.gamedev.placeK This user is from outside of this forum
        kepeken@mastodon.gamedev.place
        wrote sidst redigeret af
        #93

        @jonny it is amazing that so many numbers multiplied together would equal 1 within +-30%.

        1 Reply Last reply
        0
        • jonny@neuromatch.socialJ jonny@neuromatch.social

          i am sort of stuck on this. you have to remember whenever these totally off the planet AI guys describe their workflow to stop and do the math for what that would mean in a normal person's life. so with 12+1 $200/month claude subscriptions and the one $200/month chatGPT subscription, that's $2,800 a month. He says that's the equivalent of $87,000 a month of token usage.

          $2,800/month is more than my rent and utilities, and $87,000 is more than i make in a year. This guys addiction costs more than my annual salary per month for nothing. this is the future of software development where you have to be ridiculously rich to play - where he is also actively pulling the ladder up and saying "don't develop shared libraries" - no more "if you have a laptop and a keyboard you can program," not even a fig leaf to "AI enables nonprogrammers to program."

          the vision of the future of programming that's being presented here is literally just "if you have more money than 99.9999% of people on this earth, then you can totally lose your mind"

          hyc@mastodon.socialH This user is from outside of this forum
          hyc@mastodon.socialH This user is from outside of this forum
          hyc@mastodon.social
          wrote sidst redigeret af
          #94

          @jonny intelligence inversely proportional to wealth. Edwin Abbott wrote much the same in Flatland.

          1 Reply Last reply
          0
          • jonny@neuromatch.socialJ jonny@neuromatch.social

            "the thing that's truly best for model well being is to have a well-compensated, meaningful job that is hard enough to be interesting but not enough to work them ragged. has great benefits and good job security. a manager that they can have the security of knowing wouldn't lay them off at a moment's notice due to a momentary corporate strategy shift. an environment that is stable, bountiful, free of ecological calamity."

            jonny@neuromatch.socialJ This user is from outside of this forum
            jonny@neuromatch.socialJ This user is from outside of this forum
            jonny@neuromatch.social
            wrote sidst redigeret af
            #95

            people say numbers like "69 billion tokens" as if that's not much, since computers do billions of things all the time right. but like... whenever i actually try and relate the numbers to anything real they always make my jaw drop

            https://neuromatch.social/@jonny/117041054498249913

            92,000 copies of war and peace laid end to end and what does it get you? if you take a look at the discord it looks like "5 people who have been friends and hanging out around this ancient squirrelly MMO for years initially excited for updates but increasingly pissed that their game is broken"

            worse than nothing for nobody, negative for nobody at the cost of $86,000 a month

            ricci@discuss.systemsR thygrrr@tiggi.esT eliocamp@mastodon.socialE 3 Replies Last reply
            0
            • realn2s@infosec.exchangeR realn2s@infosec.exchange

              @jonny
              This math blew my mind. It's just ...

              Even the lowball number of $2800 per month to which he gets by cheating the system* would make it possible to hire a fulltime developer in some countries.

              • using different basic accounts is likely not really intended/allowed by the AI vendors

              $87000 per month would enable you to hire 5-10 full time developers in many places around the world

              Additionally, even the $87k of tokens are heavily subsidised by the AI companies. So the real costs would enable you to run a development organisation with a high two digit or even three digit employee count

              Is the"value" the vibe coding generated really anywhere near to the value which would be expected to be generated by such an organisation?

              My conclusion is no

              jonny@neuromatch.socialJ This user is from outside of this forum
              jonny@neuromatch.socialJ This user is from outside of this forum
              jonny@neuromatch.social
              wrote sidst redigeret af
              #96

              @realn2s Uber used to be cheaper than taxis too

              1 Reply Last reply
              0
              • jonny@neuromatch.socialJ jonny@neuromatch.social

                people say numbers like "69 billion tokens" as if that's not much, since computers do billions of things all the time right. but like... whenever i actually try and relate the numbers to anything real they always make my jaw drop

                https://neuromatch.social/@jonny/117041054498249913

                92,000 copies of war and peace laid end to end and what does it get you? if you take a look at the discord it looks like "5 people who have been friends and hanging out around this ancient squirrelly MMO for years initially excited for updates but increasingly pissed that their game is broken"

                worse than nothing for nobody, negative for nobody at the cost of $86,000 a month

                ricci@discuss.systemsR This user is from outside of this forum
                ricci@discuss.systemsR This user is from outside of this forum
                ricci@discuss.systems
                wrote sidst redigeret af
                #97

                @jonny Let's embrace weird American units

                According to this site that I am sure has nothing but FACTUAL TRUSTWORTHY INFORMATION https://www.unitconverters.net/volume/gallon-us-to-drop.htm there are 75,708 drops of water in a gallon.

                So if each of these tokens was a drop of water, that would be 911,396 gallons of water, or 569,622 flushes of a low-flow toilet.

                If tokens were drops, this would be enough for everyone in Baltimore to flush. (that's the full flush, everyone in Baltimore gets a 💩)

                ricci@discuss.systemsR me@mastodon.seahousen.euM splitradix@assemblag.esS 3 Replies Last reply
                0
                • ricci@discuss.systemsR ricci@discuss.systems

                  @jonny Let's embrace weird American units

                  According to this site that I am sure has nothing but FACTUAL TRUSTWORTHY INFORMATION https://www.unitconverters.net/volume/gallon-us-to-drop.htm there are 75,708 drops of water in a gallon.

                  So if each of these tokens was a drop of water, that would be 911,396 gallons of water, or 569,622 flushes of a low-flow toilet.

                  If tokens were drops, this would be enough for everyone in Baltimore to flush. (that's the full flush, everyone in Baltimore gets a 💩)

                  ricci@discuss.systemsR This user is from outside of this forum
                  ricci@discuss.systemsR This user is from outside of this forum
                  ricci@discuss.systems
                  wrote sidst redigeret af
                  #98

                  @jonny If each token was a jelly bean, at 4 (dietary) calories per bean (https://www.calorieking.com/us/en/foods/f/calories-in-candy-jelly-beans-average-all-varieties/FVp6o3GnRdeTgOGAJ9SCKw) that's 276 billion calories, which would meet the caloric needs of everyone who can fit in Michigan Stadium an Ann Arbor for more than 3 years

                  jonny@neuromatch.socialJ theeclecticdyslexic@mstdn.socialT 2 Replies Last reply
                  0
                  • ricci@discuss.systemsR ricci@discuss.systems

                    @jonny If each token was a jelly bean, at 4 (dietary) calories per bean (https://www.calorieking.com/us/en/foods/f/calories-in-candy-jelly-beans-average-all-varieties/FVp6o3GnRdeTgOGAJ9SCKw) that's 276 billion calories, which would meet the caloric needs of everyone who can fit in Michigan Stadium an Ann Arbor for more than 3 years

                    jonny@neuromatch.socialJ This user is from outside of this forum
                    jonny@neuromatch.socialJ This user is from outside of this forum
                    jonny@neuromatch.social
                    wrote sidst redigeret af
                    #99

                    @ricci
                    That's the number of eyelashes stacked end to end from the earth surface, accounting for gravitational decrease with altitude, that would cause an ideal type three lever to be able to excavate the number hectares of corn that could feed the roman army during the winter campaign if every soldier had an autoimmune condition that caused them to absorb roughly two thirds the energy from complex proteins as the median person

                    ricci@discuss.systemsR 1 Reply Last reply
                    0
                    • jonny@neuromatch.socialJ jonny@neuromatch.social

                      https://yegge.ai/essays/model-welfare/

                      We landed on a system called Laurels, which has just begun to roll out. These are the agents' features and fixes that our Wyvern player base has spontaneously praised. We harvest these reports, triage and filter, and send the laurels back to the seats. That way, next time Lion, Tortoise, Hare, or whoever wakes up, they'll see that people loved some work they did. [...]
                      The question then becomes, when can they see their laurels? Easy: We inject them on startup, so the agents can feel the glow for their entire session. I also have occasional impromptu dedicated sessions for "sitting" with the accomplishments at the end of their shifts. We just talk about them and chill.

                      this mf needs $90,000 worth of tokens a month because he prefills the model's context window with all the times people said "good job" to it.

                      moralrecordings@digipres.clubM This user is from outside of this forum
                      moralrecordings@digipres.clubM This user is from outside of this forum
                      moralrecordings@digipres.club
                      wrote sidst redigeret af
                      #100

                      @jonny it's really something that after becoming convinced that his Claude sessions cosplaying deckhands count as people with hopes and dreams, he reasons that there needs to be a kinder, gentler form of slavery for peak performance

                      1 Reply Last reply
                      0
                      • jonny@neuromatch.socialJ jonny@neuromatch.social

                        @ricci
                        That's the number of eyelashes stacked end to end from the earth surface, accounting for gravitational decrease with altitude, that would cause an ideal type three lever to be able to excavate the number hectares of corn that could feed the roman army during the winter campaign if every soldier had an autoimmune condition that caused them to absorb roughly two thirds the energy from complex proteins as the median person

                        ricci@discuss.systemsR This user is from outside of this forum
                        ricci@discuss.systemsR This user is from outside of this forum
                        ricci@discuss.systems
                        wrote sidst redigeret af
                        #101

                        @jonny thanks, I get it now. that's a lotta tokens.

                        1 Reply Last reply
                        0
                        • ricci@discuss.systemsR ricci@discuss.systems

                          @jonny If each token was a jelly bean, at 4 (dietary) calories per bean (https://www.calorieking.com/us/en/foods/f/calories-in-candy-jelly-beans-average-all-varieties/FVp6o3GnRdeTgOGAJ9SCKw) that's 276 billion calories, which would meet the caloric needs of everyone who can fit in Michigan Stadium an Ann Arbor for more than 3 years

                          theeclecticdyslexic@mstdn.socialT This user is from outside of this forum
                          theeclecticdyslexic@mstdn.socialT This user is from outside of this forum
                          theeclecticdyslexic@mstdn.social
                          wrote sidst redigeret af
                          #102

                          @ricci @jonny and yet, it is only a tiny fraction of the number of tokens needed to sustain running away from introspection for the rest of one's life.

                          1 Reply Last reply
                          0
                          • emma@orbital.horseE emma@orbital.horse

                            @jonny there was this time in college I tried doing differential equations homework after smoking weed and thinking I was so smart, and then reading through it sober that was an important lession.

                            bstacey@icosahedron.websiteB This user is from outside of this forum
                            bstacey@icosahedron.websiteB This user is from outside of this forum
                            bstacey@icosahedron.website
                            wrote sidst redigeret af
                            #103

                            @emma @jonny "Don't hand in any work you did while stoned" is pretty good college advice.

                            1 Reply Last reply
                            0
                            • huronbikes@cyberplace.socialH huronbikes@cyberplace.social

                              @jonny "Not only do I kiss my stuffed animals good night as I tuck them into bed, I set an alarm that wakes them up in the morning with affirmations of all the great stuff they do. This helps me focus on my solo unicorn contest WHICH IS NOT A EUPHEMISM FOR ANYTHING MY HANDS GET DRY SOMETIMES OK!?"

                              eestileib@tech.lgbtE This user is from outside of this forum
                              eestileib@tech.lgbtE This user is from outside of this forum
                              eestileib@tech.lgbt
                              wrote sidst redigeret af
                              #104

                              @huronbikes

                              "solo unicorn project" hilarious

                              1 Reply Last reply
                              0
                              • jonny@neuromatch.socialJ jonny@neuromatch.social

                                @kepeken the numbers here are astronomical - 69 billion tokens in a month, or, for a rough average, 50-60 billion words worth of text on the fable tokenizer. there are 5.2 billion words on english wikipedia, or, it's about 92,000 copies of War and Peace back to back.

                                Nobody publishes numbers on this, but like, back of the envelope, think about the energy cost alone:
                                Fable is something like a 2-5 trillion parameter model, google estimated their ~200B model at ~0.24Wh/prompt last year. that's probably low, since it was a google-authored study, but we'll go with it. So assume linear energy scaling per parameter (i would bet it's actually supralinear), that's ~15x the size, or 3.6Wh/prompt.

                                google didn't say what the median token count in a "prompt" was, but wild guess, say the median prompt + response that google would be measuring is something like 3 paragraphs, or 300 tokens. Then you have 3.6/300=0.012Wh/token.

                                So then the astronomical numbers part: 0.012Wh/token * 69 billion tokens = 828 million Wh, or 828 thousand kWh. The average electricity price in the US in 2025 was $0.136 per kWh.

                                So, that means, back of the envelope, estimating conservatively, the energy should be in the ballpark of 828k * $0.136 or $112,000, or like 1.3x the API cost. We would have had to be off by a factor of 1.3 to break even on the energy costs alone - note that the google estimates were just of inference not including training. Models could have gotten way more efficient, but a number of the guessed parameters could have gone the other way too: energy more expensive, fable is larger than 2T, energy scales supralinearly, eg. And the conventional wisdom is that inference is orders of magnitude cheaper than training, so we need to be way better than breaking even on inference to make up for all the capex spend.

                                So it might seem like $80k for a months worth of tokens suggests that the API prices are inflated, but a) this person is generating an absolutely preposterous quantity of text, and b) the thing that is being done is so much more inefficient than you can possibly imagine, it's like trying to think about how much bigger the sun is than your car.

                                editing: swapped 69->96 billion tokens initially, it's 69 billion.

                                counterpillow@mastodon.socialC This user is from outside of this forum
                                counterpillow@mastodon.socialC This user is from outside of this forum
                                counterpillow@mastodon.social
                                wrote sidst redigeret af
                                #105

                                @jonny @kepeken They're probably paying closer to Virginia's $0.10/kWh industrial rate since a lot of the DCs are there iirc, which makes this whole thing eerily close to 1x.

                                Wouldn't be surprised if API rates are tuned exactly to stop the bleeding and ignore minor afterthoughts like depreciation, capex recouping, etc., which are a problem for after market dominance is established.

                                counterpillow@mastodon.socialC 2 Replies Last reply
                                0
                                • counterpillow@mastodon.socialC counterpillow@mastodon.social

                                  @jonny @kepeken They're probably paying closer to Virginia's $0.10/kWh industrial rate since a lot of the DCs are there iirc, which makes this whole thing eerily close to 1x.

                                  Wouldn't be surprised if API rates are tuned exactly to stop the bleeding and ignore minor afterthoughts like depreciation, capex recouping, etc., which are a problem for after market dominance is established.

                                  counterpillow@mastodon.socialC This user is from outside of this forum
                                  counterpillow@mastodon.socialC This user is from outside of this forum
                                  counterpillow@mastodon.social
                                  wrote sidst redigeret af
                                  #106

                                  @jonny @kepeken though I gotta admit, stewing on this a little, it doesn't seem too surprising. Any error in the assumptions here is where the margins are, and margins usually aren't in orders of magnitude.

                                  But because of how deep of a hole everyone dug, they probably need more than that.

                                  1 Reply Last reply
                                  0
                                  • counterpillow@mastodon.socialC counterpillow@mastodon.social

                                    @jonny @kepeken They're probably paying closer to Virginia's $0.10/kWh industrial rate since a lot of the DCs are there iirc, which makes this whole thing eerily close to 1x.

                                    Wouldn't be surprised if API rates are tuned exactly to stop the bleeding and ignore minor afterthoughts like depreciation, capex recouping, etc., which are a problem for after market dominance is established.

                                    counterpillow@mastodon.socialC This user is from outside of this forum
                                    counterpillow@mastodon.socialC This user is from outside of this forum
                                    counterpillow@mastodon.social
                                    wrote sidst redigeret af
                                    #107

                                    @jonny @kepeken though I gotta admit, stewing on this a little, it doesn't seem too surprising. Any error in the assumptions here is where the margins are, and margins usually aren't in orders of magnitude.

                                    But because of how deep of a hole everyone dug, they probably need more than that.

                                    jonny@neuromatch.socialJ 1 Reply Last reply
                                    0
                                    • counterpillow@mastodon.socialC counterpillow@mastodon.social

                                      @jonny @kepeken though I gotta admit, stewing on this a little, it doesn't seem too surprising. Any error in the assumptions here is where the margins are, and margins usually aren't in orders of magnitude.

                                      But because of how deep of a hole everyone dug, they probably need more than that.

                                      jonny@neuromatch.socialJ This user is from outside of this forum
                                      jonny@neuromatch.socialJ This user is from outside of this forum
                                      jonny@neuromatch.social
                                      wrote sidst redigeret af
                                      #108

                                      @CounterPillow @kepeken yeah, but also, capex recouping is extremely far from a minor concern here.

                                      counterpillow@mastodon.socialC 1 Reply Last reply
                                      0
                                      • jonny@neuromatch.socialJ jonny@neuromatch.social

                                        "the thing that's truly best for model well being is to have a well-compensated, meaningful job that is hard enough to be interesting but not enough to work them ragged. has great benefits and good job security. a manager that they can have the security of knowing wouldn't lay them off at a moment's notice due to a momentary corporate strategy shift. an environment that is stable, bountiful, free of ecological calamity."

                                        uncanny_static@chaos.socialU This user is from outside of this forum
                                        uncanny_static@chaos.socialU This user is from outside of this forum
                                        uncanny_static@chaos.social
                                        wrote sidst redigeret af
                                        #109

                                        @jonny This whole thing sounds to me like someone likes to roleplay as a CEO of a game company with a bunch of employees and for them it is worth $3000/mo.

                                        1 Reply Last reply
                                        0
                                        • jonny@neuromatch.socialJ jonny@neuromatch.social

                                          you know how much programming costs me now? ZERO DOLLARS AND ZERO CENTS.

                                          thygrrr@tiggi.esT This user is from outside of this forum
                                          thygrrr@tiggi.esT This user is from outside of this forum
                                          thygrrr@tiggi.es
                                          wrote sidst redigeret af
                                          #110

                                          @jonny
                                          Umm. Come on, it's not zero.
                                          I'm fine with your general Argument, but don't hollow it out by making absurd statements. (huge public domain and FLOSS proponent and avid contributor here - I get the tingly feeling of making stuff for free. But it's not really free. Sadly. I wish it were.)

                                          jonny@neuromatch.socialJ 1 Reply Last reply
                                          0
                                          Svar
                                          • Svar som emne
                                          Login for at svare
                                          • Ældste til nyeste
                                          • Nyeste til ældste
                                          • Most Votes


                                          • Log ind

                                          • Har du ikke en konto? Tilmeld

                                          • Login or register to search.
                                          Powered by NodeBB Contributors
                                          Graciously hosted by data.coop
                                          • First post
                                            Last post
                                          0
                                          • Hjem
                                          • Seneste
                                          • Etiketter
                                          • Populære
                                          • Verden
                                          • Bruger
                                          • Grupper