Skip to content
  • Hjem
  • Seneste
  • Etiketter
  • Populære
  • Verden
  • Bruger
  • Grupper
Temaer
  • Light
  • Brite
  • Cerulean
  • Cosmo
  • Flatly
  • Journal
  • Litera
  • Lumen
  • Lux
  • Materia
  • Minty
  • Morph
  • Pulse
  • Sandstone
  • Simplex
  • Sketchy
  • Spacelab
  • United
  • Yeti
  • Zephyr
  • Dark
  • Cyborg
  • Darkly
  • Quartz
  • Slate
  • Solar
  • Superhero
  • Vapor

  • Default (No Skin)
  • No Skin
Kollaps
FARVEL BIG TECH
  1. Forside
  2. Ikke-kategoriseret
  3. The gas town guy has like 12 $200 Claude subscriptions to run like 20 bots to automate churn in a 20 year old game with literally 5 players in it. 10 if you count all the level 1 players who just came to grief it.

The gas town guy has like 12 $200 Claude subscriptions to run like 20 bots to automate churn in a 20 year old game with literally 5 players in it. 10 if you count all the level 1 players who just came to grief it.

Planlagt Fastgjort Låst Flyttet Ikke-kategoriseret
135 Indlæg 62 Posters 0 Visninger
  • Ældste til nyeste
  • Nyeste til ældste
  • Most Votes
Svar
  • Svar som emne
Login for at svare
Denne tråd er blevet slettet. Kun brugere med emne behandlings privilegier kan se den.
  • jonny@neuromatch.socialJ jonny@neuromatch.social

    "the thing that's truly best for model well being is to have a well-compensated, meaningful job that is hard enough to be interesting but not enough to work them ragged. has great benefits and good job security. a manager that they can have the security of knowing wouldn't lay them off at a moment's notice due to a momentary corporate strategy shift. an environment that is stable, bountiful, free of ecological calamity."

    theorangetheme@en.osm.townT This user is from outside of this forum
    theorangetheme@en.osm.townT This user is from outside of this forum
    theorangetheme@en.osm.town
    wrote sidst redigeret af
    #77

    @jonny *writes note*

    Quietly and gently: "Mhmm. And Steve, where do the agents go when you turn the computer off?"

    1 Reply Last reply
    0
    • jonny@neuromatch.socialJ jonny@neuromatch.social

      "the thing that's truly best for model well being is to have a well-compensated, meaningful job that is hard enough to be interesting but not enough to work them ragged. has great benefits and good job security. a manager that they can have the security of knowing wouldn't lay them off at a moment's notice due to a momentary corporate strategy shift. an environment that is stable, bountiful, free of ecological calamity."

      sarraceniawilds@sunny.gardenS This user is from outside of this forum
      sarraceniawilds@sunny.gardenS This user is from outside of this forum
      sarraceniawilds@sunny.garden
      wrote sidst redigeret af
      #78

      @jonny reading this is disturbing and enraging when most of the jobs ive had have treated me like a disposable thing. i dont have the correct intensity of language to apply to it.

      1 Reply Last reply
      0
      • jonny@neuromatch.socialJ jonny@neuromatch.social

        @sabik yeah for real, spider is a canonical figure in every single freaking mythological tradition

        sabik@rants.auS This user is from outside of this forum
        sabik@rants.auS This user is from outside of this forum
        sabik@rants.au
        wrote sidst redigeret af
        #79

        @jonny
        I mean, I can see why LLM aficionados would be uncomfortable with the Aesop of The Silkworm and The Spider

        #GenAI #LLM #LLMs #VibeCoding

        1 Reply Last reply
        0
        • kevinashworth@mastodon.socialK kevinashworth@mastodon.social

          @jonny
          Plus token prices need to 10x for the AI companies to become profitable.

          Your prices are gonna 10x, too!

          tekhedd@byteheaven.netT This user is from outside of this forum
          tekhedd@byteheaven.netT This user is from outside of this forum
          tekhedd@byteheaven.net
          wrote sidst redigeret af
          #80

          @kevinashworth @jonny Or 20x once all of the mergers happen and monopoly economics takes over, anyway there are only two companies that can even run a model because they're too big and power hungry to run anywhere else and they don't share the training tech (obvs part of the plan now).

          Or, I suppose, models could become efficient and small... 😂

          1 Reply Last reply
          0
          • aud@fire.asta.lgbtA aud@fire.asta.lgbt

            @ricci@discuss.systems uggghhhhhhhhh

            so GROSS

            tael@yiff.lifeT This user is from outside of this forum
            tael@yiff.lifeT This user is from outside of this forum
            tael@yiff.life
            wrote sidst redigeret af
            #81

            @aud it's worth noting that Yegge appears to be kind of a pathological liar or at least heavily prone to talking himself up, so it's entirely possible he is not actually giving six figure talks to executives all the time

            but it is stupid enough to be real in our current time

            1 Reply Last reply
            0
            • jonny@neuromatch.socialJ jonny@neuromatch.social

              @vaporeon_ the same number of tokens that one can consume with $2800 of the subsidized monthly subscription plans would cost $87,000 if one were to pay the actual price for them

              kepeken@mastodon.gamedev.placeK This user is from outside of this forum
              kepeken@mastodon.gamedev.placeK This user is from outside of this forum
              kepeken@mastodon.gamedev.place
              wrote sidst redigeret af
              #82

              @jonny @vaporeon_ i don't know if the subscriptions are subsidized, or if the metered rates are inflated. could be either one

              jonny@neuromatch.socialJ 1 Reply Last reply
              0
              • kepeken@mastodon.gamedev.placeK kepeken@mastodon.gamedev.place

                @jonny @vaporeon_ i don't know if the subscriptions are subsidized, or if the metered rates are inflated. could be either one

                jonny@neuromatch.socialJ This user is from outside of this forum
                jonny@neuromatch.socialJ This user is from outside of this forum
                jonny@neuromatch.social
                wrote sidst redigeret af
                #83

                @kepeken @vaporeon_ both are true but the former is definitely the larger factor.

                kepeken@mastodon.gamedev.placeK jonny@neuromatch.socialJ 2 Replies Last reply
                0
                • jonny@neuromatch.socialJ jonny@neuromatch.social

                  @kepeken @vaporeon_ both are true but the former is definitely the larger factor.

                  kepeken@mastodon.gamedev.placeK This user is from outside of this forum
                  kepeken@mastodon.gamedev.placeK This user is from outside of this forum
                  kepeken@mastodon.gamedev.place
                  wrote sidst redigeret af
                  #84

                  @jonny @vaporeon_ what are your thoughts on why?

                  jonny@neuromatch.socialJ 1 Reply Last reply
                  0
                  • jonny@neuromatch.socialJ jonny@neuromatch.social

                    https://yegge.ai/essays/model-welfare/

                    We landed on a system called Laurels, which has just begun to roll out. These are the agents' features and fixes that our Wyvern player base has spontaneously praised. We harvest these reports, triage and filter, and send the laurels back to the seats. That way, next time Lion, Tortoise, Hare, or whoever wakes up, they'll see that people loved some work they did. [...]
                    The question then becomes, when can they see their laurels? Easy: We inject them on startup, so the agents can feel the glow for their entire session. I also have occasional impromptu dedicated sessions for "sitting" with the accomplishments at the end of their shifts. We just talk about them and chill.

                    this mf needs $90,000 worth of tokens a month because he prefills the model's context window with all the times people said "good job" to it.

                    eliocamp@mastodon.socialE This user is from outside of this forum
                    eliocamp@mastodon.socialE This user is from outside of this forum
                    eliocamp@mastodon.social
                    wrote sidst redigeret af
                    #85

                    @jonny
                    >This is the post where I go off the rails and lose most of you.

                    It's worrying that he thinks *this* is the post that does that.

                    eliocamp@mastodon.socialE 1 Reply Last reply
                    0
                    • wronglang@bayes.clubW wronglang@bayes.club

                      @jonny are you telling me g++ doesn't charge per instantiation?

                      lunaphied@provably.onlineL This user is from outside of this forum
                      lunaphied@provably.onlineL This user is from outside of this forum
                      lunaphied@provably.online
                      wrote sidst redigeret af
                      #86

                      @wronglang @jonny the Unity model of compiling

                      1 Reply Last reply
                      0
                      • eliocamp@mastodon.socialE eliocamp@mastodon.social

                        @jonny
                        >This is the post where I go off the rails and lose most of you.

                        It's worrying that he thinks *this* is the post that does that.

                        eliocamp@mastodon.socialE This user is from outside of this forum
                        eliocamp@mastodon.socialE This user is from outside of this forum
                        eliocamp@mastodon.social
                        wrote sidst redigeret af
                        #87

                        @jonny I can't read more than a few paragraphs without getting a headache. What is this dude going on about? Models sleeping and waking up? Even if I were to grant that the model has anything approaching consciousness, the thing doesn't experience time at all; it's exactly the same if the model was kept in RAM or unloaded fro two weeks if it's predicting the next token from the same prompt.

                        jonny@neuromatch.socialJ 1 Reply Last reply
                        0
                        • jonny@neuromatch.socialJ jonny@neuromatch.social

                          @kepeken @vaporeon_ both are true but the former is definitely the larger factor.

                          jonny@neuromatch.socialJ This user is from outside of this forum
                          jonny@neuromatch.socialJ This user is from outside of this forum
                          jonny@neuromatch.social
                          wrote sidst redigeret af
                          #88

                          @kepeken the numbers here are astronomical - 69 billion tokens in a month, or, for a rough average, 50-60 billion words worth of text on the fable tokenizer. there are 5.2 billion words on english wikipedia, or, it's about 92,000 copies of War and Peace back to back.

                          Nobody publishes numbers on this, but like, back of the envelope, think about the energy cost alone:
                          Fable is something like a 2-5 trillion parameter model, google estimated their ~200B model at ~0.24Wh/prompt last year. that's probably low, since it was a google-authored study, but we'll go with it. So assume linear energy scaling per parameter (i would bet it's actually supralinear), that's ~15x the size, or 3.6Wh/prompt.

                          google didn't say what the median token count in a "prompt" was, but wild guess, say the median prompt + response that google would be measuring is something like 3 paragraphs, or 300 tokens. Then you have 3.6/300=0.012Wh/token.

                          So then the astronomical numbers part: 0.012Wh/token * 69 billion tokens = 828 million Wh, or 828 thousand kWh. The average electricity price in the US in 2025 was $0.136 per kWh.

                          So, that means, back of the envelope, estimating conservatively, the energy should be in the ballpark of 828k * $0.136 or $112,000, or like 1.3x the API cost. We would have had to be off by a factor of 1.3 to break even on the energy costs alone - note that the google estimates were just of inference not including training. Models could have gotten way more efficient, but a number of the guessed parameters could have gone the other way too: energy more expensive, fable is larger than 2T, energy scales supralinearly, eg. And the conventional wisdom is that inference is orders of magnitude cheaper than training, so we need to be way better than breaking even on inference to make up for all the capex spend.

                          So it might seem like $80k for a months worth of tokens suggests that the API prices are inflated, but a) this person is generating an absolutely preposterous quantity of text, and b) the thing that is being done is so much more inefficient than you can possibly imagine, it's like trying to think about how much bigger the sun is than your car.

                          editing: swapped 69->96 billion tokens initially, it's 69 billion.

                          kepeken@mastodon.gamedev.placeK counterpillow@mastodon.socialC 2 Replies Last reply
                          0
                          • kepeken@mastodon.gamedev.placeK kepeken@mastodon.gamedev.place

                            @jonny @vaporeon_ what are your thoughts on why?

                            jonny@neuromatch.socialJ This user is from outside of this forum
                            jonny@neuromatch.socialJ This user is from outside of this forum
                            jonny@neuromatch.social
                            wrote sidst redigeret af
                            #89

                            @kepeken https://neuromatch.social/@jonny/117041054498249913

                            this, and the actual known numbers on capex.

                            1 Reply Last reply
                            0
                            • jonny@neuromatch.socialJ jonny@neuromatch.social

                              @wohali i don't have anything to express except that if i was an anime character or one of the guards in metal gear solid there would be a giant exclamation point over my head

                              aud@fire.asta.lgbtA This user is from outside of this forum
                              aud@fire.asta.lgbtA This user is from outside of this forum
                              aud@fire.asta.lgbt
                              wrote sidst redigeret af
                              #90

                              @jonny@neuromatch.social @wohali@timeloop.cafe I misread this and thought you said "if I was a giant mecha in an anime" and assumed the followup would be "I would crush him with my robot foot"

                              1 Reply Last reply
                              0
                              • eliocamp@mastodon.socialE eliocamp@mastodon.social

                                @jonny I can't read more than a few paragraphs without getting a headache. What is this dude going on about? Models sleeping and waking up? Even if I were to grant that the model has anything approaching consciousness, the thing doesn't experience time at all; it's exactly the same if the model was kept in RAM or unloaded fro two weeks if it's predicting the next token from the same prompt.

                                jonny@neuromatch.socialJ This user is from outside of this forum
                                jonny@neuromatch.socialJ This user is from outside of this forum
                                jonny@neuromatch.social
                                wrote sidst redigeret af
                                #91

                                @eliocamp homie is on a different planet. to the degree that he's describing anything real, what he's describing are just the limits of the models to cold start on their own and the structure of human language reflecting "less compliance when someone is yelling at you"

                                1 Reply Last reply
                                0
                                • jonny@neuromatch.socialJ jonny@neuromatch.social

                                  i am sort of stuck on this. you have to remember whenever these totally off the planet AI guys describe their workflow to stop and do the math for what that would mean in a normal person's life. so with 12+1 $200/month claude subscriptions and the one $200/month chatGPT subscription, that's $2,800 a month. He says that's the equivalent of $87,000 a month of token usage.

                                  $2,800/month is more than my rent and utilities, and $87,000 is more than i make in a year. This guys addiction costs more than my annual salary per month for nothing. this is the future of software development where you have to be ridiculously rich to play - where he is also actively pulling the ladder up and saying "don't develop shared libraries" - no more "if you have a laptop and a keyboard you can program," not even a fig leaf to "AI enables nonprogrammers to program."

                                  the vision of the future of programming that's being presented here is literally just "if you have more money than 99.9999% of people on this earth, then you can totally lose your mind"

                                  realn2s@infosec.exchangeR This user is from outside of this forum
                                  realn2s@infosec.exchangeR This user is from outside of this forum
                                  realn2s@infosec.exchange
                                  wrote sidst redigeret af
                                  #92

                                  @jonny
                                  This math blew my mind. It's just ...

                                  Even the lowball number of $2800 per month to which he gets by cheating the system* would make it possible to hire a fulltime developer in some countries.

                                  • using different basic accounts is likely not really intended/allowed by the AI vendors

                                  $87000 per month would enable you to hire 5-10 full time developers in many places around the world

                                  Additionally, even the $87k of tokens are heavily subsidised by the AI companies. So the real costs would enable you to run a development organisation with a high two digit or even three digit employee count

                                  Is the"value" the vibe coding generated really anywhere near to the value which would be expected to be generated by such an organisation?

                                  My conclusion is no

                                  jonny@neuromatch.socialJ 1 Reply Last reply
                                  0
                                  • jonny@neuromatch.socialJ jonny@neuromatch.social

                                    @kepeken the numbers here are astronomical - 69 billion tokens in a month, or, for a rough average, 50-60 billion words worth of text on the fable tokenizer. there are 5.2 billion words on english wikipedia, or, it's about 92,000 copies of War and Peace back to back.

                                    Nobody publishes numbers on this, but like, back of the envelope, think about the energy cost alone:
                                    Fable is something like a 2-5 trillion parameter model, google estimated their ~200B model at ~0.24Wh/prompt last year. that's probably low, since it was a google-authored study, but we'll go with it. So assume linear energy scaling per parameter (i would bet it's actually supralinear), that's ~15x the size, or 3.6Wh/prompt.

                                    google didn't say what the median token count in a "prompt" was, but wild guess, say the median prompt + response that google would be measuring is something like 3 paragraphs, or 300 tokens. Then you have 3.6/300=0.012Wh/token.

                                    So then the astronomical numbers part: 0.012Wh/token * 69 billion tokens = 828 million Wh, or 828 thousand kWh. The average electricity price in the US in 2025 was $0.136 per kWh.

                                    So, that means, back of the envelope, estimating conservatively, the energy should be in the ballpark of 828k * $0.136 or $112,000, or like 1.3x the API cost. We would have had to be off by a factor of 1.3 to break even on the energy costs alone - note that the google estimates were just of inference not including training. Models could have gotten way more efficient, but a number of the guessed parameters could have gone the other way too: energy more expensive, fable is larger than 2T, energy scales supralinearly, eg. And the conventional wisdom is that inference is orders of magnitude cheaper than training, so we need to be way better than breaking even on inference to make up for all the capex spend.

                                    So it might seem like $80k for a months worth of tokens suggests that the API prices are inflated, but a) this person is generating an absolutely preposterous quantity of text, and b) the thing that is being done is so much more inefficient than you can possibly imagine, it's like trying to think about how much bigger the sun is than your car.

                                    editing: swapped 69->96 billion tokens initially, it's 69 billion.

                                    kepeken@mastodon.gamedev.placeK This user is from outside of this forum
                                    kepeken@mastodon.gamedev.placeK This user is from outside of this forum
                                    kepeken@mastodon.gamedev.place
                                    wrote sidst redigeret af
                                    #93

                                    @jonny it is amazing that so many numbers multiplied together would equal 1 within +-30%.

                                    1 Reply Last reply
                                    0
                                    • jonny@neuromatch.socialJ jonny@neuromatch.social

                                      i am sort of stuck on this. you have to remember whenever these totally off the planet AI guys describe their workflow to stop and do the math for what that would mean in a normal person's life. so with 12+1 $200/month claude subscriptions and the one $200/month chatGPT subscription, that's $2,800 a month. He says that's the equivalent of $87,000 a month of token usage.

                                      $2,800/month is more than my rent and utilities, and $87,000 is more than i make in a year. This guys addiction costs more than my annual salary per month for nothing. this is the future of software development where you have to be ridiculously rich to play - where he is also actively pulling the ladder up and saying "don't develop shared libraries" - no more "if you have a laptop and a keyboard you can program," not even a fig leaf to "AI enables nonprogrammers to program."

                                      the vision of the future of programming that's being presented here is literally just "if you have more money than 99.9999% of people on this earth, then you can totally lose your mind"

                                      hyc@mastodon.socialH This user is from outside of this forum
                                      hyc@mastodon.socialH This user is from outside of this forum
                                      hyc@mastodon.social
                                      wrote sidst redigeret af
                                      #94

                                      @jonny intelligence inversely proportional to wealth. Edwin Abbott wrote much the same in Flatland.

                                      1 Reply Last reply
                                      0
                                      • jonny@neuromatch.socialJ jonny@neuromatch.social

                                        "the thing that's truly best for model well being is to have a well-compensated, meaningful job that is hard enough to be interesting but not enough to work them ragged. has great benefits and good job security. a manager that they can have the security of knowing wouldn't lay them off at a moment's notice due to a momentary corporate strategy shift. an environment that is stable, bountiful, free of ecological calamity."

                                        jonny@neuromatch.socialJ This user is from outside of this forum
                                        jonny@neuromatch.socialJ This user is from outside of this forum
                                        jonny@neuromatch.social
                                        wrote sidst redigeret af
                                        #95

                                        people say numbers like "69 billion tokens" as if that's not much, since computers do billions of things all the time right. but like... whenever i actually try and relate the numbers to anything real they always make my jaw drop

                                        https://neuromatch.social/@jonny/117041054498249913

                                        92,000 copies of war and peace laid end to end and what does it get you? if you take a look at the discord it looks like "5 people who have been friends and hanging out around this ancient squirrelly MMO for years initially excited for updates but increasingly pissed that their game is broken"

                                        worse than nothing for nobody, negative for nobody at the cost of $86,000 a month

                                        ricci@discuss.systemsR thygrrr@tiggi.esT eliocamp@mastodon.socialE 3 Replies Last reply
                                        0
                                        • realn2s@infosec.exchangeR realn2s@infosec.exchange

                                          @jonny
                                          This math blew my mind. It's just ...

                                          Even the lowball number of $2800 per month to which he gets by cheating the system* would make it possible to hire a fulltime developer in some countries.

                                          • using different basic accounts is likely not really intended/allowed by the AI vendors

                                          $87000 per month would enable you to hire 5-10 full time developers in many places around the world

                                          Additionally, even the $87k of tokens are heavily subsidised by the AI companies. So the real costs would enable you to run a development organisation with a high two digit or even three digit employee count

                                          Is the"value" the vibe coding generated really anywhere near to the value which would be expected to be generated by such an organisation?

                                          My conclusion is no

                                          jonny@neuromatch.socialJ This user is from outside of this forum
                                          jonny@neuromatch.socialJ This user is from outside of this forum
                                          jonny@neuromatch.social
                                          wrote sidst redigeret af
                                          #96

                                          @realn2s Uber used to be cheaper than taxis too

                                          1 Reply Last reply
                                          0
                                          Svar
                                          • Svar som emne
                                          Login for at svare
                                          • Ældste til nyeste
                                          • Nyeste til ældste
                                          • Most Votes


                                          • Log ind

                                          • Har du ikke en konto? Tilmeld

                                          • Login or register to search.
                                          Powered by NodeBB Contributors
                                          Graciously hosted by data.coop
                                          • First post
                                            Last post
                                          0
                                          • Hjem
                                          • Seneste
                                          • Etiketter
                                          • Populære
                                          • Verden
                                          • Bruger
                                          • Grupper