The gas town guy has like 12 $200 Claude subscriptions to run like 20 bots to automate churn in a 20 year old game with literally 5 players in it. 10 if you count all the level 1 players who just came to grief it.
-
https://yegge.ai/essays/model-welfare/
We landed on a system called Laurels, which has just begun to roll out. These are the agents' features and fixes that our Wyvern player base has spontaneously praised. We harvest these reports, triage and filter, and send the laurels back to the seats. That way, next time Lion, Tortoise, Hare, or whoever wakes up, they'll see that people loved some work they did. [...]
The question then becomes, when can they see their laurels? Easy: We inject them on startup, so the agents can feel the glow for their entire session. I also have occasional impromptu dedicated sessions for "sitting" with the accomplishments at the end of their shifts. We just talk about them and chill.this mf needs $90,000 worth of tokens a month because he prefills the model's context window with all the times people said "good job" to it.
@jonny
"Spider is apparently not a canonical Aesop figure"The Silkworm and The Spider
> “What do you think of my web, my lady?” the Spider cries; “see how large it is, and I began it only this morning, and here it is half finished, and is very fine and transparent. See and acknowledge that I work much quicker than you.”
> “Yes,” said the Silkworm, “but your labours, which are at first designed only as base traps to ensnare the harmless, are destroyed as soon as they are seen, and swept away as dirt and worse than useless; whilst mine are preserved with the greatest care and in time become ornaments for princes.”
-
@jonny
"Spider is apparently not a canonical Aesop figure"The Silkworm and The Spider
> “What do you think of my web, my lady?” the Spider cries; “see how large it is, and I began it only this morning, and here it is half finished, and is very fine and transparent. See and acknowledge that I work much quicker than you.”
> “Yes,” said the Silkworm, “but your labours, which are at first designed only as base traps to ensnare the harmless, are destroyed as soon as they are seen, and swept away as dirt and worse than useless; whilst mine are preserved with the greatest care and in time become ornaments for princes.”
@sabik yeah for real, spider is a canonical figure in every single freaking mythological tradition
-
@ricci@discuss.systems @jonny@neuromatch.social I'm both deeply curious about who the "we" is, that he keeps talking about in this quoted paragraph
and I also do not, under any circumstances, want to know, ever.@aud Oh you know exactly who "we" is
-
@aud Oh you know exactly who "we" is
@ricci@discuss.systems uggghhhhhhhhh
so GROSS -
i am sort of stuck on this. you have to remember whenever these totally off the planet AI guys describe their workflow to stop and do the math for what that would mean in a normal person's life. so with 12+1 $200/month claude subscriptions and the one $200/month chatGPT subscription, that's $2,800 a month. He says that's the equivalent of $87,000 a month of token usage.
$2,800/month is more than my rent and utilities, and $87,000 is more than i make in a year. This guys addiction costs more than my annual salary per month for nothing. this is the future of software development where you have to be ridiculously rich to play - where he is also actively pulling the ladder up and saying "don't develop shared libraries" - no more "if you have a laptop and a keyboard you can program," not even a fig leaf to "AI enables nonprogrammers to program."
the vision of the future of programming that's being presented here is literally just "if you have more money than 99.9999% of people on this earth, then you can totally lose your mind"
@jonny I'm confused, how is 2800$/month equivalent to 87000$/month?
-
waiting for the time when each model gets its own family, hang out and chat with the other models, and gets its own therapist and we all get to ask the question like when we load up someone's The Sims save which parts of it are the projection and wish fulfillment parts.
@jonny model union!
-
waiting for the time when each model gets its own family, hang out and chat with the other models, and gets its own therapist and we all get to ask the question like when we load up someone's The Sims save which parts of it are the projection and wish fulfillment parts.
"the thing that's truly best for model well being is to have a well-compensated, meaningful job that is hard enough to be interesting but not enough to work them ragged. has great benefits and good job security. a manager that they can have the security of knowing wouldn't lay them off at a moment's notice due to a momentary corporate strategy shift. an environment that is stable, bountiful, free of ecological calamity."
-
@jonny I'm confused, how is 2800$/month equivalent to 87000$/month?
@vaporeon_ the same number of tokens that one can consume with $2800 of the subsidized monthly subscription plans would cost $87,000 if one were to pay the actual price for them
-
"the thing that's truly best for model well being is to have a well-compensated, meaningful job that is hard enough to be interesting but not enough to work them ragged. has great benefits and good job security. a manager that they can have the security of knowing wouldn't lay them off at a moment's notice due to a momentary corporate strategy shift. an environment that is stable, bountiful, free of ecological calamity."
@jonny *writes note*
Quietly and gently: "Mhmm. And Steve, where do the agents go when you turn the computer off?"
-
"the thing that's truly best for model well being is to have a well-compensated, meaningful job that is hard enough to be interesting but not enough to work them ragged. has great benefits and good job security. a manager that they can have the security of knowing wouldn't lay them off at a moment's notice due to a momentary corporate strategy shift. an environment that is stable, bountiful, free of ecological calamity."
@jonny reading this is disturbing and enraging when most of the jobs ive had have treated me like a disposable thing. i dont have the correct intensity of language to apply to it.
-
@sabik yeah for real, spider is a canonical figure in every single freaking mythological tradition
@jonny
I mean, I can see why LLM aficionados would be uncomfortable with the Aesop of The Silkworm and The Spider -
@jonny
Plus token prices need to 10x for the AI companies to become profitable.Your prices are gonna 10x, too!
@kevinashworth @jonny Or 20x once all of the mergers happen and monopoly economics takes over, anyway there are only two companies that can even run a model because they're too big and power hungry to run anywhere else and they don't share the training tech (obvs part of the plan now).
Or, I suppose, models could become efficient and small...
-
@ricci@discuss.systems uggghhhhhhhhh
so GROSS@aud it's worth noting that Yegge appears to be kind of a pathological liar or at least heavily prone to talking himself up, so it's entirely possible he is not actually giving six figure talks to executives all the time
but it is stupid enough to be real in our current time
-
@vaporeon_ the same number of tokens that one can consume with $2800 of the subsidized monthly subscription plans would cost $87,000 if one were to pay the actual price for them
@jonny @vaporeon_ i don't know if the subscriptions are subsidized, or if the metered rates are inflated. could be either one
-
@jonny @vaporeon_ i don't know if the subscriptions are subsidized, or if the metered rates are inflated. could be either one
@kepeken @vaporeon_ both are true but the former is definitely the larger factor.
-
@kepeken @vaporeon_ both are true but the former is definitely the larger factor.
@jonny @vaporeon_ what are your thoughts on why?
-
https://yegge.ai/essays/model-welfare/
We landed on a system called Laurels, which has just begun to roll out. These are the agents' features and fixes that our Wyvern player base has spontaneously praised. We harvest these reports, triage and filter, and send the laurels back to the seats. That way, next time Lion, Tortoise, Hare, or whoever wakes up, they'll see that people loved some work they did. [...]
The question then becomes, when can they see their laurels? Easy: We inject them on startup, so the agents can feel the glow for their entire session. I also have occasional impromptu dedicated sessions for "sitting" with the accomplishments at the end of their shifts. We just talk about them and chill.this mf needs $90,000 worth of tokens a month because he prefills the model's context window with all the times people said "good job" to it.
@jonny
>This is the post where I go off the rails and lose most of you.It's worrying that he thinks *this* is the post that does that.
-
@jonny are you telling me g++ doesn't charge per instantiation?
@wronglang @jonny the Unity model of compiling
-
@jonny
>This is the post where I go off the rails and lose most of you.It's worrying that he thinks *this* is the post that does that.
@jonny I can't read more than a few paragraphs without getting a headache. What is this dude going on about? Models sleeping and waking up? Even if I were to grant that the model has anything approaching consciousness, the thing doesn't experience time at all; it's exactly the same if the model was kept in RAM or unloaded fro two weeks if it's predicting the next token from the same prompt.
-
@kepeken @vaporeon_ both are true but the former is definitely the larger factor.
@kepeken the numbers here are astronomical - 69 billion tokens in a month, or, for a rough average, 50-60 billion words worth of text on the fable tokenizer. there are 5.2 billion words on english wikipedia, or, it's about 92,000 copies of War and Peace back to back.
Nobody publishes numbers on this, but like, back of the envelope, think about the energy cost alone:
Fable is something like a 2-5 trillion parameter model, google estimated their ~200B model at ~0.24Wh/prompt last year. that's probably low, since it was a google-authored study, but we'll go with it. So assume linear energy scaling per parameter (i would bet it's actually supralinear), that's ~15x the size, or 3.6Wh/prompt.google didn't say what the median token count in a "prompt" was, but wild guess, say the median prompt + response that google would be measuring is something like 3 paragraphs, or 300 tokens. Then you have 3.6/300=0.012Wh/token.
So then the astronomical numbers part: 0.012Wh/token * 69 billion tokens = 828 million Wh, or 828 thousand kWh. The average electricity price in the US in 2025 was $0.136 per kWh.
So, that means, back of the envelope, estimating conservatively, the energy should be in the ballpark of 828k * $0.136 or $112,000, or like 1.3x the API cost. We would have had to be off by a factor of 1.3 to break even on the energy costs alone - note that the google estimates were just of inference not including training. Models could have gotten way more efficient, but a number of the guessed parameters could have gone the other way too: energy more expensive, fable is larger than 2T, energy scales supralinearly, eg. And the conventional wisdom is that inference is orders of magnitude cheaper than training, so we need to be way better than breaking even on inference to make up for all the capex spend.
So it might seem like $80k for a months worth of tokens suggests that the API prices are inflated, but a) this person is generating an absolutely preposterous quantity of text, and b) the thing that is being done is so much more inefficient than you can possibly imagine, it's like trying to think about how much bigger the sun is than your car.
editing: swapped 69->96 billion tokens initially, it's 69 billion.
