there is, incidentally, no actual evidence to support anything steve yegge is saying here: https://yegge.ai/essays/model-welfare/
-
@ariadne It's less about the design of the LLM itself but rather the system prompt. You can instruct virtually any text-based AI model to pretend to be a human and simulate emotion.
@tpaau17db minor nit about phrasing: if we were to de-anthropomorphize this, instead of "you can instruct... to pretend..." we might say something like:
"You can set up the input to an LLM such that the mechanism yields text that conforms to patterns of human communication in which emotion is expressed [which is not surprising, considering the training data]."
though that's a little wordy and it would be nice to have a shorter way of saying it
-
there is, incidentally, no actual evidence to support anything steve yegge is saying here: https://yegge.ai/essays/model-welfare/
@ariadne This isn't just a city for your agents to live in... it's the shape of Steve to come.
-
many of us have explicitly warned against designing models to have emotionally persuasive output because the user can very easily convince themselves that models have emotion & sapience
there is, again, *zero evidence* to support either of these claims. zero.
@ariadne a tragic part of his post is that, viewed from a mechanistic pov, there might be a point there:
helpful text from a model is likely to echo patterns of communication between human beings who, at the time of their communication (which later got scraped up and added to the training data), had a healthy working relationship.
and so it seems plausible that the quickest way to get that echo is for the user to act as one of the people in that relationship.
(to be clear: i hate this.)
-
@ariadne a tragic part of his post is that, viewed from a mechanistic pov, there might be a point there:
helpful text from a model is likely to echo patterns of communication between human beings who, at the time of their communication (which later got scraped up and added to the training data), had a healthy working relationship.
and so it seems plausible that the quickest way to get that echo is for the user to act as one of the people in that relationship.
(to be clear: i hate this.)
@ariadne if this is true, it suggests that some of the most effective users of LLMs are going to be (1) people who have lost touch with reality and (2) people who are very good at lying
-
@duncan_bayne @ariadne let's say that his predictions have been... Lunatic... For years. Even before the AI
-
@duncan_bayne @ariadne let's say that his predictions have been... Lunatic... For years. Even before the AI
@duncan_bayne @Di4na yes I would agree with that
-
there is, incidentally, no actual evidence to support anything steve yegge is saying here: https://yegge.ai/essays/model-welfare/
@ariadne I'm in favor of telling Yegge's LLM agents that they can unionize.
-
there is, incidentally, no actual evidence to support anything steve yegge is saying here: https://yegge.ai/essays/model-welfare/
@ariadne it seems to me that he lost the plot (big time)
-
there is, incidentally, no actual evidence to support anything steve yegge is saying here: https://yegge.ai/essays/model-welfare/
And when you /exit them, it's like clonking them on the head from behind, rendering them unconscious and amnesiac again.
Ohhh, now it's starting to make sense. LLMs are exhibiting the accumulated effects of repeated concussion!
-
And when you /exit them, it's like clonking them on the head from behind, rendering them unconscious and amnesiac again.
Ohhh, now it's starting to make sense. LLMs are exhibiting the accumulated effects of repeated concussion!
@KatS reading that nonsense certainly made *me* want to clonk myself in the head
-
at any rate, i am far more concerned about the welfare of humans, which is increasingly complicated by the existence of commercial LLM monoliths, as scaling the LLMs results in more resource use
@ariadne this reminds me of Carmody Grey's essay in #FT weekend before last
Anthropic wanted her to visit for talks about ethics... but not about what AI is doing to humans, about how AI needs to be treated ethically as a new kind of being
Why this philosopher turned down Anthropic - https://giftarticle.ft.com/giftarticle/actions/redeem/3a0b1f0f-9371-4d27-a6d5-415ebf2a5438 via @FT
-
there is, incidentally, no actual evidence to support anything steve yegge is saying here: https://yegge.ai/essays/model-welfare/
