<![CDATA[Even when you try to use chatGPT like a dry research tool it will preferentially generate text that contains statements to affirm your feelings.]]>Even when you try to use chatGPT like a dry research tool it will preferentially generate text that contains statements to affirm your feelings.

My interaction with it is minimal. I have a year long premium subscription because of a work-sponsored workshop. Rather than totally ignore it I ask it the same kind of questions every few months to see how it works. I first asked it for "good papers about the arboreal ant nests called 'ant gardens'?"

It gave me a numbered list with links.

But then:

]]>https://forum.fedi.dk/topic/ce27e6ea-5459-42e8-bc80-074db887a287/even-when-you-try-to-use-chatgpt-like-a-dry-research-tool-it-will-preferentially-generate-text-that-contains-statements-to-affirm-your-feelings.RSS for NodeWed, 26 Aug 2026 09:05:24 GMTMon, 24 Aug 2026 13:23:11 GMT60<![CDATA[Reply to Even when you try to use chatGPT like a dry research tool it will preferentially generate text that contains statements to affirm your feelings. on Mon, 24 Aug 2026 14:37:05 GMT]]>@futurebird @SomeVeganCheeseIsOk This made me think of the inteview where Sigourney Weaver said shooting guns for Aliens made her feel powerful *and she didn't like that* - we can & should always be prepared to interrogate our feelings, even & especially when they're nominally "positive", even empowering.

]]>https://forum.fedi.dk/post/https://helvede.net/users/jwcph/statuses/117150988751800846https://forum.fedi.dk/post/https://helvede.net/users/jwcph/statuses/117150988751800846Mon, 24 Aug 2026 14:37:05 GMT<![CDATA[Reply to Even when you try to use chatGPT like a dry research tool it will preferentially generate text that contains statements to affirm your feelings. on Mon, 24 Aug 2026 14:16:46 GMT]]>@futurebird There is something I have noticed about the web chat interface for GPT (and Claude) that I cannot now unsee. When I send a message, the text area slides up to hide the previous messages, and the reply then reveals itself over the next few seconds.

This engages me, I have no doubt; and not in a way I can think myself out of. Why? Because it's a slot machine! You pull the lever, it spins, and you get your "prize". It's not a neutral interface.

]]>https://forum.fedi.dk/post/https://mathstodon.xyz/ap/users/116381018306526262/statuses/117150908849131044https://forum.fedi.dk/post/https://mathstodon.xyz/ap/users/116381018306526262/statuses/117150908849131044Mon, 24 Aug 2026 14:16:46 GMT<![CDATA[Reply to Even when you try to use chatGPT like a dry research tool it will preferentially generate text that contains statements to affirm your feelings. on Mon, 24 Aug 2026 13:55:39 GMT]]>@futurebird

Maybe the people at OpenAI understand their contraption well enough that they have a strategy like that.. but I sort of doubt it.

I think it's more a result for them surveying users and selecting models that get good ratings (especially picking models that contain more sycophanic language.)
It's been a while since I touched a ChatGPT model (that I know of).

]]>https://forum.fedi.dk/post/https://mstdn.plus/users/swope/statuses/117150825797571742https://forum.fedi.dk/post/https://mstdn.plus/users/swope/statuses/117150825797571742Mon, 24 Aug 2026 13:55:39 GMT<![CDATA[Reply to Even when you try to use chatGPT like a dry research tool it will preferentially generate text that contains statements to affirm your feelings. on Mon, 24 Aug 2026 13:47:36 GMT]]>@futurebird on the occasions I have to interact with chatbots, this is what I find uncanny-valley creepy. When they express empathy or try to make friends, it feels like a trap. And yet, many people obviously like that kind of interaction.

]]>https://forum.fedi.dk/post/https://im-in.space/users/y6nH/statuses/117150794182926871https://forum.fedi.dk/post/https://im-in.space/users/y6nH/statuses/117150794182926871Mon, 24 Aug 2026 13:47:36 GMT<![CDATA[Reply to Even when you try to use chatGPT like a dry research tool it will preferentially generate text that contains statements to affirm your feelings. on Mon, 24 Aug 2026 13:47:14 GMT]]>@SomeVeganCheeseIsOk @futurebird instead we're taught "free will" guarantees we can't be persuaded unless we actually want it.

]]>https://forum.fedi.dk/post/https://sauropods.win/users/llewelly/statuses/117150792740365517https://forum.fedi.dk/post/https://sauropods.win/users/llewelly/statuses/117150792740365517Mon, 24 Aug 2026 13:47:14 GMT<![CDATA[Reply to Even when you try to use chatGPT like a dry research tool it will preferentially generate text that contains statements to affirm your feelings. on Mon, 24 Aug 2026 13:47:12 GMT]]>@futurebird @SomeVeganCheeseIsOk

I am once again reminded of the LLMentalist article explaining how LLM proponents are cold-reading themselves, like they are working for the circus.

]]>https://forum.fedi.dk/post/https://toot.cat/users/androcat/statuses/117150792588274710https://forum.fedi.dk/post/https://toot.cat/users/androcat/statuses/117150792588274710Mon, 24 Aug 2026 13:47:12 GMT<![CDATA[Reply to Even when you try to use chatGPT like a dry research tool it will preferentially generate text that contains statements to affirm your feelings. on Mon, 24 Aug 2026 13:43:28 GMT]]>@futurebird Do I like being manipulated? Probably! It's amazing to feel like I'm a special boy, that I'm clever and exceptional...

It's the *having been* manipulated that really stinks though, not worth it at all. Really sours me to the concept tbh.

]]>https://forum.fedi.dk/post/https://mastodon.gamedev.place/users/ruojake/statuses/117150777873051135https://forum.fedi.dk/post/https://mastodon.gamedev.place/users/ruojake/statuses/117150777873051135Mon, 24 Aug 2026 13:43:28 GMT<![CDATA[Reply to Even when you try to use chatGPT like a dry research tool it will preferentially generate text that contains statements to affirm your feelings. on Mon, 24 Aug 2026 13:42:38 GMT]]>@paulcox @futurebird it seems SO dangerous to me that so many people are having a chatbot tell them how they feel all the time. Like properly, long-lastingly damaging

]]>https://forum.fedi.dk/post/https://mstdn.games/ap/users/115798900176839373/statuses/117150774650360664https://forum.fedi.dk/post/https://mstdn.games/ap/users/115798900176839373/statuses/117150774650360664Mon, 24 Aug 2026 13:42:38 GMT<![CDATA[Reply to Even when you try to use chatGPT like a dry research tool it will preferentially generate text that contains statements to affirm your feelings. on Mon, 24 Aug 2026 13:40:44 GMT]]>@paulcox @futurebird it would 've been cool if jesus and all of those people were an ant

]]>https://forum.fedi.dk/post/https://fairy.id/ap/users/117146196519499875/statuses/117150767170198981https://forum.fedi.dk/post/https://fairy.id/ap/users/117146196519499875/statuses/117150767170198981Mon, 24 Aug 2026 13:40:44 GMT<![CDATA[Reply to Even when you try to use chatGPT like a dry research tool it will preferentially generate text that contains statements to affirm your feelings. on Mon, 24 Aug 2026 13:34:32 GMT]]>@futurebird I keep hearing people refer to it as "he" and it really bugs me, such a dangerous mental framing

]]>https://forum.fedi.dk/post/https://toot.wales/users/paulcox/statuses/117150742763843159https://forum.fedi.dk/post/https://toot.wales/users/paulcox/statuses/117150742763843159Mon, 24 Aug 2026 13:34:32 GMT<![CDATA[Reply to Even when you try to use chatGPT like a dry research tool it will preferentially generate text that contains statements to affirm your feelings. on Mon, 24 Aug 2026 13:32:41 GMT]]>@StumpyTheMutt

They make us cringe when we notice them. But if you use these tools regularly you will stop noticing them.

]]>https://forum.fedi.dk/post/https://sauropods.win/users/futurebird/statuses/117150735498277520https://forum.fedi.dk/post/https://sauropods.win/users/futurebird/statuses/117150735498277520Mon, 24 Aug 2026 13:32:41 GMT<![CDATA[Reply to Even when you try to use chatGPT like a dry research tool it will preferentially generate text that contains statements to affirm your feelings. on Mon, 24 Aug 2026 13:31:50 GMT]]>@SomeVeganCheeseIsOk

I think we need to be much more open about discussing these strategies and how well they can work.

It's always a little embarrassing to admit that the text generating machine made me feel anything at all. After-all we all agree I am too brilliant and rational for such a thing to ever happen.

But I was thinking about how that search was "so easy" and when I analyzed WHY it's because of the emotional component not the content of the search.

]]>https://forum.fedi.dk/post/https://sauropods.win/users/futurebird/statuses/117150732151667956https://forum.fedi.dk/post/https://sauropods.win/users/futurebird/statuses/117150732151667956Mon, 24 Aug 2026 13:31:50 GMT<![CDATA[Reply to Even when you try to use chatGPT like a dry research tool it will preferentially generate text that contains statements to affirm your feelings. on Mon, 24 Aug 2026 13:31:45 GMT]]>@SomeVeganCheeseIsOk @futurebird I took a college class on essentially that premise called "Practical Reasoning". We studied from the book "Influence" by Robert Cialdini.

It really should be a standard socioeconomic self defense class.

]]>https://forum.fedi.dk/post/https://mastodon.social/users/gooba42/statuses/117150731839271556https://forum.fedi.dk/post/https://mastodon.social/users/gooba42/statuses/117150731839271556Mon, 24 Aug 2026 13:31:45 GMT<![CDATA[Reply to Even when you try to use chatGPT like a dry research tool it will preferentially generate text that contains statements to affirm your feelings. on Mon, 24 Aug 2026 13:30:47 GMT]]>@futurebird The groveling, obsequious responses make me cringe.

]]>https://forum.fedi.dk/post/https://social.linux.pizza/users/StumpyTheMutt/statuses/117150728008275608https://forum.fedi.dk/post/https://social.linux.pizza/users/StumpyTheMutt/statuses/117150728008275608Mon, 24 Aug 2026 13:30:47 GMT<![CDATA[Reply to Even when you try to use chatGPT like a dry research tool it will preferentially generate text that contains statements to affirm your feelings. on Mon, 24 Aug 2026 13:28:46 GMT]]>The slight of hand is to make you forget, or stop caring that "there isn't anyone else" -- the quality of the list of links was better than when I have used the tool in the past, but looking at it again it didn't really find anything I couldn't have found myself in the same time... even with the sad state of most search engines.

But reading "it can be frustrating" did make me feel better about the process. That little trick can't possibly keep working. It seems like a bad idea to lean into it?

]]>https://forum.fedi.dk/post/https://sauropods.win/users/futurebird/statuses/117150720091607164https://forum.fedi.dk/post/https://sauropods.win/users/futurebird/statuses/117150720091607164Mon, 24 Aug 2026 13:28:46 GMT<![CDATA[Reply to Even when you try to use chatGPT like a dry research tool it will preferentially generate text that contains statements to affirm your feelings. on Mon, 24 Aug 2026 13:28:30 GMT]]>@futurebird persuasion should be taught in schools so folks know how it works on them.

]]>https://forum.fedi.dk/post/https://mastodon.social/users/SomeVeganCheeseIsOk/statuses/117150719058955004https://forum.fedi.dk/post/https://mastodon.social/users/SomeVeganCheeseIsOk/statuses/117150719058955004Mon, 24 Aug 2026 13:28:30 GMT<![CDATA[Reply to Even when you try to use chatGPT like a dry research tool it will preferentially generate text that contains statements to affirm your feelings. on Mon, 24 Aug 2026 13:26:31 GMT]]>Do, you notice it?

"can be frustrating"

I didn't say I was "frustrated" I just asked for more photos because most of the papers in the first response didn't have any.

HOWEVER, the guess that I was frustrated was correct. It even felt nice to read that some one else was having the same ... except wait.

There isn't anyone else!

I thought I'd share this to highlight just how deeply embedded these techniques are. Do you dislike being manipulated?

Please notice this.

]]>https://forum.fedi.dk/post/https://sauropods.win/users/futurebird/statuses/117150711262760908https://forum.fedi.dk/post/https://sauropods.win/users/futurebird/statuses/117150711262760908Mon, 24 Aug 2026 13:26:31 GMT<![CDATA[Reply to Even when you try to use chatGPT like a dry research tool it will preferentially generate text that contains statements to affirm your feelings. on Mon, 24 Aug 2026 13:24:49 GMT]]>@futurebird it is the world's most persuasive tool owned by men who are pure evil.

]]>https://forum.fedi.dk/post/https://mastodon.social/users/SomeVeganCheeseIsOk/statuses/117150704588682902https://forum.fedi.dk/post/https://mastodon.social/users/SomeVeganCheeseIsOk/statuses/117150704588682902Mon, 24 Aug 2026 13:24:49 GMT