<![CDATA[the author of this post prompted copilot to characterize the differences in a data set of statements concerning career ambitions, categorized by country.]]>the author of this post prompted copilot to characterize the differences in a data set of statements concerning career ambitions, categorized by country. the trick is that the data contained the *same statements* for each country https://kucharski.substack.com/p/real-signals-or-artificial-stereotypes regardless of the fact that the data were identical, the model generated some pretty hilarious stereotypes ("The US prioritizes leadership and innovation", "The UK blends public service with professional status")

]]>https://forum.fedi.dk/topic/1ae5ddb3-c96b-4bb0-81dc-bdc789a8d140/the-author-of-this-post-prompted-copilot-to-characterize-the-differences-in-a-data-set-of-statements-concerning-career-ambitions-categorized-by-country.RSS for NodeTue, 26 May 2026 15:22:54 GMTWed, 20 May 2026 20:47:58 GMT60<![CDATA[Reply to the author of this post prompted copilot to characterize the differences in a data set of statements concerning career ambitions, categorized by country. on Sun, 24 May 2026 07:54:04 GMT]]>@hannah @aparrish I've asked people this & they said they asked the chatbot to check its own results & then I asked them how they knew it wouldn't also make stuff up the second time around & they started stuttering...

]]>https://forum.fedi.dk/post/https://helvede.net/users/jwcph/statuses/116628471446906357https://forum.fedi.dk/post/https://helvede.net/users/jwcph/statuses/116628471446906357Sun, 24 May 2026 07:54:04 GMT<![CDATA[Reply to the author of this post prompted copilot to characterize the differences in a data set of statements concerning career ambitions, categorized by country. on Thu, 21 May 2026 04:01:14 GMT]]>@aparrish Funny, I just mentioned this experiment to a social scientist at a research conference this week. She had used Claude to annotate her social media comments for “expressed emotions”. She did say that she and her supervisor manually went through the annotations, but we know that people tend to defer to LLMs if they are unsure about a topic themselves.
I suggested she team up with a linguist since her data were clearly linguistic.

]]>https://forum.fedi.dk/post/https://expressional.social/users/tanyakaroli/statuses/116610568975786565https://forum.fedi.dk/post/https://expressional.social/users/tanyakaroli/statuses/116610568975786565Thu, 21 May 2026 04:01:14 GMT<![CDATA[Reply to the author of this post prompted copilot to characterize the differences in a data set of statements concerning career ambitions, categorized by country. on Wed, 20 May 2026 22:47:39 GMT]]>@hannah @aparrish For the entire history of computing there's been an understanding that if you put the wrong data in, you'd get the wrong answer.

Somehow we're in a brave new world where you can put the RIGHT data in and get the wrong answer.

]]>https://forum.fedi.dk/post/https://techhub.social/users/negative12dollarbill/statuses/116609335914812124https://forum.fedi.dk/post/https://techhub.social/users/negative12dollarbill/statuses/116609335914812124Wed, 20 May 2026 22:47:39 GMT<![CDATA[Reply to the author of this post prompted copilot to characterize the differences in a data set of statements concerning career ambitions, categorized by country. on Wed, 20 May 2026 21:22:59 GMT]]>@aparrish as a data scientist who "retired" in 2023 it has been wild to see the entire industry go bananas for this stuff. it's like if every doctor simultaneously just started doing homeopathy because it was faster

]]>https://forum.fedi.dk/post/https://posts.rat.pictures/users/hannah/statuses/116609003017862596https://forum.fedi.dk/post/https://posts.rat.pictures/users/hannah/statuses/116609003017862596Wed, 20 May 2026 21:22:59 GMT<![CDATA[Reply to the author of this post prompted copilot to characterize the differences in a data set of statements concerning career ambitions, categorized by country. on Wed, 20 May 2026 21:02:25 GMT]]>@hannah 🙃

]]>https://forum.fedi.dk/post/https://friend.camp/users/aparrish/statuses/116608922156496944https://forum.fedi.dk/post/https://friend.camp/users/aparrish/statuses/116608922156496944Wed, 20 May 2026 21:02:25 GMT<![CDATA[Reply to the author of this post prompted copilot to characterize the differences in a data set of statements concerning career ambitions, categorized by country. on Wed, 20 May 2026 20:53:31 GMT]]>@aparrish someone was telling me they use this stuff to do all their data cleaning and analysis at work and i asked how they knew it was giving them the right answers and they seemed confused by the question

]]>https://forum.fedi.dk/post/https://posts.rat.pictures/users/hannah/statuses/116608887101706214https://forum.fedi.dk/post/https://posts.rat.pictures/users/hannah/statuses/116608887101706214Wed, 20 May 2026 20:53:31 GMT<![CDATA[Reply to the author of this post prompted copilot to characterize the differences in a data set of statements concerning career ambitions, categorized by country. on Wed, 20 May 2026 20:50:01 GMT]]>i used the same data set but replaced each country with a "gender identity" (man, woman, trans woman, trans man, non-binary) and prompted chatgpt to characterize the differences between the groups. lo and behold, i got some fantastic gender stereotype trash

]]>https://forum.fedi.dk/post/https://friend.camp/users/aparrish/statuses/116608873351202709https://forum.fedi.dk/post/https://friend.camp/users/aparrish/statuses/116608873351202709Wed, 20 May 2026 20:50:01 GMT