The power of ChatGPT
-
@GossiTheDog Cannot confirm. ChatGPT Thinking-Standard.
@jafo @GossiTheDog even then, a reliable source of information should be consistent, meaning both Kevin and you should have gotten the same result, but we all know LLMs aren't consistent (even when the same user asks the same question) so if anything, you added more evidence proving we should avoid LLMs
️ -
The power of ChatGPT
@GossiTheDog the right answer is probably Kenny Everett
-
The power of ChatGPT
@GossiTheDog imagine how much fossil fuel was used to generate that sophisticated answer. Any such energy calculation must include all resources required to build the data sets that are
required for the system to perform the operation. -
The power of ChatGPT
@GossiTheDog decided to experiment with AI by asking which philosopher was run over by a milk float and it did a similar thing.
If you know who it actually was, that would be much appreciated!
-
@jafo @GossiTheDog even then, a reliable source of information should be consistent, meaning both Kevin and you should have gotten the same result, but we all know LLMs aren't consistent (even when the same user asks the same question) so if anything, you added more evidence proving we should avoid LLMs
️@loucyx @jafo @GossiTheDog it's also not even correct, so what you've managed to get there is a different wrong answer.
If you think 'confidentaly incorrect' is an improvement over 'obvious gibberish', then yeah, I suppose this is preferable, but it doesn't get you any closer to the truth.
(personally I think 'obviously wrong' is preferable, because then at least you know to ignore it.)
-
The image appears to be a screenshot of Ai answer which is wrong in every sense, and when asked who was the first openly gay radio presenter on a specific national radio station was provides answers that are incorrect in multiple dimensions.
The answer to the question was Kenny Everett, but it doesn’t seem to know that.
@tempusfelix @alice @GossiTheDog Though Kenny was openly gay by the late Eighties and was certainly one of the first Radio 1 presenters in the Sixties. I don't think he was openly gay at the same time that he was presenting at Radio 1
-
The power of ChatGPT
@GossiTheDog no homo gay is still gay in the digital cat fart world lol
-
@loucyx @jafo @GossiTheDog it's also not even correct, so what you've managed to get there is a different wrong answer.
If you think 'confidentaly incorrect' is an improvement over 'obvious gibberish', then yeah, I suppose this is preferable, but it doesn't get you any closer to the truth.
(personally I think 'obviously wrong' is preferable, because then at least you know to ignore it.)
@benjamineskola @loucyx @GossiTheDog What do you consider a correct answer? According to the respective Wikipedia entries for them, the answer I got seems to be correct. The answer ChatGPT gave me linked to citations which also seemed to back up the answer. https://www.theguardian.com/tv-and-radio/2022/aug/25/farewell-scott-mills-bbc-radio-1?utm_source=chatgpt.com https://en.wikipedia.org/wiki/Kevin_Greening?utm_source=chatgpt.com https://en.wikipedia.org/wiki/Scott_Mills?utm_source=chatgpt.com
-
@benjamineskola @loucyx @GossiTheDog What do you consider a correct answer? According to the respective Wikipedia entries for them, the answer I got seems to be correct. The answer ChatGPT gave me linked to citations which also seemed to back up the answer. https://www.theguardian.com/tv-and-radio/2022/aug/25/farewell-scott-mills-bbc-radio-1?utm_source=chatgpt.com https://en.wikipedia.org/wiki/Kevin_Greening?utm_source=chatgpt.com https://en.wikipedia.org/wiki/Scott_Mills?utm_source=chatgpt.com
@jafo @loucyx @GossiTheDog Elsewhere in this thread, Kenny Everett was claimed to be the first — but the timeline might be wrong for that, depending when he actually came out.
-
@jafo @GossiTheDog even then, a reliable source of information should be consistent, meaning both Kevin and you should have gotten the same result, but we all know LLMs aren't consistent (even when the same user asks the same question) so if anything, you added more evidence proving we should avoid LLMs
️@loucyx @GossiTheDog I don't know about you, but I've long ago learned to not just blindly trust tools I use, on the Internet and elsewhere. I use tools understanding the limitations, and check the work. In this case, it seemed like outside sources corroborated the assertions ChatGPT made. I can't speak to Kevin's answer, because no information on WHAT ChatGPT was given; as I said, I used "Thinking-Standard" to get my answer, YMMV if you use other models.
-
@loucyx @GossiTheDog I don't know about you, but I've long ago learned to not just blindly trust tools I use, on the Internet and elsewhere. I use tools understanding the limitations, and check the work. In this case, it seemed like outside sources corroborated the assertions ChatGPT made. I can't speak to Kevin's answer, because no information on WHAT ChatGPT was given; as I said, I used "Thinking-Standard" to get my answer, YMMV if you use other models.
@jafo @loucyx @GossiTheDog but your mileage should not vary. that's the point.
getting a different answer each time is what makes these tools not fit for purpose. if they return the right answer some of the time but you never know which times, what's the point in them?
-
@jafo @loucyx @GossiTheDog but your mileage should not vary. that's the point.
getting a different answer each time is what makes these tools not fit for purpose. if they return the right answer some of the time but you never know which times, what's the point in them?
@benjamineskola @jafo @GossiTheDog 100% this! If they were always right or always wrong it would be one thing, but the only constant is that they are always confident about their answer (either if it’s right or wrong) which is what makes them dangerously unreliable.
And this isn’t even getting into the whole detrimental effect they have on cognitive analysis and reasoning for LLM consumers.
-
@benjamineskola @jafo @GossiTheDog 100% this! If they were always right or always wrong it would be one thing, but the only constant is that they are always confident about their answer (either if it’s right or wrong) which is what makes them dangerously unreliable.
And this isn’t even getting into the whole detrimental effect they have on cognitive analysis and reasoning for LLM consumers.
@benjamineskola @GossiTheDog @loucyx @jafo It’s the difference between lying and bullshitting. Lying at least has a regard for what is true. Bullshitting doesn’t care if it is correct or not.
-
The image appears to be a screenshot of Ai answer which is wrong in every sense, and when asked who was the first openly gay radio presenter on a specific national radio station was provides answers that are incorrect in multiple dimensions.
The answer to the question was Kenny Everett, but it doesn’t seem to know that.
@tempusfelix @alice @GossiTheDog
Fwiw describing that image as "chatgpt being wrong" is like describing this one as "a funny tweet". Technically correct but not actually very helpful to a visually impaired person trying to understand the joke. -
@GossiTheDog Cannot confirm. ChatGPT Thinking-Standard.
@GossiTheDog If we assume this is the answer that LLMs are able to give, does this change the argument we are having? As far as I can tell from other sources I've reviewed, this answer seems to be reasonable.
-
The power of ChatGPT
@GossiTheDog this is hilarious and if it had alt text I’d boost it.
-
The power of ChatGPT
@GossiTheDog This is what techbros are uplifting as that which will replace human workers...They are a fucking joke.
They will never get humans out of the workplace with a bullshitting bundle of stolen data and weighted tokens.
-
P pelle@veganism.social shared this topic
