@malte It's the horoscope effect.

@malte LLMs do grammatical logic, which is what makes them so useless, since grammatical logic innately appears to be good while innately being flawed. It's a problem that philosophers struggled with and eventually decided wasn't solvable.

@dpnash @malte @jzakotnik @gerrymcgovern My recent encounter involved "AI Overview" repeatedly telling me that a Sailfish is a gamefish despite my repeated prompts intended to get the sail area of a boat. Not sure why it wouldn't have data for that, since the simple Google search brought it up once I waded through the garbage that I hadn't actually asked for .