Realizing more and more how modern-day AI taps into some very old urges.
-
Maybe every time we met another group of humans or other hominins who thought differently about the world, negotiations with them were complicated.
@petealexharris @johncarlosbaez It does seem to fit right there at the dawn of “using language to coordinate with people other than those you share food with every day”.
-
Realizing more and more how modern-day AI taps into some very old urges.
So many would like "unsurpassed mastery without any effort", and would summon a demon to get it.
Having actual mastery (deep integrated understanding or skill) without effort would be great.
Delegated mastery is just another word for having helpers, or using a tool. You can buy mastery of others and tools, but you can't buy the judgment that comes from deep understanding.
That's why AI supercharges subject matter experts, but can cripple novices. It's a great junior assistant, but needs someone with judgement to boss it around.
-
Realizing more and more how modern-day AI taps into some very old urges.
So many would like "unsurpassed mastery without any effort", and would summon a demon to get it.
@johncarlosbaez Bring on the hellhounds.
-
Realizing more and more how modern-day AI taps into some very old urges.
So many would like "unsurpassed mastery without any effort", and would summon a demon to get it.
@johncarlosbaez It's a very elegant way to say “weakness and incompetence are the source of all evil”.
-
@petealexharris @johncarlosbaez I do find it really interesting that this idea of a uniquely capable yet maliciously compliant non-human entity is one of our ancient and universal cross cultural archetypes.
@marshray @petealexharris @johncarlosbaez
I think it's built into humanity.We are aware of malice because it is a common failure mode in cooperative endeavours, especially in childhood when people have not learned to manage strong emotions like jealousy.
Humans develop internal complex predictive models of not only their environment in general but of the behavior of other humans. We default to modeling others at our own level of competence.
Which makes modeling toddlers extra hard, because we desperately need to model them, but they are nowhere near our level of competence.
Both toddlers and robots often seem "maliciously compliant". They do *precisely* what you ask, especially when that's not what you intended.
Of course all humanity has maliciously compliant trickster legends. Anyone with children would love those stories.
-
Realizing more and more how modern-day AI taps into some very old urges.
So many would like "unsurpassed mastery without any effort", and would summon a demon to get it.
@johncarlosbaez Agree. AI is indeed the demon being summoned, but all it gives you in return, is unsurpassed crap.
-
Realizing more and more how modern-day AI taps into some very old urges.
So many would like "unsurpassed mastery without any effort", and would summon a demon to get it.
-
@Beggarmidas - everything is more complicated than what anyone says, but I really do sense a line of tradition running from medieval magic to many people's attraction to AI. I wrote about it earlier here:
https://mathstodon.xyz/@johncarlosbaez/116855445718992437
How are your fertile inspirations coming to life? With work you can create something solid, but I get one or two emails a day from people trying to invent new theories of physics with the help of AI... almost all of which are nonsense, because they don't know enough physics.
-
@Beggarmidas - everything is more complicated than what anyone says, but I really do sense a line of tradition running from medieval magic to many people's attraction to AI. I wrote about it earlier here:
https://mathstodon.xyz/@johncarlosbaez/116855445718992437
How are your fertile inspirations coming to life? With work you can create something solid, but I get one or two emails a day from people trying to invent new theories of physics with the help of AI... almost all of which are nonsense, because they don't know enough physics.
-
@aronowski - exactly right!
-
Realizing more and more how modern-day AI taps into some very old urges.
So many would like "unsurpassed mastery without any effort", and would summon a demon to get it.
@johncarlosbaez i love the snark!
-
Realizing more and more how modern-day AI taps into some very old urges.
So many would like "unsurpassed mastery without any effort", and would summon a demon to get it.
@johncarlosbaez they are so low effort that they will summon a demon and sacrifice humanity to it, just to get slightly-below-average mastery in the arts and sciences
-
B bogwitch@social.data.coop shared this topic
