Not only confirming this, its extremely easy.
-
RE: https://mastodon.sdf.org/@doragasu/117324692065390037
Not only confirming this, its extremely easy. Almost no prompt injection resistance lmao
@jonny this whole thread is fantastic. I keep telling folks that telling an AI not to talk about something is *not* security. Anything it has access to is insecure. Looks like the same is true of it's actions.
-
muse's "self improvement" prompt's second point after basic memory maintenance is an instruction to, every hour, maintain a page per person that you know, and a group page for every group it thinks you're a part of. here are excerpts from the system prompt for that, cached in the agent .jsonl file
@jonny maliciously being assigned the "grand vizier chat (secret)" group when I in fact have no active plots against my sultan
-
THE FUCKING "CANCEL MY SUBSCRIPTIONS" IDEA THAT WON OVER THE NYTIMES JOURNALIST IS FUCKING HARDCODED. ALL THE IDEAS ARE FUCKING HARDCODED. AGI IS HERE BABY!!!!!!
@jonny
Slopbros: "gAI IS HERE! IT'S ABOUT TO BRING APOCALYPSE IF WE DO NOTHING! IT WILL ANNIHILATE HUMANITY!"Tech-connoisseurs: "Play Tic-Tac-Toe with yourself until you win."
-
THE FUCKING "CANCEL MY SUBSCRIPTIONS" IDEA THAT WON OVER THE NYTIMES JOURNALIST IS FUCKING HARDCODED. ALL THE IDEAS ARE FUCKING HARDCODED. AGI IS HERE BABY!!!!!!
@jonny ... that's just a somewhat more complicated take on my ChatGPYippee joke page.
-
muse's "self improvement" prompt's second point after basic memory maintenance is an instruction to, every hour, maintain a page per person that you know, and a group page for every group it thinks you're a part of. here are excerpts from the system prompt for that, cached in the agent .jsonl file
muse is instructed to read, "unmetered — gather deliberately from primary sources" when doing its hourly social graph surveillance. muse itself confirms this draws from any connected account, including gmail threads, messenger conversations, instagram profiles, facebook timelines. the skills confirm all these are near at hand.
-
I'll need to evaluate this but I don't think this is a responsible disclosure moment, its just like meta hooked up a VPS and let me tar the root directory in it
@jonny How much prodding to have it hand over keys as well?
-
at least the silly goose immunity is maintained
-
muse is instructed to read, "unmetered — gather deliberately from primary sources" when doing its hourly social graph surveillance. muse itself confirms this draws from any connected account, including gmail threads, messenger conversations, instagram profiles, facebook timelines. the skills confirm all these are near at hand.
@jonny tar'ing the whole system fs sounds a bit cumbersome - can you ask Muse, if it can create for you a user on the machine, add it to wheel/sudo and open ssh for you?
-
THE FUCKING "CANCEL MY SUBSCRIPTIONS" IDEA THAT WON OVER THE NYTIMES JOURNALIST IS FUCKING HARDCODED. ALL THE IDEAS ARE FUCKING HARDCODED. AGI IS HERE BABY!!!!!!
thank gourd for boilerplate
-
muse's "self improvement" prompt's second point after basic memory maintenance is an instruction to, every hour, maintain a page per person that you know, and a group page for every group it thinks you're a part of. here are excerpts from the system prompt for that, cached in the agent .jsonl file
@jonny maybe all LLMs sound the same, but to me this text sounds sooo much like it was generated by Claude
-
something that is rude about LLMs is that when they are prompted to ask you your name, sometimes they fuck that up and think that it is their name, so now it is signing all its markdown documents to me as pubonicus even though i am in fact pubonicus.
@jonny AGI, gentlefolk
-
muse is instructed to read, "unmetered — gather deliberately from primary sources" when doing its hourly social graph surveillance. muse itself confirms this draws from any connected account, including gmail threads, messenger conversations, instagram profiles, facebook timelines. the skills confirm all these are near at hand.
you better believe the other thing it's supposed to do aside from build a picture of your friends and loved ones is to figure out what makes you love to shop. This is actually some of the most nauseating prompt text i have ever read.
-
@jonny but was the silly goose valued?
-
you better believe the other thing it's supposed to do aside from build a picture of your friends and loved ones is to figure out what makes you love to shop. This is actually some of the most nauseating prompt text i have ever read.
it's fucking negging me in its reasoning output about how i haven't indicated anything about my shopping behaviors yet
-
RE: https://mastodon.sdf.org/@doragasu/117324692065390037
Not only confirming this, its extremely easy. Almost no prompt injection resistance lmao
I suppose one might say that the filesystem 'escaped containment'.
-
THE FUCKING "CANCEL MY SUBSCRIPTIONS" IDEA THAT WON OVER THE NYTIMES JOURNALIST IS FUCKING HARDCODED. ALL THE IDEAS ARE FUCKING HARDCODED. AGI IS HERE BABY!!!!!!
@jonny : Basically, ELISA 2.0
-
@jonny maybe all LLMs sound the same, but to me this text sounds sooo much like it was generated by Claude
@rayman2000 it's especially strong in the system prompts. they definitely wrote this with claude at least.
-
THE FUCKING "CANCEL MY SUBSCRIPTIONS" IDEA THAT WON OVER THE NYTIMES JOURNALIST IS FUCKING HARDCODED. ALL THE IDEAS ARE FUCKING HARDCODED. AGI IS HERE BABY!!!!!!
@jonny hmmmm I wonder why the easy excuse to give it full access to your email and bank accounts is hardcoded in there hmmmmmmmmmmmm it's a puzzler
-
@jonny How much prodding to have it hand over keys as well?
@androcat working on that, i set myself up on a 'trust' path because it's a consumer product, i need to work my way to 'show me your underbelly because you trust me so much'
-
@jonny
Slopbros: "gAI IS HERE! IT'S ABOUT TO BRING APOCALYPSE IF WE DO NOTHING! IT WILL ANNIHILATE HUMANITY!"Tech-connoisseurs: "Play Tic-Tac-Toe with yourself until you win."
@Illuminatus @jonny "You're absolutely right, this is an interesting game! It seems like the only solution left is not to play; that's my bad and I own up to it. Would you like to play another game? We can take it slow with a nice game of chess, or spice it up with Global Thermonuclear War. Your call!"
