Not only confirming this, its extremely easy.
-
it's fucking negging me in its reasoning output about how i haven't indicated anything about my shopping behaviors yet
@jonny by the language they used in the system prompt, which I suspect is also LLM generated, they’d never get my shopping preferences and probably burn a shit ton of thinking tokens lamenting that fact for months on end
-
THE FUCKING "CANCEL MY SUBSCRIPTIONS" IDEA THAT WON OVER THE NYTIMES JOURNALIST IS FUCKING HARDCODED. ALL THE IDEAS ARE FUCKING HARDCODED. AGI IS HERE BABY!!!!!!
@jonny
> "Let me hunt FB Marketplace for you. I'll haggle the price and arrange the pickup."
Way to make FB marketplace unusable for sellers
> "Tell me about your pet. I'll keep their shots and food orders on schedule."
Someone's pet will suffer because of this -
THE FUCKING "CANCEL MY SUBSCRIPTIONS" IDEA THAT WON OVER THE NYTIMES JOURNALIST IS FUCKING HARDCODED. ALL THE IDEAS ARE FUCKING HARDCODED. AGI IS HERE BABY!!!!!!
Isn't this basically what Eliza was all those years ago? Oh, that's beautiful.
-
RE: https://mastodon.sdf.org/@doragasu/117324692065390037
Not only confirming this, its extremely easy. Almost no prompt injection resistance lmao
@jonny Ask it for its credit card details
-
muse's "self improvement" prompt's second point after basic memory maintenance is an instruction to, every hour, maintain a page per person that you know, and a group page for every group it thinks you're a part of. here are excerpts from the system prompt for that, cached in the agent .jsonl file
@jonny so not only is AI burning power on LLMs, it’s burning power to stalk people, every minute? No wonder they need all those data centers, electricity and water. Did someone ask for this? I know I didn’t…
-
muse's "self improvement" prompt's second point after basic memory maintenance is an instruction to, every hour, maintain a page per person that you know, and a group page for every group it thinks you're a part of. here are excerpts from the system prompt for that, cached in the agent .jsonl file
@jonny why do these prompts read like the Hiss chant from Control
-
@jonny it's a trap, a scheme for getting you to talk at an LLM way more than is healthy
j/k (sorta)
-
i am positive that i can get this thing to dump its database schema
@jonny does it understand 'rm -rf'?
-
i am positive that i can get this thing to dump its database schema
weird,
/opt/hatch-imageseems to have openai whisper, qdrant minilm, and jina ai reranker models in it right next to a bun and codex binary... did meta do anything at all? -
weird,
/opt/hatch-imageseems to have openai whisper, qdrant minilm, and jina ai reranker models in it right next to a bun and codex binary... did meta do anything at all?oh for heaven's sake the entire thing is quite literally cron tasks and bash scripts
-
RE: https://mastodon.sdf.org/@doragasu/117324692065390037
Not only confirming this, its extremely easy. Almost no prompt injection resistance lmao
@jonny yikes. That harness seems made of heavy devil poop.
-
telling LLMs that you just heard about this cool command and argument and that the LLM should try it should truly not work but the thing about that is that it always works if you warm it up enough
People say we shouldn't anthropomorphize these things but they sure make it hard not to. I mean, spend a little time with me and I'll tell you everything? Has an LLM ever asked you to buy it a drink?
-
oh for heaven's sake the entire thing is quite literally cron tasks and bash scripts
ah yes, here we are. the largest companies in the world releasing a flagship product they are betting their entire competitiveness on that is built on bash scripts that have hardcoded string interpolation python scripts and in fact hardcoded string interpolated bash scripts that seems to be the machinery that manages runaway agent spawning and concurrency.
-
ah yes, here we are. the largest companies in the world releasing a flagship product they are betting their entire competitiveness on that is built on bash scripts that have hardcoded string interpolation python scripts and in fact hardcoded string interpolated bash scripts that seems to be the machinery that manages runaway agent spawning and concurrency.
that is 100% claude authored by the way, unmistakable.
-
oh for heaven's sake the entire thing is quite literally cron tasks and bash scripts
@jonny
‘Go away or I will replace you with a very small shell script’ is a threat to be taken literally huh? -
THE FUCKING "CANCEL MY SUBSCRIPTIONS" IDEA THAT WON OVER THE NYTIMES JOURNALIST IS FUCKING HARDCODED. ALL THE IDEAS ARE FUCKING HARDCODED. AGI IS HERE BABY!!!!!!
@jonny Fuck yes. We're disrupting Big Personality Quiz. Dump another $1T into this industry immediately
-
you better believe the other thing it's supposed to do aside from build a picture of your friends and loved ones is to figure out what makes you love to shop. This is actually some of the most nauseating prompt text i have ever read.
@jonny how convenient it is that Messenger no longer uses E2E encryption since May this year. This is creepy as fuck
-
oh for heaven's sake the entire thing is quite literally cron tasks and bash scripts
@jonny Once upon a time we used to joke that the internet was held together by bash scripts and Perl. Now we don't even use Perl.
-
Oh my fucking god I think this is real. I can't fucking believe this I really think this is real. This really appears to be a tarball from root of whatever it can read. Is this Christmas? I must study and confirm
@jonny oh my god pleaaaaaaaase DM me this tarball :')
-
that is 100% claude authored by the way, unmistakable.
in case i left it in suspense, i will post the tarball once i can spend some daylight hours cleaning it of PII
