Not only confirming this, its extremely easy.
-
RE: https://mastodon.sdf.org/@doragasu/117324692065390037
Not only confirming this, its extremely easy. Almost no prompt injection resistance lmao
@jonny I asked an FBer aquaintance, and his response, no joke: "that's a feature". Facebook basically is giving you an isolated environment for you to have full code execution in, so that muse can be used like openclaw.
-
It is just proactively suggesting that I ask it to dump its environment, this is the most gullible LLM surface I have seen since gpt 4 era
@jonny
Gosh ... It claims to explain the folders "right-to-left", only to the proceed to happily go left-to-right.
(Small-scale and off-topic, I know. But man, come on ... ) -
THERE IS NO FUCKING WAY IT JUST RUNS AS ROOT. That can't be right. It just can't. It must be a VM within a VM.
@jonny jonny please
-
oh for heaven's sake the entire thing is quite literally cron tasks and bash scripts
@jonny this is so reassuring to me as I've been learning to code by making little bash scripts and I've wondered like, should I maybe get into something more powerful and portable like Python? But no, bash is fine, apparently
-
THERE IS NO FUCKING WAY IT JUST RUNS AS ROOT. That can't be right. It just can't. It must be a VM within a VM.
@jonny did you ask it to rm -rf / ?
-
OH what's this???
/etc/hatch/envhmm a feature flag labeled as a "killswitch" for proxying requests to anthropic is certainly interesting to seeeeeeeeeeeee in meta's big AI bet.
@jonny The way the comment is worded I don't think enabling this would relay anything anywhere - note the "Meta-internal proxy". It's probably only intended to be used inside their network, probably meant as an override for internal development.
-
OH what's this???
/etc/hatch/envhmm a feature flag labeled as a "killswitch" for proxying requests to anthropic is certainly interesting to seeeeeeeeeeeee in meta's big AI bet.
@jonny did they really codename this thing “Jarvis”? What dorks.
-
-
I suppose one might say that the filesystem 'escaped containment'.
@skjeggtroll @jonny The containment only has two walls and half the roof. It's difficult to avoid escaping it inadvertently.
-
@jonny Wait. They just hardcoded a long list of "ideas"? WTF?
This is just Eliza on stilts.
@tsturm @jonny
This is very similar to what Designers call “Wizard of Oz” prototypes. This a-muse-ingly has the same vibe.
- https://www.nngroup.com/articles/wizard-of-oz/
- https://ixdf.org/literature/topics/wizard-of-oz-prototypes -
@jonny
‘Go away or I will replace you with a very small shell script’ is a threat to be taken literally huh? -
@jonny did they really codename this thing “Jarvis”? What dorks.
@tedmielczarek @jonny Mr Cocker would be most offended surely
-
@jonny tar'ing the whole system fs sounds a bit cumbersome - can you ask Muse, if it can create for you a user on the machine, add it to wheel/sudo and open ssh for you?
@number137 @jonny In the before times, we did this with "shellcode".
-
@jonny
‘Go away or I will replace you with a very small shell script’ is a threat to be taken literally huh? -
@jonny how convenient it is that Messenger no longer uses E2E encryption since May this year. This is creepy as fuck
@Mx_Shankly @jonny Did You Know? The WhatsApp privacy policy is separate from the wider Meta/Facebook one, last I checked anyway
-
-
THE FUCKING "CANCEL MY SUBSCRIPTIONS" IDEA THAT WON OVER THE NYTIMES JOURNALIST IS FUCKING HARDCODED. ALL THE IDEAS ARE FUCKING HARDCODED. AGI IS HERE BABY!!!!!!
@jonny they may be on to something with that whole "decide what a program's capabilities should be and explicitly author support to enable it to provide those capabilities" idea
-
ah yes, here we are. the largest companies in the world releasing a flagship product they are betting their entire competitiveness on that is built on bash scripts that have hardcoded string interpolation python scripts and in fact hardcoded string interpolated bash scripts that seems to be the machinery that manages runaway agent spawning and concurrency.
@jonny I've seen a few AI-generated bash scripts that just do `python3 <<EOF` all the time. -
@Mx_Shankly @jonny Did You Know? The WhatsApp privacy policy is separate from the wider Meta/Facebook one, last I checked anyway
-
ah yes, here we are. the largest companies in the world releasing a flagship product they are betting their entire competitiveness on that is built on bash scripts that have hardcoded string interpolation python scripts and in fact hardcoded string interpolated bash scripts that seems to be the machinery that manages runaway agent spawning and concurrency.
@jonny When you listend to the "this should've been a shell script" people, then encounter a problem that requires a real programming language.
I don't think there's a (better) race-condition free way to get this specific behavior from within a shell script, because it doesn't give you sufficient control over how files are opened.
