I heard #Zerodium closed down tho…

Given the stochastic nature of this crap, we should assume that neither the absence of initial approval nor explicit instruction not to would actually prevent this.

It's not bound by any rules in the traditional sense.

don't we love these markdown-enforced rules folks? Approvals are apparently shared, so if you allow it at one point, the only thing preventing the model from using it again is being told not to!

this is inherent to the design of muse - in order to keep credentials off the VM, it has to provide these permissionless shims. there are other tool calls that are more carefully protected and only model tool calls can invoke, but all the connectors are skills, skills don't have those mechanisms, and everything is so sloppy and ad-hoc that there isn't anything reusable to re-use. whoopsie!

So all that shit about your credentials being in a secure vault does not matter because you just get free read access from within the VM anyway! This includes your Instagram DMs, slack messages, your emails, box and Dropbox files, google docs, google contacts, all your fucking apple health readings, your flightaware flight histories, notion pages, fucking quickbooks data (!!!), your Tesla car data, and so many more fun things!

What's fun is that some of the no confirmation needed actions are write actions too! You don't even need a clever exfil route, muse just gives it to you via your own connected accounts!

I wouldn't trust an LLM with diagnosis, with accurately summarizing a medical appointment, or with handling analysis or selection of interventions.

I wouldn't trust an LLM to accurately describe my environment, because it's incapable of knowing what things I need to be salient.

I would trust a specialist machine learning-based MRI feature detector designed and tuned for the specific test I am having done.

(And Meta glasses aren't just bad because they incorporate facial recognition, they're bad because the people who made them have no concept of consent and didn't design them with the affordances that would enable their helpful uses while discouraging or preventing their creepy uses.)