I have been watching this story simmer for several days.
-
RE: https://infosec.exchange/@hacks4pancakes/116192434654015384
I have been watching this story simmer for several days. I've been wary of it. It fits too neatly into the criticisms and warnings many of us have been raising. But it's starting to look like, yes, they are using an LLM to make critical decisions.
At the same time I have heard parts of speeches from the US Secretary of War.* I have been dismayed by his shallow thinking. It doesn't help that his speeches also sound like they are also composed by an LLM.
*formerly Defense
As The Washington Post reports, the US military is extensively using Palantir’s Maven Smart System in the conflict, which has had Anthropic’s Claude chatbot integrated since 2024.
(https://futurism.com/artificial-intelligence/ban-anthropic-military-pentagon-relying-iran)
Okay. Military has been using data mining for a long time. And adding a chatbot to such a system "makes sense" if you think like the product manager of Murder Software Deluxe.
[Taking a very deep breath, imagine 15+ expletives about the general state of the world here.]
I automatically assumed that when "AI" is mentioned in posts and articles, that they just use the wrong word for data mining.
Why the [expletives] would you use a fancy text generator to select targets for airstrikes? That's even... I literally don't have words for this.
Except for words one isn't supposed to use in polite society.
-
My disgust for war, for the military, is not the result of being sheltered.
I hate your wars because I know exactly what they are and how when violence occurs it reverberates for generations.
Someone has lost a daughter and with her many of their reasons for living. What grim task will they devote themselves to?
What would you do, Pete, if they killed your family? Do you think you are the only person who loves their children?
I think you must.
@futurebird Alternately, Pete is incapable of the emotion we living mammals experience as "love", and assume that everyone else is an undead husk like himself.
-
My disgust for war, for the military, is not the result of being sheltered.
I hate your wars because I know exactly what they are and how when violence occurs it reverberates for generations.
Someone has lost a daughter and with her many of their reasons for living. What grim task will they devote themselves to?
What would you do, Pete, if they killed your family? Do you think you are the only person who loves their children?
I think you must.
@futurebird Personally, I doubt that the Trumpistas love any one other than themselves, everyone else is a tool for their use
-
Right wing war hawk commentators are saying that hitting a civilian target, a school filled with little girls is "good strategy, actually" we, the soft-handed peace-nicks are simply not smart enough to understand the strategic power of this action.
But, if the Department of war won't say it remains unclear if this atrocity is based on incompetence or dim-witted malice.
update: We can infer that they "missed"
https://shakedown.social/@AAronL1968/116193541496761440@futurebird which right wing commentators are saying that bombing an elementary school is a brilliant plan?
"bombing 8 year olds = smart" is a hot take that they should be remembered for.
-
The events feel unreal but the deaths are very real. This is not a video game. This is not a text adventure.
@futurebird “Not a video game.”
It seems that is how it’s being treated. They are using AI because they fired anyone who understood and was competent in the jobs they are occupying. And killing people has now become a game so they can pretend that they are important and that the US is still a world leader.
War is bad enough when run by experienced and knowledgeable people.
-
@futurebird If "we" can only win by being as terrible as "them", why should I feel any moral imperative that "we" should win?
@RogerBW @futurebird related: people cheering on the iranian military after they hit AWS data centers:
https://bsky.app/profile/richard.wickedproblems.earth/post/3mgf7hc3vcs2s/quoteslike, they're not only noticing that it is valid & legal to target enemy data centers during wartime; there's also tons of people writing words to the effect of "dear iran, please hit more of our data centers."
-
The events feel unreal but the deaths are very real. This is not a video game. This is not a text adventure.
@futurebird
IIRC, the CIA did something similar during the vietnam war.They were tracking movements of groups of people (because people who don't stay in place and especially go to places that were forcefully emptied are obviously viet cong).
Turns out, it was often elderly and children returning to where they formerly lived, for cultural reasons CIA analysts didn't care to learn about, like to honor their ancestors.
So the US send soldiers to execute old people and small children, because they were obviously viet cong.
-
Right wing war hawk commentators are saying that hitting a civilian target, a school filled with little girls is "good strategy, actually" we, the soft-handed peace-nicks are simply not smart enough to understand the strategic power of this action.
But, if the Department of war won't say it remains unclear if this atrocity is based on incompetence or dim-witted malice.
update: We can infer that they "missed"
https://shakedown.social/@AAronL1968/116193541496761440@futurebird "Strategic bombing" is exactly equivalent to "terrorist attack", except for the funding.
-
The impulse to use an LLM, and other shortcuts to make such decisions is indicative of a lack of serious interest in the details of the situation.
A level of study and interest that ought to be present for decisions that kill so many people.
I think that's why it matters.
-
Right wing war hawk commentators are saying that hitting a civilian target, a school filled with little girls is "good strategy, actually" we, the soft-handed peace-nicks are simply not smart enough to understand the strategic power of this action.
But, if the Department of war won't say it remains unclear if this atrocity is based on incompetence or dim-witted malice.
update: We can infer that they "missed"
https://shakedown.social/@AAronL1968/116193541496761440@futurebird I predict Whiskey Pete's demise will be swift and violent. You reap what you sow.
-
The impulse to use an LLM, and other shortcuts to make such decisions is indicative of a lack of serious interest in the details of the situation.
A level of study and interest that ought to be present for decisions that kill so many people.
I think that's why it matters.
But the problem with "serious study" of international politics is that when you learn more about a people, a culture you start to like them. You start to *become* like them.
Any tool that enables killing without such engagement is putting us on a fast track to atrocity.
Punch cards. Such a wonderful technology. (I collect punch cards, have always been fascinated by them). I can also never forget how they provided emotional distance for one of the greatest genocides.
-
@futurebird "Strategic bombing" is exactly equivalent to "terrorist attack", except for the funding.
@futurebird Also, even if we all pretend to switch off our living-animal brains and think like we're undead husks or alien ghouls for a while: We've known since WWII that terror bombing of civilians *doesn't even work*. When the Nazis firebombed England, English citizens started publicly demanding that the government *intensified* the war effort, and became more willing to put up with the miseries of the war economy.
Which makes sense, if we switch our living-animal brains back on: If some asshole just murdered your kids in their school, you're not usually going to demand your government sue for peace. You're going to do whatever you possibly can to see that asshole get treated to the worst Hell has to offer.
-
@gotofritz @futurebird the point is not whether the LLM selected a target that a human wouldn't have selected. The point is that an LLM was used for target selection. Even if the selection had been appropriate that would have been a game changer. The fact that it was inappropriate just highlights the problem, it's not *in itself* the problem, which is the manifestly reduced role of human decision making in lethal strikes.
-
But the problem with "serious study" of international politics is that when you learn more about a people, a culture you start to like them. You start to *become* like them.
Any tool that enables killing without such engagement is putting us on a fast track to atrocity.
Punch cards. Such a wonderful technology. (I collect punch cards, have always been fascinated by them). I can also never forget how they provided emotional distance for one of the greatest genocides.
Maybe if more people had to look at the city maps, if they had to read the local papers, and study the site there would have been more objections. Maybe you see a "street view" photo of the cross guard escorting the girls to class. Maybe you notice a paper sign in the window of a shop saying a new toy is in stock.
The target isn't just coordinates, it's a place where people live. People who don't care about international politics any more than the kids playing on your own block.
-
@RogerBW @futurebird related: people cheering on the iranian military after they hit AWS data centers:
https://bsky.app/profile/richard.wickedproblems.earth/post/3mgf7hc3vcs2s/quoteslike, they're not only noticing that it is valid & legal to target enemy data centers during wartime; there's also tons of people writing words to the effect of "dear iran, please hit more of our data centers."
@RogerBW @futurebird i used to think i was anti-war, but really, i was always just anti-aggressor.
When you live in the aggressor country, being anti-aggressor usually translates to political demands to stop fighting. This was true for the u.s.-initiated war in Vietnam; the u.s.-initiated war war in Iraq; the 2nd u.s.-initiated war in Iraq; etc.
But this time, i don't just want the fighting to stop; i also want the u.s. military to lose, because a "victory" would mean that evil has won.
-
How?
-
RE: https://infosec.exchange/@hacks4pancakes/116192434654015384
I have been watching this story simmer for several days. I've been wary of it. It fits too neatly into the criticisms and warnings many of us have been raising. But it's starting to look like, yes, they are using an LLM to make critical decisions.
At the same time I have heard parts of speeches from the US Secretary of War.* I have been dismayed by his shallow thinking. It doesn't help that his speeches also sound like they are also composed by an LLM.
*formerly Defense
@futurebird If AI was used then all the directors of the company (Anthropic?) should be tried for war crime.
-
@gotofritz @futurebird the point is not whether the LLM selected a target that a human wouldn't have selected. The point is that an LLM was used for target selection. Even if the selection had been appropriate that would have been a game changer. The fact that it was inappropriate just highlights the problem, it's not *in itself* the problem, which is the manifestly reduced role of human decision making in lethal strikes.
And what is the "benefit" of reducing the human friction in such decisions?
It's easier to kill 1000 people by pushing a button than it is to look in their eyes and do the deed with your own hands.
But the results are the same, and as a war crime the button pusher is just as guilty. (And the people who set up the button, knowing what it could enable are guilty too.)
-
@RogerBW @futurebird i used to think i was anti-war, but really, i was always just anti-aggressor.
When you live in the aggressor country, being anti-aggressor usually translates to political demands to stop fighting. This was true for the u.s.-initiated war in Vietnam; the u.s.-initiated war war in Iraq; the 2nd u.s.-initiated war in Iraq; etc.
But this time, i don't just want the fighting to stop; i also want the u.s. military to lose, because a "victory" would mean that evil has won.
@RogerBW @futurebird (to be clear, that's also what victory meant/would-have-meant for the previous mentioned wars; it's just that now i'm more aware of it.)
-
@futurebird If AI was used then all the directors of the company (Anthropic?) should be tried for war crime.
I was not kidding in this post. I will never forgive the people who did this.
|
https://sauropods.win/@futurebird/113866111349182003
