Free software people: A major goal of free software is for individuals to be able to cause software to behave in the way they want it toLLMs: (enable that)Free software people: Oh no not like that
-
Clearly my most unpopular thread ever, so let me add a clarification: submitting LLM generated code you don't understand to an upstream project is absolute bullshit and you should never do that. Having an LLM turn an existing codebase into something that meets your local needs? Do it. The code may be awful, it may break stuff you don't care about, and that's what all my early patches to free software looked like. It's ok to solve your problem locally.
@mjg59 you might be missing a few of people's issues with LLMs. Our programmer standpoint is quite niche.
What happens to people with jobs that are affected by LLMs? They either start using LLMs to match the competition's performance, or get obsoleted... What if they can't actually afford using LLMs to stay competitive?...
And then there's art.
On top of all of that LLMs are energy and resource-hungry, ruining the environment and making everything more expensive...
-
Not even close. Humans build mental models of things and, if correct in one area, are likely to be correct in adjacent ones. And, in most cases, are able to say ‘I don’t know” when they don’t know the answer. Books (at least, those from reputable publishers) are reviewed by technical reviewers who spot factual errors, and have finite contents and so will simply not contain an answer if it is not something the author thought to write.
LLMs will interpolate over an n-dimensional latent space to provide a convincing answer. That answer may, if those bits of the latent space were well populated by things in the training set, be correct. But there is no difference from an LLM’s perspective between a correct and incorrect answer, only a likely and unlikely one.
@david_chisnall @mjg59 @ignaloidas I have encountered plenty of people and books that were wrong, so I still have to engage my brain and double check, though.
-
When I write code I am turning a creative idea into a mechanical embodiment of that idea. I am not creating beauty. Every line of code I write is a copy of another line of code I've read somewhere before, lightly modified to meet my needs. My code is not intended to evoke emotion. It does not change people think about the world. The idea→code pipeline in my head is not obviously distinguishable from the prompt->code process in an LLM
@mjg59 Funny one, but you forgot the most important of code. It's a tool for human understanding. Statistics can *probably* find some common pattern, but it have nothing to do with "understanding".
-
@mjg59 Yeah, as soon as there‘s an ethically sourced and trained free LLM that‘s not controlled by very shitty companies I‘m totally on board with you.
Until then we shouldn’t let that shit near our projects.
-
Free software people: A major goal of free software is for individuals to be able to cause software to behave in the way they want it to
LLMs: (enable that)
Free software people: Oh no not like that@mjg59
I can't help but feel this leads to short-term decision making.
On the one hand I get it, people have shit to do and don't want to fight with upstream projects to get their needs met. Software dev culture can be a warzone.
On the other, I see this as creating a bunch of fragile siloed work, everyone solving their own immediate needs in the short term rather than working together to build a more robust long-term solution for most needs. No assumptions challenged in their approach or potential improvements to their workflow, just a "yes boss" and something that may work in the now.
It feels like the seeds of an increasingly insular world, "got mine jack" culture. -
When I write code I am turning a creative idea into a mechanical embodiment of that idea. I am not creating beauty. Every line of code I write is a copy of another line of code I've read somewhere before, lightly modified to meet my needs. My code is not intended to evoke emotion. It does not change people think about the world. The idea→code pipeline in my head is not obviously distinguishable from the prompt->code process in an LLM
@mjg59 I somewhat agree, but I would like to extend this idea even further: current copyright laws cover software. copyright was meant to protect creative pursuits, which code (as you put it) is not. Many other technical fields don't have a copyright either. Let's abolish the software copyrights that so much of big tech profits from.
Until then, I think it's fair for people to want to avoid having their code be copied without attribution.
-
@mjg59 @barnoid Yeah I think many of us need the back and forth with the compiler to fully flesh out an idea - it's certainly something that I've heard other people say as well.
And not just coding. Even emails or just plain old speech. Explaining an idea to someone else often results in me realising it wasn't fully formed after all, and the process of communicating it to someone else forces me to make it better. -
This post did not contain any content.
@mjg59 That's an unrealistic example. My piano playing is MUCH worse than the code I used to write.
-
@dngrs sure! Define smaller blocks, examine them, modify if the output isn't what you need
@mjg59 "sure" as in you're agreeing or disagreeing with me?
-
@promovicz
That completely oversimplifies what's being discussed here. Every math book you ever studied is copyright, that does not mean you cannot use what you learned to solve math problems. -
-
@Nfoonf Back in the day I had software that didn't do what I wanted, and I didn't know C yet. I patched stuff in many awful ways that met my needs and which taught me nothing in the moment and could never be upstreamed. How would having a machine help me achieve that make free software worse?
@mjg59 but you are paying the owner of the machine a recurring rent, aren't you? does this not bother you? what this machine does for you will never be yours, you will pay them again and again. you do not own the tools of your trade anymore. If the rent seeking owner denies you access or you can not afford it anymore this is all gone.
-
@bluca (The original version of this is pretty anti-semitic and the author is a fucking nazi)
@mjg59 yeah sorry I had no idea, already deleted earlier as someone else told me
-
-
@mjg59 you might be missing a few of people's issues with LLMs. Our programmer standpoint is quite niche.
What happens to people with jobs that are affected by LLMs? They either start using LLMs to match the competition's performance, or get obsoleted... What if they can't actually afford using LLMs to stay competitive?...
And then there's art.
On top of all of that LLMs are energy and resource-hungry, ruining the environment and making everything more expensive...
@mjg59 but wait, there's more
What if you're not renowned security expert and open-source celebrity @mjg59 (that currently works at nvidia btw, profiting from the LLM boom, sorry) but just some guy trying to make ends meet doing some coding?...
Now you get an LLM mandate from your company that comes with the implication that 'either you boost your productivity with 80% or we fire you and contract a cheap prompter in your place'...
-
@promovicz I think a set of instructions to a machine should not be copyrightable and the rest flows from there.
@mjg59 Since you don't want to talk about the human/social side, you can only miss it.
-
@troed @chris_evelyn @mjg59 last time I checked, Mistral models were merely open weight, with no training dataset available nor training pipeline released as FOSS. Has that changed?
-
@mjg59 but you are paying the owner of the machine a recurring rent, aren't you? does this not bother you? what this machine does for you will never be yours, you will pay them again and again. you do not own the tools of your trade anymore. If the rent seeking owner denies you access or you can not afford it anymore this is all gone.
@mjg59 before all this computer stuff I learned a manual craft, I still own the skills, I can use them when I need them, no one has to be paid. I can gift these skills to people, that need but can not afford them otherwise. Is this not, what all is about?
-
Free software people: A major goal of free software is for individuals to be able to cause software to behave in the way they want it to
LLMs: (enable that)
Free software people: Oh no not like that@mjg59 heh, poked the bear with this one.
unfortunately most computer users are also not set up in a way where a subtle piece of malware injected into a python script or something could ruin their day.
tao uses them for generating proofs, which seems to work, and I have had some use to similar ends. they're quite bad if you have any delay in your feedback loop though
-
@david_chisnall @mjg59 @ignaloidas I have encountered plenty of people and books that were wrong, so I still have to engage my brain and double check, though.
@mnl @david_chisnall @mjg59 @ignaloidas
Yes, but that is also not the argument.
If you read a book to extract information, you already have a mental model of the failure modes (or can build one, like students do)
- Is the author known to be proficient in the space
- Is the publisher reputable
- Is the book 'new'Depending on the answers to those questions, you either take the content as absolutely correct, likely correct, plausible, or problematic. You can know those things before
1/2
