Skip to content
  • Hjem
  • Seneste
  • Etiketter
  • Populære
  • Verden
  • Bruger
  • Grupper
Temaer
  • Light
  • Brite
  • Cerulean
  • Cosmo
  • Flatly
  • Journal
  • Litera
  • Lumen
  • Lux
  • Materia
  • Minty
  • Morph
  • Pulse
  • Sandstone
  • Simplex
  • Sketchy
  • Spacelab
  • United
  • Yeti
  • Zephyr
  • Dark
  • Cyborg
  • Darkly
  • Quartz
  • Slate
  • Solar
  • Superhero
  • Vapor

  • Default (No Skin)
  • No Skin
Kollaps
FARVEL BIG TECH
  1. Forside
  2. Ikke-kategoriseret
  3. I keep seeing lots of people saying "LLMs are like compilers/assemblers for prompts"

I keep seeing lots of people saying "LLMs are like compilers/assemblers for prompts"

Planlagt Fastgjort Låst Flyttet Ikke-kategoriseret
59 Indlæg 46 Posters 0 Visninger
  • Ældste til nyeste
  • Nyeste til ældste
  • Most Votes
Svar
  • Svar som emne
Login for at svare
Denne tråd er blevet slettet. Kun brugere med emne behandlings privilegier kan se den.
  • mcc@mastodon.socialM mcc@mastodon.social

    @mntmn @cwebber I think the single interesting thing LLMs have revealed is that there is a substantial market segment who has an active desire for natural language interfaces to the computer and who will flip from "do not engage to the computer" to "engage with the computer" if a natural language interface became available.

    I do not personally want a natural language interface to the computer. I also do not believe the thing LLM vendors have built is a natural language interface to the computer

    dhobern@scicomm.xyzD This user is from outside of this forum
    dhobern@scicomm.xyzD This user is from outside of this forum
    dhobern@scicomm.xyz
    wrote sidst redigeret af
    #16

    @mcc @mntmn @cwebber

    I think there's a broader corollary (or perhaps it's actually a central subset of what you describe).

    I always thought most people shared my experience that the exciting thing about the Internet, and good Internet search in particular, was that it offered access to the most relevant sources of information for any query. It was then on me to assess these sources and try to understand the topic at hand.

    LLMs have resoundingly demonstrated that for most people this is all too much work and reminds them of school.

    A majority of people clearly don't want to have to put in so much effort. They'd rather have an unambiguous answer that comes back and that they can treat as authoritative.

    Sidenote - this is why mansplaining is a thing.

    So, the primary (and I would argue, intended) result of the current "AI" mania is that the world is happily replumbing all its information and knowledge streams so that everyone receives whatever sanctioned propaganda those behind the curtain want to shovel out. (Pick a metaphor and stick with it ...)

    LLMs are an assault on human communication and our ability to reason, organise and plan. They are the oligarch's wet dream.

    1 Reply Last reply
    0
    • cwebber@social.coopC cwebber@social.coop

      I keep seeing lots of people saying "LLMs are like compilers/assemblers for prompts"

      Noooooooooo
      Noooooooooooooooooooooooooooo

      LLMs are not compilers, and they're not assemblers. Determinism is a key aspect to assemblers and compilers.

      And they *certainly* can't be part of a reproducible pipeline

      joeyh@sunbeam.cityJ This user is from outside of this forum
      joeyh@sunbeam.cityJ This user is from outside of this forum
      joeyh@sunbeam.city
      wrote sidst redigeret af
      #17

      @cwebber of course a deterministic LLM could be made. But ~noone would use it. Being able to reroll the dice is an important part of the confidence game.

      cwebber@social.coopC 1 Reply Last reply
      0
      • cwebber@social.coopC cwebber@social.coop

        I keep seeing lots of people saying "LLMs are like compilers/assemblers for prompts"

        Noooooooooo
        Noooooooooooooooooooooooooooo

        LLMs are not compilers, and they're not assemblers. Determinism is a key aspect to assemblers and compilers.

        And they *certainly* can't be part of a reproducible pipeline

        rosie@0x4d4f5448.systemsR This user is from outside of this forum
        rosie@0x4d4f5448.systemsR This user is from outside of this forum
        rosie@0x4d4f5448.systems
        wrote sidst redigeret af
        #18
        We love it when changes have non-localized and unpredictable results;
        1 Reply Last reply
        0
        • cstanhope@social.coopC cstanhope@social.coop

          @drwho @mcc @mntmn @cwebber

          I once heard a joke that went something like:

          Q: What's the highest level language you can program in?

          A: Grad student.

          (I only mention the joke because the underlying truth of it seems to be exposed in many ways, including the current LLM mess we're in.)

          drwho@masto.hackers.townD This user is from outside of this forum
          drwho@masto.hackers.townD This user is from outside of this forum
          drwho@masto.hackers.town
          wrote sidst redigeret af
          #19

          @cstanhope @mcc @mntmn @cwebber I like it.

          ryanc@infosec.exchangeR 1 Reply Last reply
          0
          • ireneista@adhd.irenes.spaceI ireneista@adhd.irenes.space

            @mcc @mntmn @cwebber we aren't quite sure where to start in telling this story, so maybe we won't get into detail, but we were shocked to realize that megacorps have no ambitions for voice assistants beyond turning light bulbs on and off. no desire to build a general-purpose UI at all.

            mcc@mastodon.socialM This user is from outside of this forum
            mcc@mastodon.socialM This user is from outside of this forum
            mcc@mastodon.social
            wrote sidst redigeret af
            #20

            @ireneista @mntmn @cwebber well it's a general purpose UI *now* but only in a very monkeys paw way

            1 Reply Last reply
            0
            • joeyh@sunbeam.cityJ joeyh@sunbeam.city

              @cwebber of course a deterministic LLM could be made. But ~noone would use it. Being able to reroll the dice is an important part of the confidence game.

              cwebber@social.coopC This user is from outside of this forum
              cwebber@social.coopC This user is from outside of this forum
              cwebber@social.coop
              wrote sidst redigeret af
              #21

              @joeyh I mean real talk that's why I don't play preset seeds in roguelikes, hooked on that RNG juice

              alina@girldick.gayA eviloatmeal@ak.angelstrapped.comE 2 Replies Last reply
              0
              • mcc@mastodon.socialM mcc@mastodon.social

                @mntmn @cwebber I think the single interesting thing LLMs have revealed is that there is a substantial market segment who has an active desire for natural language interfaces to the computer and who will flip from "do not engage to the computer" to "engage with the computer" if a natural language interface became available.

                I do not personally want a natural language interface to the computer. I also do not believe the thing LLM vendors have built is a natural language interface to the computer

                dryak@mstdn.scienceD This user is from outside of this forum
                dryak@mstdn.scienceD This user is from outside of this forum
                dryak@mstdn.science
                wrote sidst redigeret af
                #22

                @mcc @mntmn @cwebber speaking of expanding to more users and of assembler:

                An argument I've heard is that: in the past high level compiled languages have replaced assembler, and LLMs are the next step.

                Well, assembler -- and assembler-adjacent stuff like C's SIMD intrinsics -- are still relied upon (think finely optimised low-lvl libraries in some fields like gaming, video codecs, and number crunching in scientific data analysis).
                ...

                dryak@mstdn.scienceD 1 Reply Last reply
                0
                • dryak@mstdn.scienceD dryak@mstdn.science

                  @mcc @mntmn @cwebber speaking of expanding to more users and of assembler:

                  An argument I've heard is that: in the past high level compiled languages have replaced assembler, and LLMs are the next step.

                  Well, assembler -- and assembler-adjacent stuff like C's SIMD intrinsics -- are still relied upon (think finely optimised low-lvl libraries in some fields like gaming, video codecs, and number crunching in scientific data analysis).
                  ...

                  dryak@mstdn.scienceD This user is from outside of this forum
                  dryak@mstdn.scienceD This user is from outside of this forum
                  dryak@mstdn.science
                  wrote sidst redigeret af
                  #23

                  @mcc @mntmn @cwebber ...
                  It's not gone. I suspect there might be even more people with the know how than back in the days.
                  It's just that thier numbers haven't grown as fast as, e.g., the number of people who nowadays know only Python or other high-lvl languages, and would never dare to learn anything lower-lvl and would be abandonning computing back in the days.
                  ...

                  dryak@mstdn.scienceD 1 Reply Last reply
                  0
                  • dryak@mstdn.scienceD dryak@mstdn.science

                    @mcc @mntmn @cwebber ...
                    It's not gone. I suspect there might be even more people with the know how than back in the days.
                    It's just that thier numbers haven't grown as fast as, e.g., the number of people who nowadays know only Python or other high-lvl languages, and would never dare to learn anything lower-lvl and would be abandonning computing back in the days.
                    ...

                    dryak@mstdn.scienceD This user is from outside of this forum
                    dryak@mstdn.scienceD This user is from outside of this forum
                    dryak@mstdn.science
                    wrote sidst redigeret af
                    #24

                    @mcc @mntmn @cwebber ...
                    Proper software engineering done by human with brains that can hold an actual mental model of the design implication isn't going away.

                    At best, what we have is a (very unreliable) tool that will allow people who are utterly allergic to programming languages to still be able to play around code.

                    1 Reply Last reply
                    0
                    • cwebber@social.coopC cwebber@social.coop

                      I keep seeing lots of people saying "LLMs are like compilers/assemblers for prompts"

                      Noooooooooo
                      Noooooooooooooooooooooooooooo

                      LLMs are not compilers, and they're not assemblers. Determinism is a key aspect to assemblers and compilers.

                      And they *certainly* can't be part of a reproducible pipeline

                      smn@l3ib.orgS This user is from outside of this forum
                      smn@l3ib.orgS This user is from outside of this forum
                      smn@l3ib.org
                      wrote sidst redigeret af
                      #25

                      @cwebber they're lossy pseudorandom decompression

                      1 Reply Last reply
                      0
                      • cstanhope@social.coopC cstanhope@social.coop

                        @drwho @mcc @mntmn @cwebber

                        I once heard a joke that went something like:

                        Q: What's the highest level language you can program in?

                        A: Grad student.

                        (I only mention the joke because the underlying truth of it seems to be exposed in many ways, including the current LLM mess we're in.)

                        O This user is from outside of this forum
                        O This user is from outside of this forum
                        octorine@fosstodon.org
                        wrote sidst redigeret af
                        #26

                        @cstanhope @drwho @mcc @mntmn @cwebber And to bring it full circle, grad students *can* be compilers.

                        1 Reply Last reply
                        0
                        • mntmn@mastodon.socialM mntmn@mastodon.social

                          @cwebber exactly this. on the flip side, there seemed to be a vast desire among management types and maybe hobbyists for some super easy super high level language. but idk if it's even worth going there. avoiding the details only works until it doesn't

                          O This user is from outside of this forum
                          O This user is from outside of this forum
                          octorine@fosstodon.org
                          wrote sidst redigeret af
                          #27

                          @mntmn @cwebber My company is 100% invested in ai. It's all management talks about. Before LLMs, we were all in on no-code or low code languages, web robots and such.

                          It's basically the same fantasy as before, but this time the whole world is along for the ride.

                          1 Reply Last reply
                          0
                          • cwebber@social.coopC cwebber@social.coop

                            @joeyh I mean real talk that's why I don't play preset seeds in roguelikes, hooked on that RNG juice

                            alina@girldick.gayA This user is from outside of this forum
                            alina@girldick.gayA This user is from outside of this forum
                            alina@girldick.gay
                            wrote sidst redigeret af
                            #28

                            @cwebber @joeyh the binding of isaac, enter the gungeon and dead cells are worse than a slot machine for my adhd brain

                            1 Reply Last reply
                            0
                            • cwebber@social.coopC cwebber@social.coop

                              I keep seeing lots of people saying "LLMs are like compilers/assemblers for prompts"

                              Noooooooooo
                              Noooooooooooooooooooooooooooo

                              LLMs are not compilers, and they're not assemblers. Determinism is a key aspect to assemblers and compilers.

                              And they *certainly* can't be part of a reproducible pipeline

                              mirabilos@toot.mirbsd.orgM This user is from outside of this forum
                              mirabilos@toot.mirbsd.orgM This user is from outside of this forum
                              mirabilos@toot.mirbsd.org
                              wrote sidst redigeret af
                              #29

                              @cwebber oh, they could… if you operated them yourself. Snapshotting, and saving the PRNG seed.

                              1 Reply Last reply
                              0
                              • cwebber@social.coopC cwebber@social.coop

                                I keep seeing lots of people saying "LLMs are like compilers/assemblers for prompts"

                                Noooooooooo
                                Noooooooooooooooooooooooooooo

                                LLMs are not compilers, and they're not assemblers. Determinism is a key aspect to assemblers and compilers.

                                And they *certainly* can't be part of a reproducible pipeline

                                rdviii@famichiki.jpR This user is from outside of this forum
                                rdviii@famichiki.jpR This user is from outside of this forum
                                rdviii@famichiki.jp
                                wrote sidst redigeret af
                                #30

                                @cwebber mostly agree, especially about them not being compilers, but some compilers aren't deterministic. You'll get a different result in memory layout or optimization sometimes. Especially for quantum compilers, where the compilation process itself is known to be NP hard, so heuristics are used.

                                yaleman@mastodon.socialY 1 Reply Last reply
                                0
                                • eramdam@social.erambert.meE eramdam@social.erambert.me

                                  @cwebber If I hear "LLMs are like higher level languages" one more time I will end up on the news, i think

                                  kkarhan@infosec.spaceK This user is from outside of this forum
                                  kkarhan@infosec.spaceK This user is from outside of this forum
                                  kkarhan@infosec.space
                                  wrote sidst redigeret af
                                  #31

                                  @eramdam @cwebber +1

                                  1 Reply Last reply
                                  0
                                  • cwebber@social.coopC cwebber@social.coop

                                    I keep seeing lots of people saying "LLMs are like compilers/assemblers for prompts"

                                    Noooooooooo
                                    Noooooooooooooooooooooooooooo

                                    LLMs are not compilers, and they're not assemblers. Determinism is a key aspect to assemblers and compilers.

                                    And they *certainly* can't be part of a reproducible pipeline

                                    nobody@mastodon.acm.orgN This user is from outside of this forum
                                    nobody@mastodon.acm.orgN This user is from outside of this forum
                                    nobody@mastodon.acm.org
                                    wrote sidst redigeret af
                                    #32

                                    @cwebber
                                    PGO go brrrrr

                                    1 Reply Last reply
                                    0
                                    • cwebber@social.coopC cwebber@social.coop

                                      I keep seeing lots of people saying "LLMs are like compilers/assemblers for prompts"

                                      Noooooooooo
                                      Noooooooooooooooooooooooooooo

                                      LLMs are not compilers, and they're not assemblers. Determinism is a key aspect to assemblers and compilers.

                                      And they *certainly* can't be part of a reproducible pipeline

                                      baloouriza@social.tulsa.ok.usB This user is from outside of this forum
                                      baloouriza@social.tulsa.ok.usB This user is from outside of this forum
                                      baloouriza@social.tulsa.ok.us
                                      wrote sidst redigeret af
                                      #33

                                      @cwebber This is more like the Pentium 4 idea of predictive branching, but with even larger pipeline stalls. Except the P4 could still do math.

                                      1 Reply Last reply
                                      0
                                      • drwho@masto.hackers.townD drwho@masto.hackers.town

                                        @cstanhope @mcc @mntmn @cwebber I like it.

                                        ryanc@infosec.exchangeR This user is from outside of this forum
                                        ryanc@infosec.exchangeR This user is from outside of this forum
                                        ryanc@infosec.exchange
                                        wrote sidst redigeret af
                                        #34

                                        @drwho @cstanhope @mcc @mntmn @cwebber Honestly, I would prefer LLM generated code over grad student generated code.

                                        1 Reply Last reply
                                        0
                                        • rdviii@famichiki.jpR rdviii@famichiki.jp

                                          @cwebber mostly agree, especially about them not being compilers, but some compilers aren't deterministic. You'll get a different result in memory layout or optimization sometimes. Especially for quantum compilers, where the compilation process itself is known to be NP hard, so heuristics are used.

                                          yaleman@mastodon.socialY This user is from outside of this forum
                                          yaleman@mastodon.socialY This user is from outside of this forum
                                          yaleman@mastodon.social
                                          wrote sidst redigeret af
                                          #35

                                          @rdviii Ok but who's actually talking about *quantum compilers* when they are just saying "compilers" as a general term? ... other than people who work exclusively on QC's, who would be ... an incredibly tiny minority 🙂

                                          1 Reply Last reply
                                          0
                                          Svar
                                          • Svar som emne
                                          Login for at svare
                                          • Ældste til nyeste
                                          • Nyeste til ældste
                                          • Most Votes


                                          • Log ind

                                          • Har du ikke en konto? Tilmeld

                                          • Login or register to search.
                                          Powered by NodeBB Contributors
                                          Graciously hosted by data.coop
                                          • First post
                                            Last post
                                          0
                                          • Hjem
                                          • Seneste
                                          • Etiketter
                                          • Populære
                                          • Verden
                                          • Bruger
                                          • Grupper