Skip to content
  • Hjem
  • Seneste
  • Etiketter
  • Populære
  • Verden
  • Bruger
  • Grupper
Temaer
  • Light
  • Brite
  • Cerulean
  • Cosmo
  • Flatly
  • Journal
  • Litera
  • Lumen
  • Lux
  • Materia
  • Minty
  • Morph
  • Pulse
  • Sandstone
  • Simplex
  • Sketchy
  • Spacelab
  • United
  • Yeti
  • Zephyr
  • Dark
  • Cyborg
  • Darkly
  • Quartz
  • Slate
  • Solar
  • Superhero
  • Vapor

  • Default (No Skin)
  • No Skin
Kollaps
FARVEL BIG TECH
  1. Forside
  2. Ikke-kategoriseret
  3. The coreutils Rust rewrite story is pretty funny.

The coreutils Rust rewrite story is pretty funny.

Planlagt Fastgjort Låst Flyttet Ikke-kategoriseret
198 Indlæg 103 Posters 144 Visninger
  • Ældste til nyeste
  • Nyeste til ældste
  • Most Votes
Svar
  • Svar som emne
Login for at svare
Denne tråd er blevet slettet. Kun brugere med emne behandlings privilegier kan se den.
  • lcamtuf@infosec.exchangeL lcamtuf@infosec.exchange

    The coreutils Rust rewrite story is pretty funny.

    Coreutils are tools like rm, mv, mkdir, etc. Unlike binutils, this isn't a fertile ground for memory safety bugs. But, the rewrite was completed, and in the spirit of progress, Canonical decided to switch.

    But do you know what coreutils are a fertile ground for? Race conditions around file creation, deletion, permission setting, and so on. The original code accounted for decades of hard-learned lessons in that space. The Rust rewrite did not:

    https://seclists.org/oss-sec/2026/q2/332

    PS. I'm not dunking on Rust. It's just that... starting over from scratch has its hidden costs.

    zwarich@hachyderm.ioZ This user is from outside of this forum
    zwarich@hachyderm.ioZ This user is from outside of this forum
    zwarich@hachyderm.io
    wrote sidst redigeret af
    #122

    @lcamtuf We clearly need a type system capable of expressing TOCTOU-safety.

    1 Reply Last reply
    0
    • w8emv@a2mi.socialW w8emv@a2mi.social

      @hyc @lcamtuf

      One thing that the Rust rewrite of coreutils tried to do was to prove that it was making steady progress by the number of test cases originating from GNU coreutils that it could pass.

      I very much suspect that there's a whole host of race condition tests that made it into the test corpus late in the game.

      Test-driven rewrite has its limits.

      Note the uptick in failures at the very right edge of the graph, they are currently under 90% tests successful.

      #coreutils #uutils

      hyc@mastodon.socialH This user is from outside of this forum
      hyc@mastodon.socialH This user is from outside of this forum
      hyc@mastodon.social
      wrote sidst redigeret af
      #123

      @w8emv @lcamtuf a rather damning graph for Canonical, choosing to deploy when they knew it was less than 90% compatible. Even if they were passing 100% of the test suite you'd expect problems with edge cases that hadn't been covered yet.

      1 Reply Last reply
      0
      • xerz@soc.masfloss.netX xerz@soc.masfloss.net

        @lispi314 @hypha @star @lcamtuf in fairness GNU has a viable alternative, gccrs is aiming for Rust 1.49 and is getting quite close https://rust-gcc.github.io/2026/04/13/2026-03-monthly-report.html

        .....not sure what compiler version uutils requires tho

        lispi314@udongein.xyzL This user is from outside of this forum
        lispi314@udongein.xyzL This user is from outside of this forum
        lispi314@udongein.xyz
        wrote sidst redigeret af
        #124

        @xerz@soc.masfloss.net @hypha@cafe.mycelium.locahlo.st @star@fed.amazonawaws.com @lcamtuf@infosec.exchange Last I had heard from gccrust is that it couldn’t even be used for bootstrap compiling yet, without enforcing any of the semantics a Rust compiler is expected to.

        It’s unclear whether it also now does that as of this progress report or not. If it does then that would be progress indeed.

        star@fed.amazonawaws.comS 1 Reply Last reply
        0
        • erincandescent@akko.erincandescent.netE This user is from outside of this forum
          erincandescent@akko.erincandescent.netE This user is from outside of this forum
          erincandescent@akko.erincandescent.net
          wrote sidst redigeret af
          #125
          @r @ireneista @pinskia @lcamtuf any widget toolkit they have is heavily entangled with the HTML renderer, and the advanced typography is stuff like HarfBuzz
          q@glauca.spaceQ 1 Reply Last reply
          0
          • P pinskia@hachyderm.io

            @ireneista @lcamtuf

            "Netscape went bankrupt trying to re-write their software from scratch"

            It is also why Microsoft Edge went from something written from scratch to be a fork of chromium. The story is the same and even more it is about the similar product. Plus it is a recent example of the whole starting from scratch issues.

            lispi314@udongein.xyzL This user is from outside of this forum
            lispi314@udongein.xyzL This user is from outside of this forum
            lispi314@udongein.xyz
            wrote sidst redigeret af
            #126

            @pinskia@hachyderm.io @ireneista@adhd.irenes.space @lcamtuf@infosec.exchange They also just didn’t really have a reason to care about writing their own browser much either. I think their main revenue streams had diverged from that already.

            1 Reply Last reply
            0
            • lispi314@udongein.xyzL lispi314@udongein.xyz
              @raymaccarthy @lcamtuf Rust seems to in-practice accomplish very little Ada doesn't do better.
              raymaccarthy@mastodon.ieR This user is from outside of this forum
              raymaccarthy@mastodon.ieR This user is from outside of this forum
              raymaccarthy@mastodon.ie
              wrote sidst redigeret af
              #127

              @lispi314 @lcamtuf
              C++ programmers are not going to use Ada or Modula-3.
              Ada or any version of Modula / Oberon would be totally anathema to C programmers.

              Rust is better than C and maybe has some advantages over C++, and that's the market it's aimed at. The selling point is that it's C like, with classes, types and "Memory Safe". And turning off the Memory safe.

              1 Reply Last reply
              0
              • sten@chaos.socialS sten@chaos.social

                @darkuncle @ChuckMcManis @lcamtuf Sure, but perhaps don't do your learning in production? 🙂

                lispi314@udongein.xyzL This user is from outside of this forum
                lispi314@udongein.xyzL This user is from outside of this forum
                lispi314@udongein.xyz
                wrote sidst redigeret af
                #128
                @sten @darkuncle @ChuckMcManis @lcamtuf Got to get the company investing in the continuous training of their workers somehow, right?
                1 Reply Last reply
                0
                • erincandescent@akko.erincandescent.netE erincandescent@akko.erincandescent.net
                  @r @ireneista @pinskia @lcamtuf any widget toolkit they have is heavily entangled with the HTML renderer, and the advanced typography is stuff like HarfBuzz
                  q@glauca.spaceQ This user is from outside of this forum
                  q@glauca.spaceQ This user is from outside of this forum
                  q@glauca.space
                  wrote sidst redigeret af
                  #129

                  @r @ireneista @erincandescent @pinskia @lcamtuf HarfBuzz is perfectly usable on its own. It only took me a week of hair pulling to get it into an Metal renderer for Eurovision; even had proper RTL/LTR mixing and Emoji support

                  r@glauca.spaceR 1 Reply Last reply
                  0
                  • q@glauca.spaceQ q@glauca.space

                    @r @ireneista @erincandescent @pinskia @lcamtuf HarfBuzz is perfectly usable on its own. It only took me a week of hair pulling to get it into an Metal renderer for Eurovision; even had proper RTL/LTR mixing and Emoji support

                    r@glauca.spaceR This user is from outside of this forum
                    r@glauca.spaceR This user is from outside of this forum
                    r@glauca.space
                    wrote sidst redigeret af
                    #130

                    @q @ireneista @erincandescent @pinskia @lcamtuf we were under the impression that browsers had additional "miscellaneous bullshit" such as font fallback selection and "OS-specific quirks" (we're not sure what if anything that actually refers to)

                    r@glauca.spaceR 1 Reply Last reply
                    0
                    • r@glauca.spaceR r@glauca.space

                      @q @ireneista @erincandescent @pinskia @lcamtuf we were under the impression that browsers had additional "miscellaneous bullshit" such as font fallback selection and "OS-specific quirks" (we're not sure what if anything that actually refers to)

                      r@glauca.spaceR This user is from outside of this forum
                      r@glauca.spaceR This user is from outside of this forum
                      r@glauca.space
                      wrote sidst redigeret af
                      #131

                      @q @ireneista @erincandescent @pinskia @lcamtuf we know *for sure* that browsers get involved in "emoji presentation" because we reported a bug in that area

                      Firefox also has a hack workaround to ignore "Segoe UI Emoji" for country flags, specifically to fix Mastodon (and some other sites of this nature which use a "OS font stack" philosophy)

                      ireneista@adhd.irenes.spaceI q@glauca.spaceQ r@glauca.spaceR 3 Replies Last reply
                      0
                      • r@glauca.spaceR r@glauca.space

                        @q @ireneista @erincandescent @pinskia @lcamtuf we know *for sure* that browsers get involved in "emoji presentation" because we reported a bug in that area

                        Firefox also has a hack workaround to ignore "Segoe UI Emoji" for country flags, specifically to fix Mastodon (and some other sites of this nature which use a "OS font stack" philosophy)

                        ireneista@adhd.irenes.spaceI This user is from outside of this forum
                        ireneista@adhd.irenes.spaceI This user is from outside of this forum
                        ireneista@adhd.irenes.space
                        wrote sidst redigeret af
                        #132

                        @r @q @erincandescent @pinskia @lcamtuf yes browsers implement their own font fallback logic which is a duplicate of what OS core libraries and fontconfig do, just slightly different. they implement their own so as to not have to engage with OSes.

                        ireneista@adhd.irenes.spaceI 1 Reply Last reply
                        0
                        • ireneista@adhd.irenes.spaceI ireneista@adhd.irenes.space

                          @r @q @erincandescent @pinskia @lcamtuf yes browsers implement their own font fallback logic which is a duplicate of what OS core libraries and fontconfig do, just slightly different. they implement their own so as to not have to engage with OSes.

                          ireneista@adhd.irenes.spaceI This user is from outside of this forum
                          ireneista@adhd.irenes.spaceI This user is from outside of this forum
                          ireneista@adhd.irenes.space
                          wrote sidst redigeret af
                          #133

                          @r @q @erincandescent @pinskia @lcamtuf the way that corporations would describe this need is that browsers implement their own thing because otherwise there's no way to achieve consistent behavior across OSes

                          our view is that this attitude, if taken seriously, will always lead to a monolith

                          and also it is equivalent in practical terms to not wanting to engage with OSes

                          r@glauca.spaceR 1 Reply Last reply
                          0
                          • josh@hactivedirectory.comJ josh@hactivedirectory.com

                            @ChuckMcManis I actually find questioning the why behind something to be important. In your experience at Google, did the devs rewriting things have _access_ to the documentation as to why something was done? Was it like disbelief of the stated facts or were there holes in the notetaking about the reasoning?

                            @darkuncle @lcamtuf

                            L This user is from outside of this forum
                            L This user is from outside of this forum
                            leon_p_smith@ioc.exchange
                            wrote sidst redigeret af
                            #134

                            @josh @ChuckMcManis

                            Two problems: that kind of documentation often does not exist, and if it does, that kind of documentation often gets ignored. "Too theoretical, not practical, etc. etc., but more often if they were self aware and being honest, it's more like 'I don't understand'"

                            I mean, I agree, this kind of documentation can be invaluable, if employers are willing to let (and encourage) engineers to write *and* read it. (What did you do today? Read a bunch of documentation that you barely understand? Do better tomorrow!)

                            Concurrency poses a real challenge, as most programmers don't even begin to comprehend the issues in play. I know I was taking graduate classes before that light bulb really turned on.

                            1 Reply Last reply
                            0
                            • r@glauca.spaceR r@glauca.space

                              @q @ireneista @erincandescent @pinskia @lcamtuf we know *for sure* that browsers get involved in "emoji presentation" because we reported a bug in that area

                              Firefox also has a hack workaround to ignore "Segoe UI Emoji" for country flags, specifically to fix Mastodon (and some other sites of this nature which use a "OS font stack" philosophy)

                              q@glauca.spaceQ This user is from outside of this forum
                              q@glauca.spaceQ This user is from outside of this forum
                              q@glauca.space
                              wrote sidst redigeret af
                              #135

                              @pinskia @lcamtuf @erincandescent @ireneista @r I also had to implement this for the renderer, it wasn’t too difficult. and yes, there was emoji specific code

                              ireneista@adhd.irenes.spaceI 1 Reply Last reply
                              0
                              • lcamtuf@infosec.exchangeL lcamtuf@infosec.exchange

                                The coreutils Rust rewrite story is pretty funny.

                                Coreutils are tools like rm, mv, mkdir, etc. Unlike binutils, this isn't a fertile ground for memory safety bugs. But, the rewrite was completed, and in the spirit of progress, Canonical decided to switch.

                                But do you know what coreutils are a fertile ground for? Race conditions around file creation, deletion, permission setting, and so on. The original code accounted for decades of hard-learned lessons in that space. The Rust rewrite did not:

                                https://seclists.org/oss-sec/2026/q2/332

                                PS. I'm not dunking on Rust. It's just that... starting over from scratch has its hidden costs.

                                dckim@mastodon.socialD This user is from outside of this forum
                                dckim@mastodon.socialD This user is from outside of this forum
                                dckim@mastodon.social
                                wrote sidst redigeret af
                                #136

                                @lcamtuf I guess they all needed to be written within the same code so that rust could fail...

                                Truly comical...

                                1 Reply Last reply
                                0
                                • q@glauca.spaceQ q@glauca.space

                                  @pinskia @lcamtuf @erincandescent @ireneista @r I also had to implement this for the renderer, it wasn’t too difficult. and yes, there was emoji specific code

                                  ireneista@adhd.irenes.spaceI This user is from outside of this forum
                                  ireneista@adhd.irenes.spaceI This user is from outside of this forum
                                  ireneista@adhd.irenes.space
                                  wrote sidst redigeret af
                                  #137

                                  @q @pinskia @lcamtuf @erincandescent @r sigh fontconfig, of course, says that if the user has a preference as to the rendering of emoji they should express that preference in XML

                                  which is an interesting extreme of the individualism as a replacement for communal responsibility thing

                                  1 Reply Last reply
                                  0
                                  • ireneista@adhd.irenes.spaceI ireneista@adhd.irenes.space

                                    @r @q @erincandescent @pinskia @lcamtuf the way that corporations would describe this need is that browsers implement their own thing because otherwise there's no way to achieve consistent behavior across OSes

                                    our view is that this attitude, if taken seriously, will always lead to a monolith

                                    and also it is equivalent in practical terms to not wanting to engage with OSes

                                    r@glauca.spaceR This user is from outside of this forum
                                    r@glauca.spaceR This user is from outside of this forum
                                    r@glauca.space
                                    wrote sidst redigeret af
                                    #138

                                    @ireneista @q @erincandescent @pinskia @lcamtuf hrm, we've seen the "engage with OSes" perspective quite a bit recently, but we're personally much closer to the attitude of "OSes have dragged their feet so much that everyone making applications decided they're just not going to play that game anymore (and hence finding better and better ways to bypass the OS)"

                                    ireneista@adhd.irenes.spaceI erincandescent@akko.erincandescent.netE 2 Replies Last reply
                                    0
                                    • r@glauca.spaceR r@glauca.space

                                      @ireneista @q @erincandescent @pinskia @lcamtuf hrm, we've seen the "engage with OSes" perspective quite a bit recently, but we're personally much closer to the attitude of "OSes have dragged their feet so much that everyone making applications decided they're just not going to play that game anymore (and hence finding better and better ways to bypass the OS)"

                                      ireneista@adhd.irenes.spaceI This user is from outside of this forum
                                      ireneista@adhd.irenes.spaceI This user is from outside of this forum
                                      ireneista@adhd.irenes.space
                                      wrote sidst redigeret af
                                      #139

                                      @r @q @erincandescent @pinskia @lcamtuf here's the thing

                                      the web platform is trying to be an OS, in every way except the kernel

                                      or if you want more precise language, most platforms of that breadth are OSes and the web platform is the one that isn't

                                      ireneista@adhd.irenes.spaceI 1 Reply Last reply
                                      0
                                      • ireneista@adhd.irenes.spaceI ireneista@adhd.irenes.space

                                        @r @q @erincandescent @pinskia @lcamtuf here's the thing

                                        the web platform is trying to be an OS, in every way except the kernel

                                        or if you want more precise language, most platforms of that breadth are OSes and the web platform is the one that isn't

                                        ireneista@adhd.irenes.spaceI This user is from outside of this forum
                                        ireneista@adhd.irenes.spaceI This user is from outside of this forum
                                        ireneista@adhd.irenes.space
                                        wrote sidst redigeret af
                                        #140

                                        @r @q @erincandescent @pinskia @lcamtuf the web platform's governing bodies, and the ungoverned steering that browser vendors do without engaging with the official processes, are also perfectly capable of making bad decisions, becoming frozen in time, etc

                                        it's in a slightly more community-focused place than most OSes right now, but that doesn't make it immune to those social problems

                                        ireneista@adhd.irenes.spaceI 1 Reply Last reply
                                        0
                                        • r@glauca.spaceR r@glauca.space

                                          @ireneista @q @erincandescent @pinskia @lcamtuf hrm, we've seen the "engage with OSes" perspective quite a bit recently, but we're personally much closer to the attitude of "OSes have dragged their feet so much that everyone making applications decided they're just not going to play that game anymore (and hence finding better and better ways to bypass the OS)"

                                          erincandescent@akko.erincandescent.netE This user is from outside of this forum
                                          erincandescent@akko.erincandescent.netE This user is from outside of this forum
                                          erincandescent@akko.erincandescent.net
                                          wrote sidst redigeret af
                                          #141

                                          @r @ireneista @q @pinskia @lcamtuf i think the unix desktop (collectively) has certainly dragged its feet on a lot of things just through lack of a forcing function. the only common way of doing X is often the way it was done in 1996. if you need things you couldn’t do in 1996, well…

                                          ireneista@adhd.irenes.spaceI 1 Reply Last reply
                                          0
                                          Svar
                                          • Svar som emne
                                          Login for at svare
                                          • Ældste til nyeste
                                          • Nyeste til ældste
                                          • Most Votes


                                          • Log ind

                                          • Har du ikke en konto? Tilmeld

                                          • Login or register to search.
                                          Powered by NodeBB Contributors
                                          Graciously hosted by data.coop
                                          • First post
                                            Last post
                                          0
                                          • Hjem
                                          • Seneste
                                          • Etiketter
                                          • Populære
                                          • Verden
                                          • Bruger
                                          • Grupper