Skip to content
  • Hjem
  • Seneste
  • Etiketter
  • Populære
  • Verden
  • Bruger
  • Grupper
Temaer
  • Light
  • Brite
  • Cerulean
  • Cosmo
  • Flatly
  • Journal
  • Litera
  • Lumen
  • Lux
  • Materia
  • Minty
  • Morph
  • Pulse
  • Sandstone
  • Simplex
  • Sketchy
  • Spacelab
  • United
  • Yeti
  • Zephyr
  • Dark
  • Cyborg
  • Darkly
  • Quartz
  • Slate
  • Solar
  • Superhero
  • Vapor

  • Default (No Skin)
  • No Skin
Kollaps
FARVEL BIG TECH
  1. Forside
  2. Ikke-kategoriseret
  3. The coreutils Rust rewrite story is pretty funny.

The coreutils Rust rewrite story is pretty funny.

Planlagt Fastgjort Låst Flyttet Ikke-kategoriseret
198 Indlæg 103 Posters 194 Visninger
  • Ældste til nyeste
  • Nyeste til ældste
  • Most Votes
Svar
  • Svar som emne
Login for at svare
Denne tråd er blevet slettet. Kun brugere med emne behandlings privilegier kan se den.
  • hyc@mastodon.socialH hyc@mastodon.social

    @lcamtuf See this all the time - people storm in trying to change things before trying to understand how the current things work. People who don't learn from what's been done before. Society doesn't progress from efforts like theirs. You only make progress by learning from and building on top of what came before.

    w8emv@a2mi.socialW This user is from outside of this forum
    w8emv@a2mi.socialW This user is from outside of this forum
    w8emv@a2mi.social
    wrote sidst redigeret af
    #113

    @hyc @lcamtuf

    One thing that the Rust rewrite of coreutils tried to do was to prove that it was making steady progress by the number of test cases originating from GNU coreutils that it could pass.

    I very much suspect that there's a whole host of race condition tests that made it into the test corpus late in the game.

    Test-driven rewrite has its limits.

    Note the uptick in failures at the very right edge of the graph, they are currently under 90% tests successful.

    #coreutils #uutils

    hyc@mastodon.socialH bob_zim@infosec.exchangeB 2 Replies Last reply
    0
    • lcamtuf@infosec.exchangeL lcamtuf@infosec.exchange

      The coreutils Rust rewrite story is pretty funny.

      Coreutils are tools like rm, mv, mkdir, etc. Unlike binutils, this isn't a fertile ground for memory safety bugs. But, the rewrite was completed, and in the spirit of progress, Canonical decided to switch.

      But do you know what coreutils are a fertile ground for? Race conditions around file creation, deletion, permission setting, and so on. The original code accounted for decades of hard-learned lessons in that space. The Rust rewrite did not:

      https://seclists.org/oss-sec/2026/q2/332

      PS. I'm not dunking on Rust. It's just that... starting over from scratch has its hidden costs.

      lispi314@udongein.xyzL This user is from outside of this forum
      lispi314@udongein.xyzL This user is from outside of this forum
      lispi314@udongein.xyz
      wrote sidst redigeret af
      #114
      @lcamtuf Or why crappy abstractions for POSIX APIs are worse.
      1 Reply Last reply
      0
      • seirdy@pleroma.envs.netS seirdy@pleroma.envs.net

        @Doomed_Daniel@mastodon.gamedev.place @ireneista@irenes.space @lcamtuf@infosec.exchange @puppygirlhornypost2@transfem.social I’m just saying that slim POSIX implementations that prioritize small size aren’t the best references for a clean-room GNU coreutil rewrite. FreeBSD utils and GNU documentation would be better.

        Given the different language, I’m not sure that lightly referencing the GNU source code would even pose a legal risk.

        puppygirlhornypost2@transfem.socialP This user is from outside of this forum
        puppygirlhornypost2@transfem.socialP This user is from outside of this forum
        puppygirlhornypost2@transfem.social
        wrote sidst redigeret af
        #115

        @Seirdy@pleroma.envs.net @lcamtuf@infosec.exchange @Doomed_Daniel@mastodon.gamedev.place @ireneista@adhd.irenes.space Also, BSD-Clause and MIT are compatible licenses. IANAL though, so I'm hesitant to discuss how this would actually impact "porting" BSD-Clause code from C to an MIT Licensed Rust codebase

        1 Reply Last reply
        0
        • xerz@soc.masfloss.netX xerz@soc.masfloss.net

          @star @hypha @lcamtuf yeah, the audits should have come first, not the other way around

          all they did was give them free patches, so uh... yet another Rust advantage? ​

          lispi314@udongein.xyzL This user is from outside of this forum
          lispi314@udongein.xyzL This user is from outside of this forum
          lispi314@udongein.xyz
          wrote sidst redigeret af
          #116
          @xerz @star @hypha @lcamtuf Switching to dependencies with a single non-replaceable toolchain is also irresponsible.

          Core utilities should not rely on something that can believably be slopped into oblivion with no viable replacement (C compilers are a dime a dozen and comparatively much easier to implement, with many functional replacements readily available).

          Proper specification of all the core toolchains should be a bare minimum.
          xerz@soc.masfloss.netX 1 Reply Last reply
          0
          • puppygirlhornypost2@transfem.socialP puppygirlhornypost2@transfem.social

            @lcamtuf@infosec.exchange @Seirdy@pleroma.envs.net @Doomed_Daniel@mastodon.gamedev.place @ireneista@adhd.irenes.space i find it annoying because on GNU coreutil systems i am so used to being able to just append whatever flag i forgot to put in the front and then it's like ❌ nah

            raven667@hachyderm.ioR This user is from outside of this forum
            raven667@hachyderm.ioR This user is from outside of this forum
            raven667@hachyderm.io
            wrote sidst redigeret af
            #117

            @puppygirlhornypost2 @ireneista People talking about UX are often talking about GUIs but aside from GNU making clean copyleft license versions of the (at the time) proprietary Unix utils, GNU also spent a lot of effort in UX like long options and fewer arbitrary restrictions (which made sense on a PDP but not on the larger systems of the 90's and later) which is how they got to be so popular, before Linux was even created. It's too bad that some of the other systems keep looking back farther for inspiration rather than looking around and forward for what the UX of a Unix should be.

            ireneista@adhd.irenes.spaceI 1 Reply Last reply
            0
            • raven667@hachyderm.ioR raven667@hachyderm.io

              @puppygirlhornypost2 @ireneista People talking about UX are often talking about GUIs but aside from GNU making clean copyleft license versions of the (at the time) proprietary Unix utils, GNU also spent a lot of effort in UX like long options and fewer arbitrary restrictions (which made sense on a PDP but not on the larger systems of the 90's and later) which is how they got to be so popular, before Linux was even created. It's too bad that some of the other systems keep looking back farther for inspiration rather than looking around and forward for what the UX of a Unix should be.

              ireneista@adhd.irenes.spaceI This user is from outside of this forum
              ireneista@adhd.irenes.spaceI This user is from outside of this forum
              ireneista@adhd.irenes.space
              wrote sidst redigeret af
              #118

              @raven667 @puppygirlhornypost2 they did, yeah, you're right. they deserve credit for that work.

              they did so in a time when UX wasn't yet a science (or rather, design was a science but had not been made rigorous in the domain of computing), so perhaps it's understandable that they still have a ton of UX problems... but you're right. still way better than earlier attempts.

              1 Reply Last reply
              0
              • raymaccarthy@mastodon.ieR raymaccarthy@mastodon.ie

                @lcamtuf
                I learned C++ after Modula-2 and before C.
                I learned programming earlier.

                Learning a programming language isn't learning programming (extracting requirements, specification, design, coding, test etc).
                I looked at Rust. C++ certainly has got too complicated since 1987, but I wonder does Rust *only* help with memory safety?
                Main memory safety in general relates to using pointers that are invalid, accessing arrays out of bounds and past the end of strings.
                Partly bad libraries & design.

                lispi314@udongein.xyzL This user is from outside of this forum
                lispi314@udongein.xyzL This user is from outside of this forum
                lispi314@udongein.xyz
                wrote sidst redigeret af
                #119
                @raymaccarthy @lcamtuf Rust seems to in-practice accomplish very little Ada doesn't do better.
                raymaccarthy@mastodon.ieR 1 Reply Last reply
                0
                • K kynx@fosstodon.org

                  @ChuckMcManis @lcamtuf now why the hell, after all these years, have I not heard of Chesterton’s Fence? Is this what I missed by not learning my trade at a uni? Kinda rhetorical, but I _still_ feel I must’ve missed something other than the debt…

                  Anyway, thank you. It’s going to provide a nice two-worder when reviewing prs by newbies - and a lot of oldbies and, lest l forget, their sloppy chums.

                  G This user is from outside of this forum
                  G This user is from outside of this forum
                  geofflangdale@mastodon.social
                  wrote sidst redigeret af
                  #120

                  @Kynx @ChuckMcManis @lcamtuf I don't get the big deal about Chesterton's Fence and think it's probably safe to remove it from our lexicon tbh

                  1 Reply Last reply
                  0
                  • lispi314@udongein.xyzL lispi314@udongein.xyz
                    @xerz @star @hypha @lcamtuf Switching to dependencies with a single non-replaceable toolchain is also irresponsible.

                    Core utilities should not rely on something that can believably be slopped into oblivion with no viable replacement (C compilers are a dime a dozen and comparatively much easier to implement, with many functional replacements readily available).

                    Proper specification of all the core toolchains should be a bare minimum.
                    xerz@soc.masfloss.netX This user is from outside of this forum
                    xerz@soc.masfloss.netX This user is from outside of this forum
                    xerz@soc.masfloss.net
                    wrote sidst redigeret af
                    #121

                    @lispi314 @hypha @star @lcamtuf in fairness GNU has a viable alternative, gccrs is aiming for Rust 1.49 and is getting quite close https://rust-gcc.github.io/2026/04/13/2026-03-monthly-report.html

                    .....not sure what compiler version uutils requires tho

                    lispi314@udongein.xyzL 1 Reply Last reply
                    0
                    • lcamtuf@infosec.exchangeL lcamtuf@infosec.exchange

                      The coreutils Rust rewrite story is pretty funny.

                      Coreutils are tools like rm, mv, mkdir, etc. Unlike binutils, this isn't a fertile ground for memory safety bugs. But, the rewrite was completed, and in the spirit of progress, Canonical decided to switch.

                      But do you know what coreutils are a fertile ground for? Race conditions around file creation, deletion, permission setting, and so on. The original code accounted for decades of hard-learned lessons in that space. The Rust rewrite did not:

                      https://seclists.org/oss-sec/2026/q2/332

                      PS. I'm not dunking on Rust. It's just that... starting over from scratch has its hidden costs.

                      zwarich@hachyderm.ioZ This user is from outside of this forum
                      zwarich@hachyderm.ioZ This user is from outside of this forum
                      zwarich@hachyderm.io
                      wrote sidst redigeret af
                      #122

                      @lcamtuf We clearly need a type system capable of expressing TOCTOU-safety.

                      1 Reply Last reply
                      0
                      • w8emv@a2mi.socialW w8emv@a2mi.social

                        @hyc @lcamtuf

                        One thing that the Rust rewrite of coreutils tried to do was to prove that it was making steady progress by the number of test cases originating from GNU coreutils that it could pass.

                        I very much suspect that there's a whole host of race condition tests that made it into the test corpus late in the game.

                        Test-driven rewrite has its limits.

                        Note the uptick in failures at the very right edge of the graph, they are currently under 90% tests successful.

                        #coreutils #uutils

                        hyc@mastodon.socialH This user is from outside of this forum
                        hyc@mastodon.socialH This user is from outside of this forum
                        hyc@mastodon.social
                        wrote sidst redigeret af
                        #123

                        @w8emv @lcamtuf a rather damning graph for Canonical, choosing to deploy when they knew it was less than 90% compatible. Even if they were passing 100% of the test suite you'd expect problems with edge cases that hadn't been covered yet.

                        1 Reply Last reply
                        0
                        • xerz@soc.masfloss.netX xerz@soc.masfloss.net

                          @lispi314 @hypha @star @lcamtuf in fairness GNU has a viable alternative, gccrs is aiming for Rust 1.49 and is getting quite close https://rust-gcc.github.io/2026/04/13/2026-03-monthly-report.html

                          .....not sure what compiler version uutils requires tho

                          lispi314@udongein.xyzL This user is from outside of this forum
                          lispi314@udongein.xyzL This user is from outside of this forum
                          lispi314@udongein.xyz
                          wrote sidst redigeret af
                          #124

                          @xerz@soc.masfloss.net @hypha@cafe.mycelium.locahlo.st @star@fed.amazonawaws.com @lcamtuf@infosec.exchange Last I had heard from gccrust is that it couldn’t even be used for bootstrap compiling yet, without enforcing any of the semantics a Rust compiler is expected to.

                          It’s unclear whether it also now does that as of this progress report or not. If it does then that would be progress indeed.

                          star@fed.amazonawaws.comS 1 Reply Last reply
                          0
                          • erincandescent@akko.erincandescent.netE This user is from outside of this forum
                            erincandescent@akko.erincandescent.netE This user is from outside of this forum
                            erincandescent@akko.erincandescent.net
                            wrote sidst redigeret af
                            #125
                            @r @ireneista @pinskia @lcamtuf any widget toolkit they have is heavily entangled with the HTML renderer, and the advanced typography is stuff like HarfBuzz
                            q@glauca.spaceQ 1 Reply Last reply
                            0
                            • P pinskia@hachyderm.io

                              @ireneista @lcamtuf

                              "Netscape went bankrupt trying to re-write their software from scratch"

                              It is also why Microsoft Edge went from something written from scratch to be a fork of chromium. The story is the same and even more it is about the similar product. Plus it is a recent example of the whole starting from scratch issues.

                              lispi314@udongein.xyzL This user is from outside of this forum
                              lispi314@udongein.xyzL This user is from outside of this forum
                              lispi314@udongein.xyz
                              wrote sidst redigeret af
                              #126

                              @pinskia@hachyderm.io @ireneista@adhd.irenes.space @lcamtuf@infosec.exchange They also just didn’t really have a reason to care about writing their own browser much either. I think their main revenue streams had diverged from that already.

                              1 Reply Last reply
                              0
                              • lispi314@udongein.xyzL lispi314@udongein.xyz
                                @raymaccarthy @lcamtuf Rust seems to in-practice accomplish very little Ada doesn't do better.
                                raymaccarthy@mastodon.ieR This user is from outside of this forum
                                raymaccarthy@mastodon.ieR This user is from outside of this forum
                                raymaccarthy@mastodon.ie
                                wrote sidst redigeret af
                                #127

                                @lispi314 @lcamtuf
                                C++ programmers are not going to use Ada or Modula-3.
                                Ada or any version of Modula / Oberon would be totally anathema to C programmers.

                                Rust is better than C and maybe has some advantages over C++, and that's the market it's aimed at. The selling point is that it's C like, with classes, types and "Memory Safe". And turning off the Memory safe.

                                1 Reply Last reply
                                0
                                • sten@chaos.socialS sten@chaos.social

                                  @darkuncle @ChuckMcManis @lcamtuf Sure, but perhaps don't do your learning in production? 🙂

                                  lispi314@udongein.xyzL This user is from outside of this forum
                                  lispi314@udongein.xyzL This user is from outside of this forum
                                  lispi314@udongein.xyz
                                  wrote sidst redigeret af
                                  #128
                                  @sten @darkuncle @ChuckMcManis @lcamtuf Got to get the company investing in the continuous training of their workers somehow, right?
                                  1 Reply Last reply
                                  0
                                  • erincandescent@akko.erincandescent.netE erincandescent@akko.erincandescent.net
                                    @r @ireneista @pinskia @lcamtuf any widget toolkit they have is heavily entangled with the HTML renderer, and the advanced typography is stuff like HarfBuzz
                                    q@glauca.spaceQ This user is from outside of this forum
                                    q@glauca.spaceQ This user is from outside of this forum
                                    q@glauca.space
                                    wrote sidst redigeret af
                                    #129

                                    @r @ireneista @erincandescent @pinskia @lcamtuf HarfBuzz is perfectly usable on its own. It only took me a week of hair pulling to get it into an Metal renderer for Eurovision; even had proper RTL/LTR mixing and Emoji support

                                    r@glauca.spaceR 1 Reply Last reply
                                    0
                                    • q@glauca.spaceQ q@glauca.space

                                      @r @ireneista @erincandescent @pinskia @lcamtuf HarfBuzz is perfectly usable on its own. It only took me a week of hair pulling to get it into an Metal renderer for Eurovision; even had proper RTL/LTR mixing and Emoji support

                                      r@glauca.spaceR This user is from outside of this forum
                                      r@glauca.spaceR This user is from outside of this forum
                                      r@glauca.space
                                      wrote sidst redigeret af
                                      #130

                                      @q @ireneista @erincandescent @pinskia @lcamtuf we were under the impression that browsers had additional "miscellaneous bullshit" such as font fallback selection and "OS-specific quirks" (we're not sure what if anything that actually refers to)

                                      r@glauca.spaceR 1 Reply Last reply
                                      0
                                      • r@glauca.spaceR r@glauca.space

                                        @q @ireneista @erincandescent @pinskia @lcamtuf we were under the impression that browsers had additional "miscellaneous bullshit" such as font fallback selection and "OS-specific quirks" (we're not sure what if anything that actually refers to)

                                        r@glauca.spaceR This user is from outside of this forum
                                        r@glauca.spaceR This user is from outside of this forum
                                        r@glauca.space
                                        wrote sidst redigeret af
                                        #131

                                        @q @ireneista @erincandescent @pinskia @lcamtuf we know *for sure* that browsers get involved in "emoji presentation" because we reported a bug in that area

                                        Firefox also has a hack workaround to ignore "Segoe UI Emoji" for country flags, specifically to fix Mastodon (and some other sites of this nature which use a "OS font stack" philosophy)

                                        ireneista@adhd.irenes.spaceI q@glauca.spaceQ r@glauca.spaceR 3 Replies Last reply
                                        0
                                        • r@glauca.spaceR r@glauca.space

                                          @q @ireneista @erincandescent @pinskia @lcamtuf we know *for sure* that browsers get involved in "emoji presentation" because we reported a bug in that area

                                          Firefox also has a hack workaround to ignore "Segoe UI Emoji" for country flags, specifically to fix Mastodon (and some other sites of this nature which use a "OS font stack" philosophy)

                                          ireneista@adhd.irenes.spaceI This user is from outside of this forum
                                          ireneista@adhd.irenes.spaceI This user is from outside of this forum
                                          ireneista@adhd.irenes.space
                                          wrote sidst redigeret af
                                          #132

                                          @r @q @erincandescent @pinskia @lcamtuf yes browsers implement their own font fallback logic which is a duplicate of what OS core libraries and fontconfig do, just slightly different. they implement their own so as to not have to engage with OSes.

                                          ireneista@adhd.irenes.spaceI 1 Reply Last reply
                                          0
                                          Svar
                                          • Svar som emne
                                          Login for at svare
                                          • Ældste til nyeste
                                          • Nyeste til ældste
                                          • Most Votes


                                          • Log ind

                                          • Har du ikke en konto? Tilmeld

                                          • Login or register to search.
                                          Powered by NodeBB Contributors
                                          Graciously hosted by data.coop
                                          • First post
                                            Last post
                                          0
                                          • Hjem
                                          • Seneste
                                          • Etiketter
                                          • Populære
                                          • Verden
                                          • Bruger
                                          • Grupper