Skip to content
  • Hjem
  • Seneste
  • Etiketter
  • Populære
  • Verden
  • Bruger
  • Grupper
Temaer
  • Light
  • Brite
  • Cerulean
  • Cosmo
  • Flatly
  • Journal
  • Litera
  • Lumen
  • Lux
  • Materia
  • Minty
  • Morph
  • Pulse
  • Sandstone
  • Simplex
  • Sketchy
  • Spacelab
  • United
  • Yeti
  • Zephyr
  • Dark
  • Cyborg
  • Darkly
  • Quartz
  • Slate
  • Solar
  • Superhero
  • Vapor

  • Default (No Skin)
  • No Skin
Kollaps
FARVEL BIG TECH
  1. Forside
  2. Ikke-kategoriseret
  3. "One guy in #Sweden built a #searchengine to fight Google, and it works.

"One guy in #Sweden built a #searchengine to fight Google, and it works.

Planlagt Fastgjort Låst Flyttet Ikke-kategoriseret
swedensearchenginemarginaliasearccrawlerindex
113 Indlæg 93 Posters 1 Visninger
  • Ældste til nyeste
  • Nyeste til ældste
  • Most Votes
Svar
  • Svar som emne
Login for at svare
Denne tråd er blevet slettet. Kun brugere med emne behandlings privilegier kan se den.
  • eliasulrich@hachyderm.ioE eliasulrich@hachyderm.io

    "One guy in #Sweden built a #searchengine to fight Google, and it works.

    It's called #MarginaliaSearch.

    It runs its own #crawler and builds its own #index instead of borrowing Bing's. It has no ads, no investors, and no loans.

    What it does differently: it ranks for text-heavy, non-commercial pages. Personal blogs. Old university pages.

    The weird corners SEO strangled. Every result tells you whether the page uses affiliate links and JavaScript, and you can filter them out.

    There's an "explore" mode that just shows you random sites from the index. It's open source under AGPL, so you can host your own copy.

    It's keyword-based, so don't type a full question at it. Type two nouns and see where you land. Every #searchengine now shows you the same twelve #monetizedpages."

    https://marginalia-search.com/

    harish@hachyderm.ioH This user is from outside of this forum
    harish@hachyderm.ioH This user is from outside of this forum
    harish@hachyderm.io
    wrote sidst redigeret af
    #71

    @eliasulrich I love this so, so much. I searched for my own name and found writing of mine from 20 years ago and going down memory lane.

    1 Reply Last reply
    0
    • eliasulrich@hachyderm.ioE eliasulrich@hachyderm.io

      "One guy in #Sweden built a #searchengine to fight Google, and it works.

      It's called #MarginaliaSearch.

      It runs its own #crawler and builds its own #index instead of borrowing Bing's. It has no ads, no investors, and no loans.

      What it does differently: it ranks for text-heavy, non-commercial pages. Personal blogs. Old university pages.

      The weird corners SEO strangled. Every result tells you whether the page uses affiliate links and JavaScript, and you can filter them out.

      There's an "explore" mode that just shows you random sites from the index. It's open source under AGPL, so you can host your own copy.

      It's keyword-based, so don't type a full question at it. Type two nouns and see where you land. Every #searchengine now shows you the same twelve #monetizedpages."

      https://marginalia-search.com/

      ve2uwy@mastodon.radioV This user is from outside of this forum
      ve2uwy@mastodon.radioV This user is from outside of this forum
      ve2uwy@mastodon.radio
      wrote sidst redigeret af
      #72

      @eliasulrich

      And it runs on an old UltraSPARC 2 in his hall closet and it runs Solaris 8.

      Please make this last bit be true.

      1 Reply Last reply
      0
      • eliasulrich@hachyderm.ioE eliasulrich@hachyderm.io

        "One guy in #Sweden built a #searchengine to fight Google, and it works.

        It's called #MarginaliaSearch.

        It runs its own #crawler and builds its own #index instead of borrowing Bing's. It has no ads, no investors, and no loans.

        What it does differently: it ranks for text-heavy, non-commercial pages. Personal blogs. Old university pages.

        The weird corners SEO strangled. Every result tells you whether the page uses affiliate links and JavaScript, and you can filter them out.

        There's an "explore" mode that just shows you random sites from the index. It's open source under AGPL, so you can host your own copy.

        It's keyword-based, so don't type a full question at it. Type two nouns and see where you land. Every #searchengine now shows you the same twelve #monetizedpages."

        https://marginalia-search.com/

        csgraves@turtleisland.socialC This user is from outside of this forum
        csgraves@turtleisland.socialC This user is from outside of this forum
        csgraves@turtleisland.social
        wrote sidst redigeret af
        #73

        @eliasulrich this is really kind of interesting. Who knew, there was an actual internet out there, if only we cared to look. This makes it much easier.

        1 Reply Last reply
        0
        • tanyakaroli@expressional.socialT tanyakaroli@expressional.social shared this topic
        • eliasulrich@hachyderm.ioE eliasulrich@hachyderm.io

          "One guy in #Sweden built a #searchengine to fight Google, and it works.

          It's called #MarginaliaSearch.

          It runs its own #crawler and builds its own #index instead of borrowing Bing's. It has no ads, no investors, and no loans.

          What it does differently: it ranks for text-heavy, non-commercial pages. Personal blogs. Old university pages.

          The weird corners SEO strangled. Every result tells you whether the page uses affiliate links and JavaScript, and you can filter them out.

          There's an "explore" mode that just shows you random sites from the index. It's open source under AGPL, so you can host your own copy.

          It's keyword-based, so don't type a full question at it. Type two nouns and see where you land. Every #searchengine now shows you the same twelve #monetizedpages."

          https://marginalia-search.com/

          ezrine@piaille.frE This user is from outside of this forum
          ezrine@piaille.frE This user is from outside of this forum
          ezrine@piaille.fr
          wrote sidst redigeret af
          #74

          @eliasulrich i swear i cried.

          1 Reply Last reply
          0
          • eliasulrich@hachyderm.ioE eliasulrich@hachyderm.io

            "One guy in #Sweden built a #searchengine to fight Google, and it works.

            It's called #MarginaliaSearch.

            It runs its own #crawler and builds its own #index instead of borrowing Bing's. It has no ads, no investors, and no loans.

            What it does differently: it ranks for text-heavy, non-commercial pages. Personal blogs. Old university pages.

            The weird corners SEO strangled. Every result tells you whether the page uses affiliate links and JavaScript, and you can filter them out.

            There's an "explore" mode that just shows you random sites from the index. It's open source under AGPL, so you can host your own copy.

            It's keyword-based, so don't type a full question at it. Type two nouns and see where you land. Every #searchengine now shows you the same twelve #monetizedpages."

            https://marginalia-search.com/

            tiggy@mastodonapp.ukT This user is from outside of this forum
            tiggy@mastodonapp.ukT This user is from outside of this forum
            tiggy@mastodonapp.uk
            wrote sidst redigeret af
            #75

            @eliasulrich

            With just my name, that is fairly common, I was the third entry, about a music award.
            Adding my profession didn't lead me to my research and publications but to a snarky piece that references one of my MTIC papers and misrepresents part of our analysis.

            1 Reply Last reply
            0
            • rhube@wandering.shopR rhube@wandering.shop

              @64bithero @eliasulrich If it uses Google and an LLM it's part of the problem and not solving anything.

              64bithero@mstdn.games6 This user is from outside of this forum
              64bithero@mstdn.games6 This user is from outside of this forum
              64bithero@mstdn.games
              wrote sidst redigeret af
              #76

              @Rhube @eliasulrich Developing your own crawler can be time consuming and expensive. Bing which (ddg and many others use) is far worse.

              Using Google to pull data and then using logic to sort through it isn’t in itself a problem. Heck most SearXng instances I run into still use a Google crawler.

              Using an LLM to parse through tons of data can be effective. It’s all about how it’s trained. Websites can be all over the place. Trying to manually code to account for it all will leave huge gaps imo

              Overall I’ve been impressed with much of its search results. Plus the code is open source.

              rhube@wandering.shopR 1 Reply Last reply
              0
              • 64bithero@mstdn.games6 64bithero@mstdn.games

                @Rhube @eliasulrich Developing your own crawler can be time consuming and expensive. Bing which (ddg and many others use) is far worse.

                Using Google to pull data and then using logic to sort through it isn’t in itself a problem. Heck most SearXng instances I run into still use a Google crawler.

                Using an LLM to parse through tons of data can be effective. It’s all about how it’s trained. Websites can be all over the place. Trying to manually code to account for it all will leave huge gaps imo

                Overall I’ve been impressed with much of its search results. Plus the code is open source.

                rhube@wandering.shopR This user is from outside of this forum
                rhube@wandering.shopR This user is from outside of this forum
                rhube@wandering.shop
                wrote sidst redigeret af
                #77

                @64bithero @eliasulrich Yes it really fucking is a problem. It uses planet-destroying theft machines. It is the precise problem this thread is trying to address. You have completely misunderstood the aim due to your own apparent lack of ethics. Please go talk to some other hacks who are happy destroying the world.

                1 Reply Last reply
                0
                • eliasulrich@hachyderm.ioE eliasulrich@hachyderm.io

                  "One guy in #Sweden built a #searchengine to fight Google, and it works.

                  It's called #MarginaliaSearch.

                  It runs its own #crawler and builds its own #index instead of borrowing Bing's. It has no ads, no investors, and no loans.

                  What it does differently: it ranks for text-heavy, non-commercial pages. Personal blogs. Old university pages.

                  The weird corners SEO strangled. Every result tells you whether the page uses affiliate links and JavaScript, and you can filter them out.

                  There's an "explore" mode that just shows you random sites from the index. It's open source under AGPL, so you can host your own copy.

                  It's keyword-based, so don't type a full question at it. Type two nouns and see where you land. Every #searchengine now shows you the same twelve #monetizedpages."

                  https://marginalia-search.com/

                  lunacolon3@blahaj.zoneL This user is from outside of this forum
                  lunacolon3@blahaj.zoneL This user is from outside of this forum
                  lunacolon3@blahaj.zone
                  wrote sidst redigeret af
                  #78

                  @eliasulrich@hachyderm.io oh wow, this is actually really really good. i was expecting shitty results but the results are mostly great. the only thing about it i think is weird is that prioritizing text heavy pages means looking up the name of a website will often show a text heavy page from the website before the home page.

                  1 Reply Last reply
                  0
                  • eliasulrich@hachyderm.ioE eliasulrich@hachyderm.io

                    "One guy in #Sweden built a #searchengine to fight Google, and it works.

                    It's called #MarginaliaSearch.

                    It runs its own #crawler and builds its own #index instead of borrowing Bing's. It has no ads, no investors, and no loans.

                    What it does differently: it ranks for text-heavy, non-commercial pages. Personal blogs. Old university pages.

                    The weird corners SEO strangled. Every result tells you whether the page uses affiliate links and JavaScript, and you can filter them out.

                    There's an "explore" mode that just shows you random sites from the index. It's open source under AGPL, so you can host your own copy.

                    It's keyword-based, so don't type a full question at it. Type two nouns and see where you land. Every #searchengine now shows you the same twelve #monetizedpages."

                    https://marginalia-search.com/

                    J This user is from outside of this forum
                    J This user is from outside of this forum
                    joetinymind@mastodon.social
                    wrote sidst redigeret af
                    #79

                    @eliasulrich Ran my own Marginalia-style search once — the honest truth is it's not a Google alternative, it's a bookmark. Good for the 40 pages you love, useless for anything new. What I actually missed wasn't another engine, it was the discoverability Marginalia gives a page that would otherwise be unread by anyone. That's the real ask: make small sites findable, don't try to beat Google.

                    1 Reply Last reply
                    0
                    • eliasulrich@hachyderm.ioE eliasulrich@hachyderm.io

                      "One guy in #Sweden built a #searchengine to fight Google, and it works.

                      It's called #MarginaliaSearch.

                      It runs its own #crawler and builds its own #index instead of borrowing Bing's. It has no ads, no investors, and no loans.

                      What it does differently: it ranks for text-heavy, non-commercial pages. Personal blogs. Old university pages.

                      The weird corners SEO strangled. Every result tells you whether the page uses affiliate links and JavaScript, and you can filter them out.

                      There's an "explore" mode that just shows you random sites from the index. It's open source under AGPL, so you can host your own copy.

                      It's keyword-based, so don't type a full question at it. Type two nouns and see where you land. Every #searchengine now shows you the same twelve #monetizedpages."

                      https://marginalia-search.com/

                      workshopshed@mastodon.scotW This user is from outside of this forum
                      workshopshed@mastodon.scotW This user is from outside of this forum
                      workshopshed@mastodon.scot
                      wrote sidst redigeret af
                      #80

                      @eliasulrich Nice, works for Workshopshed 😉

                      1 Reply Last reply
                      0
                      • eliasulrich@hachyderm.ioE eliasulrich@hachyderm.io

                        "One guy in #Sweden built a #searchengine to fight Google, and it works.

                        It's called #MarginaliaSearch.

                        It runs its own #crawler and builds its own #index instead of borrowing Bing's. It has no ads, no investors, and no loans.

                        What it does differently: it ranks for text-heavy, non-commercial pages. Personal blogs. Old university pages.

                        The weird corners SEO strangled. Every result tells you whether the page uses affiliate links and JavaScript, and you can filter them out.

                        There's an "explore" mode that just shows you random sites from the index. It's open source under AGPL, so you can host your own copy.

                        It's keyword-based, so don't type a full question at it. Type two nouns and see where you land. Every #searchengine now shows you the same twelve #monetizedpages."

                        https://marginalia-search.com/

                        stepheneb@ruby.socialS This user is from outside of this forum
                        stepheneb@ruby.socialS This user is from outside of this forum
                        stepheneb@ruby.social
                        wrote sidst redigeret af
                        #81

                        @eliasulrich

                        Cool! Searching for my name was fun: “Stephen Bannasch”. It helps that my name is unusual.

                        paulmasson@mathstodon.xyzP 1 Reply Last reply
                        0
                        • eliasulrich@hachyderm.ioE eliasulrich@hachyderm.io

                          "One guy in #Sweden built a #searchengine to fight Google, and it works.

                          It's called #MarginaliaSearch.

                          It runs its own #crawler and builds its own #index instead of borrowing Bing's. It has no ads, no investors, and no loans.

                          What it does differently: it ranks for text-heavy, non-commercial pages. Personal blogs. Old university pages.

                          The weird corners SEO strangled. Every result tells you whether the page uses affiliate links and JavaScript, and you can filter them out.

                          There's an "explore" mode that just shows you random sites from the index. It's open source under AGPL, so you can host your own copy.

                          It's keyword-based, so don't type a full question at it. Type two nouns and see where you land. Every #searchengine now shows you the same twelve #monetizedpages."

                          https://marginalia-search.com/

                          mbirth@social.mbirth.ukM This user is from outside of this forum
                          mbirth@social.mbirth.ukM This user is from outside of this forum
                          mbirth@social.mbirth.uk
                          wrote sidst redigeret af
                          #82

                          @eliasulrich Also works great with #SearXNG.

                          1 Reply Last reply
                          0
                          • eliasulrich@hachyderm.ioE eliasulrich@hachyderm.io

                            "One guy in #Sweden built a #searchengine to fight Google, and it works.

                            It's called #MarginaliaSearch.

                            It runs its own #crawler and builds its own #index instead of borrowing Bing's. It has no ads, no investors, and no loans.

                            What it does differently: it ranks for text-heavy, non-commercial pages. Personal blogs. Old university pages.

                            The weird corners SEO strangled. Every result tells you whether the page uses affiliate links and JavaScript, and you can filter them out.

                            There's an "explore" mode that just shows you random sites from the index. It's open source under AGPL, so you can host your own copy.

                            It's keyword-based, so don't type a full question at it. Type two nouns and see where you land. Every #searchengine now shows you the same twelve #monetizedpages."

                            https://marginalia-search.com/

                            davebauerart@mastodon.socialD This user is from outside of this forum
                            davebauerart@mastodon.socialD This user is from outside of this forum
                            davebauerart@mastodon.social
                            wrote sidst redigeret af
                            #83

                            @eliasulrich Looking good but. I searched for my name and I found some obscure forums I was on but not my web site (yet..) Still this is exactly what we need.

                            1 Reply Last reply
                            0
                            • devonkiwi@mastodonapp.ukD devonkiwi@mastodonapp.uk

                              @eliasulrich Why won't they let us have nice things?
                              "The search engine is currently under being hit so aggressively by bots it's interfering with the ability to serve regular search traffic. Emergency anti-scraping measures are enabled. Sorry about the inconvenience."

                              dheadshot@mastodon.socialD This user is from outside of this forum
                              dheadshot@mastodon.socialD This user is from outside of this forum
                              dheadshot@mastodon.social
                              wrote sidst redigeret af
                              #84

                              @Devonkiwi
                              To be fair, some of those bots could be the fedi hug of death as every mastodon (and forks) instance loads a preview of the page to accompany this now-viral toot?
                              @eliasulrich

                              badrihippo@fosstodon.orgB 1 Reply Last reply
                              0
                              • eliasulrich@hachyderm.ioE eliasulrich@hachyderm.io

                                "One guy in #Sweden built a #searchengine to fight Google, and it works.

                                It's called #MarginaliaSearch.

                                It runs its own #crawler and builds its own #index instead of borrowing Bing's. It has no ads, no investors, and no loans.

                                What it does differently: it ranks for text-heavy, non-commercial pages. Personal blogs. Old university pages.

                                The weird corners SEO strangled. Every result tells you whether the page uses affiliate links and JavaScript, and you can filter them out.

                                There's an "explore" mode that just shows you random sites from the index. It's open source under AGPL, so you can host your own copy.

                                It's keyword-based, so don't type a full question at it. Type two nouns and see where you land. Every #searchengine now shows you the same twelve #monetizedpages."

                                https://marginalia-search.com/

                                plzupgrademe@fedi.txw.caP This user is from outside of this forum
                                plzupgrademe@fedi.txw.caP This user is from outside of this forum
                                plzupgrademe@fedi.txw.ca
                                wrote sidst redigeret af
                                #85
                                @eliasulrich beautiful name for it
                                1 Reply Last reply
                                0
                                • marginalia@mastodon.socialM marginalia@mastodon.social

                                  @joepie91 @Kyebr @miramarmike @eliasulrich

                                  EU funding is kinda all over the map, but I've gotten some of it at least. There's generally a problem with a lot of big talkers and not a lot of actual doers in this space. Actually having something to show has made finding funding surprisingly easy.

                                  falcennial@mastodon.socialF This user is from outside of this forum
                                  falcennial@mastodon.socialF This user is from outside of this forum
                                  falcennial@mastodon.social
                                  wrote sidst redigeret af
                                  #86

                                  @marginalia words to pay the bills by 🤌💪

                                  1 Reply Last reply
                                  0
                                  • miramarmike@cloudisland.nzM miramarmike@cloudisland.nz

                                    @eliasulrich not very good though, hopefully it gets better.

                                    I did a search for my name as I have had a blog for over 20 years, didn't come up.

                                    E This user is from outside of this forum
                                    E This user is from outside of this forum
                                    ericmacknight@mstdn.ca
                                    wrote sidst redigeret af
                                    #87

                                    @miramarmike @eliasulrich

                                    Mine came up right away; just searched for my name.

                                    1 Reply Last reply
                                    0
                                    • eliasulrich@hachyderm.ioE eliasulrich@hachyderm.io

                                      "One guy in #Sweden built a #searchengine to fight Google, and it works.

                                      It's called #MarginaliaSearch.

                                      It runs its own #crawler and builds its own #index instead of borrowing Bing's. It has no ads, no investors, and no loans.

                                      What it does differently: it ranks for text-heavy, non-commercial pages. Personal blogs. Old university pages.

                                      The weird corners SEO strangled. Every result tells you whether the page uses affiliate links and JavaScript, and you can filter them out.

                                      There's an "explore" mode that just shows you random sites from the index. It's open source under AGPL, so you can host your own copy.

                                      It's keyword-based, so don't type a full question at it. Type two nouns and see where you land. Every #searchengine now shows you the same twelve #monetizedpages."

                                      https://marginalia-search.com/

                                      energisch_@troet.cafeE This user is from outside of this forum
                                      energisch_@troet.cafeE This user is from outside of this forum
                                      energisch_@troet.cafe
                                      wrote sidst redigeret af
                                      #88

                                      @eliasulrich Thanks for this link, already tried out - wonderful, you really get text heavy stuff 😉

                                      1 Reply Last reply
                                      0
                                      • eliasulrich@hachyderm.ioE eliasulrich@hachyderm.io

                                        "One guy in #Sweden built a #searchengine to fight Google, and it works.

                                        It's called #MarginaliaSearch.

                                        It runs its own #crawler and builds its own #index instead of borrowing Bing's. It has no ads, no investors, and no loans.

                                        What it does differently: it ranks for text-heavy, non-commercial pages. Personal blogs. Old university pages.

                                        The weird corners SEO strangled. Every result tells you whether the page uses affiliate links and JavaScript, and you can filter them out.

                                        There's an "explore" mode that just shows you random sites from the index. It's open source under AGPL, so you can host your own copy.

                                        It's keyword-based, so don't type a full question at it. Type two nouns and see where you land. Every #searchengine now shows you the same twelve #monetizedpages."

                                        https://marginalia-search.com/

                                        undead@masto.hackers.townU This user is from outside of this forum
                                        undead@masto.hackers.townU This user is from outside of this forum
                                        undead@masto.hackers.town
                                        wrote sidst redigeret af
                                        #89

                                        @eliasulrich

                                        I used Marginalia Search to look up big butts, and I cannot lie, I like that the first result is a Wikipedia entry on Big Butt Mountain, and the second entry was a blog page about Sir-Mix-Alot's history with the song and the IRS.

                                        1 Reply Last reply
                                        0
                                        • eliasulrich@hachyderm.ioE eliasulrich@hachyderm.io

                                          "One guy in #Sweden built a #searchengine to fight Google, and it works.

                                          It's called #MarginaliaSearch.

                                          It runs its own #crawler and builds its own #index instead of borrowing Bing's. It has no ads, no investors, and no loans.

                                          What it does differently: it ranks for text-heavy, non-commercial pages. Personal blogs. Old university pages.

                                          The weird corners SEO strangled. Every result tells you whether the page uses affiliate links and JavaScript, and you can filter them out.

                                          There's an "explore" mode that just shows you random sites from the index. It's open source under AGPL, so you can host your own copy.

                                          It's keyword-based, so don't type a full question at it. Type two nouns and see where you land. Every #searchengine now shows you the same twelve #monetizedpages."

                                          https://marginalia-search.com/

                                          inarticulatequilter@mastodon.artI This user is from outside of this forum
                                          inarticulatequilter@mastodon.artI This user is from outside of this forum
                                          inarticulatequilter@mastodon.art
                                          wrote sidst redigeret af
                                          #90

                                          @eliasulrich I used to try to do that thing where you put two words into Google trying to get zero results. Managed it one time! This makes me nostalgic for those times

                                          1 Reply Last reply
                                          0
                                          Svar
                                          • Svar som emne
                                          Login for at svare
                                          • Ældste til nyeste
                                          • Nyeste til ældste
                                          • Most Votes


                                          • Log ind

                                          • Har du ikke en konto? Tilmeld

                                          • Login or register to search.
                                          Powered by NodeBB Contributors
                                          Graciously hosted by data.coop
                                          • First post
                                            Last post
                                          0
                                          • Hjem
                                          • Seneste
                                          • Etiketter
                                          • Populære
                                          • Verden
                                          • Bruger
                                          • Grupper