Skip to content
  • Hjem
  • Seneste
  • Etiketter
  • Populære
  • Verden
  • Bruger
  • Grupper
Temaer
  • Light
  • Brite
  • Cerulean
  • Cosmo
  • Flatly
  • Journal
  • Litera
  • Lumen
  • Lux
  • Materia
  • Minty
  • Morph
  • Pulse
  • Sandstone
  • Simplex
  • Sketchy
  • Spacelab
  • United
  • Yeti
  • Zephyr
  • Dark
  • Cyborg
  • Darkly
  • Quartz
  • Slate
  • Solar
  • Superhero
  • Vapor

  • Default (No Skin)
  • No Skin
Kollaps
FARVEL BIG TECH
khm@hj.9fs.netK

khm@hj.9fs.net

@khm@hj.9fs.net
About
Indlæg
3
Emner
0
Fremhævelser
0
Grupper
0
Følgere
0
Følger
0

Vis Original

Indlæg

Seneste Bedste Controversial

  • Google Search rests on a social contract: their bots can crawl our sites, they can index our sites, and they can show excerpts of our sites because
    khm@hj.9fs.netK khm@hj.9fs.net
    yeah, the most comon one of those is meta-externalagent but that gets matched by wler because the url included has the word 'crawler' in it

    CC: @macronaut@mas.to @hyc@mastodon.social @inthehands@hachyderm.io
    Ikke-kategoriseret

  • Google Search rests on a social contract: their bots can crawl our sites, they can index our sites, and they can show excerpts of our sites because
    khm@hj.9fs.netK khm@hj.9fs.net
    in nginx I have this
    if ($http_user_agent ~* (uptime|bot|index|spider|wler|brave)) { return 402 "Just send the money"; }
    it keeps out the riffraff.

    CC: @hyc@mastodon.social @inthehands@hachyderm.io
    Ikke-kategoriseret

  • Google Search rests on a social contract: their bots can crawl our sites, they can index our sites, and they can show excerpts of our sites because
    khm@hj.9fs.netK khm@hj.9fs.net
    I return 402 Payment Required to googlebot user agents
    Ikke-kategoriseret
  • Log ind

  • Har du ikke en konto? Tilmeld

  • Login or register to search.
Powered by NodeBB Contributors
Graciously hosted by data.coop
  • First post
    Last post
0
  • Hjem
  • Seneste
  • Etiketter
  • Populære
  • Verden
  • Bruger
  • Grupper