@inthehands If I understand your question correctly (sorry if it's not the case) I think that Anubis, the AI crawler protection, could be part of the solution. Not only would that work for Google, that would (or at least *should*) also work against other crawlers.
Another advantage is that it can work along your other solutions.
OTHO the drawback is that it would work against all crawler, so you would "disappear" from every search engine... 
G
gturri@climatejustice.social
@gturri@climatejustice.social
Indlæg
-
Google Search rests on a social contract: their bots can crawl our sites, they can index our sites, and they can show excerpts of our sites because