yeah, the most comon one of those is meta-externalagent but that gets matched by wler because the url included has the word 'crawler' in it

CC: @macronaut@mas.to @hyc@mastodon.social @inthehands@hachyderm.io

in nginx I have this

if ($http_user_agent ~* (uptime|bot|index|spider|wler|brave)) { return 402 "Just send the money"; }

it keeps out the riffraff.

CC: @hyc@mastodon.social @inthehands@hachyderm.io

I return 402 Payment Required to googlebot user agents