<![CDATA[I'd completely missed this but apparently Meta are changing their T&amp;Cs for business users of their platforms to force all companies to allow Meta to scrape and index their content.]]>I'd completely missed this but apparently Meta are changing their T&Cs for business users of their platforms to force all companies to allow Meta to scrape and index their content. If you disagree, you have to stop using Meta platforms.
https://www.niemanlab.org/2026/10/metas-new-commercial-terms-will-allow-the-scraping-of-news-sites-legal-experts-say/

Scraping starts October 30th apparently.

Yuk.

Anyone know which bot they'll use? Feels likely to be `meta-externalagent` from docs: https://developers.facebook.com/documentation/sharing/webmasters/web-crawlers/

]]>https://forum.fedi.dk/topic/b252bba1-4c3f-40ce-a513-6173890e3d2d/i-d-completely-missed-this-but-apparently-meta-are-changing-their-t-amp-cs-for-business-users-of-their-platforms-to-force-all-companies-to-allow-meta-to-scrape-and-index-their-content.RSS for NodeThu, 29 Oct 2026 01:51:36 GMTFri, 16 Oct 2026 15:04:42 GMT60<![CDATA[Reply to I'd completely missed this but apparently Meta are changing their T&amp;Cs for business users of their platforms to force all companies to allow Meta to scrape and index their content. on Fri, 16 Oct 2026 16:08:12 GMT]]>@tdp_org oh blocking claude to get those notices is def quicker than my immediate "scroll down to to the contributors block in the sidebar". TIL!

]]>https://forum.fedi.dk/post/https://mastodon.social/users/hrbrmstr/statuses/117451449462957813https://forum.fedi.dk/post/https://mastodon.social/users/hrbrmstr/statuses/117451449462957813Fri, 16 Oct 2026 16:08:12 GMT<![CDATA[Reply to I'd completely missed this but apparently Meta are changing their T&amp;Cs for business users of their platforms to force all companies to allow Meta to scrape and index their content. on Fri, 16 Oct 2026 15:31:50 GMT]]>@hrbrmstr There's a certain irony to this

]]>https://forum.fedi.dk/post/https://mastodon.social/users/tdp_org/statuses/117451306495480742https://forum.fedi.dk/post/https://mastodon.social/users/tdp_org/statuses/117451306495480742Fri, 16 Oct 2026 15:31:50 GMT<![CDATA[Reply to I'd completely missed this but apparently Meta are changing their T&amp;Cs for business users of their platforms to force all companies to allow Meta to scrape and index their content. on Fri, 16 Oct 2026 15:19:49 GMT]]>@tdp_org this is a decent resource to keep on the radar https://github.com/ai-robots-txt/ai.robots.txt

]]>https://forum.fedi.dk/post/https://mastodon.social/users/hrbrmstr/statuses/117451259213893514https://forum.fedi.dk/post/https://mastodon.social/users/hrbrmstr/statuses/117451259213893514Fri, 16 Oct 2026 15:19:49 GMT<![CDATA[Reply to I'd completely missed this but apparently Meta are changing their T&amp;Cs for business users of their platforms to force all companies to allow Meta to scrape and index their content. on Fri, 16 Oct 2026 15:10:15 GMT]]>@tdp_org meta-externalagent and meta-webindexer are heavy hitters from them (partially tracked here: https://observatory.rud.is/rules)

facebookexternalhit and HatchFeed (agent.meta.ai) sometimes from from their attributed v4 and v6 ranges but low volume and seem to be user-initiated (note the deliberately broken x axis)

]]>https://forum.fedi.dk/post/https://mastodon.social/users/hrbrmstr/statuses/117451221590137603https://forum.fedi.dk/post/https://mastodon.social/users/hrbrmstr/statuses/117451221590137603Fri, 16 Oct 2026 15:10:15 GMT