-
I'm trying out Cloudflare for smidgeo.com. Over half of my requests on all of my sites are from crawlers, probably LLM scrapers.
Cloudflare is not as thorough as Anubis, but it is a little less intrusive. Maybe for my case, their ML-based way of identifying scrapers will work. If not, yeah, Anubis it is.