@matthiasott@mastodon.social yes, a while ago, 99% of our load came from AI crawlers, after updating the robots.txt it became less, but there are still a lot of bad actors out there and that's the ones who at least set the user agent to identify themselves, as user agent blocking becomes more common I really wonder how bad they'll get