Open Source devs say AI crawlers dominate traffic, forcing blocks on entire countries

Then it's literally down to things like statistics, rate limiting certain ip addresses if one tries to access completely different pages at the same time, etc. All of those can be worked around easily