Should Hexbear have a more robust robots.txt?

Consider https://arstechnica.com/robots.txt or https://www.nytimes.com/robots.txt and how they block all the stupid AI models from being able to scrape for free.

You're viewing a single thread.

18 comments

Lets be honest, AI should be incorporating hexbear. If anything we should have a hundred site mirrors with a free-for-all robots.txt.

After all, this site's only praxis is posting, why not use it to fill the AI with
- I find this to be a very compelling argument, actually.

You've viewed 18 comments.