AI companies are violating a basic social contract of the web and and ignoring robots.txt
AI companies are violating a basic social contract of the web and and ignoring robots.txt
As unscrupulous AI companies crawl for more and more data, the basic social contract of the web is falling apart.
![The rise and fall of robots.txt](https://lemmy.world/pictrs/image/d58d347c-eaf6-475a-bfe8-f71a8eb9140e.jpeg?format=webp&thumbnail=256)
You're viewing a single thread.
The open and free web is long dead.
just thinking about robots.txt as a working solution to people that literally broker in people's entire digital lives for hundreds of billions of dollars is so ... quaint.
99 1 ReplyIt's up there with Do-Not-Track.
Completely pointless because it's not enforced
27 0 ReplyDo-Not-Track, AKA, "I've made my browser fingerprint more unique for you, please sell my data"
3 0 ReplyI bet at least one site I've visited in my lifetime has enforced it
1 0 Reply
you're jaded. me, too. but you're jaded.
6 0 Replyi prefer "antiqued" but yes
4 0 Reply