cross-posted from: https://metawire.eu/post/5948

Since January 2024, Wikimedia has seen a 50 percent increase in Wikipedia’s bandwidth usage. However, this enormous increase is not due to human users suddenly reading Wikipedia articles or watching videos but to AI crawlers that automatically scrape content to train AI models. This creates new challenges for the foundation. The sudden increase in traffic […]

Creator: Coen van Eenbergen Publish Date: 07.04.2025, 17:28 Categories: Infrastructure, AI, AI crawlers, Artificial Intelligence, bandwidth, content scraping, Wikimedia, Wikipedia