We don't have a reliable way to prevent large-scale automated web scraping from overwhelming smaller websites' server capacity.
open
Global / Unspecified, Global
Aggressive scraping bots, including those collecting data to train AI models, can overload smaller websites not built to handle that volume of automated traffic. Balancing open web access with protection against this kind of strain remains unresolved.
Citation ID: WS00840
Title: We don't have a reliable way to prevent large-scale automated web scraping from overwhelming smaller websites' server capacity.
URL: https://www.worldsolve.org/index.php?api=problem&id=840