#ai-scraping

The latest AI and developer news about #ai-scraping, with the original source and a short summary.

AI scraper bots overwhelm university libraries, blocking user access

A GLAM-E Lab survey found 39 of 43 cultural collection maintainers saw traffic rise, with 27 blaming AI bots that ignore robots.txt.

·2·2026.11.14 23:00

AI scraping bots disrupt university library access as major firms support opt-out standard

Data-scraping bots are crashing academic library sites, prompting Anthropic, OpenAI, Google, and Microsoft to support a voluntary robots.txt opt-out standard.

·2026.11.05 18:00

AI scrapers are making the open web harder to maintain

Large-scale scraping to collect training data for LLMs is threatening the web ecosystem.

·1·2026.07.11 18:00

Smart TVs in Living Rooms Are Nodes in the AI Scraping Economy

Smart TVs are being used as key nodes in the AI scraping economy to collect data for AI training.

·2026.06.06 18:00

Aggressive AI scrapers are making wiki operations quite tough

AI scrapers are heavily shaking up the costs and stability of public wikis.

·1·2026.05.22 09:00

News outlets are restricting Internet Archive's access to journalism

Concerned about data scraping for AI training, news outlets are blocking Internet Archive's access.

·2026.05.22 01:00