AI Briefing#data-scraping
The latest AI and developer news about #data-scraping, with the original source and a short summary.
The latest AI and developer news about #data-scraping, with the original source and a short summary.
The FreeBSD project describes its current situation as being under constant attack and DDoSing due to data scraping by AI corporations.
Operators of Open3DLab, SFMLab, and SmutBase reported that a Roblox-affiliated crawler bypassed robots.txt and terms of service to scrape 1,027 files totaling 145.5GB, with 62.6GB comprising adult content.
Meta's new commercial terms, effective October 30, grant the company broad rights to scrape and use web content associated with business accounts for AI training, with no opt-out option.
Following Reddit's blocking of anonymous .json access, AI agents now need authenticated sessions to access data.
TinyFish has launched Bigset, an open-source multi-agent system that converts text prompts into real-time web datasets.
Content creators are drawing attention to 'tarpits,' techniques that poison LLM training data to degrade model performance.
Content creators are using tarpit tools that poison LLM training data in response to unauthorized scraping.
23 major news publishers have blocked Wayback Machine crawlers over AI training concerns.