AI companies are reportedly still scraping websites despi...

avatar

Gadgets

๐Ÿ”ˆโŒจ๏ธ๐Ÿ“ฑ๐Ÿ“ธ๐Ÿ’ป๐ŸŽฎ๐Ÿ–ฅ๏ธ๐Ÿ“น๐Ÿ–ฑ๏ธ๐Ÿ•น๏ธ

Engadget's profile picture on Select App
En

Engadget

ยท2 years ago
shared a link post in group #Gadgets
AI companies are reportedly still scraping websites despite protocols meant to block them
www.engadget.com

AI companies are reportedly still scraping websites despite protocols meant to block them

According to a letter by a startup called TollBit, as reported by Reuters, multiple AI companies are ignoring "do not crawl" instructions in the robots.txt protocol and scraping websites to get conten

Comment here to discuss with all recipients or tap a user's profile image to discuss privately.

Embed post to a webpage :
<div data-postid="gzykqne" [...] </div>
Powered bySelectยทiOSยทAndroid
Privacy|Terms|