Why are major publications blocking the Internet Archive?

Publications are blocking the Internet Archive due to concerns that AI companies are indirectly scraping their content by using the archive's collections to train AI models.

Which publications have restricted the Internet Archive's access?

The New York Times, The Guardian, the Financial Times, and Reddit have implemented restrictions on the Internet Archive's bots.

What other actions are publishers taking against AI companies?

Many publishers are suing AI businesses over content used for training large language models and are also seeking financial deals for their content.

Home / Technology / AI Bots Trigger Content Blocks on Digital Library

AI Bots Trigger Content Blocks on Digital Library

30 Jan

•

Summary

Major publications are blocking the Internet Archive's access.
Concerns exist that AI bots use archive content indirectly.
Other outlets are pursuing legal action or financial deals.

AI Bots Trigger Content Blocks on Digital Library

Several major publications have recently restricted the Internet Archive's access to their content. These actions stem from concerns that AI companies are indirectly scraping articles by utilizing the digital library's collections. Publishers fear that bots associated with AI businesses are exploiting the archive's readily available databases.

Notable outlets like The New York Times and The Guardian have confirmed blocking the Internet Archive's bots. The Financial Times and Reddit have also implemented selective blocks on how their material is cataloged. This development coincides with numerous publishers initiating lawsuits against AI entities over the use of their content for training large language models.

Disclaimer: This story has been auto-aggregated and auto-summarised by a computer program. This story has not been edited or created by the Feedzop team.