The quest to ‘destructively scan’ all the world’s books

In early 2024, executives at artificial intelligence start-up Anthropic ramped up an ambitious project they sought to keep quiet. It was code-named Project Panama, and internal documents filed in court described it as an “effort to destructively scan all the books in the world.”

According to the filings, the company had spent tens of millions of dollars to acquire and slice the spines off potentially millions of books, before scanning their pages to feed knowledge into the AI models behind products such as Claude, its popular chatbot. A judge ruled this fair use.

Details of Project Panama emerged in more than 4,000 pages of documents in a copyright lawsuit brought by book authors against Anthropic. The company agreed to pay $1.5 billion to settle the case in August – but a district judge’s decision last week to unseal a slew of documents in the case more fully revealed Anthropic’s zealous pursuit of books.

Today on “Post Reports,” technology reporter Will Oremus explains the lengths to which AI firms such as Anthropic, Meta, Google and OpenAI went to obtain colossal troves of data with which to “train” their software – a frantic and sometimes clandestine race to acquire the collected works of humanity.

He and host Martine Powers discuss how AI companies’ efforts sometimes might have crossed over into the illegal, and how authors and artists might fare in an AI-centered future.

Today’s show was produced by Rennie Svirnovskiy. It was edited by Dennis Funk and mixed by Sam Bair.

Subscribe to The Washington Post here.