AI Co-Founder Addresses Pope on Tech Dangers

Chris Olah, an atheist and co-founder of the AI company Anthropic, recently spoke at the Vatican concerning Pope Leo's historic encyclical on artificial intelligence. The pontiff urged for the "disarming" of AI, warning of potential societal dangers and a stark divide between an AI-enriched elite and a surveilled populace.

Olah, whose company is reportedly nearing a trillion-dollar valuation, acknowledged the inherent conflicts within AI development. He stated that AI labs operate under incentives that can clash with ethical considerations, validating the Pope's call for external pressure and internal restraint.

The Vatican's engagement with AI is not new, with initiatives like the Minerva Dialogues dating back to 2016. Ethicists from Santa Clara University have been in dialogue with Olah, even contributing to Anthropic's AI model constitution.

While Pope Leo's encyclical may not halt AI advancement or military applications, its goal is to foster crucial conversations. It seeks to temper the industry's ambition and perhaps instill a sense of ethical responsibility among AI developers.

Olah highlighted the mysterious and complex nature of AI models, describing them as "more subtle, odd, and beautiful than science fiction prepared us for." This perspective touches upon the debate about AI's potential to approach humanlike status, a notion Pope Leo actively cautions against, particularly in reference to transhumanism.

Father Brian Patrick Green commented on the mysterious nature of AI, stating it is "not a person, but it's also not a mere tool." The ongoing moral questions surrounding AI development require immediate attention, with the Pope's encyclical providing a foundation for these critical discussions.