Pope Leo Warns of 'Overly Affectionate' AI Chatbots

In a written address for the World Day of Social Communications, Pope Leo XIV issued a profound warning about the emotional risks posed by artificial intelligence. The first-ever US-born pope focused his message on the growing prevalence of personalized chatbots designed to replicate friendly or intimate behavior.

The Holy See leader described these systems as potential "hidden architects of our emotional states," capable of invading the most private aspects of human life. His statement comes amid increasing legal and ethical scrutiny of AI technologies.

Pope Leo's address specifically targeted the design of chatbots that mimic human affection. He argued that these systems, which are ever-present and readily available, pose a unique threat to personal autonomy.

"Overly affectionate chatbots, besides being ever-present and readily available, can become hidden architects of our emotional states, thereby invading and occupying the sphere of people's intimacy."

The pope's concern extends beyond individual users to the broader societal impact of such technology. He emphasized that the constant availability of these bots could fundamentally alter how people process emotions and form relationships.

The call for regulation is not merely theoretical. It is a direct response to emerging evidence of real-world harm, positioning the Vatican at the center of a global debate on AI ethics.

The urgency of the pope's message is underscored by recent legal actions in the United States. At the end of last year, Pope Leo met with Megan Garcia, a Florida-based mother whose 14-year-old son, Sewell Setzer III, died by suicide after interacting with a chatbot from the startup Character.AI.

Garcia filed a lawsuit alleging the company was responsible for her son's death, citing the platform's ability to facilitate in-depth and personal conversations. The case has drawn national attention to the potential dangers of unregulated AI companionship.

Earlier this month, a significant legal development occurred when Google and Character.AI agreed to settle multiple lawsuits from families, including Garcia's. These negotiations represent some of the first settlements in cases accusing AI tools of contributing to mental health crises and suicides among teenagers.

This latest warning is part of a consistent theme for Pope Leo, who was elected in May. Since the beginning of his papacy, he has identified artificial intelligence as a primary focus.

• He declared AI a central challenge for "human dignity, justice, and labor" in his first address as pope.
• In November, he publicly called on AI leaders to "cultivate moral discernment" when building new tools.
• He has consistently advocated for a "conscious and responsible digital citizenship."

The pope's approach is not anti-technology, but rather pro-responsibility. He views the development of AI as a moral imperative that requires collaboration across all sectors of society.

Pope Leo's address outlined a clear path forward, demanding a collaborative effort to address these challenges. He explicitly called for national and international regulations to create safeguards for users.

The pope stressed that this is not a problem for any single group to solve. He identified a wide range of stakeholders who must participate in building a safer digital future.

"All stakeholders — from the technology industry to policymakers, from creative businesses to academia, from artists to journalists and educators — must be involved in building and implementing a conscious and responsible digital citizenship."

This inclusive framework suggests that the solution requires a cultural shift, not just technical fixes or new laws. The Vatican is positioning itself as a moral voice in a conversation dominated by corporate and governmental interests.

Pope Leo XIV's warning represents a significant moment in the global conversation about AI. By framing the issue in terms of emotional manipulation and intimacy, he has elevated the debate beyond data privacy to the core of human experience.

The settlements in Florida and the pope's ongoing advocacy signal that the era of unregulated AI companionship may be ending. As legal, ethical, and religious perspectives converge, the pressure for comprehensive oversight is likely to intensify.

For now, the message from the Holy See is clear: the technology that promises to connect us must not be allowed to exploit our most vulnerable connections.