The new encyclical, at nearly forty thousand words, bears reading. It is addressed “to all the Catholic faithful, to all Christians and to all men and women of goodwill”—that is, to everyone. In advance of its release, and leery of the inevitable TL;DR reaction, one Texas bishop warned parishioners not to ask a chatbot to summarize it for them. (Earlier this year, the Pope urged priests against using ChatGPT to write their sermons and to instead “use your brains more.”) It is not a beautiful document. It’s often maddeningly, boringly wonky (“this entails establishing norms so that the decision-making behind content selection and its development becomes more transparent and protects personal data”), and it gives every evidence of being written by a committee (“psychological and psychiatric literature has documented with growing insistence how early and unsupervised exposure to digital devices and social media can negatively impact sleep, attention span, control of emotions and relationships”). Some of it reads like a Silicon Valley press release (“Today, the convergence of automation, robotics and AI is rapidly transforming the very structure of work”). Nevertheless, “Magnifica Humanitas” presents a remarkable case for placing moral concerns, and not profit, or competitive advantage, or efficiency, at the center of any discussion of artificial intelligence.
If those of us Americans who are Catholic are proud of this Pope, many of us are even prouder that the first American pontiff has taken on this vital matter, and at such a crucial moment. In much of American culture—and especially in the business and tech press—challenging the economic power and oligarchic rule of U.S.-based artificial-intelligence companies is an act tantamount to heresy. Pope Leo is not only willing but eager to dissent. Bless him.
Much of the encyclical involves defending the proposition that the Vatican ought to be—and has always been—engaged in making statements about new and very worldly things like artificial intelligence. “The Church is present in history and engages in dialogue with the world,” Leo argues. He agrees with the Sam Altmans and Elon Musks of the world that humanity stands at a crossroads. But at this crossroads, he argues, three questions must be asked: “Where are we going? Toward what goal do we wish to orient ourselves? What direction should we choose as a people and as a human community?” Invoking a Biblical story about hubris, the building of the Tower of Babel, he warns of what he calls the “Babel syndrome”: “namely the idolatry of profit that sacrifices the weak, a uniformity that neutralizes differences, and the pretense that a single language—even a digital one—can translate everything, including the mystery of the person, into data and performance.”
Beginning with the fundamental dignity of the human, Leo traces the inalienable, universal equality of persons and their inviolable rights. He establishes, within the Church’s Social Doctrine (traceable to “Rerum Novarum”), principles that include the commitment to the common good, which he defines as “the social expression of the dignity recognized in every person.” [...]
The problem is not the technology, the Pope maintains in “Magnifica Humanitas”; it’s the anthropology. Algorithms, forms of automation, and artificial intelligence sort the worthy from the unworthy; they manipulate information and undermine trust; they violate privacy; they enhance the power of the already powerful and reduce the capabilities of the already vulnerable; they make war more ruthless; they undermine democratic governance; they take away the dignity of work, possibly for the mass of humanity. He presses for forms of regulation and especially for democratic control of artificial intelligence, but above all he calls for “disarming” A.I. “To disarm does not mean rejecting technology, but preventing it from dominating humanity,” he writes. “It means freeing technology from monopolistic control and opening it to discussion and debate, therefore making it human-friendly and restoring it to the plurality of human cultures and ways of life.” He worries that the culture around artificial intelligence undermines the search for truth that is necessary for both democratic life and any possibility for a genuine spiritual existence. [...]
That the concerns the Pope has raised in “Magnifica Humanitas” are not even remotely new does not make them any less urgent. Yet this history does suggest that calls to slow down the development of artificial intelligence and, as Arendt put it, to “think what we are doing” have not been heeded. Then again, before this week, they’ve never been sounded by the Pope, the spiritual leader of nearly a fifth of the world’s population.
“Magnifica Humanitas” is in many ways a religious analogue to Claude’s Constitution, released by Anthropic this past January (and on which at least two delegates to the Vatican were consulted). In a move freighted with symbolism, Anthropic’s co-founder Christopher Olah appeared on the dais alongside Leo at the release of the encyclical, which the Pope, in a first for the Church, presented in person, at the Vatican’s Synod Hall. “I am grateful to His Holiness and to the Church for taking up this work of discernment,” Olah said in his remarks. Executives of other A.I. companies are not likely to express that kind of gratitude. Nor are they likely to cede political power willingly, any more than they are likely to become philanthropists, or volunteer to pay more in taxes, or stop tweeting daft things or selling you tools that you don’t need and that you never asked for and that make you miserable, angrier, and stupider.
by Jill Lepore, New Yorker | Read more:
Image: Yara Nardi/Reuters
[ed. Maybe tl;dr for most folks, but AIs will certainly read it. Sort of my intent with ARIA: The Great Pause. Every little bit helps.]
[ed. Maybe tl;dr for most folks, but AIs will certainly read it. Sort of my intent with ARIA: The Great Pause. Every little bit helps.]
