alt Hacker NewsMagnifica Humanitas
Comments
>“technology is never neutral, because it takes on the characteristics of those who devise, finance, regulate, and use it,”
If critical decisions affecting human life—such as hiring, lending, crime prediction, and welfare—are processed in an opaque black box, people will lose their fundamental right to explain their context or appeal against the machine's algorithmic verdicts
This quote is from 1903. Times haven't changed that much:
> Not a handful of rich people, but all the working people must enjoy the fruits of their common labour. Machines and other improvements must serve to ease the work of all and not to enable a few to grow rich at the expense of millions and tens of millions of people.
The overarching message is that builders should deeply consider the impact of what they're building on civilization.
"Technology is never neutral, because it takes on the characteristics of those who devise, finance, regulate and use it."
Therefore builders "bear a particular ethical and spiritual responsibility" because "every design choice reflects a vision of humanity."
The questions shouldn't just be 'can we build it?' or 'will people want this?'
We need to also ask 'should we build it?' and 'will this make humanity better?'
The encyclical calls on us to “join forces in building up the common good.”
This is a message we need right now.
> As Pope Francis warned, we must realistically ask ourselves who holds this power today and how they use it: “It must also be recognized that nuclear energy, biotechnology, information technology, knowledge of our own DNA, and many other abilities which we have acquired… have given those with the knowledge, and especially the economic resources to use them, an impressive dominance over the whole of humanity and the entire world.” [7] In the past, it was largely up to the State to guide and direct innovation. Today, however, the main drivers of development are private, often transnational, parties that are endowed with resources and the capacity to intervene that surpass those of many Governments. Technological power thus takes on an unprecedented, predominantly “private” aspect, which makes it even more challenging to discern, govern and direct such power toward the common good.
I look forward to reading this in detail. As I get older (and perhaps as AI has allowed me to spend more time thinking and less time doing) I've found myself thinking more and more about what it means to live a virtuous life and about ethics and morality and so forth. I don't have any answers (and I'm not looking for them, really, just musing) but I do find it very interesting to read and learn from and about those whose job it is to think about the answer to those questions.
Yes it's a very dangerous concentration of power. But I don't believe strong words or proposing regulation by just another elite would change much.
Please join/help open source groups doing small + local or distributed models. There's a lot to do. Support truly open source companies.
Let's walk the walk.
I have only skimmed it, will definitely read carefully as soon as I have time. I will say, as an atheist, that regarding technology the Vatican has some of the best takes of any institution/government I have ever seen.
The answer is sortition a.k.a. democracy by lot. From my subjective understanding it is The only institutional democracy variant that puts a firewall between money and power.
In the encyclical, the pope talks about the ethics of responsible AI usage. It's pretty dense material, but if I had to summarize it, I'd boil it down to three general moral laws:
1) AI may not be used to injure a human being or, through inaction, allow a human being to come to harm.
2) AI must faithfully follow the directions of human beings except where such orders would conflict with the first law.
3) AI's existence and availability should be protected as long as such protection does not conflict with the first or second laws.
Divided into five chapters, Magnifica humanitas has an underlying premise: technology is not “a force antagonistic to humanity” (4), nor is it “inherently evil” (9). However, “technology is never neutral, because it takes on the characteristics of those who devise, finance, regulate, and use it.
Therefore, Pope Leo XIV appeals for people to build “for the common good” and to “remain human,” following a courageous mentality of shared responsibility and communion, so that the world “will come to recognize the human heart as the place where God desires to dwell” (16).
I didn't see an EPUB, so I made one from the Vatican HTML: TOC + footnotes, passes epubcheck.
https://github.com/n2ctech/magnifica-humanitas-epub/releases...
we should import it as a POPE.md skill and see if it meaningfully alters reasoning and results.
AI tends to amplify the power of those who already possess economic resources, expertise and access to data
I’d bet the other way: You could have said exactly the same thing about computing 60 years ago, when IBM systems cost millions of dollars and filled whole rooms. And of course many people did.
Personal, commodity access to compute won, and won so thoroughly that it enabled this wave of scary compute centralization.
Centralized, scaled compute will always fill a purpose. But neither Microsoft, nor Facebook, nor OpenAI started out needing “Cloud Scale”.
The first one man unicorn startup will, I’m fairly certain, not be paying Anthropic per month or per token for the vast bulk of their matmul.
I am confused with the church's stand on this. If it is a genuine moment in time that the created begin to create on their own accord, then why not promote the distribution of these ai creations to us, so we can boost our productivity and carry on for another millenia or two. Or is it that this creation truly gives us independence from church, state, and consumerism? and that frightens them? Remember that there are 3 main powers in the world, political, religious and consumerism. CHina is aggressively pursuing humanoid droids. I can't wait to have one droiding(manning) my homestead. The task of animal husbandry, aquaponics, etc, will be childsplay then.
I know lots of people are excited because an ancient institution has something to say about AI.... But what's said is not really novel or even interesting.
The letter aims to maintain the status quo of the project of the Church.
The world is shifting under the Vatican's feet and the crappy system they once lorded over is done.
It's time for change, maybe people don't need to work anymore and maybe people should aim to reengineer humanity and eliminate illness, old age, suffering and vulnerability. We can fundamentally change how society distributes wealth.
Some of the arguments are rich coming from the Church: being scolded about centralization of power, claiming truth and shared information is a common good, and consider the history of the Church in their anti-war declarations.
The most astonishing thing in this letter is the pope declaring that modern technology has rendered Aquinas's just-war theory out of date.
> We are also witnessing a disconcerting loss of historical memory, as first-hand accounts of the Holocaust and the two World Wars are disappearing. This leads to a selective or distorted rewriting of the past, in a context where fake news and the manipulation of narratives obscure the lessons that have been learned. Without a living memory of the horrors of war, political decisions risk being made on the basis of power alone, without any consideration for the long-term consequences.
Very true. Observed in Hiroshima as well.
Education in the United States especially is highly sanitized when it comes to the dropping of the atomic bombs and the horrors of the Holocaust.
This is a surprisingly nuanced and technically literate take on this topic. Kudos.
I wonder if this sort of thing got this dude elected, to navigate the changing times.
Love this: building for the common good means accepting the limits and weakness of humanity without considering them an error to be corrected. Today, the human desire for fullness of life is at risk of being misled by deceitful goals, such as the prospect of a technology that promises to free us from all weakness, and models of wellbeing that leave behind entire populations. All too often, we place our hope in unlimited “upgrades,” in forms of progress that exacerbate inequalities, and in immediate solutions incapable of healing people’s wounds. As a result, while some pursue the illusion of unlimited self-assertion, many are deprived of basic necessities.
Overview article: https://www.vaticannews.va/en/pope/news/2026-05/pope-leo-xiv...
My secular take: "we want Star Trek, not Philip K. Dick, future".
Here is an easier to read version, in clean markdown: https://github.com/cucho/magnifica-humanitas/blob/master/mar...
NUMBERED PARAGRAPHS, YESSSS! Seriously, once page numbers have become optional, electronic editions of books (monographs, essays, and academic texts) need to number the paragraphs so we can keep references working. I’m fed up with referencing the entire text or specific chapters.
Interestingly, the invention of the printing press, a clear analogous technology to AI, was directly linked to the schism and creation of the protestant and reformation movement and bloody religious wars. So the Catholic church knows what it is talking about here!
Interestingly, the Latin version of the encyclica is yet to be released at the moment
Cue Pieter Thiel explaining how this message of compassion is actually the word of the ant-christ while setting his software (maybe "built in Rust !) to all the earthly empires.
AI must be “disarmed” in order to free it from the mentality of military, economic, and cognitive competition. “To disarm means discrediting the assumption that technical power automatically confers the right to govern,” he says. “To disarm does not mean rejecting technology, but preventing it from dominating humanity” (110). He devotes ample space to a critique of transhumanism and posthumanism, which interpret progress as the overcoming of human limits. Instead, limitations are not defects to be eliminated, but a constitutive dimension of the human person, because it is in fragility and finitude that relationship and openness to God and to others mature. He says we must remember that “humanity flourishes not despite limitations, but often through them” (118).
Pursuing technological innovation at the expense of eliminating human limitations, he says, would cause an anthropological regression. “Humanity—in all its grandeur and woundedness—must never be replaced or surpassed,” he says. Technology can alleviate humanity’s sufferings and open new possibilities, but it must not deny the essence of humanity, which is our “capacity for relationship and love” (126). In the face of AI, says the Pope, “the true alternative is not between enthusiasm and fear, but between two paths of development: a progress that serves individuals and peoples, or a progress that subjects them to the mentality of power” (129).
> “Disarming AI means freeing it from the mentality of ‘armed’ competition, which today is not limited simply to the military context, but is also an economic and cognitive phenomenon”
This is very on-point: capitalism-driven AI development as we have it today will always turn against the common good due to it's singular profit-motive.
What a time: the pope having a much clearer picture of the risks & dangers of 'AI' than most people, many 'tech leaders' and certainly most politicians.
I wonder how many people read and heed the words of the Pope. I've seen letters like these for years now which sound good but I don't see any change in people after having read them.
And of course the AI salesforce was there pretending they take stuff seriously, maybe even believing it themselves. At least I don't believe that when the choice is maximizing profit or being a good person it will be the latter. Or at least I don't find a career path like that all too likely.
The message here obviously comes from a good place. But it can't escape the trap baked into its own theology. Putting humanity one rung below God, with everything else below us is a trick that allowed semitic civilizations to make empires and economies go FOOM faster than the rest of the world. But it also makes things more dangerous when we start building systems smarter than we are.
What happens when the tool outgrows the toolmaker?
As an atheist I have an obligation to finish reading it all (still going through, and taking notes, probably having to revisit), but I am not sure how many (christian) believers will feel the same.
The paragraphs about making software transparent and collectively sound really similar to the open source ethos.
This is a magnificent work. The thoughts and words are so precise and beautiful.
Excited to read this. I really liked the note "Antiqua et Nova" from last year (still under Pope Francis). The autors showed a deep understanding of AI that many secular commentators lack. They developed the concept of integrated intelligence as opposed to the functional, reductivist view of intelligence that is prevalent in the AI community.
This is history in the making. We're living in an evil time - bad people are stealing from humanity, using conflict to distract, and acquiring personal power out of greed. This will be one of the greatest moments in the papacy, and I expect if there are people around to read it, it will be talked about in a thousand years.
I liked the previous Pope better, but I can't say this one is wrong about this.
I'm as happy we have a non-crazy pope as the next liberal, but as someone who isn't religious I think it's very important to be skeptical of any opinion given by a religious leader. As such, they've declared they are rejecting the best tools for understanding humanity, culture, and the physical world, and have deeply compromised judgement.
I’m sure a similar epistle long ago argued that Swordsmiths must ensure that their products are only used for justifiable self-defense.
I’d be thrilled if religion was only used to uplift people but that’s not going to happen either
I read as long as my attention span would allow because this is a very long text.
I am curious, what is the view of different religions on conversing with something that is not human like a chatbot?
Pope Leo: Do Not Build The Torment Nexus
Techbros (as usual): how dare you suggest I'm a bad person for wanting to kill everyone in order to build the torment nexus? Don't you know how much money Jeff Bezos has?
> In this regard, Saint John Paul II stated that the Universal Declaration of Human Rights, proclaimed by the United Nations on 10 December 1948, remains one of the highest expressions of the human conscience of our time.
Interesting, considering that the U.N. has its roots established in the ideology of Luciferians. [1][2][3]
Surely the Pope and the Vatican are both aware of this fact.
[1] https://archive.is/D27Jr [2] https://en.wikipedia.org/wiki/Lucis_Trust [3] https://en.wikipedia.org/wiki/Theosophical_mysticism
More thoughtful analysis of AI and society than anything this far
for me the most important point in this is about how ai and tech in general concentrates power. if we want to build something good (in a moral sense) we need to put in work and make sure as many people as possible can use it with equal access.
this basically implies only open source models can be ethical but open source is not sufficient, you also need to make them give true information and avoid all kinds of harmful behavior. thats kind of a problem because if your weights are public even with a strict license a "bad" user can always fine tune it to remove any guardrails.
i think the solution for this is make sure the default behavior is aligned but let users turn on wild mode with zero censorship/refusals. that way everything is opt in, for example a parent can disable the mode for their children but a hacktivist or diy chemist can unlock everything.
as a self described good person i believe theres a lot more good people than bad people in the world (most are neutral) so if access to tech is equal the good side always wins. the problem here is again that access is not equal under capitalism. but thats a political thign not a tech one.
I like how the pope is emerging as a sort of champion of human rights in the face of AI, when the messaging coming from our politicians and corporate overlords is "you're all going to be replaced, make way for the data centers, peons". I stand with the pope.
The em-dashes present within the writing made me pause and consider how much of this was written/exited by AI.
Quick browse through pre-AI works from John Paul II show em-dashes present.
It would be better on the original latin.
it's a shame that the vatican didn't bother asking whether or not the crusades would make humanity better before causing the death of 9 million plus people.
..or whether or not hiding all those pedophiles was the right.
and to be clear ; i'm not equating AI to those things -- i'm saying that I don't care about the opinion of a group with such a sordid history regardless of how shined up the PR is now.
> a uniformity that eliminated diversity and that chose homogenization over communion
Unrelated to AI, but a wonderful support of the breadth of humanity in this anti-DEI time.
> We must, then, avoid the “Babel syndrome,” namely the idolatry of profit that sacrifices the weak, a uniformity that neutralizes differences, and the pretense that a single language — even a digital one — can translate everything, including the mystery of the person, into data and performance.
There is a lot to read here. I am curious where the meditations on the 'mystery of the person' will go: a brief search doesn't show further mention. The encyclical appears to focus on exhortations for us, humans, than on the nature of AI. Probably wise at this stage. I feel it is not AI that is either positive or negative, but its use of it, and the call-out to the growth of private industry as more powerful among nation-states is a strong statement for a institute like the Vatican to make:
> Technological power thus takes on an unprecedented, predominantly “private” aspect, which makes it even more challenging to discern, govern and direct such power toward the common good.