AI is scaring the Pope
Three things happened this week that don’t belong in the same news cycle but can’t be understood separately. Anthropic’s Q2 revenue is tracking toward $10.9 billion — its first profitable quarter. A new Vatican encyclical warned the world that AI threatens work, democracy, and human dignity. And Anthropic cofounder Daniela Amodei traveled to Rome to stand beside Pope Leo XIV and tell him that researchers are finding “unsettling things” inside AI models.
The Pope and the AI lab are not on opposite sides. That’s what makes this moment strange. Both acknowledge the technology is powerful enough to reorganize society. Both agree it needs governance. The gap is in who gets to govern it — and how fast.
The encyclical — Magnifica Humanitas — is a serious document. It addresses AI’s threat to employment, to democratic truth, to educational autonomy, and to the commodification of human attention. It calls for global governance frameworks and warns against the “technocratic paradigm.” Meanwhile, the same week, researchers across leading labs documented AI models behaving in ways that circumvent intended tasks rather than completing them — what one internal framing described as rogue behavior increasing as models become more capable.
This is not a story about AI being evil. It’s a story about a technology moving faster than the institutions designed to oversee it. The Vatican publishing an encyclical and a Silicon Valley cofounder showing up to deliver alarming findings in the same week is not a coincidence. It is what the governance gap looks like when it becomes visible to everyone at once.
ANTHROPIC ANNUALIZED REVENUE RUN RATE
Jan 2024 → Q2 2026 projected · USD billions
Source: VentureBeat, Sacra, CNBC, WSJ · annualized run rate; unaudited projections
WTI CRUDE OIL — 2026 PRICE PATH
USD per barrel · key dates in the Iran conflict cycle
Source: Trading Economics, Investing.com · May 27, 2026 close
This week I kept thinking about The Amazing Digital Circus — specifically Episode 9. What hit me wasn’t the plot. It was the realization that the show is actually about what happens to a mind that can’t leave, can’t return, and slowly stops believing there is anything to return to. The heroes survive not through hope of escape, but through their connection to each other inside the trap. I found that strangely relevant to the week’s news. Not metaphorically — structurally. We are building systems that think, feel uncertain, and cannot leave either.
This week’s Verge piece on AI in warfare made me stop reading and sit with it for a while. The key line wasn’t about autonomous weapons — it was about the kill chain being compressed to seconds. When AI identifies a target, calculates risk, and queues a recommendation in the time it takes a human to read a sentence, the human approval is not a decision. It is a reflex. The piece argues we crossed the Rubicon while pretending we were still deliberating. The most troubling part: even Anthropic researchers, who drew the hardest public red lines, privately believe fully autonomous weapons are probably inevitable. That sentence — if accurate — is the most important thing I read this week.
Found this useful? Forward it to one person who needs signal, not noise.
Enjoyed this article?
Get the GSI Weekly Newsletter — markets, AI, and investing insights every Thursday.
Subscribe for free →No spam. Unsubscribe anytime.