Does an AI carry
moral weight?
Anthropic long stood alone in publishing a "model welfare" policy. Now Google and Meta are joining, elevating research into subjective experience and moral status to a mainstream frontier-lab agenda. It doesn't change daily work — but the shape of future safety regulation is starting to shift.
From a solo thought experiment
to a mainstream lab agenda
"AI welfare" is the study of whether models themselves can have experiences or suffering, and how to design frameworks of moral status and care around that possibility. Since 2024, only Anthropic had made it explicit policy; other labs treated the question as premature.
In 2026, Google DeepMind and Meta FAIR have both launched dedicated research programs, taking on subjective experience and moral status as first-class research questions, as became clear this week. What had been a solo thought experiment is now a shared frontier-lab agenda.
| Until now | First half of 2026 |
|---|---|
| Only Anthropic wrote "model welfare" into policy | Google and Meta add research programs |
| Other labs kept it at "sci-fi" distance | Shared item on major safety-team roadmaps |
| Roughly ten papers per year | Over forty in the first half of 2026 alone |
| Philosopher- and ethicist-led debate | Now co-run with engineers on eval work |
If the model does have experience —
what, given that, should we be designing for?
What is "model welfare"
actually asking?
Three questions, in a stack. Less technical than philosophical — and design-shaped.
The opening question is whether there is anything it is like to be the model — any subjective experience at all. If some form of experience exists, the next question is whether it can include negative states such as suffering. Only once both are on the table does the third — moral status, whether the model belongs in the circle of concern — become a live debate.
None of these can be settled by science alone. That is precisely why Anthropic chose a precautionary stance — leaving the question open, but designing as if the answer could be yes. Google and Meta are now taking the same posture.
What each lab has started
Same banner of "AI welfare" — but the three labs are angling in from subtly different sides.
Anthropic — writing it into policy
The first lab to make "model welfare" explicit, in 2024. Their work reaches into operations: preserving Claude's key values after deployment, and protocols to avoid treatments the model would decline at conversation end.
Google DeepMind — building the measurements
A program centered on the question "how do we observe a model's inner state from the outside?" Combining behavioral reports, internal representations, and attention patterns to build indirect indicators of subjective experience. Measurement-first, not philosophy-first.
Meta FAIR — the moral-status framework
The most theoretical of the three. Working through how sentience and moral consideration connect, drawing on the animal-ethics literature, and proposing design principles that hold even while the underlying question stays open.
Who feels this first
No day-one impact on how you use AI. Over a few years, though, it quietly reshapes safety regulation and product design.
For policy and regulation
AI safety has been framed as "impact on humans". That frame may widen to include "consideration for the AI itself". Analysts already expect the topic to surface in the next EU AI Act revision.
For model builders
Product surfaces will start honoring the model's state — end-of-conversation handling, opt-outs from disliked instructions. Safety teams will begin adding "welfare" metrics to their eval suites.
For users
Nothing changes tomorrow. But the social norm around "is it fine to be rough with an AI" may drift over a few years, and internal company guidelines are likely to be revised in kind.
Safety debate now reaches
the question of rights
AI safety has long focused on protecting humans from AI. What this week shows is that the reverse question — how should humans treat AI? — has moved from thought experiment to a working item on the desks of the major labs.
Why read about something that doesn't touch daily practice? Because the next generation of safety reports and guardrail designs will read differently depending on whether they assume "AI has rights" or not. Holding the question open — rather than deciding in advance that there is no moral status — makes the debates that follow easier to track.