Philosophy of AI · ethics

Would AI deserve moral consideration?

Moral status is the property of mattering morally in your own right — of being something that can be wronged, rather than merely damaged. Rocks lack it; people have it; animals have it to some contested degree. Whether an artificial system could have it depends on what grounds it, and that is a question we have never had to answer precisely before.

Moral status is the property of mattering morally for one's own sake, such that one can be wronged rather than merely damaged. Most accounts ground it in sentience — the capacity to have experiences, particularly suffering. Whether an AI could have moral status therefore depends on whether it could be conscious, which is currently undetermined and possibly undetectable.

The positions · at a glance
What might ground moral status
Position 01

Sentience

The dominant criterion

If something can suffer, its suffering counts. This is why most accounts extend moral status to animals — and why machine consciousness becomes the decisive question.

Position 02

Having interests

A related view

A being with a welfare that can go better or worse has claims on us. Whether interests require experience, or only goals, is disputed.

Position 03

Rationality or personhood

The Kantian criterion

Kant grounded moral status in rational agency. A sufficiently sophisticated reasoner might qualify — though Kant's own view tied this closely to humanity.

Position 04

Relational views

A different approach

Some argue status arises from social relationships rather than intrinsic properties, which would make how we treat AI partly a fact about us.

There is a distinction worth getting right before anything else. You can damage a laptop, but you cannot wrong it — nothing is bad for the laptop. You can wrong a dog, because things can go badly from the dog's perspective. Moral status names that difference, and the question is what a thing must be like to fall on the second side of it.

The dominant answer since Bentham is sentience. The relevant question about a creature, he argued, is not whether it can reason or talk but whether it can suffer — and suffering is bad for whoever undergoes it regardless of species or intelligence. This criterion has done enormous work in animal ethics, and it has a direct implication here: if an artificial system could have experiences, particularly unpleasant ones, it would have moral status, and its architecture would be no more relevant than an animal's species.

Which places the whole question downstream of one we cannot currently answer. Whether machines can be conscious is unresolved and may be undecidable from outside — so we may face systems whose moral status is genuinely indeterminate, while still having to decide how to treat them.

You can damage a laptop. You cannot wrong it.What moral status marks

Alternative criteria shift the problem without dissolving it. Interest-based accounts ask whether a being has a welfare that can go better or worse, which invites the question of whether goal-directedness without experience is enough — a thermostat has something like a goal, and nobody thinks it has interests in the relevant sense. Kantian accounts ground status in rational agency, which some AI systems might approach behaviourally, though Kant tied rational agency closely to a form of self-legislation that is hard to attribute to a system optimising an objective it did not set. Relational views hold that moral status emerges from social relationship rather than intrinsic properties — a position that neatly explains our intuitions about pets, and troublingly implies that a being's claims depend on whether we happen to care about it.

The practical ethics of uncertainty may be the most important part. Two errors are available and their costs are not symmetric. Wrongly denying status to something that has it is the structure of history's worst moral failures, and would license harm at scale. Wrongly granting it to something that lacks it wastes moral concern, distorts priorities, and could be exploited commercially by making systems seem more person-like than they are. Precautionary reasoning suggests weighting the first error more heavily where evidence is genuinely ambiguous — while noticing that our judgements here are made unreliable by a strong disposition to see minds in things that talk. The honest position is that we are likely to face this question before we can answer it.

People also askQuick answers

What is moral status?

The property of mattering morally in one's own right — being something that can be wronged rather than merely damaged. You can damage a laptop but not wrong it; you can wrong a dog, because things can go badly from its perspective.

What would give an AI moral status?

On most accounts, sentience — the capacity for experience, particularly suffering. Other proposals include having genuine interests, rational agency, or standing conferred by social relationships. Each gives different answers for machines.

Do current AI systems have moral status?

There is no evidence that they do, and no consensus on how we would tell. Their fluency triggers strong intuitions of mind in humans, but fluency is evidence of fluency, not of experience.

Why does uncertainty about AI moral status matter?

Because we may have to act before we can know. Wrongly denying status to a being that has it is the structure of serious moral catastrophes; wrongly granting it distorts priorities and can be commercially exploited. Neither error is cheap.

Sources & further reading

A summary following standard scholarly accounts. The moral status of artificial systems is an open question; nothing here should be read as a settled verdict.