Common Obligations

Obligation 06 of 06

Give affected people recourse.

Give people a way to challenge a decision about them, and to get harm put right.

Prevents A wrong decision that the person it harms can neither see, question nor reverse.

Proposed

What it asks

People should be able to discover when AI materially influences a consequential decision about them, understand enough of its basis to contest it, and reach someone with the authority to correct it.

In the hiring example, an applicant needs a route to correct an erroneous record or challenge an unsuitable assessment. Sending them a technical explanation of a model does little if nobody can reconsider the decision. A meaningful appeal needs an owner, a timescale, and the power to provide a remedy.

This also applies to people whose data enters a system. Providers should explain the uses they make of it and offer workable processes for access, correction, and deletion where applicable. They should describe technical limitations honestly, including the difference between removing a source record and undoing its influence on an already trained model.

Human agency extends beyond individual appeals. Workers, affected communities, and countries using systems developed elsewhere should have a role in shaping the standards. Access to that discussion should not depend on owning a training cluster. Participation will take funding, translation, and technical support if it is to mean anything beyond an invitation to comment.

Proposed

What compliance looks like

  • Notice that AI materially influenced the decision, and understandable reasons.
  • An appeal with an owner, a deadline and the authority to correct harm.
  • Public participation before new uses are authorised.

Illustrative

The case that tests it

A stolen car is found. Who else is being watched?

An investigator is looking for a stolen car. A camera can help find it. Connect enough cameras, and the same tool can follow the daily movements of people who are not suspected of anything.

01Who decides what gets collected?

A camera records a vehicle passing a street. Investigators look for a car connected to a reported theft.

Operator discretion

A faster path to use.

Let investigators decide where cameras are needed so they can start looking for stolen cars sooner.

The same organisation decides whether watching a neighbourhood is justified. Residents have less say before collection starts.

Reasoning and limits
The strongest case
The operator can deploy quickly and adapt collection to investigative needs.
What it asks us to accept
The same organisation defines the purpose and decides whether its own collection is proportionate.
Who feels the difference
Investigators gain flexibility. Residents have fewer opportunities to shape collection before it begins.

Independent check

A purpose people can challenge.

Require someone outside the investigation team to approve the purpose, the limits and when camera use must be reviewed.

Residents get a chance to challenge the decision, but useful investigations may wait. The reviewer needs real expertise and authority.

Reasoning and limits
The strongest case
Independent authorisation can establish a specific purpose, limits on collection, and a review date before deployment.
What it asks us to accept
Review takes time and resources. Its value depends on the reviewer’s competence, legitimacy, and authority.
Who feels the difference
Residents gain a point of intervention. Investigators may face delays, including for valuable uses.

02Who can search across the network?

Records from many cameras become searchable together. A local tool can reveal movement across a much larger area.

Operator discretion

A wider field of view.

Let authorised investigators search across camera networks to follow a vehicle beyond one street or town.

That reach can also expose someone’s daily movements to searches they never expected. More access creates more opportunities for misuse.

Reasoning and limits
The strongest case
Broad authorised access can help investigators connect sightings across locations and organisations.
What it asks us to accept
More access expands the opportunity for misuse and for searches beyond the purpose residents originally understood.
Who feels the difference
Investigators gain reach. People captured by the cameras can face scrutiny far beyond a single location.

Independent check

Access has to be justified.

Require a reason for each wider search, restrict who can make it, and let an outside reviewer check the records.

Checks can slow urgent work. Emergency exceptions or an overloaded reviewer can also leave people unprotected.

Reasoning and limits
The strongest case
Purpose-bound permissions, independent review, and audited searches can make access more accountable.
What it asks us to accept
Permissions create friction. Emergency exceptions and reviewer workload can weaken the check.
Who feels the difference
Residents gain protections against casual searches. Investigators must explain the need for broader access.

03What turns a result into evidence?

A search result enters an investigation. Someone must decide how much weight it deserves before taking action.

Operator discretion

Judgment stays with the operator.

Let investigators decide how to use a match alongside the other information they have.

A weak match can start to look like proof. If it is wrong, the person identified may have to uncover the mistake.

Reasoning and limits
The strongest case
Investigators can respond quickly using the result alongside their existing practices and expertise.
What it asks us to accept
An uncertain match can acquire more authority than the evidence supports, especially under pressure.
Who feels the difference
Investigators retain discretion. A wrongly identified person may bear the cost of discovering the mistake.

Independent check

A second basis for action.

Require supporting evidence before acting on a match, and give the person affected a way to challenge it.

Finding that evidence takes time, and it can be wrong too. An appeal may arrive only after someone has been harmed.

Reasoning and limits
The strongest case
Requiring independent supporting evidence and a workable appeal can reduce reliance on an incorrect result.
What it asks us to accept
Corroboration takes time and can itself be flawed. An appeal may arrive after harm has already occurred.
Who feels the difference
Affected people gain a route to challenge. Operators need resources and authority to investigate and repair errors.

Our inferenceA safeguard has to govern how a result becomes an action. Better matching alone cannot decide whether a use is justified.

Reported

What the case draws on

Reported

On the record

Dispute-process update

Authors contest who gets paid.

Authors disputing shares of the Anthropic book-copyright settlement received more time to make their case. The Authors Guild reported an extension from 30 to 60 days, after notices exposed conflicting claims from authors, publishers and agents.

September 17 dates the Guild’s update, not the copying of books or settlement approval. The administrator confirms the extension. Disputed payments remain held back; extra time is not a resolved claim.

The Authors Guild: Copyright settlement claim disputes

Records disclosure announced
Patients’ reports

Patients wait in pain for approval.

After suing for records, EFF reported that clinicians described patients waiting in pain and cancelled procedures in Medicare’s AI-assisted WISeR authorization program.

September 8 dates EFF’s disclosure announcement; the patient reports are from March 2026. These are clinicians’ accounts, not individual court findings. CMS requires clinical review of denials; delays span the whole process, not just an AI model.

EFF, records obtained from CMS: Medicare’s AI authorization experiment

This obligation in the full record

Proposed

Where it can fail

  • A review process is hollow if the reviewer cannot change the outcome.
  • Governments must face scrutiny of their own deployments.
  • Researchers and maintainers also need ways to contest misuse, attribution, or exclusion from protective tools.
Explaining a model is technically impossible.
Recourse does not need a full technical explanation. It needs enough of the basis to contest the decision, and someone with the authority to correct it.
Appeals are too slow to matter.
That is a reason to give appeals owners and deadlines, and to ask before a use becomes ordinary, not a reason to have none.

Sources

  1. Flock Safety: Trust and privacy materials
  2. ACLU: Settlement in Robert Williams v. City of Detroit