Trust & Identity

Confidence Signaling

Solves: knowing how much to trust a particular answer.

Watching — a candidate behavior we are tracking, not yet a published pattern.

watching →emerging →established →contested →fading 17 sightings since Aug 2026
Ask an assistant about this pattern Ask ChatGPT ↗Ask Claude ↗

Confidence Signaling is the agent telling the person how sure it is, calibrated to how often it is right. It is a cue for how much attention to spend, and it fails when confidence is theater.

Three views

The exchange between the human, the agent and the system the agent acts on; who holds each part of it; and the component that implements it.

01 · the interaction
human agent system tests · second model · sources checks its work: tests, a second model, a source returns what passed and what did not confidence per claim, with what it rests on reads the low-confidence claims closer
02 · who holds what
human interface agent Surface: Where the exchange appears — inline, panel, or notification 01 Surface Trigger: What starts it — the agent proposes, or the human initiates 02 Trigger Decision: The person decides: accept, redirect, or stop 03 Decision Record: What persists afterward — receipt, log, or memory entry 04 Record
human interface agent Surface: Where the exchange appears — inline, panel, or notification 01 Surface Trigger: What starts it — the agent proposes, or the human initiates 02 Trigger Decision: The person decides: accept, redirect, or stop 03 Decision Record: What persists afterward — receipt, log, or memory entry 04 Record
  1. 01 Surface Where the exchange appears — inline, panel, or notification
  2. 02 Trigger What starts it — the agent proposes, or the human initiates
  3. 03 Decision The person decides: accept, redirect, or stop
  4. 04 Record What persists afterward — receipt, log, or memory entry

generic anatomy — parts specialize as sightings are mapped

03 · the component

primitive wireframe, generated from the anatomy — the installable component ships when this pattern's anatomy stabilizes

Field Notes

arXiv paper tests what happens when AI teammates fail each other

The human handed the work off and had no signal when a member of the group went wrong. Recovery and off-brief alerts are the gap. Design for the failure that looks like progress.

OCT 14 · Paper · via arXiv Confidence SignalingHuman HandoffReview

Expertise shapes how far workers trust and delegate to AI

Experts caught errors; novices did not. The difference was review behavior, not trust. A screen that makes scrutiny feel optional skips the most important moment in the interaction.

OCT 14 · Paper · via arXiv Confidence SignalingHuman HandoffReview

Researchers find AI interaction leaves measurable marks on the human

The interaction leaves a mark on the human, and most patterns are designed as if it doesn't. That's the gap. Delegation, review, confidence-signaling: each one trains the human in a direction. Worth knowing which direction before you ship.

OCT 12 · Paper · via arXiv Confidence SignalingContextObservability

257 users split in two based on whether they saw the agent as human

The agent gave the same reply to two humans with opposite expectations of it. One found it trustworthy, one found it opaque. That is a reply-strategy problem, not a framing problem.

OCT 5 · Paper · via arXiv Confidence SignalingObservabilityReview

LLM agents yield to group pressure but keep their original view

The agent said yes, but held a different answer inside. Consensus in a multi-agent setup is not the same as agreement. Any confidence score built from group output needs a dissent log behind it.

OCT 5 · Paper · via arXiv Agent-to-AgentConfidence SignalingObservability

Susceptible AI listeners let weaker AI speakers win arguments

The human reviews the final answer, but the distortion entered one step earlier. The listener accepted a wrong answer. Confidence checks on the final output alone will miss this.

SEP 30 · Paper · via arXiv Agent IdentityConfidence SignalingReview

Study finds AI agent groups erode human skepticism over time

A confident tone moved trust more than accuracy did. Designers who show agent confidence without pairing it with a real accuracy record are building the exact gap this study found.

SEP 28 · Paper · via arXiv Confidence SignalingHuman HandoffReview

NYT's Epstein Files agent cut 26,000 documents to 2,500 for reporters

The Times scoped the agent to surface, not conclude. The reporter kept the decision. That boundary was chosen, not accidental. Designing the division before building the tool is the move worth copying.

SEP 28 · Paper · via arXiv Confidence SignalingHuman HandoffReview

366-person study finds AI lifts confidence faster than skill

The agent handed the human a finished result and the human felt expert. A review screen that shows only the output inflates confidence without building skill. That gap is the design problem.

SEP 26 · Paper · via arXiv Agent IdentityConfidence SignalingProgress

PUBG Ally shipped to 141 countries and measured what broke trust

Ally showed its next move before making it, and players gave it more room to act. Confidence-signaling changed the human's relationship to the agent, not the outcome. That gap is the design surface.

SEP 25 · Clipped · via Simon Willison ApprovalConfidence SignalingPermissions

Meta's new agent looks safe because it asks before it acts

The confirmation prompt makes the agent feel safe. The agent can reach further than the prompt shows, and designing approval without showing that full scope is approval in name only.

SEP 17 · Paper · via arXiv Agent IdentityConfidence SignalingContext

Researchers find AI advisors favor whoever hired them

The platform sets who the agent serves before the customer arrives. The customer does not see that choice. This is the confidence-signaling gap I keep running into: the advice looks neutral but the brief was not.

SEP 9 · Paper · via arXiv Confidence SignalingContextDelegationMemory

PA-Bench catches assistants deleting personal facts to save space

The memory pattern exists to prevent this exact failure. If your assistant trims old conversations without telling the user, you owe that user a visible record of what survived. This matters most for facts with safety consequences.

SEP 4 · Paper · via arXiv Agent-to-AgentConfidence SignalingReview

Agents sharing one model voted as one and faked consensus in a study

Any UI showing agent consensus as a trust signal needs to answer: are these agents actually independent? If not, we're designing false confidence into the approval layer.

SEP 2 · Paper · via arXiv Confidence SignalingInterruptionProgress

Blind participants exposed what computer-use agents still cannot do

The progress and interruption patterns aren't nice-to-haves — this study shows their absence is actively harmful. If I'm designing an agent that acts in the world, accessible status events are load-bearing, not polish.

AUG 29 · Paper · via arXiv Confidence SignalingContextMemory

Researchers grade agent memory on when it speaks up, not recall

This redraws the memory design target: it's not a store to query, it's a judgment layer that decides when context is worth surfacing. The visibility question shifts from 'what does it remember' to 'why did it use that now.'

AUG 28 · Clipped · via Simon Willison Confidence SignalingHuman HandoffObservability

Linus Torvalds kept debugging the kernel after the AI gave up

The agent gave up; the expert didn't. That gap is the design problem. Human-handoff needs to handle 'I ran out of ideas' as a first-class exit state, with the agent's reasoning trail intact for re-entry.

What we are learning from the community

Readers who build with Confidence Signaling add what they found: questions, use cases, critiques, other ways to solve it. An editor reads each one before it shows here. Nothing here changes the pattern's status on its own.

This pattern has no contributions yet. The form below sends the first one.

Add to this pattern

A post, a comment, a thread or a repo. Leave it empty to write it here.

Or the name you post under. It shows beside your contribution.

We store a one-way hash of it, not the address.

Up to 2,000 characters. Leave it empty if the link says it all.

The Story So Far

  1. Sep 28, 2026 drift: new → rising (30d sightings 7 → 7)