← Field Notes
OCT 14 · Paper · via arXiv Confidence SignalingHuman HandoffReview

Expertise shapes how far workers trust and delegate to AI

Experts caught errors; novices did not. The difference was review behavior, not trust. A screen that makes scrutiny feel optional skips the most important moment in the interaction.

Machine summary of the source

A controlled think-aloud study examined how expertise and trust shape the way workers pass work to an AI assistant. Novices accepted AI output with little scrutiny. Experts checked AI output against their own knowledge and caught more errors before those errors carried forward. The gap matters for product design. A single review screen treats a novice and an expert as if they need the same thing. They do not. The novice needs more signal about where the AI is confident and where it is guessing. The expert needs enough transparency to apply their own judgment fast, without having to reconstruct what the AI did from scratch. The study also found that stated trust and actual behavior diverged. Workers who said they trusted the AI still hesitated before passing over consequential tasks. That hesitation is the moment where a person decides whether the AI's output is good enough to act on. Interfaces that rush past that moment, or that make review feel like friction, leave the worker without the footing they need to catch mistakes.

The summary above is generated; the note at the top is the editorial judgment. Primary source ↗