The hidden cost of calling your AI agent an employee

Each participant received five documents containing built-in errors and 20 minutes to review them. Only one detail changed across the three groups. One set of managers was told an AI tool they used had produced the work. Another was told an AI employee named ALEX-3, a direct report, had done it. A third was told a human employee named Alex, also a direct report, had written it.

Wiles explains why that label might matter with a comparison.

“If you think of AI as a tool, like a spreadsheet, and there’s a mistake you make in it, you think, oh man, I made a mistake,” Wiles said. “But if you were to start calling your spreadsheet Steve, then at some point you might be convinced that Steve made a mistake, as opposed to you were working with this tool and you made a mistake.”

Why the label changes behavior

Did giving an AI a job title actually change anything? For most managers, barely. But among the roughly 23% whose organizations already list AI agents on their org charts, it changed quite a bit. The AI employee framing reduced their error detection by about 16% compared with the AI tool framing, according to the paper. Only the human employee group got the careful scrutiny you’d expect.

“I think that framing them as an employee sort of changes their mode of operation where they’re no longer thinking, ‘I’m working with a tool,’ they’re thinking, ‘I’m delegating to an employee,'” she said.