Amazon says human-in-the-loop AI oversight is failing because humans stop paying attention

General News

Summary

Amazon security leadership is questioning whether human-in-the-loop AI oversight can scale safely for agentic systems. The article argues that repeated manual review leads to normalization of deviance and alarm fatigue, which reduces human attention over time. Amazon instead favors end-to-end accountability, layered policy controls, and agent identity tracking to manage AI actions. The piece also notes that Google, Microsoft, and IBM are taking related but different approaches to AI governance and security. This creates a broader market focus on tools and frameworks for AI access control, auditability, and policy enforcement.

Classifications

industries
Entertainment
applications
Accounting and Taxes

AskAI Classifications

Labels
SaaS Identity and Access Management Cybersecurity Software

Linked Companies

1Password
$250M to $500M
IBM
$1B+
Amazon
$1B+
Google LLC
$100M to $250M
Microsoft
$1B+
Apono
$1M to $5M