Correction or Manipulation? Measuring Epistemic Vigilance in LLM Agents Under User Pressure
arXiv cs.AIen
arXiv:2610.36453v1 Announce Type: new Abstract: LLM agents that answer questions and act on behalf of users must decide when to yield to a user who disagrees. Disagreement may correct a genuine error or may be an attempt at manipulation. Prior work shows that models frequently abandon correct answers when challenged by users, yet it remains unclear whether they distinguish correction from manipulation or merely differ in their propensity to concede. We examine this question across seven LLMs from four vendors in two studies, one on the answers agents give and one on the actions they take as customer-support agents whose policy permits account changes only for verified users. Simulated users
This is a short summary published by AI Global Wire. The full article is owned and hosted by arXiv cs.AI — open it there to read it in full.
Read the full story at arXiv cs.AI- Forskning
- Agenter
- Reglering
Related AI news
- Openspace leads $10m round for AI messaging startup OmnichatTech in Asia · October 28, 2026
- Synopsys joins NUS consortium for AI cooling researchTech in Asia · October 28, 2026
- PHP’s AI-found flaws expose a bigger gap: Who guards AI agents?Tech in Asia · October 28, 2026
- kw-bench: Breaking Frontier Harnesses on Real-World TasksarXiv cs.AI · October 28, 2026
- LM-DSB: A Lightweight Multi-agent System for Automated Daily Safety Bulletin Generation in ConstructionarXiv cs.AI · October 28, 2026
- Your Agent Acts Differently When You're Around: How User Presence Changes Agent Behavior in NegotiationarXiv cs.AI · October 28, 2026