Large language models show systematic failures in incorporating evolving medical knowledge
arXiv cs.AIen
arXiv:2610.30631v1 Announce Type: new Abstract: Medical knowledge evolves as clinical guidelines revise recommendations, yet whether large language models (LLMs) faithfully incorporate such changes remains unclear. We introduce ChronoEvo, comprising 1,709 recommendation-level revisions across 12 forms of medical knowledge change, to distinguish recognition of revised guidance from incorporation into clinical recommendations. In the primary model, 90.8% of responses recognized revisions and 80.2% were clinically correct, but only 58.5% fully incorporated guidance, yielding a 32.3-percentage-point recognition-incorporation gap. This dissociation persisted across 14 models and was corroborated
This is a short summary published by AI Global Wire. The full article is owned and hosted by arXiv cs.AI — open it there to read it in full.
Read the full story at arXiv cs.AI- Forskning
Related AI news
- RoleFlow: Self-Evolving Multi-Role Agentic Collaboration via Structural AdaptationarXiv cs.AI · October 23, 2026
- Soft Ontology Priors over Latent Concept Posteriors for Weakly Supervised Neuro-Symbolic LearningarXiv cs.AI · October 23, 2026
- When Stable and Preferred Semantics Agree: A Path-Based ApproacharXiv cs.AI · October 23, 2026
- Route-and-Generate: KL-Regularized Router Improvement for Reasoning Routing in LLMsarXiv cs.AI · October 23, 2026
- Diagnosing Personalization Failures in Mobile GUI AgentsarXiv cs.AI · October 23, 2026
- Better Reasoning, Not Just Bigger Models: A Structure-Grounded Framework for Efficient and Reliable InferencearXiv cs.AI · October 23, 2026