TxnQA: Benchmarking Analytical Reasoning and Evidence Grounding over Transaction Event Sequences
arXiv cs.AIen
arXiv:2610.27256v1 Announce Type: new Abstract: Analyzing merchant transaction histories requires dynamic temporal filtering, entity resolution, and aggregation over irregular event streams--operations poorly captured by static tabular or time-series forecasting benchmarks. We introduce TxnQA, an analytical QA benchmark comprising 27 task families (81 templates) alongside a 5-scenario fraud-risk reasoning suite that evaluates both verdicts and supporting evidence over synthetic, privacy-mitigated transaction data. Ground-truth answers are computed programmatically, and model performance is decomposed into format-following rate (FFR), conditional content accuracy (CA), and end-to-end correctn
This is a short summary published by AI Global Wire. The full article is owned and hosted by arXiv cs.AI — open it there to read it in full.
Read the full story at arXiv cs.AI- Forskning
Related AI news
- MedPAO-Assist: Edge-Deployable, Modality-Aware Agentic AI for Radiology Report StructuringarXiv cs.AI · October 21, 2026
- DataPraxis: Scaling Analytics Tasks via Verified Workspace EvolutionarXiv cs.AI · October 21, 2026
- Fix, Not Just Resample: Bounded Compiler-Guided Repair in Lean 4arXiv cs.AI · October 21, 2026
- LightCRS: Lightweight Multi-Domain Conversational Recommendation SystemarXiv cs.AI · October 21, 2026
- When Planning Problems Become Hard for LLMs: Separating Structural Complexity from Semantic InterpretabilityarXiv cs.AI · October 21, 2026
- SPEM: Structure-Aware Procedural Memory for Efficient Skill Use in LLM AgentsarXiv cs.AI · October 21, 2026