MMShopBench: A Real-Log Benchmark for Multimodal, Multi-Turn Shopping Agents
arXiv cs.AIen
arXiv:2607.29002v1 Announce Type: new Abstract: Online shoppers increasingly turn to AI shopping assistants, using images and multi-turn dialogue to express and refine product needs that are difficult to articulate in text alone. However, existing benchmarks largely rely on text-only or synthetic requests, underrepresenting complex real-world shopping requirements jointly expressed through images and language. We introduce MMShopBench, the first real-log benchmark for multimodal, multi-turn shopping agents. Built from carefully cleaned and manually annotated shopping logs, MMShopBench provides ground-truth annotations of each request's purchase intent and mandatory product requirements. Agen
This is a short summary published by AI Global Wire. The full article is owned and hosted by arXiv cs.AI — open it there to read it in full.
Read the full story at arXiv cs.AI- Forskning
- Agenter
- Bild
Related AI news
- An Ontology-Guided, Deduplication-Aware Extraction Layer for Knowledge Graph Construction from Heterogeneous DocumentsarXiv cs.AI · August 3, 2026
- EarlyDx: An Admission-Anchored Benchmark for Open-Ended Generation of Evidence-Supported ED-Encounter DiagnosesarXiv cs.AI · August 3, 2026
- LLM Framework for Discovering Major Mathematical Conjectures: AI's Quest for the Next Riemann HypothesisarXiv cs.AI · August 3, 2026
- Library Reachability in LSR-Synth: How Anti-Memorization Design Changes the Measurement of Symbolic DiscoveryarXiv cs.AI · August 3, 2026
- On the Generalization of Steering Vectors for Chain-of-Thought FaithfulnessarXiv cs.AI · August 3, 2026
- CAGE: Certified Authorization under Typed-Return Uncertainty for Tool-Using AgentsarXiv cs.AI · August 3, 2026