The Communication Bottleneck: A Round-Trip Study of Tree-Structured Expression Serialization in Language Models
arXiv cs.AIen
arXiv cs.AI
AI Global WirearXiv:2609.21509v1 Announce Type: new Abstract: When language models reason in chain-of-thought or exchange free-text intermediates, they serialize structured information into natural language. How much tree-structured compositional content survives this bottleneck? We propose a round-trip protocol that answers this question empirically for tree-structured expressions. A generator converts a procedurally generated arithmetic expression into a word problem, a separate extractor recovers the expression from the word problem alone, and symbolic equivalence provides an exact oracle. Evaluating all pairwise combinations of sixteen models yields a communication matrix whose marginals separate gene
This is a short summary published by AI Global Wire. The full article is owned and hosted by arXiv cs.AI — open it there to read it in full.
Read the full story at arXiv cs.AI- Forskning
Related AI news
- A researcher used GPT-6 Astra to decipher a WWI German radio transmission from 1918, one of the 50 famous unsolved ciphers listed on a German science blog (prinz)Techmeme · September 21, 2026
- DENSE: Distilling Agent Trajectories into Evidence-Grounded Shortcut Trees for Self-RefinementarXiv cs.AI · September 21, 2026
- GVPO++: Group Variance Policy Optimization for LLM Post-Training and On-Policy DistillationarXiv cs.AI · September 21, 2026
- Driving on Registers, Reasoning on Risk: Risk-Aware Occupancy for Register-Based End-to-End Autonomous DrivingarXiv cs.AI · September 21, 2026
- RBS-Attention: Radius-Bounded Sparse Prefill for Long-Context Large Language ModelsarXiv cs.AI · September 21, 2026
- Decoupling Internal Representational Changes and Causal Importance in Fine-Tuned Large Language ModelsarXiv cs.AI · September 21, 2026