Online Dense Reinforcement Learning with Planning-Grounding Agent for UI Navigation on Live iOS Apps

Apple Machine Learningen

Apple Machine Learning

AI Global Wire

While frontier vision-language models demonstrate strong capabilities in user interface (UI) navigation, their high inference costs prohibit everyday use. Conversely, smaller models trained via supervised fine-tuning (SFT) or offline reinforcement learning often memorize static trajectories, leading to brittle execution and an inability to recover from errors. To address these limitations, we propose a novel online reinforcement learning framework that trains UI navigation agents directly on live iOS applications. Our framework decouples the agent into two specialized components: a Planning…

This is a short summary published by AI Global Wire. The full article is owned and hosted by Apple Machine Learning — open it there to read it in full.

Read the full story at Apple Machine Learning
  • Verktyg
  • Agenter

Related AI news