RLTL;DR: Self-Improvement by Internalizing Self-Generated Feedback

Apple Machine Learningen

Apple Machine Learning

AI Global Wire

The common paradigm of reinforcement learning with verifiable rewards (RLVR) is to let agents make multiple attempts at a task, and optimize towards the successful ones. This becomes problematic in the realms of self-improvement, where tasks are so difficult that the agent has a low or even no chance of success, and where there are no teacher models or example solutions to distill from. In this paper, we introduce RLTL;DR. After each failed attempt, we show the policy the verifier outputs and let it write its own feedback, in the form of a single TL;DR insight. The next rollout is conditioned…

This is a short summary published by AI Global Wire. The full article is owned and hosted by Apple Machine Learning — open it there to read it in full.

Read the full story at Apple Machine Learning
  • Forskning
  • Agenter
  • Reglering

Related AI news