No AI summary available for this article.
Why It Matters
An interactive world model must follow the user's actions, remember the places it has shown, and stream in real time.
Provenance
Discovered via ArXiv and published by ArXiv.
Key Claims
Original description
An interactive world model must follow the user's actions, remember the places it has shown, and stream in real time. The tension is structural: control wants a short horizon, memory wants an unbounded one. ReWorld separates the two during training and bounds them at inference. Mixed per-head attention windows confine most heads to the recent past while a small set of global heads attends over the entire history, and random head routing keeps either capability from binding to particular heads; random chunk dropping makes sparse histories in-distribution. At inference the whole past lives under...
Discovered via ArXiv
Research papers and preprints from arXiv.
Publisher: arxiv.org
ID: http://arxiv.org/abs/2608.23565v1 · Indexed 6 days ago