Princeton Researcher Proposes Recurrent Looped Transformer That Fixes 96 Blocks Per Token with Unbounded Temporal Depth

A Princeton researcher has proposed the Recurrent Looped Transformer (RLT), a novel architecture that carries decoder state across every token by executing 96 transformer blocks per token step and maintaining temporal depth that is theoretically unbounded. Unlike standard transformers that process tokens with a fixed forward pass, RLT loops the decoder state, enabling the model to accumulate and refine reasoning across time steps in a way that standard architectures structurally cannot. This has direct implications for tasks requiring sustained reasoning, long-horizon planning, or stateful computation — areas where current autoregressive transformers frequently degrade. For researchers and architects evaluating next-generation model designs, RLT offers a concrete alternative to simply scaling parameter count or context window length. Developers working on reasoning-heavy applications should watch whether this approach demonstrates practical efficiency gains in downstream benchmarks.