2025.10.29 - #53 - Unitree 탐방기, From Masks to Worlds: A Hitchhiker's Guide to World Models

[changh95]

[U-AMC]

Unitree 탐방기

[SunandBean]

From Masks to Worlds: A Hitchhiker's Guide to World Models

• 링크: https://arxiv.org/abs/2510.20668

• Figure 1: The evolution of world models across five stage.

• Figure 2: The architecture of a true world model.

• This subsystem, which models state transitions, observations, rewards, and terminations, serves as
  the foundation for the Generation property.

Stage 1: Mask-based models across modalities

• Separate models (specialized architectures

Stage 2: Unified Models

• reduction of fragmentation
• leading to powerful cross-modal transfer
• limited to single-shot synthesis -> lack the capacity for continuous, real-time closed-loop interaction

Stage 3: Interactive generative models

• closed action-perception loop, sustaining interaction through low-latency response and action-conditioned evolution
• language-based, video-based, and scene-based
• hard to sustain long-horizon consistency
• prone to losing context and hallucinating objects

Stage 4: Memory and consistency

• A world model that acts without memory is reactive yet forgetful
• externalized memory
• extending capacity and span
• regulating memory for consistency
• interplay among architecture, scale, and data

Stage 5: Towards true world models

• A true world model is not merely a sophisticated simulator controlled by a user; it is a self-sustaining computational ecosystem.
• Its defining properties are not just programmed but emergent.