How I Study AI - Learn AI Papers & Lectures the Easy Way

Learning to Reason in 4D: Dynamic Spatial Understanding for Vision Language Models

Intermediate

Shengchao Zhou, Yuxin Chen et al.Dec 23arXiv

The paper tackles a big blind spot in vision-language models: understanding how objects move and relate in 3D over time (dynamic spatial reasoning, or DSR).

#dynamic spatial reasoning#vision-language models#4D understanding

CRISP: Contact-Guided Real2Sim from Monocular Video with Planar Scene Primitives

Intermediate

Zihan Wang, Jiashun Wang et al.Dec 16arXiv

CRISP turns a normal phone video of a person into a clean 3D world and a virtual human that can move in it without breaking physics.

#real-to-sim#human-scene interaction#planar primitives

Efficiently Reconstructing Dynamic Scenes One D4RT at a Time

Intermediate

Chuhan Zhang, Guillaume Le Moing et al.Dec 9arXiv

D4RT is a new AI model that turns regular videos into moving 3D scenes (4D) quickly and accurately.

#D4RT#dynamic 4D reconstruction#query-based decoding

Papers3

Learning to Reason in 4D: Dynamic Spatial Understanding for Vision Language Models

CRISP: Contact-Guided Real2Sim from Monocular Video with Planar Scene Primitives

Efficiently Reconstructing Dynamic Scenes One D4RT at a Time