GeoWorld is a new way for AI to plan several steps into the future by thinking in shapes (geometry) instead of only numbers.
The paper treats the last layer of a Large Language Model (the softmax over tokens) as an Energy-Based Model, which lets us measure a new signal called spilled energy.