EgoActor is a vision-language model that turns everyday instructions like 'Go to the door and say hi' into step-by-step, egocentric actions a humanoid robot can actually do.
This paper introduces OmniAgent, a smart video-and-audio detective that actively decides when to listen and when to look.