Go back to projects View external

Ego2World: Video-Compiled Symbolic Simulator for Embodied Agents

#Multimodal Models #Embodied AI #LLM Agent #Symbolic Simulation

Summary

Ego2World compiles real kitchen videos into an executable symbolic world for embodied-agent evaluation.

What the System Includes

  • world-state and belief-state abstractions,
  • reset / query / observe / check / step interfaces,
  • geometry-aware observation,
  • action-feasibility checking,
  • failure recovery and process-dynamics modeling.

My Role

I work as the first author and core developer on the project. The system is designed to evaluate long-horizon planning, state maintenance, and recovery ability for large-model agents in partially observable environments.