Google’s Genie 4 world model adds audio, more realistic worlds, and real-time steering

Google DeepMind has released Genie 4, a world model that generates photorealistic and interactive worlds with real-time audio, allowing users to type prompts mid-simulation to change the scene. The model also features freeform edits, such as changing the weather or camera angle, and can maintain a consistent scene for up to two minutes. Genie 4 is closely integrated with Google's Gemini AI model, which acts as the director that plans steps and checks frames while Genie creates the visuals. The model has the potential to be used for robot testing and simulation in the real world.