Google releases the world model Genie 4, adding native audio and real-time control

Google has released the next-generation world model Genie 4, which improves on Genie 3 in image quality, motion, and physical interaction, and adds native audio generation that can synchronously generate ambient sounds, musical sounds, and character interaction dialogue. Genie 4 supports keyboard control of characters or the camera, and can also modify weather, add objects, and change events using natural language during runtime. Google has also integrated Gemini into the generation process as a guiding agent, responsible for observing the frames, breaking down goals, and checking frame by frame, while Genie is responsible for generating visuals, sound, and dynamic changes.