- New system generates explorable 3D worlds from text or images and updates scenes in real time as users interact
- Model supports gaming, storytelling and virtual experiences, with API access and benchmarking work underway
Alibaba Group has released HappyOyster 1.0, an “open world model” that can generate and dynamically update interactive digital environments from a single line of text or an image, marking a move into real-time, user-driven world generation.
Developed by Alibaba Token Hub division, the system is designed to simulate state transitions in physical environments, maintaining long-range consistency of characters and settings while updating causal chains between actions and outcomes as users intervene.
Unlike traditional text-to-video tools that render a fixed output after a prompt, HappyOyster continuously responds to user inputs during generation, allowing scenes to evolve in real time.
Two main modes
The product offers two main modes. In the adventure mode, users move through a generated 3D world in first person, with support for actions such as jumping, crouching, vehicle use and combat, enabling continuous exploration of more than one minute.
Directing mode shifts control to a “god’s-eye view,” allowing users to pause scenes, rewind narrative points and alter story direction on the fly.
It supports more than three minutes of high-definition output and can export shareable content.
Potential applications include rapid prototyping for game development, interactive short-form drama production, virtual companionship and immersive tourism experiences.
Applications
In gaming, developers could generate physics-consistent open-world prototypes without writing extensive code. In tourism, users could choose routes or virtually enter environments such as the deep sea or the moon.
The company said world models remain an early-stage field lacking standardized benchmarks. Alibaba is working with Nanjing University to develop a framework covering interaction quality, cross-modal alignment, long-horizon consistency and physical simulation, while also preparing to open API access.
HappyOyster is currently open for user registration at https://www.happyoyster.cn, with daily free usage credits available until July 17.
