NVIDIA Cosmos-H-Dreams: Bringing Real-Time Generative Simulation to Surgical Robotics

NVIDIA has introduced Cosmos-H-Dreams, a real-time generative simulator that creates interactive and photorealistic surgical environments for training. This system distills a massive surgical "world model" into a more efficient student model that generates video based on live actions from a human or an AI policy. A unique training technique called self-forcing distillation enables the model to learn from its own generated outputs, making it stable enough for long, interactive use. Served through the FlashDreams inference engine, the simulator allows for closed-loop control on a single GPU, providing a safer and more accessible way to develop surgical robotics.