WebRTC‑enabled surgical robot simulator powered by Cosmos‑3 AI
The project provides a runtime layer that streams AI‑generated surgical robot motions via WebRTC, letting users control a virtual dVRK robot in the browser. It resolves a LoRA‑fine‑tuned Cosmos‑3 checkpoint from Hugging Face, validates 12×44 action tensors, and produces frame‑by‑frame rollouts. Designed for researchers and developers needing a quick, self‑hosted demo of high‑fidelity surgical simulation without building the model infrastructure from scratch. Its CLI tools and web interface make it easier than piecing together separate model loaders and video pipelines.
View on GitHub →hcltech-robotics/cosmos-3-h-surgical-simulator