Spaces:
Sleeping
Sleeping
| title: "AEGIS-Reason: Post-Training Cosmos Reason 2 for Healthcare Physical AI" | |
| emoji: π‘οΈ | |
| colorFrom: green | |
| colorTo: blue | |
| sdk: gradio | |
| sdk_version: "4.44.1" | |
| python_version: "3.12" | |
| app_file: app.py | |
| pinned: true | |
| license: apache-2.0 | |
| tags: | |
| - nvidia | |
| - cosmos | |
| - physical-ai | |
| - healthcare | |
| - robotics | |
| - cosmos-cookoff | |
| - isaac-sim | |
| - gradio | |
| short_description: "Cosmos Reason 2 healthcare Physical AI β 3D arena" | |
| # π‘οΈ AEGIS-Reason: Post-Training Cosmos Reason 2 for Vision-Grounded Multi-Robot Healthcare Coordination | |
| **NVIDIA Cosmos Cookoff 2026 β Competition Submission** | |
| The first-ever application of Cosmos Reason 2 to healthcare Physical AI β a fully interactive, physics-grounded 3D hospital arena with live VLM inference, uncertainty-quantified multi-robot coordination, and a 119-entry medical knowledge base across 4 embodied robot classes and 12 clinical domains. | |
| ## ποΈ Isaac Lab 3D Arena β Main Showcase | |
| The centerpiece is a **449,580-character self-contained 3D simulation** (zero external dependencies) orchestrating 4 classes of healthcare robots inside a unified hospital floor plan: | |
| | Robot | Physics Model | Key Metric (seed=42) | | |
| |-------|--------------|---------------------| | |
| | π¦Ύ Surgical Arms (da Vinci Xi) | 7-DOF kinematics, Jacobian IK, Kelvin-Voigt tissue | 1.9Γ speed, 90% tremor reduction | | |
| | π₯ Hospital AMR Fleet | DWA, SLAM + A*, collision avoidance | 1.3Γ throughput, collisions 2 β 0 | | |
| | π Medical Drones | 3D BΓ©zier flight, wind-coupled dynamics | 73% on-time, energy β16% | | |
| | π¦Ώ Rehab Exoskeleton | Inverted-pendulum gait, biomechanical torque | Falls 28 β 9, 6MWT 152 β 208 m | | |
| Every slider change re-simulates all 4 robot subsystems and updates entity counts, physics trajectories, narration text, and CR2 inference chains in real time. | |
| ## β‘ Cosmos Reason 2 Integration | |
| CR2 (8B, Qwen3-VL, 256K context) serves as the decision-making backbone in three integration patterns: live VLM inference with 5-axis reasoning chains, LoRA post-training (r=16, Ξ±=32, 22 hospital SFT examples), and critic/reward role in the Cosmos closed-loop flywheel. | |
| ## π Architecture | |
| 10,989 lines of research-grade Python across 7 modules (AβG), producing 112 functions, 24 interactive Gradio tabs, 14 interactive 3D plots, and 22 event-driven callbacks. The full NVIDIA Physical AI stack: Cosmos WFMs, Isaac Sim 6.0, PhysX 5.6.1, Dynamo, NIM v1.6.0, Jetson AGX Thor (2,070 FP4 TFLOPS), Earth-2, and CRAG retrieval. | |
| ## π Running Locally | |
| ```bash | |
| git clone https://huggingface.co/spaces/YOUR_USERNAME/AEGIS-Reason | |
| cd AEGIS-Reason | |
| pip install -r requirements.txt | |
| python app.py | |
| ``` | |
| Optional (for live CR2 inference β requires GPU with β₯8 GB VRAM): | |
| ```bash | |
| pip install torch transformers accelerate peft | |
| ``` | |
| Without a GPU, the application runs in cached/simulated mode with full interactivity across all 24 tabs. | |
| ## π Files | |
| | File | Description | | |
| |------|-------------| | |
| | `app.py` | Main application (12,825 lines) | | |
| | `requirements.txt` | Python dependencies | | |
| | `README.md` | This file (HF Spaces metadata) | | |
| ## π Cosmos Cookoff 2026 | |
| Built for the NVIDIA Cosmos Cookoff 2026. Judging criteria: Quality of Ideas, Technical Implementation, Design, and Impact. Judges from Datature, Hugging Face, Nebius, Nexar, and NVIDIA. | |