
I am a Senior Research Scientist at the Seattle Research Lab (SRL) at NVIDIA, working on robotics and AI. My research interests include generalist robot policies, evaluation and benchmarking. I received my Ph.D. in Robotics from Carnegie Mellon University, and my B.A.Sc. in Engineering Science from the University of Toronto, with a major in Aerospace.
You can contact me at xuningy at nvidia dot com.
Highlights
- 07/2026 Gave two invited talks: Australian Centre for Robotics at the University of Sydney and University of New South Wales
- 07/2026 Gave a talk at the RSS 2026 workshop Toward Open-World Failure Recovery for Robots
- 07/2026 Invited panelist at the RSS 2026 workshop Trustworthy Embodied Foundation Models
- 07/2026 Wrote a blog on how to evaluate general-purpose robot policies for real-world deployment
- 04/2026 RoboLab has been accepted to RSS 2026 (29.7% AR)!
- 04/2026 AdaVoMP has been accepted to ICML 2026 (26.6% AR)!
- 04/2026 RoboLab is released! Highlighted in Nvidia’s National Robotics Week
- 05/2024 Built an automatic pick-and-place pipeline in simulation in collaboration with Intrinsic.AI: TechCrunch, AI Business, The Robot Report
- 2019 In-place hover-to-hover flip of a quadrotor, featured by Rapyuta Robotics
Selected publications
-
RoboLab: A High-Fidelity Simulation Benchmark for Analysis of Task Generalist Policies RSS 2026 bibtex paper code project
-
Cosmos 3: Omnimodal World Models for Physical AI arXiv 2026 paper code models project
-
VoLo: A Physical Orchestrator for Open-Vocabulary Long-Horizon Manipulation CoRL 2026 under review paper project
-
AdaVoMP: Adaptive Volumetric Mechanical Property Fields Invariant to Resolution ICML 2026 paper project
-
VLA-0: Building State-of-the-Art VLAs with Zero Modification arXiv 2025 paper code project
-
Robot Policy Evaluation for Sim-to-Real Transfer: A Benchmarking Perspective RSS 2025 WS bibtex paper
-
RoboArena: Distributed Real-World Evaluation of Generalist Robot Policies RSS 2025 bibtex paper
-
Inference-Time Policy Steering through Human Interactions ICRA 2025 bibtex paper project
-
Aim My Robot: Precision Local Navigation to Any Object RAL 2025 bibtex paper project
-
Fast Explicit-Input Assistance for Teleoperation in Clutter IROS 2024 bibtex paper code
-
Assisted Mobile Robot Teleoperation with Intent-aligned Trajectories via Biased Incremental Action Sampling IROS 2020 bibtex paper code talk
-
Fast and Agile Vision-Based Flight with Teleoperation and Collision Avoidance on a Multirotor ISER 2018 bibtex paper video