Runyu Ding Ph.D. student Department of Electrical and Electronic Engineering The University of Hong Kong Email: dingry977 [at] gmail [dot] com

Biography

I received my Ph.D. degree at The University of Hong Kong in 2024, advised by Prof. Xiaojuan Qi. Before that I obtained my B.Eng. degree from Tsinghua University in 2020.

My research interests focus on 3D vision and embodied AI.

Publications

Bunny-VisionPro: Real-Time Bimanual Dexterous Teleoperation for Imitation Learning
Runyu Ding*, Yuzhe Qin*, Jiyue Zhu*, Chengzhe Jia, Shiqi Yang, Ruihan Yang, Xiaojuan Qi, Xiaolong Wang
arxiv, 2024
[Project Page] [Documentation] [Code]  

V-IRL: Grounding Virtual Intelligence in Real Life
Jihan Yang, Runyu Ding, Ellis Brown, Xiaojuan Qi, Saining Xie
arxiv, 2024
[Project Page] [Code]  

Can 3D Vision-Language Models Truly Understand Natural Language?
Weipeng Deng, Runyu Ding, Jihan Yang, Jiahui Liu, Yijiang Li, Xiaojuan Qi, Edith Ngai
arxiv, 2024
[Code]  

Lowis3D: Language-Driven Open-World Instance-Level 3D Scene Understanding
Runyu Ding, Jihan Yang, Chuhui Xue, Wenqing Zhang, Song Bai, Xiaojuan Qi
arxiv, 2023
[Project Page]

RegionPLC: Regional Point-Language Contrastive Learning for Open-World 3D Scene Understanding
Jihan Yang*, Runyu Ding*, Zhe Wang, Xiaojuan Qi
Computer Vision and Pattern Recognition Conference (CVPR), 2024
[Project Page] [Code]  

PLA: Language-Driven Open-Vocabulary 3D Scene Understanding
Runyu Ding*, Jihan Yang*, Chuhui Xue, Wenqing Zhang, Song Bai, Xiaojuan Qi
Computer Vision and Pattern Recognition Conference (CVPR), 2023
[Project Page] [Code]  

Towards Efficient 3D Object Detection with Knowledge Distillation
Jihan Yang, Shaoshuai Shi, Runyu Ding, Zhe Wang, Xiaojuan Qi
Advances in Neural Information Processing Systems (NeurIPS) 2022.
[Code]

DODA: Data-oriented Sim-to-Real Domain Adaptation for 3D Semantic Segmentation
Runyu Ding*, Jihan Yang*, Xiaojuan Qi
European Conference on Computer Vision (ECCV), 2022.
[Code]

PAConv: Position Adaptive Convolution with Dynamic Kernel Assembling on Point Clouds
Mutian Xu*, Runyu Ding*, Hengshuang Zhao, Xiaojuan Qi
Computer Vision and Pattern Recognition Conference (CVPR), 2021.
[Code]

Experiences

• Student Intern, University of California San Diego.
  Aug. 2023 - Present
  
  Working with Prof. Xiaolong Wang

• Research Intern, ByteDance.
  March 2022 - May 2023
  
  Working with Dr. Song Bai.

• Research Intern, SenseTime Research.
  Oct. 2020 - Aug. 2021
  
  Working with Prof. Jifeng Dai.

• Research Intern, STCA Microsoft.

  July 2019 - Aug. 2019
  
  

Activities

Conference Reviewer: CVPR, ICCV, ECCV, ACM MM

Journal Reviewer: IJCV, PR

• Language-Driven Open-Vocabulary 3D Scene Understanding. C3DV Workshop in CVPR 2023.
  

• Language-Driven Open-Vocabulary 3D Scene Understanding. VALSE 2023.
  

• DODA: Data-Oriented Sim-to-Real Domain Adaptation for 3D Semantic Segmentation. Zhidongxi.
  

• PAConv: Position Adaptive Convolution with Dynamic Kernel Assembling on Point Clouds. Jiangmen.
  

Education

• The University of Hong Kong
  Sept. 2020 - Sept. 2024
  
  Ph.D. at CVMI-Lab
  

• Tsinghua University
  Sept. 2015 - June 2020
  
  Bachelor in Software Engineering
  

Honors & Awards