Runwei Guan currently a Year-3 Joint Ph.D candidate by University of Liverpool, Xi’an Jiaotong-Liverpool University and Institute of Deep Perception Technology, Jiangsu Industrial Technology Research Institute. He is currently supervised by Prof. Yutao Yue, Prof. Ka Lok Man, Prof. Jeremy Smith and Prof. Eng Gee Lim. He will join The Hong Kong University of Science and Technology as a post-doctoral research fellow in December this year, supervised by Prof. Hui Xiong (IEEE Fellow and AAAS Fellow). He is also the AI researcher in Institute of Deep Percetpion Technology. Besides, He is starting a business in the field of AI + IVF.

Research Interests

His research interests are focused on Multi-Modal Learning, encompassing

1. Multi-Sensor and Multi-Task Perception
2. Visual Grounding
3. Visual Question Answering
4. Radar-based Embodied Perception
5. AI applications on IVF

Publications (* denotes equal contributions)

Preprint

• RePaIR: Repair Pruning at Initialization Resilience
  |paper|code|
  Haocheng Zhao^*, Runwei Guan^*, Limin Yu, Junqing Zhang, Ka Lok Man, Yutao Yue

• radarODE: An ODE-Embedded Deep Learning Model for Contactless ECG Reconstruction from Millimeter-Wave Radar
  |paper|code|
  Yuanyuan Zhang, Runwei Guan, Lingxiao Li, Rui Yang, Yutao Yue, Eng Gee Lim

• Talk2Radar: Bridging Natural Language with 4D mmWave Radar for 3D Referring Expression Comprehension
  |paper|code|
  Runwei Guan^*, Ruixiao Zhang^*, Ningwei Ouyang^*, Jianan Liu^*, Ka Lok Man, Xiaohao Cai, Ming Xu, Jeremy Smith, Eng Gee Lim, Yutao Yue, Hui Xiong

• Referring Flexible Image Restoration
  |paper|code|
  Runwei Guan^*, Rongsheng Hu^*, Zhuhao Zhou, Tianlang Xue, Ka Lok Man, Jeremy Smith, Eng Gee Lim, Weiping Ding, Yutao Yue

• WaterVG: Waterway Visual Grounding based on Text-Guided Vision and mmWave Radar
  |paper|code|
  Runwei Guan^*, Liye Jia^*, Fengyufan Yang^*, Shanliang Yao, Erick Purwanto, Xiaohui Zhu, Eng Gee Lim, Jeremy Smith, Ka Lok Man, Xuming Hu, Yutao Yue

• Achelous++: Power-Oriented Water-Surface Panoptic Perception Framework on Edge Devices based on Vision-Radar Fusion and Pruning of Heterogeneous Modalities
  |paper|code|
  Runwei Guan^*, Haocheng Zhao^*, Shanliang Yao, Ka Lok Man, Xiaohui Zhu, Limin Yu, Yong Yue, Jeremy Smith, Eng Gee Lim, Weiping Ding, Yutao Yue

Selected Conference Papers

• Achelous: A fast unified water-surface panoptic perception framework based on fusion of monocular camera and 4d mmwave radar
  |ITSC 2023|paper|code|
  Runwei Guan^*, Shanliang Yao^*, Xiaohui Zhu, Ka Lok Man, Eng Gee Lim, Jeremy Smith, Yong Yue, Yutao Yue

• PLSR: Unstructured Pruning with Layer-Wise Sparsity Ratio
  |ICMLA 2023|paper|code|
  Haocheng Zhao, Limin Yu, Runwei Guan, Liye Jia, Junqing Zhang, Yutao Yue

Selected Journal Papers

• Waterscenes: A multi-task 4d radar-camera fusion dataset and benchmark for autonomous driving on water surfaces
  |IEEE Transactions on Intelligent Transportation Systems|Website|
  Shanliang Yao^*, Runwei Guan^*, Zhaodong Wu, Yi Ni, Zile Huang, Wen Liu, Xiaohui Zhu, Yutao Yue, Yong Yue, Hyungjoon Seo, Ka Lok Man

• FindVehicle and VehicleFinder: a NER dataset for natural language-based vehicle retrieval and a keyword-based cross-modal vehicle retrieval system
  |Multimedia Tools and Applications|Paper Link|
  Runwei Guan, Ka Lok Man, Feifan Chen, Shanliang Yao, Rongsheng Hu, Xiaohui Zhu, Jeremy Smith, Eng Gee Lim, Yutao Yue

• Mask-VRDet: A robust riverway panoptic perception model based on dual graph fusion of vision and 4D mmWave radar
  |Robotics and Autonomous Systems|Paper Link|
  Runwei Guan, Shanliang Yao, Lulu Liu, Xiaohui Zhu, Ka Lok Man, Yong Yue, Jeremy Smith, Eng Gee Lim, Yutao Yue

• MAN and CAT: mix attention to nn and concatenate attention to YOLO
  |Journal of Supercomputing|Paper Link|
  Runwei Guan, Ka Lok Man, Haocheng Zhao, Ruixiao Zhang, Shanliang Yao, Jeremy Smith, Eng Gee Lim, Yutao Yue

• A clinical decision support system to predict the efficacy for EGFR-TKIs based on artificial neural network
  |Journal of Cancer Research and Clinical Oncology|Paper Link|
  Xiao Liang^*, Runwei Guan^*, Jiamin Zhu, Yue Meng, Jing Zhu, Yuxiang Yang, Yanan Cui, Jiali Dai, Weidong Mao, Liting Lv, Dong Shen, Renhua Guo

• Lightweight Traffic Referring Expression Comprehension System Based on Prompt Guidance and Sparse Cross-Modal Attention
  |IEEE Transactions on Emerging Topics in Computational Intelligence|
  Runwei Guan, Ka Lok Man, Jeremy S Smith, Eng Gee Lim, Weiping Ding, Yutao Yue

Review

• Radar-camera fusion for object detection and semantic segmentation in autonomous driving: A comprehensive review
  |IEEE Transactions on Intelligent Vehicles|Paper Link|
  Shanliang Yao, Runwei Guan, Xiaoyu Huang, Zhuoxiao Li, Xiangyu Sha, Yong Yue, Eng Gee Lim, Hyungjoon Seo, Ka Lok Man, Xiaohui Zhu, Yutao Yue

• Exploring Radar Data Representations in Autonomous Driving: A Comprehensive Review
  |Paper Link|
  Shanliang Yao, Runwei Guan, Zitian Peng, Chenhang Xu, Yilu Shi, Yong Yue, Eng Gee Lim, Hyungjoon Seo, Ka Lok Man, Xiaohui Zhu, Yutao Yue