Xiao-Ming Wu Bio Publications Services Awards
profile photo

Xiao-Ming Wu 伍晓鸣

M.S. student

School of Computer Science and Engineering

Sun Yat-sen University

Email: wuxm65@mail2.sysu.edu.cn

[G o o g l e   Scholar]    [GitHub]

Biography

I'm currently a third-year master student at Sun Yat-sen University, advised by Prof. Wei-Shi Zheng, where I develop the scientific ability and a good taste of it. Now I am also a visiting student in Macquarie university, enjoying an interesting research journey with Prof. Longbing Cao. Previously, I obtain my B.E. degree in Shandong University. At that time, I had my first attempt on scientific research and cultivate the interest in it, advised by Prof. Xin-Shun Xu and Prof. Xin Luo.

Research is for curiosity and fun.

I am interested in general deep learning topics, including algorithms, theories, systems and its applications on vision, language scenarios. My long-term goal is to build a strong, efficient (reach human-level), and safe (surpass human level) AI agent. Now I am mainly focusing on embodied AI. Previously, I also conducted research on model compression and hashing retrieval.

News

[2024-09] One paper accepted in NeurIPS 2024.

[2024-09] One paper accepted in CoRL 2024.

[2024-08] One paper accepted in ICPR 2024.

[2024-07] One paper accepted in ACM Multimedia 2024.

[2024-07] One paper accepted in ECCV 2024 (my first-author work EconomicGrasp).

[2024-02] Three papers accepted in CVPR 2024.

[2023-07] One paper accepted in ICCV 2023 (my first-author work ReSTE).

[2023-02] One paper accepted in CVPR 2023.

[2022-08] One paper accepted in CIKM 2022.

[2022-02] One paper accepted in Pattern Recognition.

[2021-12] One paper accepted in AAAI 2022 (my first-author work OASIS).

Selected Publications

Below are my selected publications. (& means equal contribution, * refers to corresponding author.)

PontTuset Grasp as You Say: Language-guided Dexterous Grasp Generation
Yi-Lin Wei, Jian-Jian Jiang, Chengyi Xing, Xiantuo Tan, Xiao-Ming Wu, Hao Li, Mark Cutkosky, Wei-Shi Zheng*.
Neural Information Processing Systems (NeurIPS), 2024.
page / paper

(Dexterous Grasp) We propose a novel task "Dexterous Grasp as You Say" (DexGYS), with a benchmark and a framework, enabling robots to perform dexterous grasping based on human commands expressed in natural language.

PontTuset Real-to-Sim Grasp: Rethinking the Gap between Simulation and Real World in Grasp Detection
Jia-Feng Cai, Zibo Chen, Xiao-Ming Wu, Jian-Jian Jiang, Yi-Lin Wei, Wei-Shi Zheng*.
Conference on Robot Learning (CoRL), 2024.
page / paper

(6-DoF Grasp) We propose a Real-to-Sim framework for 6-DoF Grasp detection, named R2SGrasp, with the key insight of bridging this gap in a real-to-sim way, and build a large-scale simulated dataset to pretrain our model to achieve great real-world performance.

PontTuset PixelFade: Privacy-preserving Person Re-identification with Noise-guided Progressive Replacement
Delong Zhang, Yi-Xing Peng, Xiao-Ming Wu, Ancong Wu*, Wei-Shi Zheng.
ACM Multimedia (MM), 2024.
paper / code

(Privacy Protection) We propose a two-step iterative method (PixelFade) for person privacy-preserving, with the partial replacement step to turn image into noise to resist recovery attack, and the constrain operation step to maintain Re-id semantics.

PontTuset An Economic Framework for 6-DoF Grasp Detection
Xiao-Ming Wu&, Jia-Feng Cai&, Jian-Jian Jiang, Dian Zheng, Yi-Lin Wei, Wei-Shi Zheng*
European Conference on Computer Vision (ECCV), 2024
paper / code

(6-DoF Grasp) We propose a new economic grasping framework for 6-DoF grasp detection to economize the training resource cost and meanwhile maintain effective grasp performance.

PontTuset Selective Hourglass Mapping for Universal Image Restoration Based on Diffusion Model
Dian Zheng, Xiao-Ming Wu, Shuzhou Yang, Jian Zhang, Jian-Fang Hu, Wei-Shi Zheng*
Computer Vision and Pattern Recognition (CVPR), 2024.
paper / code

(Image Restoration) We propose a diffusion-based universal image restoration model, with an assemble-then-separate (like the hourglass) mapping for multi-task training, to learn the shared information between different tasks.

PontTuset Estimator Meets Equilibrium Perspective: A Rectified Straight Through Estimator for Binary Neural Networks Training
Xiao-Ming Wu, Dian Zheng, Zuhao Liu, Wei-Shi Zheng*
International Conference on Computer Vision (ICCV), 2023
paper / code

(Binary Neural Networks) We propose a new perspective to view the binary neural network training: equilibrium between estimating error and gradient stability, and design a simple and effective gradient estimator (ReSTE) to balance it well.

PontTuset Discrete Online Cross-modal Hashing
Yu-Wei Zhan, Yongxin Wang, Yu Sun, Xiao-Ming Wu, Xin Luo*, Xin-Shun Xu
Pattern Recognition (PR), 2022
paper / code

(Hashing Retrieval) We propose a novel cross-modal online hashing method, directly exploiting the similarity between newly coming data and old existing data in the Hamming space to learn discriminate hashing codes.

PontTuset Online Enhanced Semantic Hashing Towards Effective and Efficient Retrieval for Streaming Multi-Modal Data
Xiao-Ming Wu, Xin Luo*, Yu-Wei Zhan, Chen-Lu Ding, Zhen-Duo Chen, Xin-Shun Xu
AAAI Conference on Artificial Intelligence (AAAI), 2022
paper / code

(Hashing Retrieval) We explore a new task, incremental multi-modal hashing, and introduce semantics to solve this task, handling the dimension mismatching problem and mitigating the inconsistent problem that occurs when new classes come.

Services and Activities

Journal Reviewer:
Pattern Analysis and Machine Intelligence (TPAMI)
Pattern Recognition (PR)

Conference Reviewer:
Computer Vision and Pattern Recognition (CVPR) 2024, 2025
ACM Multimedia (MM) 2024

Selected Awards

First Prize, Academic Scholarship of Sun Yat-Sen University for Graduate Student (中山大学硕士研究生一等奖助金), 2022, 2023, 2024.
National Scholarship of China for Graduate Student (研究生国家奖学金), 2023.
Honorable Bachelor Degree of Shandong University (山东大学荣誉学士学位), 2022.
National Scholarship of China for Undergraduate Student (本科生国家奖学金), 2019, 2021.
First Prize, Academic Scholarship of Shandong University for Undergraduate Student (山东大学本科生学业一等奖学金), 2019, 2020, 2021.