Welcome to
Prof. HUANG Rui WEBSITE
Professor Huang received his B.Sc. degree from Peking University (1999), M.Eng. degree from the Chinese Academy of Sciences (2002), and Ph.D. degree from Rutgers University (2008). From 2008 to 2010, he conducted postdoctoral research at the Computational Biomedicine Imaging and Modeling Center of Rutgers University. He then returned to China and became a faculty member at Huazhong University of Science and Technology. From 2012 to 2016, he worked as a research scientist at NEC Laboratories China. He is currently an Associate Professor and a Presidential Young Fellow at The Chinese University of Hong Kong, Shenzhen.
His research focuses on computer vision, pattern recognition, image processing, and machine learning. In recent years, his work has primarily involved intelligent video analysis, robotic vision navigation, and autonomous driving. He has published over 100 academic papers in these fields and has led or participated in numerous projects funded by the National Natural Science Foundation of China, the Ministry of Science and Technology of China, and the Shenzhen Municipal Government.
Professor Huang has received several awards, including the Best Paper Award at the International Conference on Image and Graphics (ICIG) in 2023, the Second Prize in Natural Science at the Science and Technology Awards of the China Computer Federation (CCF) in 2018, the Best Student Paper Award at the IEEE International Conference on Multimedia and Expo (ICME) in 2014, and the First Prize for Excellent Academic Papers in Natural Science from Hubei Province in 2014. He has also supervised students who have achieved top rankings in international competitions, such as the Winner of the Raw to RGB Mapping Challenge at the International Conference on Computer Vision (ICCV) in 2019 and the Winner of the Global AI Challenge on Meteorology at the IEEE International Conference on Data Mining (ICDM) in 2018.
RESEARCH INTERESTS:
Intelligent video analysis, editing, and generation
Visual SLAM, 3D reconstruction for robot navigation
BEV and 3D semantic scene parsing for autonomous driving
Graphical models for image and video modeling
Deformable models and level set methods for 2D/3D image segmentation
Machine Learning for face recognition and person identification
Other related topics in computer vision, pattern recognition, robotics, and medical image analysis
RESEARCH PROJECTS:
Vision-based autonomous driving, 2022~
Monocular visual SLAM, 2020~2023
3D semantic scene parsing, 2021~2022
Intelligent video editing for surveillance and education, 2019~2022
(Editing system demo, Edited lecture demo)
Realtime interactive virtual tourism via visual localization, 2019~2021
Person search and (re)-identification for intelligent video surveillance, 2014~2020
Face liveness detection/anti-spoofing for face recognition, 2014~2015
Multi-camera multi-target tracking for business intelligence, 2014~2015
Action recognition using deep learning, 2013~2014
Object localization and categorization using graphical models, 2008~2014
Bias field estimation for medical imaging using level set methods and graphical models, 2008~2012
Sequential data analysis using generative and discriminative graphical models, 2008~2009
Shape modeling using graphical models, 2006~2009
Object segmentation using deformable models and graphical models, 2003~2008
Face recognition using subspace analysis and graphical models, 2001~2004
Selected Journal Articles:
[J1] Denoised Non-Local Neural Network for Semantic Segmentation
Qi Song, Jie Li, Hao Guo, Rui Huang*
in IEEE Transactions on Neural Networks and Learning Systems (TNNLS), Vol. 35, No. 5, 2024.
[J2] Divide and Conquer: Improving Multi-Camera 3D Perception with 2D Semantic-Depth Priors and Input-Dependent Queries
Qi Song, Qingyong Hu, Chi Zhang, Yongquan Chen, Rui Huang*
in IEEE Transactions on Image Processing (TIP), Vol. 33, 2024.
[J3] End-to-End Video Scene Graph Generation with Temporal Propagation Transformer
Yong Zhang, Yingwei Pan*, Ting Yao, Rui Huang*, Tao Mei, Chang-Wen Chen
in IEEE Transactions on Multimedia (TMM), Vol. 26, 2024.
[J4] From Front to Rear: 3D Semantic Scene Completion through Planar Convolution and Attention-based Network
Jie Li, Qi Song, Xiaohu Yan, Yongquan Chen, Rui Huang*
in IEEE Transactions on Multimedia (TMM), Vol. 25, 2023.
[J5] Boosting Scene Graph Generation with Visual Relation Saliency
Yong Zhang, Yingwei Pan, Ting Yao, Rui Huang, Tao Mei, Chang-Wen Chen
in ACM Transactions on Multimedia Computing, Communications, and Applications (TOMM), Vol. 19, No. 1, 2023. Q1
[J6] Unsupervised Monocular Depth Perception: Focusing on Moving Objects
Hualie Jiang, Laiyan Ding, Zhenglong Sun, Rui Huang∗
in IEEE Sensors Journal, Vol. 21, No. 24. 2021. Featured Article
[J7] Cross-Modal Knowledge Adaptation for Language-Based Person Search
Yucheng Chen, Rui Huang, Hong Chang, Chuanqi Tan, Tao Xue, Bingpeng Ma
in IEEE Transactions on Image Processing (TIP), Vol. 30, No. 3, 2021.
[J8] Video-Based Pedestrian Re-Identification by Adaptive Spatio-Temporal Appearance Model
Wei Zhang, Bingpeng Ma, Kan Liu, Rui Huang*
in IEEE Transactions on Image Processing (TIP), Vol. 26, No. 4, 2017.
[J9] DeepList: Learning Deep Features with Adaptive Listwise Constraint for Person Re-identification
Jin Wang, Zheng Wang, Changxin Gao, Nong Sang, Rui Huang
in IEEE Transactions on Circuits and Systems for Video Technology (TCSVT), Vol. 27, No. 3, 2017.
[J10] Robust Visual Tracking Using Exemplar-based Detectors
Changxin Gao, Feifei Chen, Jin-Gang Yu, Rui Huang, Nong Sang
in IEEE Transactions on Circuits and Systems for Video Technology (TCSVT), Vol. 27, No. 2, 2017.
[J11] Learning Structure of Stereoscopic Image for No-reference Quality Assessment with Convolutional Neural Network
Wei Zhang, Chenfei Qu, Lin Ma, Jingwei Guan, Rui Huang
in Pattern Recognition, Vol. 59, 2016.
[J12] Multi-target Tracking Using Hough Forest Random Field
Jun Xiang, Nong Sang, Jianhua Hou, Rui Huang, Changxin Gao
in IEEE Transactions on Circuits and Systems for Video Technology (TCSVT), Vol. 26, No. 11, 2016.
[J13] Recognizing Focal Liver Lesions in CEUS with Dynamically Trained Latent Structured Models
Xiaodan Liang, Liang Lin, Qingxing Cao, Rui Huang, Yongtian Wang
in IEEE Transactions on Medical Imaging (TMI), Vol. 35, No. 3, 2016.
[J14] Real-Time Skin Color Detection under Rapidly Changing Illumination Conditions
Leyuan Liu, Nong Sang, Saiyong Yang, Rui Huang
in IEEE Transactions on Consumer Electronics (TCE), Vol. 57, No. 3, Aug, 2011.
[J15] A Level Set Method for Image Segmentation in Presence of Intensity Inhomogeneities with Application to MRI
Chunming Li, Rui Huang, Zhaohua Ding, J. Chris Gatenby, Dimitris N. Metaxas, John C. Gore
in IEEE Transactions on Image Processing (TIP), Vol. 20, No. 7, Jul, 2011.
Selected Conference Papers:
[C1] SmartEdit: Exploring Complex Instruction-based Image Editing with Multimodal Large Language Models
Yuzhou Huang, Liangbin Xie, Xintao Wang, Ziyang Yuan, Xiaodong Cun, Yixiao Ge, Jiantao Zhou, Chao Dong, Rui Huang, Ruimao Zhang, Ying Shan
in Proceedings of IEEE Computer Vision and Pattern Recognition (CVPR’24), 2024.
[C2] Incremental 3D Reconstruction through Hybrid Explicit-and-Implicit Representation
Feifei Li, Panwen Hu, Qi Song, Rui Huang*
in IEEE International Conference on Robotics and Automation (ICRA’24), oral presentation, 2024.
[C3] A Reinforcement Learning-Based Automatic Video Editing Method Using Pre-trained Vision-Language Model
Panwen Hu, Nan Xiao, Feifei Li, Yongquan Chen, Rui Huang*
in Proceedings of ACM Multimedia (ACM MM’23), 2023.
[C4] Learning to Generate Language-Supervised and Open-Vocabulary Scene Graph Using Pre-Trained Visual-Semantic Space
Yong Zhang, Yingwei Pan, Ting Yao, Rui Huang*, Tao Mei, Chang-Wen Chen
in Proceedings of IEEE Computer Vision and Pattern Recognition (CVPR’23), 2023.
[C5] Deep Semantic Statistics Matching (D2SM) Denoising Network
Kangfu Mei, Vishal M. Patel, Rui Huang*
in Proceedings of the European Conference on Computer Vision (ECCV’22), 2022.
[C6] Salient-to-Broad Transition for Video Person Re-identification
Shutao Bai, Bingpeng Ma, Hong Chang, Rui Huang, Xilin Chen
in Proceedings of IEEE Computer Vision and Pattern Recognition (CVPR’22), 2022.
[C7] Exploring Structure-aware Transformer over Interaction Proposals for Human-Object Interaction Detection
Yong Zhang, Yingwei Pan, Ting Yao, Rui Huang, Tao Mei, Chang-Wen Chen
in Proceedings of IEEE Computer Vision and Pattern Recognition (CVPR’22), 2022.
[C8] Fully Attentional Network for Semantic Segmentation
Qi Song, Jie Li, Chenghong Li, Hao Guo, Rui Huang*
in Proceeding of American Association for Artificial Intelligence (AAAI’22), 2022.
[C9] IMENet: Joint 3D Semantic Scene Completion and 2D Semantic Segmentation through Iterative Mutual Enhancement
Jie Li, Laiyan Ding, and Rui Huang*
in Proceeding of International Joint Conference on Artificial Intelligence (IJCAI’21), 2021.
[C10] BiCnet-TKS: Learning Efficient Spatial-Temporal Representation for Video Person Re-Identification
Ruibing Hou, Hong Chang, Bingpeng Ma, Rui Huang, and Shiguang Shan
in Proceedings of IEEE Computer Vision and Pattern Recognition (CVPR’21), 2021.
[C11] AttaNet: Attention-Augmented Network for Fast and Accurate Scene Parsing
Qi Song, Kangfu Mei, Rui Huang*
in Proceeding of AAAI Conference on Artificial Intelligence (AAAI’21),2021.
[C12] Sparse Single Sweep LiDAR Point Cloud Segmentation via Learning Contextual Shape Priors from Scene Completion
Xu Yan, Jiantao Gao, Jie Li, Ruimao Zhang, Zhen Li*, Rui Huang, Shuguang Cui
in Proceedings of AAAI Conference on Artificial Intelligence (AAAI’21), 2021.
[C13] Learning Memory Augmented Cascading Network for Compressed Sensing of Images
Jiwei Chen, Yubao Sun, Qingshan Liu, Rui Huang
in Proceedings of the European Conference on Computer Vision (ECCV’20), 2020.
[C14] A Spatio-temporal Appearance Representation for Video-based Pedestrian Re-identification
Kan Liu, Bingpeng Ma, Wei Zhang, Rui Huang*
in Proceedings of IEEE International Conference on Computer Vision (ICCV’15), 2015.
[C15] Person Search in a Scene by Jointly Modeling People Commonness and Person Uniqueness
Yuanlu Xu, Bingpeng Ma, Rui Huang*, Liang Lin
in Proceedings of ACM Multimedia (ACM MM’14), 2014.
[C16] A Variational Level Set Approach to Segmentation and Bias Correction of Images with Intensity Inhomogeneity
Chunming Li, Rui Huang, Zhaohua Ding, J. Chris Gatenby, Dimitris N. Metaxas, John C. Gore
in Proceedings of International Conference on Medical Image Computing and Computer Assisted Intervention (MICCAI’08), 2008.
[C17] Embedded Profile Hidden Markov Models for Shape Analysis
Rui Huang, Vladimir Pavlovic, Dimitris N. Metaxas
in Proceedings of IEEE International Conference on Computer Vision (ICCV’07), 2007.
[C18] A Graphical Model Framework for Coupling MRFs and Deformable Models
Rui Huang, Vladimir Pavlovic, Dimitris N. Metaxas
in Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR’04), 2004.
[C19] Solving the Small Sample Size Problem of LDA
Rui Huang, Qingshan Liu, Hanqing Lu, Songde Ma
in Proceedings of International Conference on Pattern Recognition (ICPR’02), 2002.
[C20] Face Recognition Using Kernel-Based Fisher Discriminant Analysis
Qingshan Liu, Rui Huang, Hanqing Lu, Songde Ma
in Proceedings of IEEE conference on Automatic Face and Gesture Recognition (FG’02), 2002.