Biography

Professor Huang received his B.Sc. degree from Peking University (1999), M.Eng. degree from the Chinese Academy of Sciences (2002), and Ph.D. degree from Rutgers University (2008). From 2008 to 2010, he conducted postdoctoral research at the Computational Biomedicine Imaging and Modeling Center of Rutgers University. He then returned to China and became a faculty member at Huazhong University of Science and Technology. From 2012 to 2016, he worked as a research scientist at NEC Laboratories China. He is currently an Associate Professor and a Presidential Young Fellow at The Chinese University of Hong Kong, Shenzhen.

His research focuses on computer vision, pattern recognition, image processing, and machine learning. In recent years, his work has primarily involved intelligent video analysis, robotic vision navigation, and autonomous driving. He has published over 100 academic papers in these fields and has led or participated in numerous projects funded by the National Natural Science Foundation of China, the Ministry of Science and Technology of China, and the Shenzhen Municipal Government.

Professor Huang has received several awards, including the Best Paper Award at the International Conference on Image and Graphics (ICIG) in 2023, the Second Prize in Natural Science at the Science and Technology Awards of the China Computer Federation (CCF) in 2018, the Best Student Paper Award at the IEEE International Conference on Multimedia and Expo (ICME) in 2014, and the First Prize for Excellent Academic Papers in Natural Science from Hubei Province in 2014. He has also supervised students who have achieved top rankings in international competitions, such as the Winner of the Raw to RGB Mapping Challenge at the International Conference on Computer Vision (ICCV) in 2019 and the Winner of the Global AI Challenge on Meteorology at the IEEE International Conference on Data Mining (ICDM) in 2018.


Research

RESEARCH INTERESTS:

Intelligent video analysis, editing, and generation

Visual SLAM, 3D reconstruction for robot navigation

BEV and 3D semantic scene parsing for autonomous driving

Graphical models for image and video modeling

Deformable models and level set methods for 2D/3D image segmentation

Machine Learning for face recognition and person identification

Other related topics in computer vision, pattern recognition, robotics, and medical image analysis


RESEARCH PROJECTS:

Vision-based autonomous driving, 2022~

Monocular visual SLAM, 2020~2023

3D semantic scene parsing, 2021~2022

Intelligent video editing for surveillance and education, 2019~2022

(Editing system demoEdited lecture demo)

Realtime interactive virtual tourism via visual localization, 2019~2021

Person search and (re)-identification for intelligent video surveillance, 2014~2020

Face liveness detection/anti-spoofing for face recognition, 2014~2015

Multi-camera multi-target tracking for business intelligence, 2014~2015

Action recognition using deep learning, 2013~2014

Object localization and categorization using graphical models, 2008~2014

Bias field estimation for medical imaging using level set methods and graphical models, 2008~2012

Sequential data analysis using generative and discriminative graphical models, 2008~2009

Shape modeling using graphical models, 2006~2009

Object segmentation using deformable models and graphical models, 2003~2008

Face recognition using subspace analysis and graphical models, 2001~2004

Awards and honors
  • 2023
  • 2019
  • 2018
  • 2014
  • 2012
  • 2007
<
  • 01

    2023

    Best Paper Award of International Conference on Image and Graphics (ICIG), 2023. Synthesizing a large scene with multiple NeRFs Shenglong Ye, Feifei Li, and Rui Huang* in Proceedings of International Conference on Image and Graphics (ICIG’23), 2023.

  • 02

    2019

    Winner of Advances in Image Manipulation (AIM'19) Raw to RGB Mapping Challenge in International Conference on Computer Vision (ICCV'19). HighEr-Resolution Network for Image Demosaicing and Enhancing, Kangfu Mei, Juncheng Li, Jiajie Zhang, Haoyu Wu, Jie Li, Rui Huang, in Proceedings of Advances in Image Manipulation (AIM’19) in conjunction with IEEE International Conference on Computer Vision (ICCV’19), 2019.

  • 03

    2018

    First Place in IEEE ICDM 2018 Global AI Challenge on Meteorology (as Supervisor)

  • 04

    2018

    Second Prize in Natural Science of Science and Technology Awards of China Computer Federation (CCF) 2018. Research on Biologically Inspired Features and Fisher Vector Methods and Techniques, Bingpeng Ma, Rui Huang, Annan Li, 2018

  • 05

    2014

    Best Student Paper Award of IEEE International Conference on Multimedia and Expo (ICME) 2014. An Expressive Deep Model for Parsing Human Action from a Single Image, Zhujin Liang, Xiaolong Wang, Rui Huang, Liang Lin, in Proceedings of IEEE International Conference on Multimedia and Expo (ICME’14), 2014.

  • 06

    2012

    First Prize of Hubei Province Natural Science Excellent Academic Paper Award 2012. Real-Time Skin Color Detection under Rapidly Changing Illumination Conditions, Leyuan Liu, Nong Sang, Saiyong Yang, Rui Huang, in IEEE Transactions on Consumer Electronics, Vol. 57, No. 3, 2011.

  • 07

    2007

    Outstanding Reviewers Award of IEEE International Conference on Computer Vision (ICCV), 2007.

>
Publications

Selected Journal Articles:


[J1] Denoised Non-Local Neural Network for Semantic Segmentation

Qi Song, Jie Li, Hao Guo, Rui Huang*

in IEEE Transactions on Neural Networks and Learning Systems (TNNLS), Vol. 35, No. 5, 2024.


[J2] Divide and Conquer: Improving Multi-Camera 3D Perception with 2D Semantic-Depth Priors and Input-Dependent Queries

Qi Song, Qingyong Hu, Chi Zhang, Yongquan Chen, Rui Huang*

in IEEE Transactions on Image Processing (TIP), Vol. 33, 2024.


[J3] End-to-End Video Scene Graph Generation with Temporal Propagation Transformer

Yong Zhang, Yingwei Pan*, Ting Yao, Rui Huang*, Tao Mei, Chang-Wen Chen

in IEEE Transactions on Multimedia (TMM), Vol. 26, 2024.


[J4] From Front to Rear: 3D Semantic Scene Completion through Planar Convolution and Attention-based Network

Jie Li, Qi Song, Xiaohu Yan, Yongquan Chen, Rui Huang*

in IEEE Transactions on Multimedia (TMM), Vol. 25, 2023.


[J5] Boosting Scene Graph Generation with Visual Relation Saliency

Yong Zhang, Yingwei Pan, Ting Yao, Rui Huang, Tao Mei, Chang-Wen Chen

in ACM Transactions on Multimedia Computing, Communications, and Applications (TOMM), Vol. 19, No. 1, 2023. Q1


[J6] Unsupervised Monocular Depth Perception: Focusing on Moving Objects

Hualie Jiang, Laiyan Ding, Zhenglong Sun, Rui Huang∗

in IEEE Sensors Journal, Vol. 21, No. 24. 2021. Featured Article


[J7] Cross-Modal Knowledge Adaptation for Language-Based Person Search

Yucheng Chen, Rui Huang, Hong Chang, Chuanqi Tan, Tao Xue, Bingpeng Ma

in IEEE Transactions on Image Processing (TIP), Vol. 30, No. 3, 2021.


[J8] Video-Based Pedestrian Re-Identification by Adaptive Spatio-Temporal Appearance Model

Wei Zhang, Bingpeng Ma, Kan Liu, Rui Huang*

in IEEE Transactions on Image Processing (TIP), Vol. 26, No. 4, 2017.


[J9] DeepList: Learning Deep Features with Adaptive Listwise Constraint for Person Re-identification

Jin Wang, Zheng Wang, Changxin Gao, Nong Sang, Rui Huang
in IEEE Transactions on Circuits and Systems for Video Technology (TCSVT), Vol. 27, No. 3, 2017.


[J10] Robust Visual Tracking Using Exemplar-based Detectors
Changxin Gao, Feifei Chen, Jin-Gang Yu, Rui Huang, Nong Sang
in IEEE Transactions on Circuits and Systems for Video Technology (TCSVT), Vol. 27, No. 2, 2017.


[J11] Learning Structure of Stereoscopic Image for No-reference Quality Assessment with Convolutional Neural Network

Wei Zhang, Chenfei Qu, Lin Ma, Jingwei Guan, Rui Huang
in Pattern Recognition, Vol. 59, 2016.


[J12] Multi-target Tracking Using Hough Forest Random Field
Jun Xiang, Nong Sang, Jianhua Hou, Rui Huang, Changxin Gao
in IEEE Transactions on Circuits and Systems for Video Technology (TCSVT), Vol. 26, No. 11, 2016.


[J13] Recognizing Focal Liver Lesions in CEUS with Dynamically Trained Latent Structured Models

Xiaodan Liang, Liang Lin, Qingxing Cao, Rui Huang, Yongtian Wang

in IEEE Transactions on Medical Imaging (TMI), Vol. 35, No. 3, 2016.


[J14] Real-Time Skin Color Detection under Rapidly Changing Illumination Conditions
Leyuan Liu, Nong Sang, Saiyong Yang, Rui Huang
in IEEE Transactions on Consumer Electronics (TCE), Vol. 57, No. 3, Aug, 2011.


[J15] A Level Set Method for Image Segmentation in Presence of Intensity Inhomogeneities with Application to MRI
Chunming Li, Rui Huang, Zhaohua Ding, J. Chris Gatenby, Dimitris N. Metaxas, John C. Gore
in IEEE Transactions on Image Processing (TIP), Vol. 20, No. 7, Jul, 2011.


Selected Conference Papers:


[C1] SmartEdit: Exploring Complex Instruction-based Image Editing with Multimodal Large Language Models

Yuzhou Huang, Liangbin Xie, Xintao Wang, Ziyang Yuan, Xiaodong Cun, Yixiao Ge, Jiantao Zhou, Chao Dong, Rui Huang, Ruimao Zhang, Ying Shan

in Proceedings of IEEE Computer Vision and Pattern Recognition (CVPR’24), 2024.


[C2] Incremental 3D Reconstruction through Hybrid Explicit-and-Implicit Representation

Feifei Li, Panwen Hu, Qi Song, Rui Huang*

in IEEE International Conference on Robotics and Automation (ICRA’24), oral presentation, 2024.


[C3] A Reinforcement Learning-Based Automatic Video Editing Method Using Pre-trained Vision-Language Model

Panwen Hu, Nan Xiao, Feifei Li, Yongquan Chen, Rui Huang*

in Proceedings of ACM Multimedia (ACM MM’23), 2023.


[C4] Learning to Generate Language-Supervised and Open-Vocabulary Scene Graph Using Pre-Trained Visual-Semantic Space

Yong Zhang, Yingwei Pan, Ting Yao, Rui Huang*, Tao Mei, Chang-Wen Chen

in Proceedings of IEEE Computer Vision and Pattern Recognition (CVPR’23), 2023.


[C5] Deep Semantic Statistics Matching (D2SM) Denoising Network

Kangfu Mei, Vishal M. Patel, Rui Huang*

in Proceedings of the European Conference on Computer Vision (ECCV’22), 2022.


[C6] Salient-to-Broad Transition for Video Person Re-identification

Shutao Bai, Bingpeng Ma, Hong Chang, Rui Huang, Xilin Chen

in Proceedings of IEEE Computer Vision and Pattern Recognition (CVPR’22), 2022.


[C7] Exploring Structure-aware Transformer over Interaction Proposals for Human-Object Interaction Detection

Yong Zhang, Yingwei Pan, Ting Yao, Rui Huang, Tao Mei, Chang-Wen Chen

in Proceedings of IEEE Computer Vision and Pattern Recognition (CVPR’22), 2022.


[C8] Fully Attentional Network for Semantic Segmentation

Qi Song, Jie Li, Chenghong Li, Hao Guo, Rui Huang*

in Proceeding of American Association for Artificial Intelligence (AAAI’22), 2022.


[C9] IMENet: Joint 3D Semantic Scene Completion and 2D Semantic Segmentation through Iterative Mutual Enhancement

Jie Li, Laiyan Ding, and Rui Huang*

in Proceeding of International Joint Conference on Artificial Intelligence (IJCAI’21), 2021.


[C10] BiCnet-TKS: Learning Efficient Spatial-Temporal Representation for Video Person Re-Identification

Ruibing Hou, Hong Chang, Bingpeng Ma, Rui Huang, and Shiguang Shan

in Proceedings of IEEE Computer Vision and Pattern Recognition (CVPR’21), 2021.


[C11] AttaNet: Attention-Augmented Network for Fast and Accurate Scene Parsing

Qi Song, Kangfu Mei, Rui Huang*

in Proceeding of AAAI Conference on Artificial Intelligence (AAAI’21),2021.


[C12] Sparse Single Sweep LiDAR Point Cloud Segmentation via Learning Contextual Shape Priors from Scene Completion

Xu Yan, Jiantao Gao, Jie Li, Ruimao Zhang, Zhen Li*, Rui Huang, Shuguang Cui

in Proceedings of AAAI Conference on Artificial Intelligence (AAAI’21), 2021.


[C13] Learning Memory Augmented Cascading Network for Compressed Sensing of Images

Jiwei Chen, Yubao Sun, Qingshan Liu, Rui Huang

in Proceedings of the European Conference on Computer Vision (ECCV’20), 2020.


[C14] A Spatio-temporal Appearance Representation for Video-based Pedestrian Re-identification

Kan Liu, Bingpeng Ma, Wei Zhang, Rui Huang*
in Proceedings of IEEE International Conference on Computer Vision (ICCV’15), 2015.


[C15] Person Search in a Scene by Jointly Modeling People Commonness and Person Uniqueness
Yuanlu Xu, Bingpeng Ma, Rui Huang*, Liang Lin
in Proceedings of ACM Multimedia (ACM MM’14), 2014.


[C16] A Variational Level Set Approach to Segmentation and Bias Correction of Images with Intensity Inhomogeneity

Chunming Li, Rui Huang, Zhaohua Ding, J. Chris Gatenby, Dimitris N. Metaxas, John C. Gore
in Proceedings of International Conference on Medical Image Computing and Computer Assisted Intervention (MICCAI’08), 2008.


[C17] Embedded Profile Hidden Markov Models for Shape Analysis
Rui Huang, Vladimir Pavlovic, Dimitris N. Metaxas
in Proceedings of IEEE International Conference on Computer Vision (ICCV’07), 2007.


[C18] A Graphical Model Framework for Coupling MRFs and Deformable Models

Rui Huang, Vladimir Pavlovic, Dimitris N. Metaxas
in Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR’04), 2004.


[C19] Solving the Small Sample Size Problem of LDA

Rui Huang, Qingshan Liu, Hanqing Lu, Songde Ma
in Proceedings of International Conference on Pattern Recognition (ICPR’02), 2002.


[C20] Face Recognition Using Kernel-Based Fisher Discriminant Analysis
Qingshan Liu, Rui Huang, Hanqing Lu, Songde Ma
in Proceedings of IEEE conference on Automatic Face and Gesture Recognition (FG’02), 2002.