Zhensong Zhang （张镇嵩）

PhD (CUHK), MS (UCAS), BEng (Xidian)

Senior researcher
Huawei Noah's Ark Lab
Email: zhensongzhang[at]hotmail[dot]com

Biography

I joined Huawei Noah's Ark Lab after I obtained my Ph.D. degree from The Chinese University of Hong Kong in 2018. Before that, I received a BEng. degree and a M.S. degree from Xidian University and University of Chinese Academy of Sciences in 2011 and 2014, respectively. I am currently working on MLLM/AIGC/3DGS.

We are looking for self-motivated interns and full times, if you are insterested in doing cool MLLM/AIGC/3DGS projects, welcome to join us, please drop me an email.

News

Selected Publications （dblp, Google Scholar）

• [Preprint] Human Motion Video Generation: A Survey
  Haiwei Xue, Xiangyang Luo, Zhanghao Hu, Xin Zhang, Xunzhi Xiang, Yuqin Dai, Jianzhuang Liu, Zhensong Zhang, Minglei Li, Jian Yang, Fei Ma, Zhiyong Wu, Changpeng Yang, Zonghong Dai, Fei Richard Yu
  [Website]

• [NeurIPS] SCRREAM : SCan, Register, REnder And Map: A Framework for Annotating Accurate and Dense 3D Indoor Scenes with a Benchmark
  HyunJun Jung, Weihang Li, Shun-Cheng Wu, William Bittner, Nikolas Brasch, Jifei Song, Eduardo Pérez-Pellitero, Zhensong Zhang, Arthur Moreau, Nassir Navab, Benjamin Busam
  To appear in NeurIPS 2024.
  [Dataset]

• [CVPR] Co-Speech Gesture Video Generation via Motion-Decoupled Diffusion Model
  Xu He, Qiaochu Huang, Zhensong Zhang, Zhiwei Lin, Zhiyong Wu, Sicheng Yang, Minglei Li, Zhiyi Chen, Songcen Xu, Xiaofei Wu
  In CVPR 2024.
  [Code]

• [CVPR] Semantics-aware Motion Retargeting with Vision-Language Models
  Haodong Zhang, Zhike Chen, Haocheng Xu, Lei Hao, Xiaofei Wu, Songcen Xu, Zhensong Zhang, Yue Wang, Rong Xiong
  In CVPR 2024.
  [Code]

• [CVPR] Low-Res Leads the Way: Improving Generalization for Super-Resolution by Self-Supervised Learning
  Haoyu Chen, Wenbo Li, Jinjin Gu, Jingjing Ren, Haoze Sun, Xueyi Zou, Youliang Yan, Zhensong Zhang, Lei Zhu
  In CVPR 2024.
  [Website]

• [ICASSP] Conversational Co-Speech Gesture Generation via Modeling Dialog Intention, Emotion, and Context with Diffusion Models
  Haiwei Xue, Sicheng Yang, Zhensong Zhang, Zhiyong Wu, Minglei Li, Zonghong Dai, Helen Meng
  In ICASSP 2024.
  

• [IJCV] Towards A Unified Network for Robust Monocular Depth Estimation: Network Architecture, Training Strategy and Dataset
  Mochu Xiang, Yuchao Dai, Feiyu Zhang, Jiawei Shi, Xinyu Tian, Zhensong Zhang
  In IJCV.
  

• [ICMI] The DiffuseStyleGesture+ Entry to the GENEA Challenge 2023
  Sicheng Yang, Haiwei Xue, Zhensong Zhang, Minglei Li, Zhiyong Wu, Xiaofei Wu, Songcen Xu, Zonghong Dai
  In ICMI 2023.
  [Code] [Reproducibility Award]

• [ACM MM] UnifiedGesture: A Unified Gesture Synthesis Model for Multiple Skeletons
  Sicheng Yang, Zilin Wang, Zhiyong Wu, Minglei Li, Zhensong Zhang, Qiaochu Huang, Lei Hao, Songcen Xu, Xiaofei Wu, Changpeng Yang, Zonghong Dai
  In ACM MM 2023.
  [Code] [Demo] [presentation]

• [IJCAI] DiffuseStyleGesture: Stylized Audio-Driven Co-Speech Gesture Generation with Diffusion Models
  Sicheng Yang, Zhiyong Wu, Minglei Li, Zhensong Zhang, Lei Hao, Weihong Bao, Ming Cheng, Long Xiao
  In IJCAI 2023.
  [Code] [Demo]

• [CVPR Highlight] QPGesture: Quantization-Based and Phase-Guided Motion Matching for Natural Speech-Driven Gesture Generation
  Sicheng Yang, Zhiyong Wu, Minglei Li, Zhensong Zhang, Lei Hao, Weihong Bao, Haolin Zhuang
  In CVPR 2023.
  [Code] [Demo] [presentation]

• [ECCV Oral] CLIFF: Carrying Location Information in Full Frames into Human Pose and Shape Estimation
  Zhihao Li, Jianzhuang Liu, Zhensong Zhang, Songcen Xu, Youliang Yan
  In ECCV 2022.
  [Code]

• [TIP] Multi-View Video Synopsis via Simultaneous Object-Shifting and View-Switching Optimization
  Zhensong Zhang, Yongwei Nie, Hanqiu Sun, Qing Zhang, Qiuxia Lai, Guiqing Li, Mingyu Xiao
  In IEEE Transactions Image Processing, 2020.

• [TIP] Video Synopsis Incorporating Object Speed and Size Changes
  Yongwei Nie, Zhenkai Li, Zhensong Zhang, Qing Zhang, Tiezheng Ma, Hanqiu Sun
  In IEEE Transactions Image Processing, 2020.

• [TVCG] Effective Video Stabilization via Joint Trajectory Smoothing and Frame Warping
  Tiezheng Ma, Yongwei Nie, Qing Zhang, Zhensong Zhang, Hanqiu Sun, Guiqing Li
  In IEEE Transactions on Visualization and Computer Graphics, 2020.

• [TCSVT] Interactive Contour Extraction via Sketch-Alike Dense-Validation Optimization
  Yongwei Nie, Xu Cao, Ping Li, Qing Zhang, Zhensong Zhang, Guiqing Li, Hanqiu Sun
  In IEEE Transactions on Circuits Systems for Video Technology, 2020

• [PR] Video super-resolution via pre-frame constrained and deep-feature enhanced sparse reconstruction
  Qiuxia Lai, Yongwei Nie, Hanqiu Sun, Qiang Xu, Zhensong Zhang, Mingyu Xiao
  In Pattern Recognition, 2020

• [TIP] Dynamic Video Stitching via Shakiness Removing
  Yongwei Nie, Tan Su, Zhensong Zhang, Hanqiu Sun and Guiqing Li
  In IEEE Transactions on Image Processing, 2018.
  [Code] [Demo]

• [SIGGRAPH Asia] Multi-video Object Synopsis Integrating Optimal View Switching
  Zhensong Zhang, Yongwei Nie, Hanqiu Sun, Qiuxia Lai and Guiqing Li
  In SIGGRAPH Asia 2017 Technical Briefs, Bangkok, Thailand, 2017.

• [TVCG] Homography Propagation and Optimization for Wide-Baseline Street Image Interpolation
  Yongwei Nie, Zhensong Zhang, Hanqiu Sun, Tan Su and Guiqing Li
  In IEEE Transactions on Visualization and Computer Graphics, 2017.
  [Code] [Demo]

• [SIGGRAPH Asia] Video Stitching for Handheld Inputs via Combined Video Stabilization
  Tan Su, Yongwei Nie, Zhensong Zhang, Hanqiu Sun and Guiqing Li
  In SIGGRAPH Asia 2016 Technical Briefs, Macau, China, 2016.

• [ICDE] A Novel Fast and Memory Efficient Parallel MLCS Algorithm for Long and Large-Scale Sequences Alignments
  Yanni Li, Yuping Wang, Zhensong Zhang, Yaxin Wang, Ding Ma, Jianbin Huang
  In the Proceedings of the 32nd IEEE International Conference on Data Engineering, Helsinki, Finland, 2016.

• [IUI] Left and Right Hand Distinction for Multi-Touch Tabletop Interactions
  Zhensong Zhang, Fengjun Zhang, Hui Chen, Jiasheng Liu, Hongan Wang and Guozhong Dai
  In the Proceedings of the 19th international conference on Intelligent User Interfaces, Haifa, Israel, 2014.

• [DKE] Multi-Objective Optimization Integration of Query Interfaces for the Deep Web based on Attribute Constraints
  Yanni Li, Yuping Wang, Peng Jiang and Zhensong Zhang
  In Data & Knowledge Engineering, 2013.

Honors & Awards

• Winner, ECCV 2022 RVC monoculer depth estimation prediction challenge
  

Miscellanies

• Paper Lists
  Computer Graphics Papers, ECCV Papers, CVPR/ICCV Papers, NeurIPS Papers