Huijie Zhang

I am an incoming Ph.D. student at University of Michigan, Ann Arbor, supervised by Prof. Qing Qu.

Previously, I obtained my Bachelor's degree in Mechanical Engineering from Huazhong university of Science and Technology, advised by Prof. Zhigang Wu; Master's degree in Mechanical Engineering and Electrical and Computer Engineering from University of Michigan, Ann Arbor, advised by Prof. Chad Jenkins

My research interests lie in generative mode and diffusion model. My previous works are related to 3D vision, robotics manipulation and reinforcement learning. Recently, my project is related to diffusion model.

[Updated in 07/2023]

CV  /  Google Scholar  /  Github

profile photo

[08/2022] Our work on TransNet was accepted by ECCV2022 Workshop!

[07/2022] Our work on Clearpose was accepted by ECCV2022!

[06/2022] Our work on Progresslabeller was accepted by IROS2022!

TransNet: Category-Level Transparent Object Pose Estimation
Huijie Zhang, Anthony Opipari, Xiaotong Chen,
Jiyue Zhu, Zeren Yu, Odest Chadwicke Jenkins,
ECCV Workshop, 2022
arXiv /website

We proposed TransNet, a two-stage pipeline that learns to estimate category-level transparent object pose using localized depth completion and surface normal estimation.

ClearPose: Large-scale Transparent Object Dataset and Benchmark
Xiaotong Chen, Huijie Zhang, Zeren Yu,
Anthony Opipari, Odest Chadwicke Jenkins,
ECCV, 2022
arXiv /github /website

We collected a large-scale transparent object dataset with RGB-D and annotated poses. And we benchmarked transparent object depth completion and poes estimation on this dataset.

ProgressLabeller: Visual Data Stream Annotation for Training Object-Centric 3D Perception
Xiaotong Chen, Huijie Zhang, Zeren Yu,
Stanley Lewis, Odest Chadwicke Jenkins,
IROS, 2022
arXiv /github /website

ProgressLabeller is an efficient 6D pose annotation method. It is also the first open source tools compatible with transparent object. It was implemented as a blender Add-on, more user-friendly for using.

Selected Project
Deep Q-learning from demonstration on Minecraft
Huijie Zhang, Phil Kangle Mu, Ying Jiang, Sihang Wei,

This Project useed Deep Q-learning from demonstration to teach agent cutting trees in Minecraft Environment

This website has been inspired by Jon Barron.