photo

Lang Nie   聂浪

I am a fourth-year Ph.D. student at Beijing Jiaotong University (BJTU) in MePro, supervised by Prof. Chunyu Lin and Prof. Yao Zhao. Recently, I have been fortunate to work with Prof. Shuaicheng Liu at University of Electronic Science and Technology of China (UESTC). Prior to that, I received my Bachelor degree at Computer Science and Technology from BJTU.

My research interests cover a range of computer vision and deep learning. I have authored or co-authored about 20 academic papers in top-tier international conferences and journals, including CVPR, ICCV, ECCV, TPAMI, TIP, TMM, TCSVT, etc. I'm open to any kind of collaboration. Please feel free to contact me through email.

  nielang [at] bjtu.edu.cn             Google Scholar             Github

Research Interests

Recently, I've been interested in exploring various image warps with deep learning, such as homography, mesh, optical flow, thin-plate spline, etc. These deep warps provide new solutions for classic computer vision tasks (e.g. image stitching, video stabilization, and so on) and demonstrate impressive performance. The specific intersts are listed below:

1) Multi-view geometry and image processing:

image/video stitching, image rectangling, homography estimation, video stabilization

3) Panoramic scene understanding:

panoramic objection detection, semantic segmentation, depth estimation, layout estimation

2) 3D reconstruction and view synthesis:

multi-view stereo (MVS), MVS + NeRF


Selected Publications

Preprint

StabStitch++: Unsupervised Online Video Stitching with Spatiotemporal Bidirectional Warps
Lang Nie, Chunyu Lin, Kang Liao, Yun Zhang, Shuaicheng Liu, Yao Zhao
[Paper] [Code] [Video]

Deep Learning for Camera Calibration and Beyond: A Survey
Kang Liao, Lang Nie, Shujun Huang, Chunyu Lin, Jing Zhang, Yao Zhao, Moncef Gabbouj, Dacheng Tao
[Paper] [Project Page]

Revisiting 360 Depth Estimation with PanoGabor: A New Fusion Perspective
Zhijie Shen, Chunyu Lin, Lang Nie, Kang Liao
[Paper] [Code]

SGFormer: Spherical Geometry Transformer for 360◦ Depth Estimation
Junsong Zhang, Zisong Chen, Chunyu Lin, Lang Nie, Zhijie Shen, Yao Zhao
[Paper] [Code]

2024

Semi-Supervised Coupled Thin-Plate Spline Model for Rotation Correction and Beyond
Lang Nie, Chunyu Lin, Kang Liao, Shuaicheng Liu, Yao Zhao
IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI)
[Paper] [Code]

360 Layout Estimation via Orthogonal Planes Disentanglement and Multi-view Geometric Consistency Perception
IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI)
Zhijie Shen, Chunyu Lin, Junsong Zhang, Lang Nie, Kang Liao, Yao Zhao
[Paper] [Code]

Eliminating Warping Shakes for Unsupervised Online Video Stitching
Lang Nie, Chunyu Lin, Kang Liao, Yun Zhang, Shuaicheng Liu, Rui Ai, Yao Zhao
European Conference on Computer Vision (ECCV)
[Paper] [Code] [Video]

Digging into contrastive learning for robust depth estimation with diffusion models
Jiyuan Wang, Chunyu Lin, Lang Nie, Kang Liao, Shuwei Shao, Yao Zhao
ACM Multimedia (ACM MM)
[Paper] [Code]

Towards Oriented Fisheye Object Detection: Dataset and Baseline
Jialin Yang, Chunyu Lin, Lang Nie, Zisen Kong, Jiapeng Wang, Yao Zhao
ACM Transactions on Multimedia Computing, Communications and Applications (TOMM)
[Paper] [Code]

TG-Pose: Delving into Topology and Geometry for Category-level Object Pose Estimation
Yue Zhan, Xin Wang, Lang Nie, Yang Zhao, Tangwen Yang, Qiuqi Ruan
IEEE Transactions on Multimedia (TMM)
[Paper] [Code] [Project Page]

WeatherDepth: Curriculum Contrastive Learning for Self-Supervised Depth Estimation under Adverse Weather Conditions
Jiyuan Wang, Chunyu Lin, Lang Nie, Shujun Huang, Yao Zhao, Xing Pan, Rui Ai
IEEE International Conference on Robotics and Automation (ICRA)
[Paper] [Code]

RecStitchNet: Learning to Stitch Images with Rectangular Boundaries
Yun Zhang, Yu-Kun Lai, Lang Nie, Fang-Lue Zhang, Lin Xu
Computational Visual Media Journal (CVMJ)
[Paper]

2023

S-OmniMVS: Incorporating Sphere Geometry into Omnidirectional Stereo Matching
Zisong Chen, Chunyu Lin, Lang Nie, Zhijie Shen, Kang Liao, Yuanzhouhan Cao, Yao Zhao
ACM Multimedia (ACM MM). (Oral presentation)
[Paper]

Parallax-Tolerant Unsupervised Deep Image Stitching
Lang Nie, Chunyu Lin, Kang Liao, Shuaicheng Liu, Yao Zhao
International Conference on Computer Vision (ICCV)
[Paper] [Code]

RecRecNet: Rectangling Rectified Wide-Angle Images by Thin-Plate Spline Model and DoF-based Curriculum Learning
Kang Liao*, Lang Nie*, Chunyu Lin, Zishuo Zheng, Yao Zhao (* Equal contribution)
International Conference on Computer Vision (ICCV)
[Paper] [Code]

GAFlow: Incorporating Gaussian Attention into Optical Flow
Ao Luo, Fan Yang, Xin Li, Lang Nie, Chunyu Lin, Haoqiang Fan, Shuaicheng Liu
International Conference on Computer Vision (ICCV)
[Paper] [Code]

Unsupervised OmniMVS: Efficient Omnidirectional Depth Inference via Establishing Pseudo-Stereo Supervision
Zisong Chen, Chunyu Lin, Lang Nie, Kang Liao, Yao Zhao
IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)
[Paper] [Code]

Deep Rotation Correction without Angle Prior
Lang Nie, Chunyu Lin, Kang Liao, Shuaicheng Liu, Yao Zhao
IEEE Transactions on Image Processing (TIP)
[Paper] [Code] [Dataset]

Disentangling Orthogonal Planes for Indoor Panoramic Room Layout Estimation with Cross-Scale Distortion Awareness
Zhijie Shen, Zishuo Zheng, Chunyu Lin, Lang Nie, Kang Liao, Shuai Zheng, Yao Zhao
IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
[Paper] [Code]

As-Deformable-As-Possible Single-image-based View Synthesis without Depth Prior
Chunlan Zhang, Chunyu Lin, Kang Liao, Lang Nie, Yao Zhao
IEEE Transactions on Circuits and Systems for Video Technology (TCSVT)
[Paper]

Complementary Bi-directional Feature Compression for Indoor 360° Semantic Segmentation with Self-distillation
Zishuo Zheng, Chunyu Lin, Lang Nie, Kang Liao, Zhijie Shen, Yao Zhao
Winter Conference on Applications of Computer Vision (WACV)
[Paper]

2022

Deep Rectangling for Image Stitching: A Learning Baseline
Lang Nie, Chunyu Lin, Kang Liao, Shuaicheng Liu, Yao Zhao
IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). (Oral presentation)
[Paper] [Code] [Dataset] [Video] [Chinese Blog]

PanoFormer: Panorama Transformer for Indoor 360° Depth Estimation
Zhijie Shen, Chunyu Lin, Kang Liao, Lang Nie, Zishuo Zheng, Yao Zhao
European Conference on Computer Vision (ECCV)
[Paper] [Code]

SivsFormer: Parallax-Aware Transformers for Single-image-based View Synthesis
Chunlan Zhang, Chunyu Lin, Kang Liao, Lang Nie, Yao Zhao
IEEE Conference on Virtual Reality and 3D User Interfaces (VR)
[Paper]

Neural Contourlet Network for Monocular 360° Depth Estimation
Zhijie Shen, Chunyu Lin, Lang Nie, Kang Liao, Yao Zhao
IEEE Transactions on Circuits and Systems for Video Technology (TCSVT)
[Paper] [Code]

2021

Unsupervised Deep Image Stitching: Reconstructing Stitched Features to Images
Lang Nie, Chunyu Lin, Kang Liao, Shuaicheng Liu, Yao Zhao
IEEE Transactions on Image Processing (TIP)
[Paper] [Code] [Dataset] [Chinese Blog]

Depth-Aware Multi-Grid Deep Homography Estimation with Contextual Correlation
Lang Nie, Chunyu Lin, Kang Liao, Shuaicheng Liu, Yao Zhao
IEEE Transactions on Circuits and Systems for Video Technology (TCSVT)
[Paper] [Code]]

Learning Edge-Preserved Image Stitching from Multi-Scale Deep Homography
Lang Nie, Chunyu Lin, Kang Liao, Yao Zhao
Neurocomputing (NEUCOM)
[Paper]

2020

A View-Free Image Stitching Network Based on Global Homography
Lang Nie, Chunyu Lin, Kang Liao, Meiqin Liu, Yao Zhao
Journal of Visual Communication and Image Representation (JVCIR)
[Paper] [Code]


Selected Awards

  • First Price in China Graduate AI Innovation Competition (Sep. 2024. Team leader.)
  • Winner of MVL Challenge on OmniCV Workshop at CVPR2023 (Jun. 2023)
  • Ph.D. Innovation Fund of BJTU (Apr. 2022)
  • China National Scholarship (Nov. 2024.)
  • China National Scholarship (Oct. 2022.)
  • China National Scholarship (Oct. 2020.)

Academic Service & Activities

Frequent Reviewer

  • IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI)
  • International Journal of Computer Vision (IJCV)
  • IEEE Transactions on Image Processing (TIP)
  • IEEE Transactions on Circuits and Systems for Video Technology (TCSVT)
  • IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
  • International Conference on Computer Vision (ICCV)
  • European Conference on Computer Vision (ECCV)
  • IEEE Winter Conference on Applications of Computer Vision (WACV)
  • IEEE International Conference on Robotics and Automation (ICRA)

Invited Talk