photo

Lang Nie   聂浪

I am a third-year Ph.D. student at Beijing Jiaotong University (BJTU) in MePro (led by Prof. Yao Zhao), supervised by Prof. Chunyu Lin. I have been fortunate to work with Prof. Shuaicheng Liu at University of Electronic Science and Technology of China (UESTC). Prior to that, I received my Bachelor degree at Computer Science and Technology from BJTU.

Recently I am looking for a research intern position with a special interest in multi-view geometry and deep learning. Here is my resume.

  nielang@bjtu.edu.cn             Google Scholar             Github

Research Interests

I am interested in exploring image warps using deep learning, such as homography, mesh, optical flow, thin-plate spline, etc. These deep warps provide new solutions for classic computer vision tasks (e.g. image stitching, video stabilization and so on) and demonstrate impressive performance. The specific intersts are listed below:

1) Multi-view geometry and image processing:

image/video stitching, image rectangling, homography estimation, video stabilization

3) Panoramic scene understanding:

panoramic objection detection, semantic segmentation, depth estimation, layout estimation

2) 3D reconstruction and view synthesis:

multi-view stereo (MVS), MVS + NeRF


Selected Publications

Preprint

Eliminating Warping Shakes for Unsupervised Online Video Stitching
Lang Nie, Chunyu Lin, Kang Liao, Yun Zhang, Shuaicheng Liu, Rui Ai, Yao Zhao
[Paper] [Code] [Video]

Semi-Supervised Coupled Thin-Plate Spline Model for Rotation Correction and Beyond
Lang Nie, Chunyu Lin, Kang Liao, Shuaicheng Liu, Yao Zhao
[Paper] [Code]

Deep Learning for Camera Calibration and Beyond: A Survey
Kang Liao, Lang Nie, Shujun Huang, Chunyu Lin, Jing Zhang, Yao Zhao, Moncef Gabbouj, Dacheng Tao
[Paper] [Project Page]

360 Layout Estimation via Orthogonal Planes Disentanglement and Multi-view Geometric Consistency Perception
Zhijie Shen, Chunyu Lin, Junsong Zhang, Lang Nie, Kang Liao, Yao Zhao
[Paper] [Code]

2024

WeatherDepth: Curriculum Contrastive Learning for Self-Supervised Depth Estimation under Adverse Weather Conditions
Jiyuan Wang, Chunyu Lin, Lang Nie, Shujun Huang, Yao Zhao, Xing Pan, Rui Ai
IEEE International Conference on Robotics and Automation (ICRA)
[Paper] [Code]

RecStitchNet: Learning to Stitch Images with Rectangular Boundaries
Yun Zhang, Yu-Kun Lai, Lang Nie, Fang-Lue Zhang, Lin Xu
Computational Visual Media Journal (CVMJ)
[Paper]

2023

S-OmniMVS: Incorporating Sphere Geometry into Omnidirectional Stereo Matching
Zisong Chen, Chunyu Lin, Lang Nie, Zhijie Shen, Kang Liao, Yuanzhouhan Cao, Yao Zhao
ACM Multimedia (MM). (Oral presentation)
[Paper] [Code]

Parallax-Tolerant Unsupervised Deep Image Stitching
Lang Nie, Chunyu Lin, Kang Liao, Shuaicheng Liu, Yao Zhao
International Conference on Computer Vision (ICCV)
[Paper] [Code]

RecRecNet: Rectangling Rectified Wide-Angle Images by Thin-Plate Spline Model and DoF-based Curriculum Learning
Kang Liao*, Lang Nie*, Chunyu Lin, Zishuo Zheng, Yao Zhao (* Equal contribution)
International Conference on Computer Vision (ICCV)
[Paper] [Code]

GAFlow: Incorporating Gaussian Attention into Optical Flow
Ao Luo, Fan Yang, Xin Li, Lang Nie, Chunyu Lin, Haoqiang Fan, Shuaicheng Liu
International Conference on Computer Vision (ICCV)
[Paper] [Code]

Unsupervised OmniMVS: Efficient Omnidirectional Depth Inference via Establishing Pseudo-Stereo Supervision
Zisong Chen, Chunyu Lin, Lang Nie, Kang Liao, Yao Zhao
IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)
[Paper] [Code]

Deep Rotation Correction without Angle Prior
Lang Nie, Chunyu Lin, Kang Liao, Shuaicheng Liu, Yao Zhao
IEEE Transactions on Image Processing (TIP)
[Paper] [Code] [Dataset]

Disentangling Orthogonal Planes for Indoor Panoramic Room Layout Estimation with Cross-Scale Distortion Awareness
Zhijie Shen, Zishuo Zheng, Chunyu Lin, Lang Nie, Kang Liao, Shuai Zheng, Yao Zhao
IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
[Paper] [Code]

As-Deformable-As-Possible Single-image-based View Synthesis without Depth Prior
Chunlan Zhang, Chunyu Lin, Kang Liao, Lang Nie, Yao Zhao
IEEE Transactions on Circuits and Systems for Video Technology (TCSVT)
[Paper]

Complementary Bi-directional Feature Compression for Indoor 360° Semantic Segmentation with Self-distillation
Zishuo Zheng, Chunyu Lin, Lang Nie, Kang Liao, Zhijie Shen, Yao Zhao
Winter Conference on Applications of Computer Vision (WACV)
[Paper]

2022

Deep Rectangling for Image Stitching: A Learning Baseline
Lang Nie, Chunyu Lin, Kang Liao, Shuaicheng Liu, Yao Zhao
IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). (Oral presentation)
[Paper] [Code] [Dataset] [Video] [Chinese Blog]

PanoFormer: Panorama Transformer for Indoor 360° Depth Estimation
Zhijie Shen, Chunyu Lin, Kang Liao, Lang Nie, Zishuo Zheng, Yao Zhao
European Conference on Computer Vision (ECCV)
[Paper] [Code]

SivsFormer: Parallax-Aware Transformers for Single-image-based View Synthesis
Chunlan Zhang, Chunyu Lin, Kang Liao, Lang Nie, Yao Zhao
IEEE Conference on Virtual Reality and 3D User Interfaces (VR)
[Paper]

Neural Contourlet Network for Monocular 360° Depth Estimation
Zhijie Shen, Chunyu Lin, Lang Nie, Kang Liao, Yao Zhao
IEEE Transactions on Circuits and Systems for Video Technology (TCSVT)
[Paper] [Code]

2021

Unsupervised Deep Image Stitching: Reconstructing Stitched Features to Images
Lang Nie, Chunyu Lin, Kang Liao, Shuaicheng Liu, Yao Zhao
IEEE Transactions on Image Processing (TIP)
[Paper] [Code] [Dataset] [Chinese Blog]

Depth-Aware Multi-Grid Deep Homography Estimation with Contextual Correlation
Lang Nie, Chunyu Lin, Kang Liao, Shuaicheng Liu, Yao Zhao
IEEE Transactions on Circuits and Systems for Video Technology (TCSVT)
[Paper] [Code]

Learning Edge-Preserved Image Stitching from Multi-Scale Deep Homography
Lang Nie, Chunyu Lin, Kang Liao, Yao Zhao
Neurocomputing (NEUCOM)
[Paper]

2020

A View-Free Image Stitching Network Based on Global Homography
Lang Nie, Chunyu Lin, Kang Liao, Meiqin Liu, Yao Zhao
Journal of Visual Communication and Image Representation (JVCIR)
[Paper] [Code]


Selected Awards

  • Winner Award of Multi-View Layout (MVL) Challenge at CVPR2023 OmniCV Workshop
  • Ph.D. Innovation Fund of BJTU (Apr. 2022)
  • China National Scholarship (Oct. 2022. 2% awarded.)
  • China National Scholarship (Oct. 2020. 3% awarded.)

Academic Service & Activities

Frequent Reviewer

  • IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
  • International Conference on Computer Vision (ICCV)
  • European Conference on Computer Vision (ECCV)
  • IEEE Winter Conference on Applications of Computer Vision (WACV)
  • International Journal of Computer Vision (IJCV)
  • IEEE Transactions on Image Processing (TIP)
  • IEEE Transactions on Circuits and Systems for Video Technology (TCSVT)
  • Information Fusion
  • Neural Network
  • Neurocomputing
  • Signal, Image and Video Processing

Invited Talk