Semi-signed prioritized neural fitting for surface reconstruction from unoriented point clouds

WACV 2024

Runsong Zhu* 1,2     Ka Di 2     Ka-Hei Hui 1     Yue Qian 2     Shi Qiu 2     Zhen Dong 3     Linchao Bao 2     Pheng-Ann Heng 1     Chi-Wing Fu 1    
(*Work partially done during an internship at Tencent AI Lab)
1The Chinese University of Hong Kong   2Tencent AI Lab  
3Wuhan University  

Abstract

TL;DR: We propose to utilize the identified signed supervision for stable surface reconstruction from unoriented point clouds.

Reconstructing 3D geometry from unoriented point clouds can benefit many downstream tasks. Recent shape modeling methods mostly adopt implicit neural representation to fit a signed distance field (SDF) and optimize the network by unsigned supervision. However, these methods occasionally have difficulty in finding the coarse shape for complicated objects, especially suffering from the ``ghost'' surfaces (\ie, fake surfaces that should not exist). To guide the network quickly fit the coarse shape, we propose to utilize the signed supervision in regions that are obviously outside the object and can be easily determined, resulting in our semi-signed supervision. To better recover high-fidelity details, a novel loss-based region sampling strategy and a progressive positional encoding (PE) method are applied to prioritize the optimization towards underfitting and complicated regions. Specifically, we voxelize and partition the object space into sign-known and sign-uncertain regions, in which different supervisions are applied. Besides, we adaptively adjust the sampling rate of each voxel according to the tracked reconstruction loss, so that the network can focus more on the complicated under-fitting regions. We conduct extensive experiments to demonstrate that our method achieves state-of-the-art performance compared to the existing fitting-based methods and comparable performance to learning-based methods on multiple datasets.

BibTeX

@inproceedings{zhu2024ssp,
        author    = {Zhu, Runsong and Kang, Di and Hui, Ka-Hei and Qian, Yue and Qiu, Shi and Dong, Zhen and Bao, Linchao and Heng, Pheng-Ann and Fu, Chi-Wing},
        title     = {SSP: Semi-Signed Prioritized Neural Fitting for Surface Reconstruction From Unoriented Point Clouds},
        booktitle = {Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision},
        pages     = {3769--3778}
        year      = {2024}
    }