Image matching for 3D reconstruction

In this dissertation, we introduce LoGLUE, a novel method of image matching for 3D reconstruction that produces results for matching images with low texture. Compared with current image matching methods, we design a backbone with the Convolutional Neural Network (CNN) to extract both coarse- and fi...

Full description

Saved in:
Bibliographic Details
Main Author: Zhang, Yixuan
Other Authors: Tan Yap Peng
Format: Thesis-Master by Coursework
Language:English
Published: Nanyang Technological University 2023
Subjects:
Online Access:https://hdl.handle.net/10356/172862
Tags: Add Tag
No Tags, Be the first to tag this record!
Institution: Nanyang Technological University
Language: English
Description
Summary:In this dissertation, we introduce LoGLUE, a novel method of image matching for 3D reconstruction that produces results for matching images with low texture. Compared with current image matching methods, we design a backbone with the Convolutional Neural Network (CNN) to extract both coarse- and fine-level features. This dissertation’s distinct contribution is the robust framework with a cross-attention and self-attention layer from Transformer that we proposed. We design the coarse-level module to do the coarse-level matching and then use an attention-based graph neural network to design the coarse-to-fine module. The results demonstrate that our framework performance is better than other existing methods when the inputs include a large patch of low-texture images. Reconstructing scenes with poor texture quality is now possible with the suggested LoGLUE framework.