标题：A Survey on the Deep Learning-Based Mismatch Removal: Principles and Methods

作者：SHIYU CHEN, CAILONG DENG, YONG ZHANG, YONG WANG, QIXIN ZHANG1, ZHIMIN ZHOU

来源出版物：IEEE

DOI: 10.1109/ACCESS.2023.3320682

出版年：2023

文献类型：Article

语种：英文

摘要：Due to the inherent limitations of matching algorithms and the complexities associated with image contents, mismatches are inevitable and can have detrimental effects on downstream tasks in computer vision and remote sensing. Researchers have published numerous reviews on mismatch removal, which may suffer from two primary deficiencies. Firstly, these reviews are often embedded within studies that primarily focus on image matching, thereby limiting the detailed and comprehensive analysis of mismatch removal methods. Secondly, reviews of deep learning (DL)-based methods, despite their numerous existence and interconnection, tend to be fragmentary and lack a systematic approach. To address these two shortcomings, this paper presents a comprehensive survey of DL-based mismatch removal principles and methods. We provide a summary of network architectures, techniques for extracting geometrical information, and various training modes. Specifically, we highlight the importance of permutation invariance in mining operations, enumerate a majority of existing mining methods, and provide an explanation of their permutation invariant properties. Furthermore, we present both the intuitive motivation and mathematical analysis of commonly used methods, elucidating their underlying principles and efficacy. In the conclusion, we predict upcoming trends based on the findings of our review, aiming to provide valuable insights into mismatch removal techniques and guide their practical applications.

关键词：Image matching, mismatch removal, deep learning, geometrical information mining, permutation invariant.

影响因子：3.9

论文链接：https://ieeexplore.ieee.org/abstract/document/10267963