The research paper discusses the use of Stable Diffusion (SD) for semantic matching of keypoints in image pairs. The authors introduce SD4Match, a method that uses a basic prompt tuning technique to harness the potential of SD, leading to significant accuracy enhancement. The approach also includes a novel conditional prompting module that conditions the prompt on the input image pair’s local details, further improving performance. The method outperforms previous ones by 12% on the SPair-71k dataset.
Publication date: 26 Oct 2023
Project Page: https://arxiv.org/abs/2310.17569v1
Paper: https://arxiv.org/pdf/2310.17569
