Half-Truths Break Similarity-Based Retrieval
IntermediateBora Kargi, Arnas Uselis et al.Feb 27arXiv
Similarity-based image–text models like CLIP can be fooled by “half-truths,” where adding one plausible but wrong detail makes a caption look more similar to an image instead of less similar.
#half-truth vulnerability#similarity-based retrieval#CLIP