arxivcs.AI2026-07-02
SemHash-LLM: A Multi-Granularity Semantic Hashing Framework for Document Deduplication
Xinyi Fang, Kejian Tong, Jiabei Liu, Tao Ning, Yuhang He
Large scale document deduplication must preserve semantic equivalence while remaining efficient over massive corpora. We present SemHash LLM, a multi granularity framework that unifies semantic projection hashing, attention weighted MinHash, contrastive boundary learning, and sel…