arxivcs.IRcs.AI2026-07-01
Real-Time Hard Negative Sampling via LLM-based Clustering for Large-Scale Two-Tower Retrieval
Ivan Ji, Liuyi Hu, Harrison, Zhao, Lei Huang, Qunshu Zhang, et al.
The two-tower model has been widely used for large-scale recommendation systems, particularly in the retrieval stage. Industry standards for training two-tower models typically involve in-batch and/or out-of-batch negative sampling. However, these methods often produce easy negat…