SAH: Shifting-Aware Asymmetric Hashing for Reverse k Maximum Inner Product Search

Authors

  • Qiang Huang National University of Singapore
  • Yanhao Wang East China Normal University
  • Anthony K. H. Tung National University of Singapore

DOI:

https://doi.org/10.1609/aaai.v37i4.25550

Keywords:

DMKM: Web Search & Information Retrieval, ML: Probabilistic Methods

Abstract

This paper investigates a new yet challenging problem called Reverse k-Maximum Inner Product Search (RkMIPS). Given a query (item) vector, a set of item vectors, and a set of user vectors, the problem of RkMIPS aims to find a set of user vectors whose inner products with the query vector are one of the k largest among the query and item vectors. We propose the first subquadratic-time algorithm, i.e., Shifting-aware Asymmetric Hashing (SAH), to tackle the RkMIPS problem. To speed up the Maximum Inner Product Search (MIPS) on item vectors, we design a shifting-invariant asymmetric transformation and develop a novel sublinear-time Shifting-Aware Asymmetric Locality Sensitive Hashing (SA-ALSH) scheme. Furthermore, we devise a new blocking strategy based on the Cone-Tree to effectively prune user vectors (in a batch). We prove that SAH achieves a theoretical guarantee for solving the RMIPS problem. Experimental results on five real-world datasets show that SAH runs 4~8x faster than the state-of-the-art methods for RkMIPS while achieving F1-scores of over 90%. The code is available at https://github.com/HuangQiang/SAH.

Downloads

Published

2023-06-26

How to Cite

Huang, Q., Wang, Y., & Tung, A. K. H. (2023). SAH: Shifting-Aware Asymmetric Hashing for Reverse k Maximum Inner Product Search. Proceedings of the AAAI Conference on Artificial Intelligence, 37(4), 4312-4321. https://doi.org/10.1609/aaai.v37i4.25550

Issue

Section

AAAI Technical Track on Data Mining and Knowledge Management