Randomized Embeddings with Slack and High-Dimensional Approximate Nearest Neighbor

Evangelos Anagnostopoulos (1) , Ioannis Z. Emiris (1, 2, 3) , Ioannis Psarros (1)

1 NKUA - National and Kapodistrian University of Athens
2 ERGA - Laboratory of Algebraic and Geometric Algorithms [Kapodistrian Univ]
3 AROMATH - AlgebRe, geOmetrie, Modelisation et AlgoriTHmes

The approximate nearest neighbor problem (e-ANN) in high dimensional Euclidean space has been mainly addressed by Locality Sensitive Hashing (LSH), which has polynomial dependence in the dimension, sublinear query time, but subquadratic space requirement. In this paper, we introduce a new definition of "low-quality" embeddings for metric spaces. It requires that, for some query point q, there exists an approximate nearest neighbor among the pre-images of the k > 1 approximate nearest neighbors in the target space. Focusing on Euclidean spaces, we employ random projections in order to reduce the original problem to one in a space of dimension inversely proportional to k. The k approximate nearest neighbors can be efficiently retrieved by a data structure such as BBD-trees. The same approach is applied to the problem of computing an approximate near neighbor, where we obtain a data structure requiring linear space, and query time in O(dn^ρ), for ρ ≈ 1 − e^2 / log(1/e). This directly implies a solution for e-ANN, while achieving a better exponent in the query time than the method based on BBD-trees. Better bounds are obtained in the case of doubling subsets of Euclidean space, by combining our method with r-nets. We implement our method in C++, and present experimental results in dimension up to 500 and 1Mil. points, which show that performance is better than predicted by the analysis. In addition, we compare our ANN approach to E2LSH, which implements LSH, and we show that the theoretical advantages of each method are reflected on their actual performance.

Domaines: Informatique [cs]; Géométrie algorithmique [cs.CG]; Algorithme et structure de données [cs.DS]; Mathématiques [math]; Géométrie métrique [math.MG]; Mathématique discrète [cs.DM]

Evangelos Anagnostopoulos, Ioannis Z. Emiris, Ioannis Psarros. Randomized Embeddings with Slack and High-Dimensional Approximate Nearest Neighbor. ACM Transactions on Algorithms, 2018, 14 (2), pp.1 - 21. ⟨10.1145/3178540⟩. ⟨hal-01897269⟩