Skip to content

Topic: Locality-sensitive hashing

Seminar
4 seminars
Seminar · Machine Learning

Efficient Reductions for k-Nearest Neighbor Search

Rasmus Pagh · IT University of Copenhagen

Fri, Nov 30, 2018 · 00:00 UTC

Theory for high-dimensional nearest-neighbor search often assumes a known search radius, a specified approximation ratio, and a request for one nearby point. Practical applications instead ask for the exact k nearest points without knowing the relevant radius; an appropriate approximation parameter also depends on the data distribution. Existing reductions between these formulations introduce polylogarithmic time or space overhead that can make them unattractive in practice. This talk presents simple, more efficient reductions that solve k-nearest-neighbor search using locality-sensitive hashi

Seminar · Machine Learning

Importance Sampling in High Dimensions via Hashing

Moses Charikar · Stanford University

Wed, Nov 28, 2018 · 17:30 UTC

Locality-sensitive hashing is widely used for high-dimensional nearest-neighbor search. This talk develops another view of hashing as a biased sampling method for density-estimation queries. Given a point set and a query, one may estimate kernel density by summing distance-dependent influence functions, or count points within a chosen radius. A linear scan is costly for large datasets and many queries. The presentation surveys recent methods that preprocess the data and use locality-sensitive hashing to construct unbiased estimators for these problems and their extensions. It covers joint work

Seminar · Machine Learning

Adventures with Randomized Algebra for Extreme-Scale Signal Processing

Anshumali Shrivastava · Rice University

Wed, Sep 26, 2018 · 21:00 UTC

At extreme scale, even conventional sampling and projection methods can become too expensive. This talk treats locality-sensitive hashing as an amortized constant-time adaptive sampler, connecting probabilistic hash tables with efficient unbiased statistical estimators. A few hash lookups can support adaptive estimation at a cost close to uniform sampling. Applications include partition-function estimation for large natural-language models such as word2vec, adaptive gradient estimation for stochastic gradient descent, and sublinear deep learning with very large parameter spaces. The talk also

Seminar · Machine Learning

Nearest Neighbor Methods I

Ilya Razenshteyn · Microsoft Research

Fri, Aug 31, 2018 · 16:30 UTC

This two-part tutorial considers the problem of indexing points in a metric space so that a query can efficiently retrieve an approximately closest stored point. It surveys established and newer data structures for high-dimensional nearest-neighbor search. The first part examines search under the l1 and Euclidean l2 distances, including locality-sensitive hashing and data-dependent hashing. The second part turns to non-Euclidean geometries and recent approaches such as spectral partitioning for metric spaces.

We use cookies for analytics.