Skip to main content

A library for performing shingling and LSH for python.

Project description

hlwy-lsh

LSH is a Python implementation of locality sensitive hashing with minhash. It is very useful for detecting near duplicate documents.

The implementation uses the MurmurHash v3 library to create document finger prints.

Cython is needed if you want to regenerate the .cpp files for the hashing and shingling code. By default the setup script uses the pregenerated .cpp sources, you can change this with the USE_CYTHON flag in setup.py

NumPy is needed to run the code.

The MurmurHash3 library is distributed under the MIT license. More information https://github.com/aappleby/smhasher

Installation

$ pip install hlwy-lsh
…

✨🍰✨

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

hlwy-lsh-0.3.6.tar.gz (126.4 kB view details)

Uploaded Source

File details

Details for the file hlwy-lsh-0.3.6.tar.gz.

File metadata

  • Download URL: hlwy-lsh-0.3.6.tar.gz
  • Upload date:
  • Size: 126.4 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/1.14.0 pkginfo/1.5.0.1 requests/2.22.0 setuptools/41.2.0 requests-toolbelt/0.9.1 tqdm/4.35.0 CPython/3.7.4

File hashes

Hashes for hlwy-lsh-0.3.6.tar.gz
Algorithm Hash digest
SHA256 b845bc7f74979bf4a0a8b02b747c68508e3c73a205827e737a3f370c2ef879d7
MD5 8ae4ecf6c3e1669b54dc24e5bf2e7922
BLAKE2b-256 bbd49e298f081e84d8af940e35c8e7684ec54b5b4cf5388479a6fb5e5e7340ab

See more details on using hashes here.

Provenance

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page