A python library for accurate and scaleable data deduplication and entity-resolution

Navigation

Verified details

These details have been verified by PyPI
Maintainers
Avatar for Derek.Eder from gravatar.com Derek.Eder Avatar for fgregg from gravatar.com fgregg

Unverified details

These details have not been verified by PyPI
Project links
Meta
Classifiers

Project description

dedupe is a library that uses machine learning to perform de-duplication and entity resolution quickly on structured data.

dedupe will help you:

  • remove duplicate entries from a spreadsheet of names and addresses

  • link a list with customer information to another with order history, even without unique customer id’s

  • take a database of campaign contributions and figure out which ones were made by the same person, even if the names were entered slightly differently for each record

dedupe takes in human training data and comes up with the best rules for your dataset to quickly and automatically find similar records, even with very large databases.

Important links:

Project details

Verified details

These details have been verified by PyPI
Maintainers
Avatar for Derek.Eder from gravatar.com Derek.Eder Avatar for fgregg from gravatar.com fgregg

Unverified details

These details have not been verified by PyPI
Project links
Meta
Classifiers

Release history Release notifications | RSS feed

3.0.3

3.0.2

3.0.1

3.0.0

2.0.24

2.0.23

2.0.22

2.0.21

2.0.20

2.0.19

2.0.18

2.0.17

2.0.16

2.0.15

2.0.14

2.0.13

2.0.12

2.0.11

2.0.10

2.0.9

2.0.8

2.0.7

2.0.6

2.0.5

2.0.4

2.0.3

2.0.2

2.0.0

1.10.0

1.9.9

1.9.8

1.9.7

1.9.6

1.9.5

1.9.4

1.9.3

1.9.2

1.9.1

1.9.0

1.8.2

1.8.1

1.8.0

1.8.0.dev1 pre-release

1.7.9

1.7.8

1.7.7

1.7.5

1.7.4

1.7.3

1.7.2

1.7.1

1.7.0

1.6.17

1.6.16

1.6.15

1.6.14

1.6.13

1.6.12

1.6.11

1.6.10

1.6.9

1.6.8

1.6.7

1.6.6

1.6.5

1.6.4

1.6.3

1.6.2

1.6.1

1.6.0

1.5.6

1.5.5

1.5.4

1.5.3

1.5.2

1.5.1

1.5.0

1.4.15

1.4.14

1.4.13

1.4.12.1

1.4.12

1.4.11

1.4.10

1.4.9

1.4.8

1.4.7

This version

1.4.6

1.4.5

1.4.4

1.4.3

1.4.2

1.4.1

1.4.0

1.3.8

1.3.7

1.3.6

1.3.5

1.3.4

1.3.3

1.3.2

1.3.1

1.3.0

1.2.8

1.2.7

1.2.6

1.2.5

1.2.4

1.2.3

1.2.2

1.2.1

1.2.0

1.1.4

1.1.3

1.1.2

1.1.1

1.1.0

1.0.2

1.0.1

1.0.0

1.0.0rc2 pre-release

1.0.0rc1 pre-release

0.8.0.1.7

0.8.0.1.6

0.8.0.1.5

0.8.0.1.4

0.8.0.1.3

0.8.0.1.1

0.8.0.1.0

0.8.0.0.8

0.8.0.0.7

0.8.0.0.6

0.8.0.0.4

0.8.0.0.3

0.8.0.0.2

0.8.0.0.1

0.8.0.0.0

0.7.7.1.9

0.7.7.1.8

0.7.7.1.7

0.7.7.1.6

0.7.7.1.5

0.7.7.1.4

0.7.7.1.3

0.7.7.1.2

0.7.7.1.1

0.7.7.1.0

0.7.7.0.4

0.7.7.0.3

0.7.7.0.2

0.7.7.0.1

0.7.7.0.0

0.7.6.9.5

0.7.6.9.4

0.7.6.9.3

0.7.6.9.2

0.7.6.9.1

0.7.6.9

0.7.6.8

0.7.6.7

0.7.6.5

0.7.6.4

0.7.6.3

0.7.6.2

0.7.6.1

0.7.6.0

0.7.5.0

0.7.4.0

0.7.3.3

0.7.3.2

0.7.3.1

0.7.3

0.6.1

0.6.0

0.5.3.0

0.5.2.1

0.5.2

0.5.1

0.5.0

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

dedupe-1.4.6.tar.gz (47.3 kB view details)

Uploaded Source

Built Distributions

dedupe-1.4.6-cp35-cp35m-macosx_10_9_x86_64.whl (50.2 kB view details)

Uploaded CPython 3.5m macOS 10.9+ x86-64

dedupe-1.4.6-cp34-cp34m-win_amd64.whl (51.0 kB view details)

Uploaded CPython 3.4m Windows x86-64

dedupe-1.4.6-cp34-cp34m-win32.whl (50.3 kB view details)

Uploaded CPython 3.4m Windows x86

dedupe-1.4.6-cp27-cp27m-win_amd64.whl (51.1 kB view details)

Uploaded CPython 2.7m Windows x86-64

dedupe-1.4.6-cp27-cp27m-win32.whl (50.2 kB view details)

Uploaded CPython 2.7m Windows x86

dedupe-1.4.6-cp27-cp27m-macosx_10_9_x86_64.whl (49.9 kB view details)

Uploaded CPython 2.7m macOS 10.9+ x86-64

File details

Details for the file dedupe-1.4.6.tar.gz.

File metadata

  • Download URL: dedupe-1.4.6.tar.gz
  • Upload date:
  • Size: 47.3 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No

File hashes

Hashes for dedupe-1.4.6.tar.gz
Algorithm Hash digest
SHA256 8517aa799a1beec2289996156842ff3326a8a17e166ce9f36aa51685c29733f3
MD5 3f1b92f541e9baedd47d61d6f6e077e3
BLAKE2b-256 690e2917d6049ae5312e06a392aba7e4181689c715e2676f2eb9cb38728ad2dd

See more details on using hashes here.

File details

Details for the file dedupe-1.4.6-cp35-cp35m-macosx_10_9_x86_64.whl.

File metadata

File hashes

Hashes for dedupe-1.4.6-cp35-cp35m-macosx_10_9_x86_64.whl
Algorithm Hash digest
SHA256 3af0755ba52376f226b73d9737db97a7041f0c972d5275ed8cf52875aefa36ac
MD5 9891d8600fb2dcfa74e20fb735293b3c
BLAKE2b-256 f9facead8afc460ef00d6dd02f6297b69d63cd07338fb8a7a43970d7529f604f

See more details on using hashes here.

File details

Details for the file dedupe-1.4.6-cp34-cp34m-win_amd64.whl.

File metadata

File hashes

Hashes for dedupe-1.4.6-cp34-cp34m-win_amd64.whl
Algorithm Hash digest
SHA256 2ecdbdfcd7edb5727adf4c0dbbc6c14b6e7946287cdae7aa9b4ab98d06138868
MD5 f0978c204b484067453dec3bcd47ebb9
BLAKE2b-256 e35f1664d50863fb47afa3c333b5e45b6dbe89d34831a536f28b7909eda4ea84

See more details on using hashes here.

File details

Details for the file dedupe-1.4.6-cp34-cp34m-win32.whl.

File metadata

File hashes

Hashes for dedupe-1.4.6-cp34-cp34m-win32.whl
Algorithm Hash digest
SHA256 c80072df28e4984a27404050f8989deb86f05290fe2fd1083a85c9b792c1b175
MD5 035567f39d8fa5d603ffb5e3a10a2a37
BLAKE2b-256 26cb385bbab638f0bb26e26b64d9025c5c4d637482bc129210b5b0319b78f701

See more details on using hashes here.

File details

Details for the file dedupe-1.4.6-cp27-cp27m-win_amd64.whl.

File metadata

File hashes

Hashes for dedupe-1.4.6-cp27-cp27m-win_amd64.whl
Algorithm Hash digest
SHA256 a8f5c87ec9c7884a3735a549df5d4de04e6088fa92b7362db6e7748d04f9a737
MD5 f224937064b2387dc377a8a031bbcec3
BLAKE2b-256 bc949b81312ad8325a84a2c0286d1987d41328afddb188fd76149564af431dbc

See more details on using hashes here.

File details

Details for the file dedupe-1.4.6-cp27-cp27m-win32.whl.

File metadata

File hashes

Hashes for dedupe-1.4.6-cp27-cp27m-win32.whl
Algorithm Hash digest
SHA256 b5d0b7740c8bf63ca9c9ec0c9ff9842d5208c4f8399bd8d01ec49193f7924d43
MD5 cd9cc4eb25e064a1103bb5d4e4624969
BLAKE2b-256 bcdf35487c1557db6d36ba9b0f48bb7c6f5db2002ddf20fc84e780be249f9f1c

See more details on using hashes here.

File details

Details for the file dedupe-1.4.6-cp27-cp27m-macosx_10_9_x86_64.whl.

File metadata

File hashes

Hashes for dedupe-1.4.6-cp27-cp27m-macosx_10_9_x86_64.whl
Algorithm Hash digest
SHA256 aa13327981042a25310944d43997e2f6936092924fbac1a11e739af27c560aec
MD5 9bd065f96f1ffac9361655b60b43424e
BLAKE2b-256 bc5cd1f8ea011a5bbdf255d75ddcff2a54dc1899d851b9da4c4826b18578640a

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page