Make record linkages in followthemoney data.

Navigation

Verified details

These details have been verified by PyPI
Maintainers
Avatar for opensanctions from gravatar.com opensanctions Avatar for pudo from gravatar.com pudo

Unverified details

These details have not been verified by PyPI
Project links
Meta
  • License: MIT
  • Author: Friedrich Lindenberg
  • Tags data, mapping, identity, followthemoney, linkage, record

Project description

nomenklatura

Nomenklatura de-duplicates and integrates different Follow the Money entities. It serves to clean up messy data and to find links between different datasets.

Design

This package will offer an implementation of an in-memory data deduplication framework centered around the FtM data model. The idea is the following workflow:

  • Accept FtM-shaped entities from a given loader (e.g. a JSON file, or a database)
  • Build an in-memory inverted index of the entities for blocking
  • Generate merge candidates using the blocking index and FtM compare
  • Provide a file-based storage format for merge challenges and decisions
  • Provide a text-based user interface to let users make merge decisions

Later on, the following might be added:

  • A web application to let users make merge decisions on the web
  • An implementation of the OpenRefine Reconciliation API based on the blocking index

This will be done in typed Python 3.

Reading

Contact, contributions etc.

This codebase is licensed under the terms of an MIT license (see LICENSE).

We're keen for any contributions, bug fixes and feature suggestions, please use the GitHub issue tracker for this repository.

Nomenklatura is currently developed thanks to a Prototypefund grant for OpenSanctions. Previous iterations of the package were developed with support from Knight-Mozilla OpenNews and the Open Knowledge Foundation Labs.

Project details

Verified details

These details have been verified by PyPI
Maintainers
Avatar for opensanctions from gravatar.com opensanctions Avatar for pudo from gravatar.com pudo

Unverified details

These details have not been verified by PyPI
Project links
Meta
  • License: MIT
  • Author: Friedrich Lindenberg
  • Tags data, mapping, identity, followthemoney, linkage, record

Release history Release notifications | RSS feed

3.13.1

3.13.0

3.12.5

3.12.4

3.12.3

3.12.1

3.12.0

3.11.5

3.11.4

3.11.3

3.11.2

3.11.1

3.10.6

3.10.5

3.10.4

3.10.3

3.10.2

3.10.1

3.9.3

3.9.2

3.9.1

3.9.0

3.8.5

3.8.4

3.8.3

3.8.2

3.8.0

3.7.0

3.6.9

3.6.8

3.6.7

3.6.6

3.6.5

3.6.4

3.6.3

3.6.2

3.6.1

3.6.0

3.5.2

3.5.1

3.5.0

3.4.2

3.4.1

3.4.0

3.3.9

3.3.8

3.3.7

3.3.6

3.3.5

3.3.4

3.3.3

3.3.2

3.3.1

3.3.0

3.2.2

3.2.1

3.2.0

3.1.0

3.0.3

3.0.1

3.0.0

2.14.1

2.14.0

2.13.2

2.13.0

2.12.0

2.11.0

2.10.1

2.10.0

2.9.5

2.9.4

2.9.3

2.9.2

2.9.1

2.9.0

2.8.2

2.8.1

2.8.0

2.7.7

2.7.6

2.7.5

2.7.4

2.7.3

2.7.2

2.7.1

2.7.0

2.6.6

2.6.5

2.6.4

2.6.3

2.6.1

2.6.0

2.5.9

2.5.8

2.5.7

2.5.6

2.5.5

2.5.4

2.5.3

2.5.2

2.5.1

2.5.0

2.4.7

2.4.6

2.4.5

2.4.4

2.4.3

2.4.2

2.4.1

2.4.0

2.3.1

2.3.0

2.2.8

2.2.7

2.2.6

2.2.5

2.2.4

2.2.3

2.2.2

2.2.1

2.1.1

2.1.0

2.0.1

2.0.0

1.4.5

1.4.4

1.4.3

1.4.2

1.4.1

1.4.0

1.3.0

1.2.5

1.2.4

1.2.3

1.2.2

1.2.1

1.2.0

1.1.2

1.1.0

1.0.3

1.0.1

1.0.0

This version

0.1.0

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

nomenklatura-0.1.0.tar.gz (13.6 kB view details)

Uploaded Source

Built Distribution

nomenklatura-0.1.0-py3-none-any.whl (16.7 kB view details)

Uploaded Python 3

File details

Details for the file nomenklatura-0.1.0.tar.gz.

File metadata

  • Download URL: nomenklatura-0.1.0.tar.gz
  • Upload date:
  • Size: 13.6 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.4.1 importlib_metadata/4.0.1 pkginfo/1.7.0 requests/2.25.1 requests-toolbelt/0.9.1 tqdm/4.60.0 CPython/3.9.4

File hashes

Hashes for nomenklatura-0.1.0.tar.gz
Algorithm Hash digest
SHA256 7b9e89494f91eb005debb82c0758d34c1cf6e17819b8141eee888a964a57458d
MD5 d59b289531e5ba07e92b4fa4ae6a635a
BLAKE2b-256 e5192e7d3c5a3b84b4c199f1e818c3167ef83ca2c8b9d7360b760b5b657016e9

See more details on using hashes here.

File details

Details for the file nomenklatura-0.1.0-py3-none-any.whl.

File metadata

  • Download URL: nomenklatura-0.1.0-py3-none-any.whl
  • Upload date:
  • Size: 16.7 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.4.1 importlib_metadata/4.0.1 pkginfo/1.7.0 requests/2.25.1 requests-toolbelt/0.9.1 tqdm/4.60.0 CPython/3.9.4

File hashes

Hashes for nomenklatura-0.1.0-py3-none-any.whl
Algorithm Hash digest
SHA256 f9ab31b96820fe9731017814c3a2501dad130b99c249210a2b998780806d4d81
MD5 640f01cb9bdc168e953de433cc89af00
BLAKE2b-256 1982c2b1318668252388947ea6acdc86b78521b89ab6d626c92934ec9fe3f8dd

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page