Micro-library to normalize text strings

Navigation

Verified details

These details have been verified by PyPI
Maintainers
Avatar for occrp from gravatar.com occrp Avatar for opensanctions from gravatar.com opensanctions Avatar for pudo from gravatar.com pudo

Unverified details

These details have not been verified by PyPI
Project links
Meta
Classifiers

Project description

normality

build

Normality is a Python micro-package that contains a small set of text normalization functions for easier re-use. These functions accept a snippet of unicode or utf-8 encoded text and remove various classes of characters, such as diacritics, punctuation etc. This is useful as a preparation to further text analysis.

WARNING: This library works much better when used in combination with pyicu, a Python binding for the International Components for Unicode C library. ICU provides much better text transliteration than the default text-unidecode.

Example

# coding: utf-8
from normality import normalize, slugify, collapse_spaces

text = normalize('Nie wieder "Grüne Süppchen" kochen!')
assert text == 'nie wieder grune suppchen kochen'

slug = slugify('My first blog post!')
assert slug == 'my-first-blog-post'

text = 'this \n\n\r\nhas\tlots of \nodd spacing.'
assert collapse_spaces(text) == 'this has lots of odd spacing.'

License

normality is open source, licensed under a standard MIT license (included in this repository as LICENSE).

Project details

Verified details

These details have been verified by PyPI
Maintainers
Avatar for occrp from gravatar.com occrp Avatar for opensanctions from gravatar.com opensanctions Avatar for pudo from gravatar.com pudo

Unverified details

These details have not been verified by PyPI
Project links
Meta
Classifiers

Release history Release notifications | RSS feed

2.5.0

2.4.0

This version

2.3.3

2.3.2

2.3.1

2.3.0

2.2.5

2.2.4

2.2.3

2.2.2

2.2.1

2.1.3

2.1.2

2.1.1

2.0.0

1.0.1

1.0.0

0.6.1

0.6.0

0.5.12

0.5.11

0.5.10

0.5.8

0.5.7

0.5.6

0.5.5

0.5.4

0.5.3

0.5.2

0.5.1

0.5.0

0.4.4

0.4.3

0.4.2

0.4.1

0.4.0

0.3.9

0.3.8

0.3.7

0.3.6

0.3.5

0.3.4

0.3.3

0.3.1

0.3.0

0.2.4

0.2.3

0.2.2

0.2.1

0.2

0.1

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

normality-2.3.3.tar.gz (10.7 kB view details)

Uploaded Source

Built Distribution

normality-2.3.3-py2.py3-none-any.whl (12.9 kB view details)

Uploaded Python 2 Python 3

File details

Details for the file normality-2.3.3.tar.gz.

File metadata

  • Download URL: normality-2.3.3.tar.gz
  • Upload date:
  • Size: 10.7 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/4.0.0 CPython/3.9.12

File hashes

Hashes for normality-2.3.3.tar.gz
Algorithm Hash digest
SHA256 c9eda72c288795294db79b1fe0b285b26f0b5e2e7b20b8fa1e617eb165fc3962
MD5 76839f8fbeee9cb6c4877c85af748958
BLAKE2b-256 d51fa0b7d6c8040c4b829ae45d84d5cbb847e2faf380a050dae5da681e3225d2

See more details on using hashes here.

File details

Details for the file normality-2.3.3-py2.py3-none-any.whl.

File metadata

  • Download URL: normality-2.3.3-py2.py3-none-any.whl
  • Upload date:
  • Size: 12.9 kB
  • Tags: Python 2, Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/4.0.0 CPython/3.9.12

File hashes

Hashes for normality-2.3.3-py2.py3-none-any.whl
Algorithm Hash digest
SHA256 ebb51520cd0f50f4b7f252fd434c62bc34f71d92e5faa6b66019c6733e59b204
MD5 23ddfdc170e5223f61431ecf59a157b7
BLAKE2b-256 a9bf09631d02efe946dc998018f611af48cb521f2820fe9cdea58f59710274f1

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page