Validation and data pipelines made easy!
Project description
Filters
The Filters library provides an easy and readable way to create complex data validation and processing pipelines, including:
Validating complex JSON structures in API requests or config files.
Parsing timestamps and converting to UTC.
Converting Unicode strings to NFC, normalizing line endings and removing unprintable characters.
Decoding Base64, including URL-safe variants.
And much more!
The output from one filter can be “piped” into the input of another, enabling you to “chain” filters together to quickly and easily create complex data pipelines.
Examples
Validate a latitude position and round to manageable precision:
(
f.Required
| f.Decimal
| f.Min(Decimal(-90))
| f.Max(Decimal(90))
| f.Round(to_nearest='0.000001')
).apply('-12.0431842')
Parse an incoming value as a datetime, convert to UTC and strip tzinfo:
f.Datetime(naive=True).apply('2015-04-08T15:11:22-05:00')
Convert every value in an iterable (e.g., list) to unicode and strip leading/trailing whitespace. This also applies Unicode normalization, strips unprintable characters and normalizes line endings automatically.
f.FilterRepeater(f.Unicode | f.Strip).apply([
b'\xe2\x99\xaa ',
b'\xe2\x94\x8f(\xc2\xb0.\xc2\xb0)\xe2\x94\x9b ',
b'\xe2\x94\x97(\xc2\xb0.\xc2\xb0)\xe2\x94\x93 ',
b'\xe2\x99\xaa ',
])
Parse a JSON string and check that it has correct structure:
(
f.JsonDecode
| f.FilterMapper(
{
'birthday': f.Date,
'gender': f.CaseFold | f.Choice(choices={'m', 'f', 'x'}),
'utcOffset':
f.Decimal
| f.Min(Decimal('-15'))
| f.Max(Decimal('+15'))
| f.Round(to_nearest='0.25'),
},
allow_extra_keys = False,
allow_missing_keys = False,
)
).apply('{"birthday":"1879-03-14", "gender":"M", "utcOffset":"1"}')
Requirements
Filters is compatible with Python 2.7 and 3.5.
Installation
Install the latest stable version via pip:
pip install filters
Install the latest development version:
pip install https://github.com/eflglobal/filters/archive/develop.zip
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distributions
Built Distribution
File details
Details for the file filters-1.1.2-py2.py3-none-any.whl
.
File metadata
- Download URL: filters-1.1.2-py2.py3-none-any.whl
- Upload date:
- Size: 34.3 kB
- Tags: Python 2, Python 3
- Uploaded using Trusted Publishing? No
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | f1d4debc549ffc1c2182a1f8e4850baeb87a2aeaac9e11fc7e7272485d5c0f6a |
|
MD5 | a821d78379a233e244a2072fae14aafb |
|
BLAKE2b-256 | e15159d50fa192cd42ea0dd01d0f75febc65ac5b6927ba70471b7d628fa1fa3d |