A Python package that provides helpers for cleaning, deduplication, enrichment, etc. in Spark
Project description
Spark ETL Python
A Python package that provides helpers for cleaning, deduplication, enrichment, etc. in Spark
Free software: MIT license
Documentation: https://spark-etl-python.readthedocs.io.
Features
TODO
Develop
In order to be able to develop on this package:
Create a virtual environment
Install pip-tools: pip install pip-tools
Run pip-sync requirements_dev.txt requirements.txt
To update dependencies, add them to requirements.in (if they are needed to run the package) or requirements_dev.in. Then run pip-compile requirements.in or pip-compile requirements_dev.in.
Credits
This package was created with Cookiecutter and the audreyr/cookiecutter-pypackage project template.
History
0.1.0 (2018-10-19)
First release on PyPI.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
File details
Details for the file spark_etl_python-0.1.5.tar.gz
.
File metadata
- Download URL: spark_etl_python-0.1.5.tar.gz
- Upload date:
- Size: 9.2 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/1.12.1 pkginfo/1.4.2 requests/2.21.0 setuptools/40.6.3 requests-toolbelt/0.8.0 tqdm/4.28.1 CPython/3.6.3
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 61e0277094a05333953789b848082e0679a13046a50c915b3beee2c049f6b702 |
|
MD5 | 46fba0707487dea5da07272ae0a10cab |
|
BLAKE2b-256 | d8515ab741032068982c7c9cc44482e2d08000c59951555b6f18033a17ee1181 |
File details
Details for the file spark_etl_python-0.1.5-py2.py3-none-any.whl
.
File metadata
- Download URL: spark_etl_python-0.1.5-py2.py3-none-any.whl
- Upload date:
- Size: 4.1 kB
- Tags: Python 2, Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/1.12.1 pkginfo/1.4.2 requests/2.21.0 setuptools/40.6.3 requests-toolbelt/0.8.0 tqdm/4.28.1 CPython/3.6.3
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 88a12e33433993fdfbb97ed5caa72b838cee000b2e9f48012e524bedc1d00454 |
|
MD5 | 3da6e63d45636b2f2cb8096c8d9e05a4 |
|
BLAKE2b-256 | 35fb877892a5ba2f3d0f2f4b700f3284ddbcaac9fae0ce9f7995b584e30f90a8 |