Frictionless Framework is a framework to describe, extract, validate, and transform tabular data
Project description
Frictionless Framework
Frictionless Framework is a framework to describe, extract, validate, and transform tabular data. It supports a great deal of data sources and formats, as well as provides popular platforms integrations. The framework is powered by the lightweight yet comprehensive Frictionless Data Specifications.
[Important Notice] We have renamed
goodtablestofrictionlesssince version 3. The framework got various improvements and was extended to be a complete data solution. The change in not breaking for the existing software so no actions are required. Please read the Migration Guide fromgoodtablesto Frictionless Framework.
Purpose
- Describe your data: You can infer, edit and save metadata of your data tables. It's a first step for ensuring data quality and usability. Frictionless metadata includes general information about your data like textual description, as well as, field types and other tabular data details.
- Extract your data: You can read your data using a unified tabular interface. Data quality and consistency are guaranteed by a schema. Frictionless supports various file protocols like HTTP, FTP, and S3 and data formats like CSV, XLS, JSON, SQL, and others.
- Validate your data: You can validate data tables, resources, and datasets. Frictionless generates a unified validation report, as well as supports a lot of options to customize the validation process.
- Transform your data: You can clean, reshape, and transfer your data tables and datasets. Frictionless provides a pipeline capability and a lower-level interface to work with the data.
Features
- Powerful Python framework
- Convenient command-line interface
- Low memory consumption for data of any size
- Reasonable performance on big data
- Support for compressed files
- Custom checks and formats
- Fully pluggable architecture
- The included API server
- More than 1000+ tests
Example
$ frictionless validate data/invalid.csv
[invalid] data/invalid.csv
row field code message
----- ------- ---------------- --------------------------------------------
3 blank-header Header in field at position "3" is blank
4 duplicate-header Header "name" in field "4" is duplicated
2 3 missing-cell Row "2" has a missing cell in field "field3"
2 4 missing-cell Row "2" has a missing cell in field "name2"
3 3 missing-cell Row "3" has a missing cell in field "field3"
3 4 missing-cell Row "3" has a missing cell in field "name2"
4 blank-row Row "4" is completely blank
5 5 extra-cell Row "5" has an extra value in field "5"
Documentation
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
File details
Details for the file frictionless-3.20.0.tar.gz.
File metadata
- Download URL: frictionless-3.20.0.tar.gz
- Upload date:
- Size: 144.0 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.2.0 pkginfo/1.5.0.1 requests/2.24.0 setuptools/50.3.0 requests-toolbelt/0.9.1 tqdm/4.50.1 CPython/3.8.0
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | a40cfaf2945a7c4b0b88e5db9604a9b406263f8ace4cf6047712352bcc3c47b4 |
|
| MD5 | 06c2591208df68ecf4fa4b815383c18f |
|
| BLAKE2b-256 | 0419bfb5b58b4b7d6a9e6f77b86c5086f1e8300e402c6fa8805febb87ebea53a |
Provenance
File details
Details for the file frictionless-3.20.0-py2.py3-none-any.whl.
File metadata
- Download URL: frictionless-3.20.0-py2.py3-none-any.whl
- Upload date:
- Size: 195.9 kB
- Tags: Python 2, Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.2.0 pkginfo/1.5.0.1 requests/2.24.0 setuptools/50.3.0 requests-toolbelt/0.9.1 tqdm/4.50.1 CPython/3.8.0
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 84ebb95093b18f6a34c47bc546e70f924c572e146c1624cdcbebd535dd4ae079 |
|
| MD5 | 134471ab2f6eaf68ef49a03a43aff894 |
|
| BLAKE2b-256 | b25007e6c7d5d981a92cd5280e443cbc490255af2d6d08a62b70a4a43eb38e03 |
