Skip to main content

Frictionless is a framework to describe, extract, validate, and transform tabular data

Project description

Frictionless Framework

Travis Coveralls PyPi Github Discord

Frictionless is a framework to describe, extract, validate, and transform tabular data. It supports a great deal of data sources and formats, as well as provides popular platforms integrations. The framework is powered by the lightweight yet comprehensive Frictionless Data Specifications.

[Important Notice] We have renamed goodtables to frictionless since version 3. The framework got various improvements and was extended to be a complete data solution. The change in not breaking for the existing software so no actions are required. Please read the Migration Guide from goodtables to Frictionless Framework.

  • we continue to bug-fix goodtables@2.x in this branch as well as it's available on PyPi as it was before
  • please note that frictionless@3.x version's API, we're working on at the moment, is not stable
  • we will release frictionless@4.x by the end of 2020 to be the first SemVer/stable version

Purpose

  • Describe your data: You can infer, edit and save metadata of your data tables. It's a first step for ensuring data quality and usability. Frictionless metadata includes general information about your data like textual description, as well as, field types and other tabular data details.
  • Extract your data: You can read your data using a unified tabular interface. Data quality and consistency are guaranteed by a schema. Frictionless supports various file protocols like HTTP, FTP, and S3 and data formats like CSV, XLS, JSON, SQL, and others.
  • Validate your data: You can validate data tables, resources, and datasets. Frictionless generates a unified validation report, as well as supports a lot of options to customize the validation process.
  • Transform your data: You can clean, reshape, and transfer your data tables and datasets. Frictionless provides a pipeline capability and a lower-level interface to work with the data.

Features

  • Powerful Python framework
  • Convenient command-line interface
  • Low memory consumption for data of any size
  • Reasonable performance on big data
  • Support for compressed files
  • Custom checks and formats
  • Fully pluggable architecture
  • The included API server
  • More than 1000+ tests

Example

$ frictionless validate data/invalid.csv
[invalid] data/invalid.csv

  row    field  code              message
-----  -------  ----------------  --------------------------------------------
             3  blank-header      Header in field at position "3" is blank
             4  duplicate-header  Header "name" in field "4" is duplicated
    2        3  missing-cell      Row "2" has a missing cell in field "field3"
    2        4  missing-cell      Row "2" has a missing cell in field "name2"
    3        3  missing-cell      Row "3" has a missing cell in field "field3"
    3        4  missing-cell      Row "3" has a missing cell in field "name2"
    4           blank-row         Row "4" is completely blank
    5        5  extra-cell        Row "5" has an extra value in field  "5"

Documentation

General

Specific

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

frictionless-3.42.0.tar.gz (154.5 kB view details)

Uploaded Source

Built Distribution

frictionless-3.42.0-py2.py3-none-any.whl (216.0 kB view details)

Uploaded Python 2 Python 3

File details

Details for the file frictionless-3.42.0.tar.gz.

File metadata

  • Download URL: frictionless-3.42.0.tar.gz
  • Upload date:
  • Size: 154.5 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.2.0 pkginfo/1.6.1 requests/2.25.0 setuptools/50.3.2 requests-toolbelt/0.9.1 tqdm/4.54.1 CPython/3.8.0

File hashes

Hashes for frictionless-3.42.0.tar.gz
Algorithm Hash digest
SHA256 7eb03567782cd50be6ee238423072f7967fbb5c35a94747f06a310cd5d5e06ea
MD5 3f0bab804106b53659960f7fc2c79a14
BLAKE2b-256 8a185a720bf36d58e4f3499729e2112fd446b72b08634727b9a27da0960c1c89

See more details on using hashes here.

Provenance

File details

Details for the file frictionless-3.42.0-py2.py3-none-any.whl.

File metadata

  • Download URL: frictionless-3.42.0-py2.py3-none-any.whl
  • Upload date:
  • Size: 216.0 kB
  • Tags: Python 2, Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.2.0 pkginfo/1.6.1 requests/2.25.0 setuptools/50.3.2 requests-toolbelt/0.9.1 tqdm/4.54.1 CPython/3.8.0

File hashes

Hashes for frictionless-3.42.0-py2.py3-none-any.whl
Algorithm Hash digest
SHA256 501156fd52da504422844a86e1dcaf9ca7a280135c71d06b60f0a0eda30c19c7
MD5 7d2a2e58c7e17ee61d6e633dd6cd5fd6
BLAKE2b-256 8d1d7d3871966b8a8f29c223a03b1bb104c2a6ce265cce37f92144f8cece9142

See more details on using hashes here.

Provenance

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page