Skip to main content

Frictionless is a framework to describe, extract, validate, and transform tabular data

Project description

Frictionless Framework

Build Coverage Release Citation Codebase Support

Frictionless is a framework to describe, extract, validate, and transform tabular data (DEVT Framework). It supports a great deal of data schemes and formats, as well as provides popular platforms integrations. The framework is powered by the lightweight yet comprehensive Frictionless Data Specifications.

Purpose

  • Describe your data: You can infer, edit and save metadata of your data tables. It's a first step for ensuring data quality and usability. Frictionless metadata includes general information about your data like textual description, as well as, field types and other tabular data details.
  • Extract your data: You can read your data using a unified tabular interface. Data quality and consistency are guaranteed by a schema. Frictionless supports various file schemes like HTTP, FTP, and S3 and data formats like CSV, XLS, JSON, SQL, and others.
  • Validate your data: You can validate data tables, resources, and datasets. Frictionless generates a unified validation report, as well as supports a lot of options to customize the validation process.
  • Transform your data: You can clean, reshape, and transfer your data tables and datasets. Frictionless provides a pipeline capability and a lower-level interface to work with the data.

Features

  • Open Source (MIT)
  • Powerful Python framework
  • Convenient command-line interface
  • Low memory consumption for data of any size
  • Reasonable performance on big data
  • Support for compressed files
  • Custom checks and formats
  • Fully pluggable architecture
  • The included API server
  • More than 1000+ tests

Example

$ frictionless validate data/invalid.csv
[invalid] data/invalid.csv

  row    field  code              message
-----  -------  ----------------  --------------------------------------------
             3  blank-header      Header in field at position "3" is blank
             4  duplicate-header  Header "name" in field "4" is duplicated
    2        3  missing-cell      Row "2" has a missing cell in field "field3"
    2        4  missing-cell      Row "2" has a missing cell in field "name2"
    3        3  missing-cell      Row "3" has a missing cell in field "field3"
    3        4  missing-cell      Row "3" has a missing cell in field "name2"
    4           blank-row         Row "4" is completely blank
    5        5  extra-cell        Row "5" has an extra value in field  "5"

Documentation

Please visit our documentation portal:

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

frictionless-4.14.2.tar.gz (166.4 kB view details)

Uploaded Source

Built Distribution

frictionless-4.14.2-py2.py3-none-any.whl (233.3 kB view details)

Uploaded Python 2 Python 3

File details

Details for the file frictionless-4.14.2.tar.gz.

File metadata

  • Download URL: frictionless-4.14.2.tar.gz
  • Upload date:
  • Size: 166.4 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.4.2 importlib_metadata/4.6.1 pkginfo/1.7.1 requests/2.26.0 requests-toolbelt/0.9.1 tqdm/4.61.2 CPython/3.9.6

File hashes

Hashes for frictionless-4.14.2.tar.gz
Algorithm Hash digest
SHA256 7b1f24a4a0bb87ba1617a90decbf2a699ded44c5db6dd51182a722bec3b0b56f
MD5 66174561b196d7be2ce84957cc542f51
BLAKE2b-256 adbb9b2c62d66e7f69b0e13691fc2b23a3f154da683a7674f0a98d9020c36dca

See more details on using hashes here.

Provenance

File details

Details for the file frictionless-4.14.2-py2.py3-none-any.whl.

File metadata

  • Download URL: frictionless-4.14.2-py2.py3-none-any.whl
  • Upload date:
  • Size: 233.3 kB
  • Tags: Python 2, Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.4.2 importlib_metadata/4.6.1 pkginfo/1.7.1 requests/2.26.0 requests-toolbelt/0.9.1 tqdm/4.61.2 CPython/3.9.6

File hashes

Hashes for frictionless-4.14.2-py2.py3-none-any.whl
Algorithm Hash digest
SHA256 8484f9e9c3d4acdac77672f9fb440e3c1b19d59a4e7d7e0d360a18e2c1b1bedd
MD5 8d0af8e9c3bb256637f25ecb1c6c5636
BLAKE2b-256 3748fac230e42a814cb1a368f0640e664b9cb98580b05425551e4ecb908b169b

See more details on using hashes here.

Provenance

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page